Discoverability
Store classification
Categories
Store labels
No public values available.
Catalog ID bMWH9VBTegX2AYBt9
Public Apify Actor
antishock/sitemap-robots-url-extractor
Extract every URL a website publishes. Reads robots.txt, discovers sitemaps, walks sitemap indexes recursively and returns URL, path, last modified date, change frequency, priority and hreflang. Optional robots.txt rule parsing. For SEO audits, content inventory and migration planning.
Active users / 30d
1
Total users
2
Runs / 30d
13
Total runs
15
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
+1 since 17 Sept
16 of 30 UTC days captured
Latest captured Runs / 30d
13
+12 since 17 Sept
16 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.002
Result
apify-default-dataset-item
Charged for each result saved to the dataset.
1
Users / 30d
1
Users / 90d
$0.002
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
Work at a Startup Scraper - YC-Backed Jobs
7 active users · 50 runs / 30d
Company Lookup - Crunchbase & Wikidata Profiles
2 active users · 33 runs / 30d
SEEK Scraper - Australia & NZ Job Listings
2 active users · 19 runs / 30d
Indie Hackers Scraper - Community Posts & Discussions
2 active users · 36 runs / 30d