Discoverability
Store classification
Categories
AI
DEVELOPER_TOOLS
AUTOMATION
Store labels
No public values available.
Catalog ID AIhBoLb0hekfgfowc
Public Apify Actor
dravara/robots-peek
Enter one public domain. Get its robots.txt sitemap URLs, user-agent groups, and disallow rules as JSON. This does not determine legal permission to crawl. Run the prefilled example.
Active users / 30d
1
Total users
2
Runs / 30d
27
Total runs
42
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 3 Sept
30 of 30 UTC days captured
Latest captured Runs / 30d
27
+14 since 3 Sept
30 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.00005
1
Users / 30d
1
Users / 90d
robots.txt read
robots-read
Fetch robots.txt for one public domain and return sitemap URLs and disallows. Read the default dataset.
$0.02
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder