Discoverability
Store classification
Categories
No public values available.
Store labels
No public values available.
Catalog ID Er2FchnEa7nHgfDwJ
Public Apify Actor
cuantic_data/robots-llms-txt-monitor
Fetches and parses a domain's robots.txt (RFC 9309) and llms.txt (the emerging AI-agent-friendly file), and flags what changed since the last run. Both files are public by design, meant to be read by automated clients - no login, no scraping of restricted content.
Active users / 30d
1
Total users
2
Runs / 30d
8
Total runs
10
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 22 Sept
10 of 30 UTC days captured
Latest captured Runs / 30d
8
+7 since 22 Sept
10 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
No public values available.
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.00005
Domain monitored
apify-default-dataset-item
Charged once per domain checked: robots.txt and llms.txt fetched, parsed and compared against the previous run.
1
Users / 30d
1
Users / 90d
$0.02
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
Sitemap URL Extractor - Bulk Sitemap.xml Scraper
1 active users · 9 runs / 30d
Bulk URL Status Checker - HTTP Status, Redirects & Timing
1 active users · 8 runs / 30d
Website Health Report - DNS, TLS & Security Headers Audit
1 active users · 8 runs / 30d
Doc to Markdown - PDF, DOCX & HTML to Markdown Converter
1 active users · 8 runs / 30d