Discoverability
Store classification
Categories
DEVELOPER_TOOLS
Store labels
No public values available.
Catalog ID b7amnMas4ZC3CzFCu
Public Apify Actor
devilscrapes/robots-txt-security-txt-auditor
Keyless, plain-HTTP compliance auditor. Given a list of sites, it fetches and parses robots.txt, security.txt (RFC 9116), ads.txt, and humans.txt into one structured audit row per site — AI-crawler posture, security contacts/expiry, and ad-tech supply-chain record counts. No API key needed.
Active users / 30d
1
Total users
2
Runs / 30d
24
Total runs
26
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
+1 since 6 Sept
26 of 30 UTC days captured
Latest captured Runs / 30d
24
+23 since 6 Sept
26 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor start
actor-start
Charged once when the Actor begins a run.
$0.20
Audit completed
audit-completed
1
Users / 30d
1
Users / 90d
Charged once per site audited — i.e. per ResultRow pushed to the dataset. A site is only billed when at least one of its four files (robots.txt, security.txt, ads.txt, humans.txt) resolved to present or absent; sites unreachable on all four are never billed.
$0.003
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
Google Ads Transparency Scraper — Advertiser Ad Library Export
31 active users · 10.4K runs / 30d
Threads Reply Scraper — Conversation Graph
10 active users · 65 runs / 30d
leboncoin France Car Scraper
6 active users · 289 runs / 30d
Twitch Chat Scraper — VOD Chat Archive
5 active users · 51 runs / 30d