Discoverability
Store classification
Categories
AI
SEO_TOOLS
Store labels
No public values available.
Catalog ID ukgdFJrXqthDRPXOz
Public Apify Actor
accountable_eel/ai-crawler-policy-lookup
Check what a website's robots.txt says about AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and more) and whether it publishes an llms.txt. Reads the site's own public files directly: no API key, no third-party service. Charged only when an explicit AI policy or llms.txt is found.
Active users / 30d
1
Total users
2
Runs / 30d
28
Total runs
70
Rating
—
No reviews
Bookmarks
0
Usage history
Latest captured Active users / 30d
1
0 since 2 Sept
30 of 30 UTC days captured
Latest captured Runs / 30d
28
+27 since 2 Sept
30 of 30 UTC days captured
1
Users / 7d
Discoverability
Categories
Store labels
No public values available.
Monetization
Pay per event
2 charge events configured
Actor Start
apify-actor-start
Charged when the Actor starts running. Number of events charged depends on Actor memory (one event per GB, minimum one event).
$0.00005
1
Users / 30d
1
Users / 90d
Successful lookup
item-lookup
Charged once per input successfully looked up and returned. Never charged when a lookup returns no data.
$0.004
Loading public Actor documentation
Reading the current public Store definition and reviews.
More from this builder
LinkedIn Profile Scraper Without Login: Bulk URLs + Work Email
11 active users · 59 runs / 30d
X (Twitter) Profile Scraper: Followers, Bio & Stats
9 active users · 116 runs / 30d
TikTok Profile Scraper: Followers Count, Bio & Stats
4 active users · 395 runs / 30d
Y Combinator Jobs Scraper: Remote Jobs & Startup Postings
3 active users · 23 runs / 30d