Parse robots.txt rules into normalized policy evidence, sitemap references, tested paths, and truthful failures.
1
Users / 30d
27
Runs / 30d
—
Rating
Updated 2 Oct 2026
Apify builder
@gifted_wagon
Leaderboard position
out of 7,042
New Actors / 30d
#569
Total Actors
#329
Active users / 30d
#765
Total users
#1555
Runs / 30d
#924
Total runs
#1709
Portfolio stats
New Actors / 30d
5
Total Actors
43
Active users / 30d
42
+3 since first snapshot
Total users
83
Runs / 30d
1.1K
+574 since first snapshot
Total runs
1.9K
Portfolio history
Daily publishing
5
Each bar represents one UTC day.
Actor portfolio
43 matching of 43 Actors · page 2 of 2
Parse robots.txt rules into normalized policy evidence, sitemap references, tested paths, and truthful failures.
1
Users / 30d
27
Runs / 30d
—
Rating
Normalize RSS 2.0, Atom, RDF, and podcast feeds into one evidence-rich dataset with deterministic limits and explicit failures.
1
Users / 30d
28
Runs / 30d
Grade HTTP defensive headers with exact response evidence, weak-value findings, redirect context, and safe fetching.
1
Users / 30d
27
Runs / 30d
Discover and audit RFC 9116 security.txt files with contact, expiry, canonical, policy, encryption, and line-level evidence.
1
Users / 30d
27
Runs / 30d
Extract semantic HTML and ARIA landmarks, accessible labels, duplicate roles, and page-structure findings from public pages.
1
Users / 30d
21
Runs / 30d
Traverse public sitemap indexes into a deduplicated URL inventory with source sitemap, lastmod, changefreq, priority, media counts, and partial-failure evidence.
1
Users / 30d
28
Runs / 30d
Audit skip-link candidates, fragment targets, document order, accessible names, and normalized bypass-navigation evidence.
1
Users / 30d
21
Runs / 30d
Audit browser Speculation Rules JSON for parse failures, prerender and prefetch coverage, URL safety, budgets, and exact declaration evidence.
1
Users / 30d
27
Runs / 30d
Inspect public TLS certificates with validity, SAN, issuer, fingerprint, protocol, authorization, and expiry evidence.
1
Users / 30d
27
Runs / 30d
Track public terms and privacy policies by clause. Find material additions, removals, obligation, entity, effective-date, retention, arbitration, data-sharing, and other risk changes with before/after evidence.
1
Users / 30d
27
Runs / 30d
Inventory external and inline scripts with origin classification, loading attributes, integrity evidence, duplicate detection, and workflow-ready risk signals.
1
Users / 30d
27
Runs / 30d
Audit viewport metadata for responsive defaults, zoom restrictions, duplicates, malformed directives, and normalized mobile-readiness evidence.
1
Users / 30d
27
Runs / 30d
Find public emails, phones, social profiles, and contact pages with evidence URLs, deduplication, bounded discovery, and private-network protection.
1
Users / 30d
28
Runs / 30d
Extract normalized page metadata with exact tag evidence, safe fetching, deterministic limits, and truthful per-URL failures.
1
Users / 30d
27
Runs / 30d
Detect CMS, ecommerce, frameworks, analytics, CDNs, hosting, payments, and support tools with evidence, confidence, and safe URL validation.
1
Users / 30d
28
Runs / 30d
Extract normalized YouTube channel videos with titles, views, publish age, duration, thumbnails, and continuation paging—no buyer API key required.
1
Users / 30d
28
Runs / 30d
Audit MX, SPF, DMARC, and optional DKIM selectors with normalized DNS evidence and actionable findings.
1
Users / 30d
29
Runs / 30d
Catch missing fields, invalid prices, duplicate IDs, inconsistent variants, and Google Merchant feed risks before import.
1
Users / 30d
31
Runs / 30d
Extract clean YouTube transcripts with timestamps, language preference, chapters, video metadata, plain text, and explicit failure records—no buyer API key required.
0
Users / 30d
29
Runs / 30d
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating
—
Rating