Crawler Bros

Scrape the US Treasury's TTB public COLA registry - approved beer, wine and spirits label applications. Search by brand/fanciful name, category, origin, permit, or date; fetch by TTB ID. Get applicant details, formulas, and label images.

Aggregate UK and EU job listings from RemoteOK, Arbeitnow, Reed.co.uk, and Adzuna (optional API key for extra countries). Filter by role, location, country, employment type, date posted, and salary. Enriched output with structured salary plus company logo, website, size, and socials.

Scrape WebsiteClosers.com business-for-sale listings - asking price, cash flow, gross income, year established, category, broker, and full descriptions for e-commerce, SaaS, agency, and other online business acquisitions.

Scrape Archive of Our Own (AO3) - the largest fanfiction archive on the web. Search by keyword, browse by fandom or tag, list an author's works, or fetch full metadata for specific works. No login required.

Query the Common Crawl URL Index for any domain or URL pattern. Discover a site's archived pages, historical URLs, capture dates, HTTP statuses and MIME types for SEO, domain intelligence and research. Also lists the available monthly crawls.

Pull DeFi data from DefiLlama's public APIs with protocols + historical TVL, chain TVL aggregates, stablecoins, yield pools, DEX volumes, lending markets, bridge volumes. No auth, no proxy, no cookies.

Scrape FlixPatrol's public Top 10 streaming charts by platform (Netflix, Disney+, HBO Max, Prime Video, Apple TV+, and 75+ more), country, content type, and date. No login required.

Extract structured opening hours for all 7 days plus live open/closed status from any Google Maps place page. Supports batch input of multiple place URLs.

Discover every sitemap file for a website. Reads robots.txt for Sitemap directives, probes common sitemap paths, and recursively unpacks sitemap-index files. HTTP-only, no proxy or cookies needed.

Scrape Sotheby's, one of the world's oldest and largest auction houses with upcoming auctions and buy-now lots spanning art, jewelry, watches, furniture, and collectibles globally.

Scrape SpotHero - the parking spot marketplace. Browse city parking overviews, search venues/addresses/businesses by name, and get per-facility live pricing, ratings, amenities, and address details for parking near any destination. No login required.

Scrape TapTap (taptap.cn) - China's mobile game platform. Rankings by chart (hot/download/playing/genre...), game details with rating/downloads/developer/tags/screenshots, keyword search across community posts, and the hot-search board. No login required.

Scrape Trade Me Property, New Zealand's largest property marketplace. Search residential properties for sale or rent by region, price, bedrooms, bathrooms, and property type. Extracts address, price, features, agency, open homes, GPS coordinates, and more.

Scrape tweets from Twitter/X by keywords with advanced filters: date range, language, engagement thresholds, media type, verified-only, and more. Returns full tweet data including author info, media, and engagement metrics.

Scrape At Home (athome.com), the US home-decor superstore. Search products by keyword, browse by department (Furniture, Rugs, Lighting, Outdoor, and more), or fetch by direct product URL. Get prices, sale status, images, dimensions, ratings, and full category breadcrumbs.

Scrape used car listings from CarMax.com by keyword search or by manufacturer. Get price, mileage, year, trim, color, transmission, fuel type, and images.

Scrape job listings from CvOnline Baltic job boards - cvonline.lt (Lithuania) and cv.ee (Estonia). Search by keyword and retrieve job title, company, salary, employment type, and more.

Scrape Fantasy Premier League data - players with stats, teams, fixtures, gameweeks, and element types. All data comes from the official FPL public API with no authentication required.

Scrape mvideo.ru - a major Russian electronics and appliance retailer. Search products, browse categories, and fetch full product details: price, rating, specifications, images, and seller info.

Scrape furnished mid- to long-term rental listings from Nestpick - rooms, studios and apartments across 3000+ cities, aggregated from Spotahome, Blueground, HousingAnywhere and other providers. Filter by price, size, rooms; enrich listings with their external booking URL.

Scrape PagineGialle.it (Italy's leading business directory). Search by category and city/comune, or fetch full business profiles by URL. Get names, addresses, phone numbers, categories, ratings, opening hours, and websites.

Scrape Australia's largest product review site, productreview.com.au. Search products and brands, browse by category, fetch product details, and extract consumer reviews with ratings, dates, and verified purchase flags.

Scrape Trustpilot business reviews, ratings, replies, and rating distributions across any business domain. Multi-business batch with rich filtering: rating range, language, date range, keyword search, verified-only, and reviews-with-company-response.

Scrape the Unity Asset Store - 120,000+ 3D/2D models, VFX, audio, tools, templates and add-ons. Search by keyword, browse by category, filter by price and publisher, sort by rating/price/release date. No auth, no proxy.