Crawler Bros

Scrape Crowd Supply (crowdsupply.com) - a crowdfunding platform focused on open-source hardware and electronics. Browse campaigns by category or search by keyword. Extracts project names, creators, funding status, amounts raised, backers, categories, and project URLs.

Scrape the WordPress.org Plugin Directory - 60,000+ plugins with ratings, active installs, developer info, categories, and compatibility data. Search by keyword/category, filter by pricing model, or fetch specific plugins by slug. No authentication required.

Scrape CueTracker.net snooker data - player profiles & bios, match results, world rankings by season, tournament draws/results, and head-to-head records between any two players. No login or proxy required.

Scrape Cult Beauty (cultbeauty.co.uk) - browse by category, brand, or skin concern, search by keyword, and filter by price, rating, and sale status. Get product name, brand, price (with sale/original price), rating, review count, image, and product URL.

Scrape Pals Cyprus Directory (palscyprus.directory), a free Cyprus business directory. Browse by category or fetch profiles by URL. Get names, phones, addresses, categories, descriptions, and source links.

Scrape DailyMed (NIH) with the official FDA drug label database. Search by drug name or NDC code, browse by drug class, or fetch full structured labels with active ingredients, dosage forms, packaging, and NDC codes.

Scrape City of Dallas building permit records from the official Dallas Open Data portal (dallasopendata.com). Filter by permit type, land use, ZIP code, issued-date range, contractor, work description, and permit value/area. Lookup exact permits by permit number. No auth, no proxy required.

Scrape dangdang.com - Chinese books e-commerce. Search by keyword, browse book categories, or fetch product details. Emits title, author, publisher, prices, discount, rating, review count and cover images.

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

Scrape DataCamp's full content catalog - 750+ courses, 30+ career tracks, and 250+ hands-on projects. Filter by topic, technology, and skill level across Data Science, Python, ML, SQL, and more.

Scrape the French government open-data portal (data.gouv.fr). Search datasets by keyword, fetch full dataset details by ID/slug, list datasets by organization, and search organizations and reuses - with titles, descriptions, resources/formats, licenses, temporal coverage and metrics.

Scrape debenhams.com, the UK department store retailer. Search by keyword, browse any department, filter by brand/gender/price/discount, or fetch specific product URLs. Returns pricing, sale price, sizes, colours, images, ratings, descriptions.

Scrape delish.com for popular recipes.

Scrape DesignCrowd.com - the crowdsourced design platform. Browse designer profiles by category and country. Extracts designer name, rating, country, earnings rank, portfolio image, and profile URL.

Scrape Dev.to, the popular blogging platform for developers (forem.com). Search by tag, by username, fetch by article ID, list latest / top / featured articles. Pulls title, body markdown, tags, reactions, comments, reading time, author, organization. HTTP-only via the public dev.to/api.

Scrape Dezeen - world's most visited architecture and design magazine. Search articles, browse by category (Architecture, Interiors, Design, Technology, Furniture, Lighting), or fetch the latest articles.

Scrape Discogs, the world's largest music database and marketplace. Search releases, masters, artists, and labels; pull full discographies; resolve marketplace listings and price stats. HTTP-only via the official Discogs API.

Scrape any public Discourse forum with latest topics, trending discussions, category browsing, tag filtering, full-text search, user profiles, and complete post threads. Works with meta.discourse.org, community forums, and any self-hosted Discourse.

Scrape Distiller (distiller.com) for spirits data. Search for whisky, bourbon, gin, rum, vodka, tequila, and more. Get Distiller scores, community ratings, ABV, tasting notes, flavor profiles, price history, and detailed metadata.

Scrape the Directory of Open Access Journals (DOAJ) - 20K+ peer-reviewed open access journals and 10M+ articles. Search journals/articles by keyword or subject, filter by language, or look up by ISSN or DOAJ article ID.

Scrape the Directory of Open Access Journals (DOAJ), 20K+ peer-reviewed open access journals and 10M+ articles. Search journals by subject/country, search articles by keyword, or look up by ISSN or DOI.

Scrape Docker Hub, container image search, pull counts, star counts, publisher and verified-publisher data, tags, architectures, OS support, categories, and user/org profiles. Pure HTTP, no auth required

Scrape the U.S. Department of Energy's OSTI.GOV public research repository - search millions of DOE-funded technical reports, journal articles, conference papers, patents, theses, and datasets by keyword, author, national lab, subject, or date range, or fetch a single record by OSTI ID.

Scrape DogTrekker.com's directory of 9,600+ dog-friendly hotels, restaurants, parks, beaches, wineries, and services across California and Nevada. Search by keyword, browse by category/region/state/city, or fetch a specific listing by ID.