Crawler Bros

Scrapes R package metadata from the CRAN database (crandb.r-pkg.org). Search packages by query, fetch by name, or list recent releases.

Scrape Crates.io with the official Rust package registry. Search crates, lookup by exact name, browse by category or keyword, list a user's crates, and pull reverse dependencies. Returns downloads, versions, licenses, repository URLs, categories, keywords, and more.

Scrape Credly's catalog of certification and skill badge programs, or verify individual earned badges by their public verification URL. Badge names, issuers, levels, costs, descriptions, and images.

Scrape Crossref, the world's largest DOI registry. Search 130M+ scholarly works, fetch by DOI, filter by date / type / journal, and pull authors, references, citation counts, ISSN, ORCIDs, and more.

Scrape Crowd Supply (crowdsupply.com) - a crowdfunding platform focused on open-source hardware and electronics. Browse campaigns by category or search by keyword. Extracts project names, creators, funding status, amounts raised, backers, categories, and project URLs.

Scrape the WordPress.org Plugin Directory - 60,000+ plugins with ratings, active installs, developer info, categories, and compatibility data. Search by keyword/category, filter by pricing model, or fetch specific plugins by slug. No authentication required.

Scrape CueTracker.net snooker data - player profiles & bios, match results, world rankings by season, tournament draws/results, and head-to-head records between any two players. No login or proxy required.

Scrape Pals Cyprus Directory (palscyprus.directory), a free Cyprus business directory. Browse by category or fetch profiles by URL. Get names, phones, addresses, categories, descriptions, and source links.

Scrape DailyMed (NIH) with the official FDA drug label database. Search by drug name or NDC code, browse by drug class, or fetch full structured labels with active ingredients, dosage forms, packaging, and NDC codes.

Scrape City of Dallas building permit records from the official Dallas Open Data portal (dallasopendata.com). Filter by permit type, land use, ZIP code, issued-date range, contractor, work description, and permit value/area. Lookup exact permits by permit number. No auth, no proxy required.

Scrape dangdang.com - Chinese books e-commerce. Search by keyword, browse book categories, or fetch product details. Emits title, author, publisher, prices, discount, rating, review count and cover images.

Scrape the Data.gov catalog (catalog.data.gov). Search 300,000+ open government datasets by keyword, organization, and format. Fetch dataset details or list organizations. No API key required.

Scrape DataCamp's full content catalog - 750+ courses, 30+ career tracks, and 250+ hands-on projects. Filter by topic, technology, and skill level across Data Science, Python, ML, SQL, and more.

Scrape the French government open-data portal (data.gouv.fr). Search datasets by keyword, fetch full dataset details by ID/slug, list datasets by organization, and search organizations and reuses - with titles, descriptions, resources/formats, licenses, temporal coverage and metrics.

Scrape debenhams.com, the UK department store retailer. Search by keyword, browse any department, filter by brand/gender/price/discount, or fetch specific product URLs. Returns pricing, sale price, sizes, colours, images, ratings, descriptions.

Scrape Decathlon US (decathlon.com) sporting-goods catalog. Search by keyword, browse any of 200+ categories, or fetch specific products by handle/URL. Get pricing, discounts, stock, brand, images, colors, sizes and full descriptions.

Scrape delish.com for popular recipes.

Scrape DesignCrowd.com - the crowdsourced design platform. Browse designer profiles by category and country. Extracts designer name, rating, country, earnings rank, portfolio image, and profile URL.

Scrape Dev.to, the popular blogging platform for developers (forem.com). Search by tag, by username, fetch by article ID, list latest / top / featured articles. Pulls title, body markdown, tags, reactions, comments, reading time, author, organization. HTTP-only via the public dev.to/api.

Scrape Dezeen - world's most visited architecture and design magazine. Search articles, browse by category (Architecture, Interiors, Design, Technology, Furniture, Lighting), or fetch the latest articles.

Scrape Discogs, the world's largest music database and marketplace. Search releases, masters, artists, and labels; pull full discographies; resolve marketplace listings and price stats. HTTP-only via the official Discogs API.

Scrape Distiller (distiller.com) for spirits data. Search for whisky, bourbon, gin, rum, vodka, tequila, and more. Get Distiller scores, community ratings, ABV, tasting notes, flavor profiles, price history, and detailed metadata.

Scrape the Directory of Open Access Journals (DOAJ) - 20K+ peer-reviewed open access journals and 10M+ articles. Search journals/articles by keyword or subject, filter by language, or look up by ISSN or DOAJ article ID.

Scrape the Directory of Open Access Journals (DOAJ), 20K+ peer-reviewed open access journals and 10M+ articles. Search journals by subject/country, search articles by keyword, or look up by ISSN or DOI.