Crawler Gang

Scrape RubyGems.org, Ruby community gem hosting with 170K+ gems. Search gems by keyword, fetch gem details, get all gems by a user/owner, or browse recent activity.

Scrape the NIH RxNorm drug database with search drugs by name, look up by RxCUI or NDC code, get brand/generic names, drug types, and spelling suggestions. Free NIH public API, no auth required.

Scrape Salarship.com - a global job board with salary estimates for 100,000+ positions. Search by keyword and location. Returns job title, company, location, estimated salary, job type, and a direct apply URL.

Scrapes app metadata from Scoop Windows package manager buckets (Main, Extras, Versions, Java). Search apps by name or fetch specific apps by exact name.

Scrape SeaRates.com - the world's largest ocean freight marketplace. Get port directories with coordinates, shipping routes, container types, and freight rate data.

Search SEC EDGAR filings, browse IPOs (S-1), get company filings, and extract XBRL financial facts. Free public API, no login or proxy required.

Scrape Serchen, a global SaaS marketplace with 40,000+ products and structured reviews. Search by keyword, browse by category, or fetch specific product pages. Returns name, description, rating, review count, logo, website URL, category, and more.

Scrape job listings from SimplyHired.com - search by keyword and location, filter by employment type, remote work, date posted, and minimum salary. Returns full job details including salary, description, benefits, and application URLs.

Scrape SmartCustomer.com - search businesses, get reviews, and fetch full business profiles. 200M+ public reviews across 130K+ businesses.

Scrape SoundCloud with search tracks and artists, browse top/trending charts, fetch all tracks from an artist, or fetch any track/playlist/user URL. Extracts plays, likes, reposts, waveforms, artwork, genre, tags, and stream URLs. No API key required.

Scrape SpaceX mission data from the official public SpaceX API - launches, rockets, crew members, Starlink satellites, launchpads, and more. No authentication required.

Scrape study guides and literary analysis from GradeSaver - a leading provider of free study guides, summaries, character analysis, themes, and quotes for literature, Shakespeare, and classic novels. Browse all guides or fetch specific book guides.

Scrape Speedrun.com â€" the largest speedrunning leaderboard and community. Search games, browse leaderboard runs, and look up world records. Returns game details, run times, runners, video proof links, and platform info.

Scrape Splunkbase - Splunk's official app marketplace. Search apps by query or category, or fetch specific apps by ID. Returns title, description, downloads, version, author, rating, categories, compatible Splunk versions, license, and more.

Scrape StartEngine (startengine.com) - an equity crowdfunding platform. Browse active private investment offerings. Extracts company name, offering slug, type, valuation cap, minimum investment, deadline, and offering URL.

Scrape apps and integrations from the SurveyMonkey App Directory. Browse all 100+ integrations, search by keyword, or fetch specific apps by ID. Returns name, tagline, description, publisher, features, pricing type, screenshots, and support links.

Scrape trading card data and prices from Scryfall (MTG) and the Pokémon TCG API. Search cards by name, browse by set, or look up by ID. Returns card details, rarity, set info, market prices (USD/EUR), legalities, and TCGplayer purchase links.

Scrape the Terraform Registry - search modules and providers, or fetch details for specific modules/providers. Returns downloads, versions, descriptions, source URLs, and verification status.

Scrape The Muse job listings - 500,000+ jobs from top companies. Filter by category, level, location, or company. Fetch individual jobs by ID. Extracts title, company, category, level, locations, description, publication date, and application URL.

Scrape recipes from TheMealDB - search by name, filter by category, cuisine area or main ingredient, or look up by ID. Returns full recipe details with ingredients, measurements, instructions, thumbnail images, and YouTube links.

Scrape Tiki.vn - Vietnam's leading e-commerce marketplace. Search products by keyword, fetch full product details, or browse by category. Returns prices (VND), ratings, seller info, brand, and more.

Scrape the Todoist Integrations directory - 130+ apps and tools that connect with Todoist. Browse by category or search by keyword. Returns names, descriptions, categories, icon URLs, developer links, and supported languages.

Scrape Toomey & Co (toomeyco.com) - a leading American auction house specializing in art, design, and decorative arts. Search and browse auction lots, browse upcoming and past auctions, and get detailed lot metadata including artist names, estimates, hammer prices, images, and condition reports.

Scrape mountain biking trails from Trailforks - the world's largest trail database. Search by keyword or region, filter by difficulty, fetch trail details, and get popular trails with ratings, distance, and elevation data.