Crawler Gang

Searches and retrieves items from the Internet Archive (archive.org) - 44M+ books, videos, audio, software, and web archives. Free, no API key required.

Track upcoming and recent IPOs from stockanalysis.com - get IPO dates, offer prices, amounts raised, exchange listings, company details, and performance data for new stock offerings.

Scrape IQAir.com for real-time air quality data - city and country AQI rankings, PM2.5, PM10, ozone levels, and historical data. No API key required.

Scrape iSeeCars.com with 4M+ used and new car listings with price analysis. Extract title, price, VIN, mileage, condition, colors, engine, MPG, transmission, drivetrain, features, dealer info, price rating (Great/Good/Fair Deal), and savings vs market value.

Scrape PC game deals from 35+ stores with Steam, GOG, Epic, Fanatical and more. Search by title, browse deals with filters, or fetch deal history. Powered by the free CheapShark API. No login required.

Scrape the Jenkins Plugin Index - search 1900+ plugins by keyword and category or fetch specific plugin details by artifactId. Returns installation counts, maintainers, dependencies, GAV, and more.

Scrape remote IT and tech job listings from Jobicy's public API. Search by keyword, industry sector, geographic region, job level, and salary range. No authentication required.

Scrape global job listings from Jobbio - search by keyword, filter by contract type and experience level, paginate through thousands of openings. Returns title, company, location, salary, skills, and direct application link.

Scrape Julia package metadata from the official Julia General Registry. Search packages by name or fetch specific packages - get version, repo URL, dependencies, and more.

Scrape legal aid organizations, law firms, and legal nonprofits from ProPublica's Nonprofit Explorer - name, location, revenue, assets, NTEE code, and IRS filing data.

Scrape nonprofit organizations and their IRS financial filings from ProPublica's Nonprofit Explorer - revenue, expenses, assets, liabilities, tax returns, and executive compensation.

Scrape Linear's integration directory - browse all 60+ integrations or fetch specific ones by slug. Extracts name, description, categories, developer, logoUrl, docsUrl, featureFlags and more.

Scrape Lobsters (lobste.rs) â€" a curated tech link aggregator. Fetch hottest, newest, or tag-filtered stories with scores, comments, tags, and author info. No authentication required.

Scrape LuaRocks - the official Lua package repository. Search modules or fetch details for specific rocks. Extract names, descriptions, authors, versions, licenses, homepages, download counts, and labels.

Scrape Macrotrends.net for historical financial data including stock prices, revenue, earnings, PE ratios, and macroeconomic indicators for thousands of stocks and economic metrics

Scrape Marktplaats.nl - the Netherlands' #1 classifieds marketplace (owned by eBay). Search listings or browse by category. Get title, price, location, condition, images, and listing URLs.

Scrape MedlinePlus, NIH's free consumer health information service. Search health topics by keyword, look up by ICD-10 code, RxCUI drug code, or LOINC lab code. Trusted source from the National Library of Medicine.

Scrape local business listings from MerchantCircle.com - 100K+ US businesses with contact info, ratings, categories, and addresses. Browse by city/state or search by keyword.

Scrapes artwork data from the Metropolitan Museum of Art's public API - 500K+ objects, free, no API key required. Search by keyword, browse by department/date/medium, or fetch specific object IDs.

Scrape MIT OpenCourseWare (ocw.mit.edu) - 2,500+ free MIT courses with full metadata: title, department, level, instructors, topics, resource types, descriptions, and image URLs. Search by keyword, browse by department or level, or fetch a single course by URL.

Scrape Modrinth â€" the largest open-source Minecraft mod and plugin registry. Search mods by keyword, filter by categories, loaders, game versions, and project types. Returns download counts, descriptions, author info, and more.

Scrape Mozilla Firefox Add-ons (AMO) - search thousands of extensions, themes, and language packs, or fetch specific add-ons by slug. Extracts full metadata: ratings, downloads, version info, authors, screenshots, and more.

Scrape MusicBrainz - the open music encyclopedia with 2M+ artists, 4M+ releases, and 30M+ recordings. Search artists, albums, songs, labels, and works. No API key required. Covers all genres and countries.

Scrape MusicBrainz, the open music encyclopedia with 2M+ artists, 4M+ releases, and 30M+ recordings. Search artists, albums, songs, labels, and works. No API key required. Covers all genres and countries.