Free crawling, search and reader APIs
Usable crawl, search, reader and unblocker APIs.
Ranked byverdict, best first, then the evidence · 37 ranked
Key
- ★ qualifies
- usable as stated; the read path was probed
- caveat
- usable, with a named limit or an unprobed read path
- trial
- a time-boxed or one-time trial, not a recurring allowance
- paid
- no free allowance; listed for its price
- fails: identity
- the identity required is not reachable without it
- fails: egress
- data cannot be read back out at a usable rate or price
- fails: quota
- the free allowance is too small to matter
- dead
- the offer or the service no longer exists
- self-hosted, last resort
- software or a node that the user installs, runs and maintains. Self-hosted options are listed last, because this site is for users who have no hardware.
- free tier, no free tier
- the record states a free allowance, or states that it has none
- identity email
- what a signup asks for. A question mark after it: a placeholder, not read from a source
- no card, card, card?
- a payment card is not asked, is asked, or the record does not say
- limit
- the limit that runs out first, for example request-rate or volume-quota
- evidence
- how the record is backed, strongest first: measured, documented, reported, inferred, unverified
- fresh until, stale since
- the check is inside its window, or past it, on today's date
- inherited, checked live
- inherited: the record was carried from an earlier source, and its check date is an upper bound. Checked live: the record was checked against the service. The chip filters on it
- verdict
- a judgement of the whole offer for the need of its topic. The data holds no number as a cut-off. Read the free allowance and the limits of the record, and decide for your own need
- duplicate, disagrees
- another record holds the same offer, or a sibling record states another value
- ★ qualifiesJina Reader
R.jina.ai is free at 20 requests a minute with no key; a free API key raises it to 500 RPM and carries 10M tokens
free tieridentity anonymousno cardlimit per-ip-shapingevidence measuredstale on 2026-12-22
- ★ qualifiesInternet Archive Wayback Machine
Keyless listing, closest and replay of existing captures; Save Page Now needs keys
free tieridentity anonymousno cardlimit per-object-capevidence measuredstale on 2026-12-22
- ★ qualifiesContext.dev
1,000 credits a month, no credit card, 10 requests a minute
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- ★ qualifiesFirecrawl
500 searches or 1,000 pages scraped a month on the Free plan, 2 concurrent requests, no card
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatCommon Crawl
Keyless index and WARC access
free tieridentity anonymousno cardlimit request-rateevidence measuredstale on 2027-01-04
- caveatCrawl4AI
1,000 credits every month once an email is verified, at 10 requests a minute and 2 at a time; a scrape costs 0.5 credit, so about 2,000 pages a month; 20...
free tieridentity emailno cardlimit request-rateevidence measuredstale on 2027-01-02
- caveatSpider
Keyless /scrape: no key and no account, 4 requests a minute (free_rpm 4 in the API's free_tier_rate_limited answer, RateLimit-Limit 4 on keyless answers...
free tieridentity anonymousno cardlimit request-rateevidence measuredstale on 2027-01-02
- caveaturlscan.io
Keyless, counted per IP address: 500 searches a day (100 an hour, 30 a minute) and 500 result retrievals a day (250 an hour, 20 a minute), at most 100...
free tieridentity anonymousno cardlimit request-rateevidence measuredstale on 2027-01-02
- caveatAnchor Browser (Crawling)
5 credits a month, up to 5 concurrent browsers and up to 500 browser sessions; a task run costs 0.1 credit, and a credit is USD 1.00 of overage, so the...
free tieridentity emailcard?limit request-rateevidence documentedstale on 2026-12-03
- caveatCloudflare Workers AI (cfai)
10,000 Neurons a day per account on Workers Free
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-12-03
- caveatFirecrawl keyless route
Free with no API key: Search, Scrape and Parse on the hosted MCP endpoint, Interact as well from official clients, the CLI, SDKs and REST API, and the...
free tieridentity anonymousno cardlimit request-rateevidence documentedstale on 2026-12-03
- caveatLinkup
USD 20 credited on signup with a professional email address and topped back up to USD 20 each month; a standard or fast search with raw results costs USD...
identity emailno cardlimit request-rateevidence documentedstale on 2026-12-03
- caveatOctoparse
Free plan, no expiry and no credit card.
free tieridentity emailno cardlimit volume-quotaevidence documentedstale on 2026-12-03
- caveatOutscraper
Pay-as-you-go with a monthly Free Tier per service, tiers resetting every 30 days: Google Maps 500 businesses, Google Maps reviews 500, Google Search 10...
free tieridentity cardlimit volume-quotaevidence documentedstale on 2026-12-03
- caveatParallel
USD 5 in free credits each month for an organization with a credit card on file, covering up to 5,000 Search API requests
free tieridentity cardlimit request-rateevidence documentedstale on 2026-12-03
- caveatParseHub
Free plan, no credit card: 200 pages per run, 5 public projects, data retention for 14 days, 200 pages of data in 40 minutes, limited support; no run count...
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-12-03
- caveatArquivo.pt
Keyless CDX server, full-text and URL search API, Memento API, image search and replay of the Portuguese web archive, each limited per IP address
free tieridentity anonymousno cardlimit request-rateevidence documentedstale on 2026-11-30
- caveatZenserp
50 free searches a month on the Free plan, USD 0, free forever; Google Search only on Free
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-30
- caveatApify
USD 5 of platform usage a month on the Free plan, 5 concurrent runs
free tieridentity emailno cardlimit per-object-capevidence documentedstale on 2026-11-22
- caveatBright Data (Crawling)
5,000 records a month on the Free Tier, no credit card
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatBrowserless (Crawling)
1,000 units a month, no card, 2 concurrent browsers, 2 minutes maximum session
free tieridentity emailno cardlimit retention-clampedevidence documentedstale on 2026-11-22
- caveatCloudflare URL Scanner
Free with a Cloudflare account; scans of the exact URL in the last 30 days
free tieridentity emailno cardlimit retention-clampedevidence documentedstale on 2026-11-22
- caveatCrawlbase
Up to 5,000 successful requests free, no credit card
free tieridentity emailno cardlimit per-object-capevidence documentedstale on 2026-11-22
- caveatDiffbot
10,000 credits a month on the Free plan, 5 requests a minute, no credit card
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatExa
USD 10 in credits on signup, reset to USD 10 on the first of each month, no payment method; a one-time USD 10 bonus after onboarding
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatKeenable
100,000 requests a month
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatScraperAPI
1,000 API credits on signup, 5 concurrent connections
free tieridentity emailno cardlimit per-object-capevidence documentedstale on 2026-11-22
- caveatScrapfly
1,000 API credits on signup, no credit card, 5 concurrent
free tieridentity emailno cardlimit per-object-capevidence documentedstale on 2026-11-22
- caveatScrapingAnt
10,000 credits a month, no credit card, refreshed monthly
free tieridentity emailno cardlimit per-object-capevidence documentedstale on 2026-11-22
- caveatSerpApi
250 searches a month on the Free plan, 50 an hour
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatTavily
1,000 API credits a month, no credit card, reset on the first of the month
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatTinyFish (Crawling)
Search free at 30 requests a minute and 500 an hour; Fetch free at 150 URLs a minute and 1,000 URLs a day
free tieridentity emailno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatYou.com
100 Web Search API queries a day through the hosted MCP route, with no API key, no account and no credit card
free tieridentity anonymousno cardlimit request-rateevidence documentedstale on 2026-11-22
- caveatZenRows
5,000 credits a month, no card, 5 concurrent requests, monthly refresh with no rollover
free tieridentity emailno cardlimit per-object-capevidence documentedstale on 2026-11-22
- caveatTavily keyless route
Search and Extract free with no account and no API key, rate-limited; the keyless cap is not published
free tieridentity anonymousno cardlimit request-rateevidence reportedstale on 2026-11-14
- caveatCloudflare Browser Rendering
Workers Free: 600 browser-seconds a day, or 10 browser-minutes; 3 concurrent browsers
free tieridentity emailno cardlimit request-rateevidence reportedstale on 2026-11-06
- caveatScrape.do
1,000 successful calls a month
free tieridentity emailno cardlimit request-rateevidence reportedstale on 2026-11-06
The query
SELECT rid, vorder FROM record WHERE topic='crawler-scraper' AND grp='usable' AND duplicate_of IS NULL AND coalesce(summary,'') NOT LIKE 'no free %' AND coalesce(summary,'') NOT LIKE 'no published free %' AND coalesce(summary,'') NOT LIKE 'no perpetual free %' ORDER BY self_hosted, vorder ASC NULLS LAST
Run it yourself: /api/v1/need/crawling, or the MCP tool need.