# Crawling

> Crawl, search, reader and unblocker APIs for reading the web at scale.

59 records: 38 usable, 9 trial, 1 paid only, 3 rejected, 8 dead. This page lists the usable, trial and paid-only records; the rejected and dead ones are on https://fshy.ajam.dev/t/crawler-scraper/rejected.md. Each line: provider (its page in Markdown), record id (its JSON is https://fshy.ajam.dev/api/v1/record/<id>), verdict, free tier, identity, card, phone, evidence, stale date, parsed price, summary. In full: https://fshy.ajam.dev/t/crawler-scraper/llms-full.txt.

Best per need: [Free crawling, search and reader APIs](https://fshy.ajam.dev/need/crawling.md)

## Usable (38)

- [Context.dev](https://fshy.ajam.dev/p/context.md) [`crawler-scraper/contextdev`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/contextdev): qualifies | free tier | email | no card | no phone | documented | stale on 2026-11-22. 1,000 credits a month, no credit card, 10 requests a minute
- [Firecrawl](https://fshy.ajam.dev/p/firecrawl.md) [`crawler-scraper/firecrawl`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/firecrawl): qualifies | free tier | email | no card | no phone | documented | stale on 2026-11-22. 500 searches or 1,000 pages scraped a month on the Free plan, 2 concurrent requests, no card
- [Internet Archive Wayback Machine](https://fshy.ajam.dev/p/internet-archive-wayback-machine.md) [`crawler-scraper/wayback`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/wayback): qualifies | free tier | anonymous | no card | no phone | measured | stale on 2026-12-22. Keyless listing, closest and replay of existing captures; Save Page Now needs keys
- [Jina Reader](https://fshy.ajam.dev/p/jina.md) [`crawler-scraper/jina-reader`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/jina-reader): qualifies | free tier | anonymous | no card | no phone | measured | stale on 2026-12-22. R.jina.ai is free at 20 requests a minute with no key; a free API key raises it to 500 RPM and carries 10M tokens
- [OpenAlex (Crawling)](https://fshy.ajam.dev/p/openalex.md) [`crawler-scraper/openalex`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/openalex): qualifies | free tier | email | no card | no phone | documented | stale on 2026-12-01 | duplicate. USD 1 of API usage a day with a free key; USD 0.10 a day with no key; the budget is priced per call, so it buys 10,000 list-and-filter calls or 1,000...
- [Anchor Browser (Crawling)](https://fshy.ajam.dev/p/anchorbrowser.md) [`crawler-scraper/anchor-browser`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/anchor-browser): qualifies-with-caveat | free tier | email | card? | phone? | documented | stale on 2026-12-03. 5 credits a month, up to 5 concurrent browsers and up to 500 browser sessions; a task run costs 0.1 credit, and a credit is USD 1.00 of overage, so the...
- [Apify](https://fshy.ajam.dev/p/apify.md) [`crawler-scraper/apify`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/apify): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. USD 5 of platform usage a month on the Free plan, 5 concurrent runs
- [Arquivo.pt](https://fshy.ajam.dev/p/arquivo.md) [`crawler-scraper/arquivo`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/arquivo): qualifies-with-caveat | free tier | anonymous | no card | no phone | documented | stale on 2026-11-30. Keyless CDX server, full-text and URL search API, Memento API, image search and replay of the Portuguese web archive, each limited per IP address
- [Bright Data (Crawling)](https://fshy.ajam.dev/p/brightdata.md) [`crawler-scraper/brightdata`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/brightdata): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 5,000 records a month on the Free Tier, no credit card
- [Browserless (Crawling)](https://fshy.ajam.dev/p/browserless.md) [`crawler-scraper/browserless`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/browserless): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 1,000 units a month, no card, 2 concurrent browsers, 2 minutes maximum session
- [Cloudflare Browser Rendering](https://fshy.ajam.dev/p/cloudflare.md) [`crawler-scraper/cfbr`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/cfbr): qualifies-with-caveat | free tier | email | no card | no phone | reported | stale on 2026-11-06. Workers Free: 600 browser-seconds a day, or 10 browser-minutes; 3 concurrent browsers
- [Cloudflare URL Scanner](https://fshy.ajam.dev/p/cloudflare.md) [`crawler-scraper/cfscan`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/cfscan): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. Free with a Cloudflare account; scans of the exact URL in the last 30 days
- [Cloudflare Workers AI (cfai)](https://fshy.ajam.dev/p/cloudflare.md) [`crawler-scraper/cfai`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/cfai): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-12-03. 10,000 Neurons a day per account on Workers Free
- [Common Crawl](https://fshy.ajam.dev/p/commoncrawl.md) [`crawler-scraper/commoncrawl`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/commoncrawl): qualifies-with-caveat | free tier | anonymous | no card | no phone | measured | stale on 2027-01-04. Keyless index and WARC access
- [Crawl4AI](https://fshy.ajam.dev/p/crawl4ai.md) [`crawler-scraper/crawl4ai`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/crawl4ai): qualifies-with-caveat | free tier | email | no card | no phone | measured | stale on 2027-01-02. 1,000 credits every month once an email is verified, at 10 requests a minute and 2 at a time; a scrape costs 0.5 credit, so about 2,000 pages a month; 20...
- [Crawlbase](https://fshy.ajam.dev/p/crawlbase.md) [`crawler-scraper/crawlbase`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/crawlbase): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. Up to 5,000 successful requests free, no credit card
- [Diffbot](https://fshy.ajam.dev/p/diffbot.md) [`crawler-scraper/diffbot`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/diffbot): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 10,000 credits a month on the Free plan, 5 requests a minute, no credit card
- [Exa](https://fshy.ajam.dev/p/exa.md) [`crawler-scraper/exa`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/exa): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. USD 10 in credits on signup, reset to USD 10 on the first of each month, no payment method; a one-time USD 10 bonus after onboarding
- [Firecrawl keyless route](https://fshy.ajam.dev/p/firecrawl.md) [`crawler-scraper/firecrawl-keyless`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/firecrawl-keyless): qualifies-with-caveat | free tier | anonymous | no card | no phone | documented | stale on 2026-12-03. Free with no API key: Search, Scrape and Parse on the hosted MCP endpoint, Interact as well from official clients, the CLI, SDKs and REST API, and the...
- [Keenable](https://fshy.ajam.dev/p/keenable.md) [`crawler-scraper/keenable`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/keenable): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 100,000 requests a month
- [Linkup](https://fshy.ajam.dev/p/linkup.md) [`crawler-scraper/linkup`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/linkup): qualifies-with-caveat | email | no card | no phone | documented | stale on 2026-12-03. USD 20 credited on signup with a professional email address and topped back up to USD 20 each month; a standard or fast search with raw results costs USD...
- [Octoparse](https://fshy.ajam.dev/p/octoparse.md) [`crawler-scraper/octoparse`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/octoparse): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-12-03. Free plan, no expiry and no credit card.
- [Outscraper](https://fshy.ajam.dev/p/outscraper.md) [`crawler-scraper/outscraper`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/outscraper): qualifies-with-caveat | free tier | card | no phone | documented | stale on 2026-12-03. Pay-as-you-go with a monthly Free Tier per service, tiers resetting every 30 days: Google Maps 500 businesses, Google Maps reviews 500, Google Search 10...
- [Parallel](https://fshy.ajam.dev/p/parallel.md) [`crawler-scraper/parallel`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/parallel): qualifies-with-caveat | free tier | card | no phone | documented | stale on 2026-12-03. USD 5 in free credits each month for an organization with a credit card on file, covering up to 5,000 Search API requests
- [ParseHub](https://fshy.ajam.dev/p/parsehub.md) [`crawler-scraper/parsehub`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/parsehub): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-12-03. Free plan, no credit card: 200 pages per run, 5 public projects, data retention for 14 days, 200 pages of data in 40 minutes, limited support; no run count...
- [Scrape.do](https://fshy.ajam.dev/p/scrape.md) [`crawler-scraper/scrapedo`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/scrapedo): qualifies-with-caveat | free tier | email | no card | no phone | reported | stale on 2026-11-06. 1,000 successful calls a month
- [ScraperAPI](https://fshy.ajam.dev/p/scraperapi.md) [`crawler-scraper/scraperapi`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/scraperapi): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 1,000 API credits on signup, 5 concurrent connections
- [Scrapfly](https://fshy.ajam.dev/p/scrapfly.md) [`crawler-scraper/scrapfly`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/scrapfly): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 1,000 API credits on signup, no credit card, 5 concurrent
- [ScrapingAnt](https://fshy.ajam.dev/p/scrapingant.md) [`crawler-scraper/scrapingant`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/scrapingant): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 10,000 credits a month, no credit card, refreshed monthly
- [SerpApi](https://fshy.ajam.dev/p/serpapi.md) [`crawler-scraper/serpapi`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/serpapi): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 250 searches a month on the Free plan, 50 an hour
- [Spider](https://fshy.ajam.dev/p/spider.md) [`crawler-scraper/spider`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/spider): qualifies-with-caveat | free tier | anonymous | no card | no phone | measured | stale on 2027-01-02. Keyless /scrape: no key and no account, 4 requests a minute (free_rpm 4 in the API's free_tier_rate_limited answer, RateLimit-Limit 4 on keyless answers...
- [Tavily](https://fshy.ajam.dev/p/tavily.md) [`crawler-scraper/tavily`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/tavily): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 1,000 API credits a month, no credit card, reset on the first of the month
- [Tavily keyless route](https://fshy.ajam.dev/p/tavily.md) [`crawler-scraper/tavily-keyless`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/tavily-keyless): qualifies-with-caveat | free tier | anonymous | no card | no phone | reported | stale on 2026-11-14. Search and Extract free with no account and no API key, rate-limited; the keyless cap is not published
- [TinyFish (Crawling)](https://fshy.ajam.dev/p/tinyfish.md) [`crawler-scraper/tinyfish`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/tinyfish): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. Search free at 30 requests a minute and 500 an hour; Fetch free at 150 URLs a minute and 1,000 URLs a day
- [urlscan.io](https://fshy.ajam.dev/p/urlscan.md) [`crawler-scraper/urlscan`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/urlscan): qualifies-with-caveat | free tier | anonymous | no card | no phone | measured | stale on 2027-01-02. Keyless, counted per IP address: 500 searches a day (100 an hour, 30 a minute) and 500 result retrievals a day (250 an hour, 20 a minute), at most 100...
- [You.com](https://fshy.ajam.dev/p/you.md) [`crawler-scraper/youdotcom`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/youdotcom): qualifies-with-caveat | free tier | anonymous | no card | no phone | documented | stale on 2026-11-22. 100 Web Search API queries a day through the hosted MCP route, with no API key, no account and no credit card
- [ZenRows](https://fshy.ajam.dev/p/zenrows.md) [`crawler-scraper/zenrows`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/zenrows): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-22. 5,000 credits a month, no card, 5 concurrent requests, monthly refresh with no rollover
- [Zenserp](https://fshy.ajam.dev/p/zenserp.md) [`crawler-scraper/zenserp`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/zenserp): qualifies-with-caveat | free tier | email | no card | no phone | documented | stale on 2026-11-30. 50 free searches a month on the Free plan, USD 0, free forever; Google Search only on Free

## Trial (9)

- [Browserbase (Crawling)](https://fshy.ajam.dev/p/browserbase.md) [`crawler-scraper/browserbase`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/browserbase): trial-only | free tier | email | no card | no phone | documented | stale on 2026-11-22. Free plan: 1 browser hour, 1,000 Search calls, 1,000 Fetch calls, 3 concurrent browsers
- [DataForSEO](https://fshy.ajam.dev/p/dataforseo.md) [`crawler-scraper/dataforseo`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/dataforseo): trial-only | free tier | any-phone | no card | documented | stale on 2026-12-03. USD 1 trial credit for new accounts; about 500 live Google SERPs at USD 0.002, or more in the Standard queue at USD 0.0006 a SERP
- [Hyperbrowser (Crawling)](https://fshy.ajam.dev/p/hyperbrowser.md) [`crawler-scraper/hyperbrowser`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/hyperbrowser): trial-only | free tier | email | no card | no phone | documented | stale on 2026-11-22. 5,000 credits on signup, 1 concurrent session, 7 days of data retention
- [Notte (Crawling)](https://fshy.ajam.dev/p/notte.md) [`crawler-scraper/notte`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/notte): trial-only | free tier | email | no card | no phone | documented | stale on 2026-12-03. USD 10 of credits, granted once with no expiry, spent on sessions, proxies, LLM tokens and functions; 5 concurrent browsers and 15-minute sessions
- [Octen](https://fshy.ajam.dev/p/octen.md) [`crawler-scraper/octenai`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/octenai): trial-only | free tier | email | no card | no phone | documented | stale on 2026-11-22. USD 5 in free balance on signup
- [SearchApi](https://fshy.ajam.dev/p/searchapi.md) [`crawler-scraper/searchapi`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/searchapi): trial-only | free tier | email | no card | no phone | reported | stale on 2026-11-17. 100 free requests on signup, no credit card required; the vendor's launch announcement describes them as complimentary searches for newly registered users...
- [Serper](https://fshy.ajam.dev/p/serper.md) [`crawler-scraper/serperdev`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/serperdev): trial-only | free tier | email | no card | no phone | documented | stale on 2026-12-03. 2,500 queries on signup, one-time, no credit card
- [Steel.dev](https://fshy.ajam.dev/p/steel.md) [`crawler-scraper/steel`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/steel): trial-only | free tier | email | no card | no phone | documented | stale on 2026-12-03. USD 30 of credits, one time, valid 90 days (about 300 browser hours at USD 0.10 an hour); 10 concurrent sessions of up to 15 minutes
- [Valyu](https://fshy.ajam.dev/p/valyu.md) [`crawler-scraper/valyu`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/valyu): trial-only | free tier | email | no card | no phone | documented | stale on 2026-12-03. USD 10 of free credits on signup, USD 20 with a company email, no card; the free credits expire 12 months after signup

## Paid only (1)

- [Perplexity](https://fshy.ajam.dev/p/perplexity.md) [`crawler-scraper/perplexity`](https://fshy.ajam.dev/api/v1/record/crawler-scraper/perplexity): paid-only | no free tier | card | no phone | documented | stale on 2026-11-22. none: the Search API is billed per successful request from the first one