fshy

Home / Crawling

urlscan.io

urlscan.io/Archivecrawler-scraper/urlscanJSONcomparereport an errorprovider JSON

Free allowance
Keyless, counted per IP address: 500 searches a day (100 an hour, 30 a minute) and 500 result retrievals a day (250 an hour, 20 a minute), at most 100 results a search
Verdict
caveatusable, with a named limit or an unprobed read path
Cost
free tier
Identity
anonymousno card, no phone
Binding limit
request-ratekeyless search 30 a minute, 100 an hour and 500 a day per IP address; keyless result retrieval 20 a minute, 250 an hour and 500 a day per IP address
Evidence
measured13 sources; a live request was made and its output kept
Freshness
stale on 2027-01-02checked 2026-11-02 (live); stale on 2027-01-02
Free tierkeyless, counted per IP address: 500 searches a day (100 an hour, 30 a minute) and 500 result retrievals a day (250 an hour, 20 a minute), at most 100 results a search
unit requests; metered on request-count; a free account (API Only) raises the daily quotas to 1,000 searches, 10,000 result requests, 5,000 public, 1,000 unlisted and 50 private scans
Pricenone stated
Limits
  • request-rate (binding) keyless search 30 a minute, 100 an hour and 500 a day per IP address source
  • request-rate (binding) keyless result retrieval 20 a minute, 250 an hour and 500 a day per IP address source
a keyless search answer carries X-Rate-Limit headers scoped to ip-address, with a concurrency limit of 10
Bindingrequest-rate keyless search: 30 a minute and 500 a day per IP address
Identityanonymous search and result retrieval answer with no key at per-IP quotas; submitting scans and the larger free quotas need a user account and an API key
Egressnot applicable: JSON and the scanned DOM
Per-object capnot applicable: the unit is a scan
Retentionscan results are public unless unlisted
Interfacerest REST search and result APIs
ToolingREST with an API-Key header or none; X-Rate-Limit headers on each rate-limited answer; a quotas endpoint at /api/v1/quotas
Composes withThe stored-scan leg under Cloudflare URL Scanner; useful when a page must be read as it was and no archive holds it
Reliabilityno reliability event recorded
NotesA scan is a page's DOM and resource list as somebody else's browser saw it, which is why it is the only source for a page that a challenge keeps from every live fetch.
Evidence notemeasured keyless quotas measured on the quotas and search endpoints; the free account's quotas read on the pricing page
Parsed numbers
  • has-free-tier 1
Evidence 13
datesourcewhat it proved
2026-10-22urlscan.io/api/v1/search/?q=domain:example.com&size=1200, 1,953 bytes, results[] with a canonical URL, no key
2026-10-30probe: https://urlscan.io/api/v1/quotaskeyless quotas are counted per IP address: search 30 a minute, 100 an hour, 500 a day; retrieve 20 a minute, 250 an hour, 500 a day; at most 100 results a search
2026-10-30urlscan.io/pricing/the free plan allows 1,000 searches a day; the same table lists 10,000 result requests, 5,000 public, 1,000 unlisted and 50 private scans
2026-10-30urlscan.io/pricing/the Free plan costs USD 0
2026-10-30probe: https://urlscan.io/api/v1/search/?q=domain:example.com&size=1the keyless search answered 200 with X-Rate-Limit-Limit 30 a minute, scope ip-address and concurrency limit 10
2026-10-30urlscan.io/docs/api/calls with no account get small quotas; the full API wants an account and a key
2026-10-30docs.urlscan.io/pages/api-rate-limitsthe quotas endpoint reports the caller's limits
2026-10-30urlscan.io/blog/2021/12/02/search-api-limitations-for-free-ua search with no account returns at most 100 results
2026-10-30docs.urlscan.io/pages/api-rate-limitsunauthenticated requests are limited per IP address
2026-10-30probe: https://urlscan.io/api/v1/search/?q=domain:example.com&size=1the keyless search API answered 200 with a 30-a-minute limit
2026-11-01urlscan.io/api/v1/quotasthe quotas endpoint, read with no key, answers scope ip-address with search limits of 500 a day, 100 an hour and 30 a minute
2026-11-01urlscan.io/api/v1/quotasthe same keyless answer limits result retrieval to 500 a day, 250 an hour and 20 a minute
2026-11-01urlscan.io/api/v1/quotasthe same keyless answer caps a search at 100 results
Unknown values 1
  • reliability note: nothing of this kind was observed