fshy

Home / Crawling

Arquivo.pt

arquivo.pt/Archivecrawler-scraper/arquivoJSONcomparereport an errorprovider JSON

Free allowance
Keyless CDX server, full-text and URL search API, Memento API, image search and replay of the Portuguese web archive, each limited per IP address
Verdict
caveatusable, with a named limit or an unprobed read path
Cost
free tier
Identity
anonymousno card, no phone
Binding limit
request-rateCDX server and the full-text and URL search API 250 requests a minute per IP address; Memento and image search 400 a minute; replay at /wayback 4,000 a minute; an IP address over any of these limits is blocked permanently; a 429 answer...
Evidence
documented8 sources; a first-party page was read and the sentence quoted
Freshness
stale on 2026-11-30checked 2026-10-30 (live); stale on 2026-11-30
Free tierkeyless CDX server, full-text and URL search API, Memento API, image search and replay of the Portuguese web archive, each limited per IP address
unit requests; metered on request-count
Pricenone stated
Limits
  • request-rate (binding) CDX server and the full-text and URL search API 250 requests a minute per IP address; Memento and image search 400 a minute; replay at /wayback 4,000 a minute source
  • request-rate (binding) an IP address over any of these limits is blocked permanently; a 429 answer means slow down source
Bindingrequest-rate 250 CDX requests a minute per IP address, and a permanent block past the limit
Identityanonymous keyless; the limits are counted per IP address
Egressnot applicable: the archived body
Per-object capnot applicable: the unit is a capture
Retentionno expiry stated
Interfacerest CDX server answering JSON lines, the Arquivo.pt API for full-text and URL search, the Memento API, image search, replay at /wayback and /noFrame/replay, and CDXJ index files for bulk access
Toolingplain HTTP with no key; the CDX server takes output=json and limit parameters
Composes withIt has no closest operation, so it answers only a listing
Reliabilitythe CDX endpoint answered 200 with a capture row and no key, with x-ratelimit-policy 250;w=60
NotesIt holds far fewer pages than the Wayback Machine but more of the non-English web.
Evidence notedocumented per-IP limits read on the vendor's API page; the CDX endpoint read with no key
Parsed numbers
  • has-free-tier 1
  • request-rate 250 requests / minute
Evidence 8
datesourcewhat it proved
2026-10-22source not publishedprobe ok at 2026-10-22T01:40Z, 0 consecutive failures
2026-10-30github.com/arquivo/pwa-technologies/wiki/APIsthe CDX server allows 250 requests a minute from one IP address
2026-10-30github.com/arquivo/pwa-technologies/wiki/APIsan IP address over the limits is blocked permanently
2026-10-30github.com/arquivo/pwa-technologies/wiki/APIsCDXJ index files are offered for bulk access beside the APIs
2026-10-30arquivo.pt/wayback/cdx?url=example.com&output=json&limit=1a keyless CDX answer carries a rate limit scoped to the IP address
2026-10-30arquivo.pt/wayback/cdx?url=example.com&output=json&limit=1a keyless CDX query answered 200 with one JSON line and a 250-a-minute policy header
2026-10-30arquivo.pt/wayback/cdx?url=example.com&output=json&limit=1a keyless CDX query with output=json returned a JSON line with its collection
2026-10-30github.com/arquivo/pwa-technologies/wiki/APIsreplay at /wayback allows 4,000 requests a minute from one IP address