# Spider

> spider.cloud | Crawling; 1 record: free tier, limits, identity cost and evidence.

HTML https://fshy.ajam.dev/p/spider/ | JSON https://fshy.ajam.dev/api/v1/entity/spider.json | how to read a record: https://fshy.ajam.dev/llms-full.txt

## Spider

- `crawler-scraper/spider` | qualifies-with-caveat | evidence measured | binding request-rate | category reader and extractor API
- needs card no, phone no, ID no, institution no | verified 2026-11-02T01:02:36.094Z (live) | stale on 2027-01-02
- url https://spider.cloud/
- free tier: keyless /scrape: no key and no account, 4 requests a minute (free_rpm 4 in the API's free_tier_rate_limited answer, RateLimit-Limit 4 on keyless answers that pass); the documented keyless call is POST with a JSON body | unit: requests | metered on: request-count | read on: 2026-10-30 | source: [1] | note: an account that passes the vendor's signup checks gets 2,500 credits worth USD 0.25 once, with no card; the balance does not expire; pay as you go is USD 1 a GB of bandwidth plus USD 0.0001 a CPU minute
- per-object cap: not applicable | source: [2]
- retention: not applicable | source: [2]
- egress: not applicable: Markdown or JSON answers | metered: no | source: [2]
- identity: anonymous | detail: /scrape takes no key and no account; keyless /crawl answers Payment Required with an offer to pay per request in USDC on Base with no account, key or signup; an account takes an email and password, or Google, GitHub or Discord
- interface: rest
- limits:
  - request-rate (binding): keyless /scrape: 4 requests a minute, named as free_rpm 4 beside paid_rpm 10000 in the API's free_tier_rate_limited answer and sent as RateLimit-Limit 4 on keyless answers that pass, the header the docs define as requests allowed a minute probe:https://api.spider.cloud/scrape?url=https://example.com
  - request-rate (binding): an account starts at 10,000 core API requests a minute and rises through four levels to 80,000 [3]
  - request-rate (binding): keyless runs from the documentation playground: 25 a day with no account [4]
- limits note: keyless GETs of /scrape with a url query answer 400 with a zero-byte body and RateLimit-Limit 4, with RateLimit-Remaining 2 or 3 in a burst, until the throttle answers 429 with RateLimit-Limit 2 and RateLimit-Remaining 0, so RateLimit-Limit differs between the 400 and 429 answers; the docs answer a GET on a POST route with 400 and define RateLimit-Limit as requests allowed a minute
- binding note: the keyless RateLimit-Limit of 4 binds before any volume; past it, a key or a per-request payment is needed
- interface detail: REST /scrape
- tooling: REST over HTTPS with JSON bodies and a Bearer key, or no key on /scrape; official clients spider-client on PyPI and @spider-cloud/spider-client on npm, with Rust, Go and CLI clients in spider-rs/spider-clients; a hosted MCP server at mcp.spider.cloud; per-request USDC payment with an EVM wallet and an x402 client
- composes with: One page per keyless call through POST /scrape with a JSON body, for a first call or a connectivity check; a GET with a url query answers 400, and crawls, searches and sustained use move to a key or a per-request USDC payment
- reliability: keyless /scrape throttles with 429: a burst of 12 parallel GETs answered 400 eight times and 429 four times, each 429 carrying Retry-After, RateLimit-Limit 2, RateLimit-Remaining 0 and a 328 byte JSON body; Retry-After read 1, 3 and 10 seconds in separate runs, and a call made after a Retry-After of 3 had elapsed answered 400 again; measured with GET, keyless POST /scrape is documented and not measured
- notes: A keyless GET of /scrape with a url query answers 400 with a zero-byte body, the documented answer to a GET on a POST route, so it returns no page content; it does reach the keyless rate limiter, which answers a burst with 429. Keyless POST /scrape with a JSON body is documented and not measured.
- evidence note: liveness, the keyless RateLimit-Limit and the keyless 429 answer are measured with GET; the keyless POST /scrape, the account credits and the paid rates are documented, not measured
- evidence:
  - [1] 2026-10-22: 400 with a zero byte body: the keyless route refused the request and sent no reason
  - [5] 2026-10-30: a new account gets 2,500 credits worth USD 0.25 with no card, subject to signup checks | capture: sha256:a60c5b3656f7ebd7ca045aff380bf2e3673efc0c9299ef08f8115bc822075380 | quote: 2,500 free credits, worth $0.25, if your signup passes our checks. No card required.
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-10-30: GET /scrape?url=... with no key answered 400, 0 bytes, with RateLimit-Limit 4 and RateLimit-Reset 7 headers | capture: sha256:eb90acf260b33fe73581a0bfa875f24d0f96696098ea88733d300d2bfab9f07b | quote: "status": 400
  - [5] 2026-10-30: the sign-up form takes an email and password, or Google, GitHub or Discord | capture: sha256:a60c5b3656f7ebd7ca045aff380bf2e3673efc0c9299ef08f8115bc822075380 | quote: Email
  - [6] 2026-10-30: a credit balance does not expire | capture: sha256:284d82c5da7443a114f78a655c6f60102b960176ba0f560ac04958d91738b97f | quote: No. There is no monthly subscription. Top up once and use the balance whenever you need it.
  - [2] 2026-10-30: pay as you go bills USD 1 a GB plus USD 0.0001 a CPU minute | capture: sha256:e58254eb9b468c931999e556cfd195b20558996d4b33882abee411bf0a966312 | quote: Plus $0.0001 per CPU minute.
  - [7] 2026-10-30: POST /scrape is documented as working with no key and no account | capture: sha256:819b7bad4847657a5e2bccf0bfaabc25bc6910cff00c3cb816d90638fcac6ed1 | quote: `POST /scrape` works with no API key and no signup. Nothing else does.
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-10-30: a keyless GET of /scrape with a url query answered 400, 0 bytes, with RateLimit-Limit 4, RateLimit-Remaining 3 and RateLimit-Reset 52 and no payment demand: the API is live and admits a keyless /scrape request | capture: sha256:b416d5f3ab37952ddc5a1e8ce3ca0c28fc40b04e1c9d09eb9aad8c08b7260d63 | quote: "ratelimit-limit": "4"
  - probe:https://api.spider.cloud/crawl 2026-10-30: a keyless GET of /crawl answered with an x402 offer to pay per request in USDC on Base with no account, key or signup, priced USD 0.005 for up to 5 MB | capture: sha256:e3a857227bb254623f3f8af8505c0818a6d86cf9d7f2465506bcc40c6c1d9157 | quote: Pay per request in USDC on Base with no account, no API key, and no signup.
  - [3] 2026-10-30: an account starts at 10,000 core API requests a minute and rises through four levels, the fourth at 80,000 | capture: sha256:849dd493370e642933620329fddc40abaca31e6ee9df4a8c44e87497d915c0b0 | quote: Every account gets at least 10,000 requests per minute on the core API, and it goes up through four levels as you use more.
  - [4] 2026-10-30: keyless runs from the documentation playground need no account and are capped at 25 a day | capture: sha256:40c1ac1772ed082d9dca458c448ee3bfee5191fd8905acfe50973f18f4766208 | quote: Keyless runs work without an account, capped at 25 a day.
  - probe:https://pypi.org/pypi/spider_client/json 2026-10-30: PyPI serves spider-client 0.1.93, a Python SDK for the Spider Cloud API whose home page is spider-rs/spider-clients | capture: sha256:07c316b079aaf1b11ddd47dbf37afd02c8e8317b38eb8f7980fc9d228f5777dc | quote: "summary":"Python SDK for Spider Cloud API"
  - probe:https://api.spider.cloud/crawl 2026-10-30: a keyless GET of /crawl answered 402 with 791 bytes of JSON and a PAYMENT-REQUIRED header | capture: sha256:27cf74a6752e50ecce3c10da1481308bb0814a19f341f660e6e3de9b84524e93 | quote: "status": 402
  - probe:https://api.spider.cloud/data/credits 2026-10-30: a keyless GET of /data/credits answered 401 with an Unauthorized JSON body, not the 402 the docs give for keyless routes other than /scrape | capture: sha256:4aaa3b950759d28cf21bd9fb19e22be4243b082a796da6b5eda80ebcd0c53b41 | quote: "status": 401
  - probe:https://registry.npmjs.org/@spider-cloud%2Fspider-client/latest 2026-10-30: npm serves @spider-cloud/spider-client 0.2.5 from the spider-rs/spider-clients repository | capture: sha256:51cf681e69cbcfbffd6dd54c16e325cc5fc2ab2e9747ed96e7f5e10da78b65a6 | quote: Isomorphic Javascript SDK for Spider Cloud services
  - [7] 2026-10-30: a GET to any content route answers 400, so a GET of /scrape tests the method and not the keyless route | capture: sha256:819b7bad4847657a5e2bccf0bfaabc25bc6910cff00c3cb816d90638fcac6ed1 | quote: Every content route is POST only. A GET or PUT to one returns `400`.
  - [8] 2026-10-30: the keyless tier is documented as a first call and connectivity check; sustained use needs a key | capture: sha256:1565f1f0993deb63fbe37ef69d88d4c1bbb2c3b096d03556858d9a8a27886cf1 | quote: Treat it as a way to make a first call and confirm connectivity. Anything sustained needs a key.
  - [3] 2026-10-30: the docs define the RateLimit-Limit header as requests allowed a minute | capture: sha256:849dd493370e642933620329fddc40abaca31e6ee9df4a8c44e87497d915c0b0 | quote: | RateLimit-Limit | Requests allowed per minute on your account. |
  - [9] 2026-10-30: per-request payment in USDC on Base through x402 needs no account, key or signup | capture: sha256:248382d58ea2af6750b9b030f9f2e9fad31c80c627862d008cabc9e424bf06f6 | quote: Pay per request in USDC on Base. No account, no API key, no signup.
  - [10] 2026-10-30: official SDKs exist for Python, JavaScript, Rust and Go, and a CLI installs with cargo | capture: sha256:d0615be4624b269ecd34ffdebe67f6e9cd6532c90550aca57e81672fed9f59df | quote: Official SDKs for Python, JavaScript, Rust, and Go.
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-11-01: the keyless 429 answer is a JSON body with code free_tier_rate_limited that names free_rpm 4 and paid_rpm 10000: the free tier is 4 requests a minute and an account 10000 | capture: sha256:37662701f2d0d1d5c02978ebd6c6a90534fb1cb0c477f045895ef4033c69db4b | quote: "free_rpm":4,"paid_rpm":10000
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-11-02: a burst of 12 parallel keyless GETs of /scrape answered 400 eight times and 429 four times; each 429 carried Retry-After 10, RateLimit-Limit 2 and RateLimit-Remaining 0, each 400 carried RateLimit-Limit 4 and RateLimit-Remaining 2 or 3 | capture: sha256:126e09c9efaa7f62f2d62703e470d46b920502df55823ed23de9b2f1f0d2ec55 | quote: "statuses": [ 429, 400, 429, 400, 429, 400, 400, 429, 400, 400, 400, 400 ]
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-11-01: the keyless 429 answer tells the caller to slow down, or create an account and add credits for up to 10,000 requests/min | capture: sha256:37662701f2d0d1d5c02978ebd6c6a90534fb1cb0c477f045895ef4033c69db4b | quote: "error":"Free tier rate limit reached. Slow down, or create an account and add credits for up to 10,000 requests/min.","code":"free_tier_rate_limited"
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-11-01: a keyless GET of /scrape answered 429 with Retry-After 3, RateLimit-Limit 2, RateLimit-Remaining 0 and RateLimit-Reset 3 | capture: sha256:dca2a0118b495514da9958d760d1ba8810ee4f5fbfb959c39c12924ec89386d1 | quote: "retry-after": "3", "ratelimit-limit": "2", "ratelimit-remaining": "0", "ratelimit-reset": "3"
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-11-01: a keyless GET of /scrape answered 429 with Retry-After 1, RateLimit-Limit 2, RateLimit-Remaining 0 and RateLimit-Reset 1 | capture: sha256:629341b8791c58662e5d6650e520c4d2a3a16c19c1f0fc2c6ac47fab78881f54 | quote: "retry-after": "1", "ratelimit-limit": "2", "ratelimit-remaining": "0", "ratelimit-reset": "1"
  - probe:https://api.spider.cloud/scrape?url=https://example.com 2026-11-01: a keyless GET probed at 19:27:59.949Z, 3.2 seconds after a 429 with Retry-After 3 probed at 19:27:56.708Z, answered 400 with RateLimit-Limit 4, RateLimit-Remaining 3 and RateLimit-Reset 59 | capture: sha256:855b3040cc05e9aaef08bc69690b4862a37f5cafa44dd2cdf9851d8e8aac969e | quote: "ratelimit-limit": "4", "ratelimit-remaining": "3", "ratelimit-reset": "59"
  - [11] 2026-11-01: the vendor's scraper pages label the live keyless run with a rate of 4 a minute | capture: sha256:f9a6aaa692c7f49212be6abb1335d0ecd6ddca859bf8f04c661cbd920977d044 | quote: run live · no key · 4/min
  - [12] 2026-11-01: the docs say going over the keyless limit returns 429 and tell the caller to honor Retry-After | capture: sha256:87bd591a3360da68a08129533eb4aebd409de6a7edb8cdc33175b0162570d7cc | quote: The keyless tier is rate limited and covers `/scrape` (and its alias `/v1/scrape`) only. Going over the limit returns `429`; honor `Retry-After`.
  - [3] 2026-11-01: an account starts at 10,000 core API requests a minute and rises through four levels, the fourth at 80,000 | capture: sha256:849dd493370e642933620329fddc40abaca31e6ee9df4a8c44e87497d915c0b0 | quote: Every account gets at least 10,000 requests per minute on the core API, and it goes up through four levels as you use more. ... | Level 4 | 80,000 |
  - [4] 2026-11-01: keyless runs from the documentation playground need no account and are capped at 25 a day | capture: sha256:40c1ac1772ed082d9dca458c448ee3bfee5191fd8905acfe50973f18f4766208 | quote: Keyless runs work without an account, capped at 25 a day.
  - [8] 2026-11-01: POST /scrape is documented as working with no Authorization header and no account | capture: sha256:1565f1f0993deb63fbe37ef69d88d4c1bbb2c3b096d03556858d9a8a27886cf1 | quote: `POST /scrape` works with no `Authorization` header and no account.
  - [8] 2026-11-01: the docs say /scrape answers with a JSON array holding one object for its single page, with a content field | capture: sha256:1565f1f0993deb63fbe37ef69d88d4c1bbb2c3b096d03556858d9a8a27886cf1 | quote: Every content route except `/transform` returns a JSON array, one object per page, including `/scrape` for its single page. ... "content": "# Example Domain
  - [8] 2026-11-01: the docs call the keyless tier a way to make a first call and confirm connectivity, and say anything sustained needs a key | capture: sha256:1565f1f0993deb63fbe37ef69d88d4c1bbb2c3b096d03556858d9a8a27886cf1 | quote: Treat it as a way to make a first call and confirm connectivity. Anything sustained needs a key.
- sources:
  - [1] https://api.spider.cloud/scrape?url=https://example.com
  - [2] https://spider.cloud/
  - [3] https://spider.cloud/docs/core/rate-limits/
  - [4] https://spider.cloud/docs/overview/
  - [5] https://spider.cloud/register/
  - [6] https://spider.cloud/faq/
  - [7] https://spider.cloud/llms.txt
  - [8] https://spider.cloud/llms-full.txt
  - [9] https://spider.cloud/docs/integrations/x402/
  - [10] https://spider.cloud/docs/libraries/
  - [11] https://spider.cloud/scrapers/indeed-scraper/
  - [12] https://spider.cloud/agent-skill/SKILL.md