fshy

Home / Storage

Source Cooperative

source.coop · 2 records in Storage · JSON

Records 2

source.coopDataset hostingstorage/source-cooperative-byte-level-re-probeJSONcomparereport an error

Free allowance
No published byte quota; the org states it 'hosts over 5 petabytes of data' across 330+ products from 130+ organisations and serves ~700 TB/month, and positions itself as 'data publishing at any scale'.
Verdict
caveatusable, with a named limit or an unprobed read path
Cost
free tier
Identity
emailno card, no phone
Binding limit
noneno named constraint binds
Evidence
reported7 sources; a third party said so
Freshness
stale on 2026-11-05checked 2026-10-21 (inherited); stale on 2026-11-05
Free tierNo published byte quota; the org states it 'hosts over 5 petabytes of data' across 330+ products from 130+ organisations and serves ~700 TB/month, and positions itself as 'data publishing at any scale'.
unit TB; metered on unstated
Pricenone stated
Identityemail email
EgressFree and unmetered in practice for the reader: anonymous GET with no credentials, Cloudflare in front, R2/Turbo-adjacent CDN headers. No egress meter appears anywhere in the docs.
Per-object capnot stated
Retentionnot stated
Interfaces3, rclone, cli s3
ToolingGenuine S3 proxy. Endpoint https://data.source.coop, --no-sign-request for reads. Upload credentials are Source-issued but in AWS format and valid only at the proxy; path is s3://<account-id>/<product-id>/ and you cannot write outside your own prefix. Accepts aws cli, boto3, rclone with a custom endpoint, plus a Source CLI and service accounts for CI.
Composes withMultiplier is data products per account/org, and orgs can hold team members. Because reads are anonymous and S3-native, this is the cleanest 'someone else's S3 on a real CDN' shape in the whole D area — it can be mounted by AList/rclone and fronted by Cloudflare exactly per §2.1.
ReliabilityBeta + announced-but-unpublished pricing means the free window has an unknown end date. Store only data that has a second home.
Parsed numbers
  • has-free-tier 1
Evidence 7
datesourcewhat it proved
2026-10-21data.source.coop/kerner-lab/fields-of-the-world/README.mdPROBED (this is the new evidence): curl -qsS -D - -> HTTP 200, Content-Length: 16187, Accept-Ranges: bytes, ETag, Last-Modified, Server: cloudflare, CF-Cache-Status: DYNAMIC. Downloaded twice and SHA-256 compared: cdd18d37e1af2320c2eaa763a6b70a8258a1ee2e5dc78e558ea0922e981e56d6 on both copies, and 16,187 bytes on disk matches the declared Content-Length — a true roundtrip, not a 200-with-empty-body.
2026-10-21source not publishedPROBED: curl -H 'Range: bytes=0-99' on the same object -> HTTP 206 Partial Content, Content-Range: bytes 0-99/16187, 100 bytes body. Range requests work, so resumable/parallel fetches are viable.
2026-10-21data.source.coop/kerner-lab?list-type=2&max-keys=5PROBED: curl '' -> real <ListBucketResult> with CommonPrefixes (fields-of-the-world-austria/, -belgium/, -brazil/, …), KeyCount 5, IsTruncated true. Anonymous bucket listing works — the catalogue is enumerable without credentials.
2026-10-21data.source.coop/?list-type=2&delimiter=/&max-keys=5PROBED: curl '' -> body is literally 'Source Cooperative Data Proxy v2.5.1', not an S3 error. Root listing is disabled but the service identifies itself; useful as a liveness probe.
2026-10-21docs.source.coop/what-is-sourceopened: 'Hosts over 5 petabytes … Serves approximately 700 terabytes of data transfer per month … Supports over 330 data products from 130+ organizations'; 'Source is currently in beta … publishing data requires applying to be a beta tester.'
2026-10-21source.coop/opened: 'Flat pricing … Pricing plans based on data volume and usage will be announced soon.' Confirms unpriced.
2026-10-21docs.source.coop/data-proxyopened: 'The Source Data Proxy provides S3-compatible access to all data hosted on Source Cooperative. You can access data through the proxy without authentication.'
Unknown values 4
  • per object cap notes: the field may be stated in a source that was not read
  • per object cap stated: the field may be stated in a source that was not read
  • retention notes: the field may be stated in a source that was not read
  • retention stated: the field may be stated in a source that was not read

source.coop/Academicstorage/source-cooperative-uncapped-public-publishing-beta-gatedJSONcomparereport an error

Free allowance
No published byte cap: 'allowing trusted organizations and individuals to publish data of any kind at any scale'.
Verdict
caveatusable, with a named limit or an unprobed read path
Cost
free tier
Identity
emailno card, no phone
Binding limit
noneno named constraint binds
Evidence
reported4 sources; a third party said so
Freshness
stale on 2026-11-05checked 2026-10-21 (inherited); stale on 2026-11-05
Free tierNo published byte cap: 'allowing trusted organizations and individuals to publish data of any kind at any scale'. Case study: Earth Genome publishes 60+ TB. Platform total reported at just over 5 PB.
unit TB; metered on unstated
Pricenone stated
Identityemail email
EgressFree public reads through the data proxy at data.source.coop - live probe returned HTTP 200 with Cloudflare in front (CF-RAY present), so reads are CDN-covered.
Per-object capnot stated
Retentionnot stated
Interfaces3 s3
ToolingObjects served at data.source.coop/<account>/<product>/...; the proxy is open source (Rust, github.com/source-cooperative/data.source.coop). Bring Your Own Bucket (BYOB) points Source at an S3 bucket you own, read via OIDC federation (sts:AssumeRoleWithWebIdentity) with no long-lived secret either side.
Composes withPer data product, owned by 'an organization or an individual' explicitly. BYOB is the important primitive: it decouples the catalogue/CDN from the bytes, so a free bucket elsewhere becomes a Source product with Cloudflare-fronted reads.
ReliabilityNonprofit (Radiant Earth 501(c)(3) parent) with in-kind AWS/Azure; beta terms can change. Storage itself lives on commodity cloud, so durability is AWS-grade.
Parsed numbers
  • has-free-tier 1
Evidence 4
datesourcewhat it proved
2026-10-21docs.source.coop/'Source allows trusted organizations and individuals to publish data of any kind at any scale'; 'apply to be a beta tester'
2026-10-21docs.source.coop/create-a-data-product'Data products can be owned by an organization or an individual'; 'By default it uses Source-managed storage... choose a connection in the us-west-2 region'
2026-10-21docs.source.coop/bring-your-own-bucket'Source staff must enable' BYOB; OIDC federation, 'Nothing long-lived is stored'
2026-10-21data.source.coop/live probe: HTTP 200, Server: cloudflare, CF-RAY a4e2ac1a8e2fa1b3-KTM
Unknown values 4
  • per object cap notes: the field may be stated in a source that was not read
  • per object cap stated: the field may be stated in a source that was not read
  • retention notes: the field may be stated in a source that was not read
  • retention stated: the field may be stated in a source that was not read