fshy

Home / Storage

Open Storage Network (OSN) via NSF ACCESS — 1 to 50 TB of S3 per allocation, 10 TB minimum

www.openstoragenetwork.org/get-involved/get-an-allocation/Academicstorage/open-storage-network-via-nsf-access-1-to-50-tb-of-s3-perJSONcomparereport an errorprovider JSON

Free allowance
'Allocations of a minimum 10 terabytes and max of 50 terabytes supporting up to 1.6 million files can be requested through the ACCESS CI allocation process.' The ACCESS documentation states it as a 10-50 TB project allocation with '1 ACCESS credit = 1 GB' and 'Campus Champions may request 1 TB...
Verdict
★ qualifiesusable as stated; the read path was probed
Cost
free tier
Identity
institution?placeholder, not evidence; card unknown, phone unknown
Binding limit
write-gatedreview (an Explore project is a 1-page proposal, reviewed, and the PI needs an institu
Evidence
reported8 sources; a third party said so
Freshness
stale on 2026-11-05checked 2026-10-21 (inherited); stale on 2026-11-05
Free tier'Allocations of a minimum 10 terabytes and max of 50 terabytes supporting up to 1.6 million files can be requested through the ACCESS CI allocation process.' The ACCESS documentation states it as a 10-50 TB project allocation with '1 ACCESS credit = 1 GB' and 'Campus Champions may request 1 TB for testing'. Above 50 TB: 'contact us to discuss the hosting and purchase of your own OSN pod'.
unit TB; metered on unstated
Pricenone stated
Limits
  • write-gated (binding) review (an Explore project is a 1-page proposal, reviewed, and the PI needs an institu source
per-object-cap: not documented; the counted limit is 'up to 1.6 million files' per allocation. Retention: 'Never purged', 'Not backed up' (support.access-ci.org resource table) — genuinely indefinite, which is unusual in this niche. request-rate: not published, but the docs note parallel requests against the inside endpoints spread across OSDs 'and therefore achieve very large training throughput'.
Identityinstitution (inferred, not read) not published
EgressFree and unmetered — this is NSF-funded infrastructure, there is no egress meter anywhere in the docs. Public buckets are readable anonymously, which is the fetch path.
Per-object capnot stated
RetentionRetention: 'Never purged', 'Not backed up' (support.access-ci.org resource table) — genuinely indefinite, which is unusual in this niche
Interfaces3, rclone, cli s3
Toolingrclone with provider = Ceph, aws cli, Cyberduck, restic. Endpoints are per-pod, e.g. https://mghp.osn.xsede.org. Bucket management is via the Coldfront portal (coldfront.osn.mghpcc.org), not the CLI.
Composes withThe multiplier is ACCESS projects, not buckets: 'one project can have many S3 Buckets as long as the total quota doesn't exceed the project network quota'. So 50 TB per ACCESS project. ACCESS allows 'Multiple requests allowed' for Explore, Discover and Accelerate project types, with credit limits of 400,000 / 1,500,000 / 3,000,000 respectively — at 3,000 credits per TB of OSN, a single Explore project (400k credits) can fund ~133 TB if it were all spent on OSN, well above the 50 TB per-project cap, meaning the per-project cap is the binding limit and multiple projects is the way past it.
ReliabilityBuckets are 'not backed up' and are created by ticket/portal form, not API — automation is limited to reads and writes, not bucket provisioning.
Parsed numbers
  • has-free-tier 1
Evidence 8
datesourcewhat it proved
2026-10-21www.openstoragenetwork.org/get-involved/get-an-allocation/'Allocations of a minimum 10 terabytes and max of 50 terabytes supporting up to 1.6 million files can be requested through the ACCESS CI allocation process'
2026-10-21support.access-ci.org/documentation/resources/osn'Project allocations run from 10 TB to 50 TB through the standard ACCESS process', '1 ACCESS credit = 1 GB', Bucket storage | 50 TB | Never purged | Not backed up
2026-10-21openstoragenetwork.github.io/docs/allocations/'3,000 ACCESS credits per 1 TB of OSN storage', total OSN allocation 1-50 TB, and OSN is 'at no cost to researchers'
2026-10-21openstoragenetwork.github.io/docs/request-bucket/public anonymous access is opt-in at bucket request: 'If your bucket should be accessible without authentication, please make a note'
2026-10-21mghp.osn.xsede.org/probe: curl -D - -> HTTP/1.1 200 OK, x-amz-request-id tx000006fe9903f5e55ebe4-...-default, Ceph RGW ListAllMyBucketsResult
2026-10-21mghp.osn.xsede.org/bir190004-bucket01/?list-type=2&max-keys=probe: curl '' -> HTTP 200, 1,100 bytes of valid ListBucketResult JSON-equivalent XML, IsTruncated true, real keys (bioconductor AnnotationHub mirror). Anonymous bucket listing works on a real public OSN bucket.
2026-10-21source not publishedprobe: curl -r 0-99 <690MB object> -> HTTP/1.1 206 Partial Content, Content-Range: bytes 0-99/81066 on the small object and 206 on the large one, Accept-Ranges: bytes, ETag present. Ranged reads work.
2026-10-21source not publishedbenchmark: single stream 64 MiB ranged GET -> 67,108,864 B in 5.35 s = 12.55 MB/s (97% of this host's 16.67 MB/s Cloudflare baseline). 16 parallel 4 MiB ranged GETs -> 10.16 MiB/s aggregate, 32 parallel -> 6.71 MiB/s. The curve DECREASES: OSN's per-connection throughput is good and a user link is the bottleneck, so parallel ranged GETs buy nothing here — do not condemn OSN with a single-stream test, it is already at line rate.
Unknown values 3
  • per object cap notes: the field may be stated in a source that was not read
  • per object cap stated: the field may be stated in a source that was not read
  • retention notes: the field may be stated in a source that was not read