Home / Hugging Face
ai data commons as storage: fineweb, common pile, dclm, dolma/olmo, pleias
huggingface.co/docs/hub/storage-limitsstorage/ai-data-commons-as-storage-fineweb-common-pile-dclm-dolmJSONcomparereport an errorprovider JSON
- Free allowance
- None for deposit: the five datasets are published for download; on Hugging Face, where FineWeb and Common Pile sit, a free user or org has public storage 'Best-effort' and private storage 100GB
- Verdict
- fails: quotathe free allowance is too small to matter
- Cost
- USD 12/TB-monthparsed from the record, in USD
- Identity
- email?placeholder, not evidence; card unknown, phone unknown
- Binding limit
- noneno named constraint binds
- Evidence
- reported6 sources; a third party said so
- Freshness
- stale on 2026-11-19checked 2026-11-04 (live); stale on 2026-11-19
| Free tier | none for deposit: the five datasets are published for download; on Hugging Face, where FineWeb and Common Pile sit, a free user or org has public storage 'Best-effort' and private storage 100GB unit none; metered on none |
|---|
| Price | USD 12 per TB-month public and USD 18 per TB-month private at Hugging Face, the host of FineWeb and Common Pile; PRO, Team or Enterprise plan needed for paid public storage |
|---|
| Identity | email (placeholder) not published |
|---|
| Egress | not recorded |
|---|
| Interface | unknown |
|---|
| Tooling | not recorded |
|---|
| Reliability | FineWeb's per-dump table totals 50,446.9 GB on disk |
|---|
| Notes | All five are read-only distribution, not deposit targets, and they all sit on infrastructure a user cannot write to. FineWeb (25.9B docs / 48.6 TB) and Common Pile (8 TB) and Pleias… |
|---|
| Evidence note | reported The 2026-11-03 evidence rows read https://huggingface.co/docs/hub/storage-limits (free tier storage), https://huggingface.co/datasets/HuggingFaceFW/fineweb/raw/main/README.md (FineWeb size) and https://huggingface.co/common-pile (Common Pile size). No vendor page read states that the five datasets are not deposit targets, and the other datasets named in the record were not read, so the rung stays reported. |
|---|
| Parsed numbers | - price-per-tb USD 12 TB / month
|
|---|
Evidence 6
More fields 1
| dead end | {"failure_class": "quota","why": "All five are read-only distribution, not deposit targets, and they all sit on infrastructure a user cannot write to. FineWeb (25.9B docs / 48.6 TB) and Common Pile (8 TB) and Pleias…","retry_when": null,"first_recorded": "2026-10-21"} |
|---|
Unknown values 7
- chaining: no value was recorded for this field
- egress terms: no value was recorded for this field
- interface: the access interface was not established
- per object cap notes: no value was recorded for this field
- per object cap stated: no value was recorded for this field
- retention stated: no value was recorded for this field
- tooling: no value was recorded for this field