domofon/datasets / dclm6b-t2 /_aggregate.json
domofon's picture
download
raw
851 Bytes
{
"engine": "tokforge",
"prefix": "dclm6b-t2",
"corpus": "dclm",
"version": "5b",
"shards": 16,
"docs": 1527666,
"tokens": 2000038912,
"bytes": 4000077824,
"files": [
"data-00000-of-00016.npy",
"data-00001-of-00016.npy",
"data-00002-of-00016.npy",
"data-00003-of-00016.npy",
"data-00004-of-00016.npy",
"data-00005-of-00016.npy",
"data-00006-of-00016.npy",
"data-00007-of-00016.npy",
"data-00008-of-00016.npy",
"data-00009-of-00016.npy",
"data-00010-of-00016.npy",
"data-00011-of-00016.npy",
"data-00012-of-00016.npy",
"data-00013-of-00016.npy",
"data-00014-of-00016.npy",
"data-00015-of-00016.npy"
],
"source_range": [
10000,
10016
],
"source_dataset": "mlfoundations/dclm-baseline-1.0",
"source_config": null,
"created_at": "2026-08-22T16:42:29Z"
}

Xet Storage Details

Size:
851 Bytes
·
Xet hash:
4ac499a925afeefa79b172b76ab61c9fef1edfb375f122e92f22eb5b861a7cce

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.