telos / data

Commit History

add: 5B-token English corpus metadata sidecar
f6c41bc
verified

Kazenowoko commited on

add: 5B-token English corpus (FineWeb-Edu)
93d4d40
verified

Kazenowoko commited on

add: 5.0B token Python binary corpus (uint16)
72d87e7
verified

Kazenowoko commited on

Upload data/python_corpus_5b.json with huggingface_hub
399fddf
verified

Kazenowoko commited on

Upload data/python_corpus_2.5b.bin with huggingface_hub
ef0a015
verified

Kazenowoko commited on

Upload data/python_corpus_1.7b.bin with huggingface_hub
fe70c2b
verified

Kazenowoko commited on