Slayer149-balanced / reports /DATA_READY.json
kacperwikiel's picture
Update tokenizer, configuration and training reports
f74b0b5 verified
Raw History Blame Contribute Delete
247 Bytes
{
"status": "ready",
"sources": {
"fineweb_edu": 3000000000,
"dclm_edu": 1000000000,
"cosmopedia": 500000000,
"finemath": 250000000
},
"tokenizer_sha256": "d1ffe47f6fd8cc19ba7c3e5d2537699d6a99d09b584d3319944f4e40fe6c44ea"
}