ForesightLoop-8 / tokenizer-validation.json
thuEcstasy1's picture
Release validated final 6B-token ForesightLoop checkpoint
e5419fe verified
Raw History Blame Contribute Delete
504 Bytes
{
"revision": "c1899de289a04d12100db370d81485cdf75e47ca",
"upstream_files_byte_exact_sha256": {
"tokenizer.json": "aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4",
"tokenizer_config.json": "d5d09f07b48c3086c508b30d1c9114bd1189145b74e982a265350c923acd8101",
"vocab.json": "ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910",
"merges.txt": "8831e4f1a044471340f7c0a83d7bd71306a5b867e95fd870f74d0c5308a904d5"
},
"probes_equal_native_tokenizer": true
}