tinysms_tokenizer / tokenizer.json
SlavaYus's picture
byte-level BPE, vocab 8192, trained on the TinyGSM train split
93f2b7d verified
Raw History Contribute Delete
546 kB
File too large to display, you can check the raw version instead.