compactlm-5m / tokenizer.json
Compactbot's picture
Add BPE tokenizer (8192 vocab)
a50c5c3 verified
Raw History
555 kB
File too large to display, you can check the raw version instead.