compactlm-5m / tokenizer.json
Compactbot's picture
Add gollem_eval byte-level BPE tokenizer (12,288 vocab) (#2)
e1fdac6
Raw
History Contribute Delete
830 kB
File too large to display, you can check the raw version instead.