tinystories-50m / tokenizer.json
Compactbot's picture
Add 8192-vocab BPE tokenizer (TinyStories)
fc3f26f verified
Raw
History
561 kB
File too large to display, you can check the raw version instead.