morginalium
/

tinystories-tokenizers

Model card Files Files and versions

tinystories-tokenizers

6.23 MB

Ctrl+K

Ctrl+K

1 contributor

History: 14 commits

morginalium's picture

Upload README.md with huggingface_hub

36d0de6 verified 30 days ago

.gitattributes

1.52 kB
initial commit 4 months ago
README.md

3.56 kB
Upload README.md with huggingface_hub 30 days ago
tokenizer_1024.json

60.4 kB
Upload tokenizer_1024.json with huggingface_hub 30 days ago
tokenizer_1536.json

95 kB
Upload tokenizer_1536.json with huggingface_hub 30 days ago
tokenizer_16384.json

1.15 MB
Upload tokenizer_16384.json with huggingface_hub 30 days ago
tokenizer_2048.json

130 kB
Upload tokenizer_2048.json with huggingface_hub 30 days ago
tokenizer_2560.json

165 kB
Upload tokenizer_2560.json with huggingface_hub 30 days ago
tokenizer_3072.json

200 kB
Upload tokenizer_3072.json with huggingface_hub 30 days ago
tokenizer_4096.json

272 kB
Upload tokenizer_4096.json with huggingface_hub 30 days ago
tokenizer_50257.json

3.59 MB
Upload tokenizer_50257.json with huggingface_hub 30 days ago
tokenizer_8192.json

560 kB
Upload tokenizer_8192.json with huggingface_hub 30 days ago