morginalium
/

tinystories-tokenizers

Model card Files Files and versions

tinystories-tokenizers

Commit History

Upload README.md with huggingface_hub

36d0de6
verified

morginalium commited on Aug 30

Upload tokenizer_8192.json with huggingface_hub

abe9ca9
verified

morginalium commited on Aug 30

Upload tokenizer_50257.json with huggingface_hub

423f97f
verified

morginalium commited on Aug 30

Upload tokenizer_4096.json with huggingface_hub

711b691
verified

morginalium commited on Aug 30

Upload tokenizer_3072.json with huggingface_hub

7b728db
verified

morginalium commited on Aug 30

Upload tokenizer_2560.json with huggingface_hub

bfd227b
verified

morginalium commited on Aug 30

Upload tokenizer_2048.json with huggingface_hub

501950c
verified

morginalium commited on Aug 30

Upload tokenizer_16384.json with huggingface_hub

667d1d0
verified

morginalium commited on Aug 30

Upload tokenizer_1536.json with huggingface_hub

a8b7664
verified

morginalium commited on Aug 30

Upload tokenizer_1024.json with huggingface_hub

1a4a14a
verified

morginalium commited on Aug 30

Update README.md

32f7e91
verified

morginalium commited on Jun 1

Update README.md

419c311
verified

morginalium commited on Jun 1

Add full suite of BPE tokenizers (1k to 50k)

da47eb4
verified

morginalium commited on Jun 1

initial commit

0caa6e8
verified

morginalium commited on Jun 1