Compactbot
/

compactlm-5m

Text Generation

small-language-model

Model card Files Files and versions

compactlm-5m / tokenizer.json

Commit History

Add BPE tokenizer (8192 vocab)

a50c5c3
verified

Compactbot commited on 2 days ago

Add gollem_eval byte-level BPE tokenizer (12,288 vocab) (#2)

e1fdac6

Compactbot commited on 3 days ago