openeurollm
/

tokenizer-256k

european-languages

Model card Files Files and versions

Commit History

Oct 27 8 days ago

14:16
Add HF tokenizer file (#2)⁠

magnrune

c4e9086

Feb 23

15:51
Update README.md

timpal0l

Verified signature
ac1ce77

Feb 20

18:51
Add model card with description, usage, and evaluation results

timpal0l

Verified signature
74b8574
16:55
Upload 262k vocab SentencePiece BPE tokenizer (trained on 175GB)

timpal0l

Verified signature
f1d2f3d
16:55
initial commit

timpal0l

Verified signature
e392cee