ASTERIZER
/

LUNA-Tokenizer

Token Classification

text-generation

Model card Files Files and versions

LUNA-Tokenizer / README.md

Commit History

Aug 28

06:30
Apply CC BY-NC-ND 4.0 license

REZIRETSA

Verified signature
d35070a
05:41
Add shared LUNA tokenizer (GPT-NeoX, vocab 50304)

REZIRETSA

Verified signature
196d102