Hugging Face's logo

ampixa
/
yak-tokenizer

tokenizers
tokenizer
nepali
devanagari
bpe
byte-level
languages-of-nepal
lossless
Model card Files
xet
 Community
2
yak-tokenizer / README.md

Commit History

5 days ago

  1. Upload Yak tokenizer

    freaktopus
    12b6d30