Hugging Face's logo

tachiwin
/
tokenizer_64k

tokenizers
tokenizer
multilingual
byte-level-bpe
indigenous-languages
tachiwin
Model card Files
xet
 Community
tokenizer_64k / tokenizer_config.json

Commit History

  1. Upload folder using huggingface_hub

    ljcamargo
    Verified signature
    cde2a6b