Hugging Face's logo

tachiwin
/
tokenizer_64k

tokenizers
tokenizer
multilingual
byte-level-bpe
indigenous-languages
tachiwin
Model card Files
xet
 Community
tokenizer_64k / evaluation /evaluation_summary.json

Commit History

  1. Upload evaluation/evaluation_summary.json with huggingface_hub

    ljcamargo
    Verified signature
    6f670ea