Hugging Face's logo

tachiwin
/
tokenizer_test4

tokenizers
tokenizer
multilingual
byte-level-bpe
indigenous-languages
tachiwin
Model card Files
xet
 Community
tokenizer_test4 / recipe

Commit History

  1. Upload recipe/train_config.yaml with huggingface_hub

    ljcamargo
    Verified signature
    45ae428

  2. Upload recipe/corpus_checksums.json with huggingface_hub

    ljcamargo
    Verified signature
    13dcc32

  3. Upload recipe/corpus_stats.json with huggingface_hub

    ljcamargo
    Verified signature
    387cbb7

  4. Upload recipe/corpus_manifest.csv with huggingface_hub

    ljcamargo
    Verified signature
    09bec38

  5. Upload recipe/special_tokens.txt with huggingface_hub

    ljcamargo
    Verified signature
    1f52e6b