Hugging Face's logo

PraneetNS
/
indic-tokenizer-v2

Model card Files
xet
 Community
indic-tokenizer-v2

Commit History

  1. Upload tokenizer_config.json with huggingface_hub

    PraneetNS
    Verified signature
    ddf010a

  2. Upload indic_tokenizer_v2.vocab with huggingface_hub

    PraneetNS
    Verified signature
    07fd4ce

  3. Upload indic_tokenizer_v2.model with huggingface_hub

    PraneetNS
    Verified signature
    2cc6c47

  4. initial commit

    PraneetNS
    Verified signature
    3343df5