laya-indic / tokenizer /tokenizer.json

Commit History

2 days ago

  1. Restore v2; v3 is now a separate model, arunp0/yama-indic

    Verified signature
    77fc5e2

3 days ago

  1. v3 (Yama): XLM-R-large trunk, Gemma-4 real-text + cause/effect data; overall .800 -> .862

    Verified signature
    698aed3

8 days ago

  1. Initial release

    Verified signature
    c864f32