laya-multilingual / tokenizer /tokenizer.json

Commit History

  1. Initial release of Laya Multilingual (mmBERT-base, 100+ languages, RLCD)

    Verified signature
    4bb4d65