Hugging Face's logo

burakaydinofficial
/
AudioProcessing

ONNX
Model card Files
xet
 Community
AudioProcessing / small100-int8 /tokenizer.json

Commit History

  1. Replace tokenizer.json with Xenova M2M-100 418M version (correct SP-aligned vocab IDs) for SMaLL-100

    burakaydinofficial
    Verified signature
    2063eec

  2. Fix tokenizer.json: add language tokens to added_tokens for alirezamsh/small100

    burakaydinofficial
    Verified signature
    f09a6ec

  1. Fix tokenizer.json for SMaLL-100 (correct BPE merge order)

    burakaydinofficial
    Verified signature
    5bdb2d4

  2. Fix tokenizer.json merge order for SMaLL-100 INT8

    burakaydinofficial
    Verified signature
    171300f

  3. Fix tokenizer.json merge order for SMaLL-100 INT8

    burakaydinofficial
    Verified signature
    cc45707

  4. Add tokenizer.json for SMaLL-100 INT8

    burakaydinofficial
    Verified signature
    050b300