sound-tokenizer / tokenizer.json

Commit History

  1. feat: GPT-style 50k tokenizer + 80 sound/paralinguistic tags

    Verified signature
    ccce676
  2. feat: GPT-style 50k tokenizer — <|reserved_N|> → 80 sound tags

    Verified signature
    ca0b7b3
  3. feat: GPT-style 50k tokenizer with 80 sound/paralinguistic tags

    Verified signature
    e5a8896