TD-tokenizer / tokenizer_config.json

Commit History

  1. Update tokenizer_config.json

    bcfe5f9
  2. Rename config.json to tokenizer_config.json

    c0e69b6
  3. Rename tokenizer_config.json to config.json

    55e95eb
  4. Upload tokenizer

    8bfd39b