text_generation_tokenizer2 / tokenizer_config.json

Commit History

  1. add tokenizer

    f2589f5
  2. add tokenizer

    60dfc3a