simpsons / tokenizer

Commit History

  1. Add tokenizer/tokenizer_config.json

    Verified signature
    482ea37
  2. Add tokenizer/special_tokens_map.json

    Verified signature
    3ce6b7c
  3. Add tokenizer/merges.txt

    Verified signature
    3f89983