Playground / tokenizer

Commit History

  1. Create tokenizer_config.json

    Verified signature
    a032292
  2. Create special_tokens_map.json

    Verified signature
    83582ec
  3. Upload merges.txt

    Verified signature
    4c1daa4
  4. Rename tokenizer.vocab.json to tokenizer/vocab.json

    Verified signature
    a732475