Commit History

  1. Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json

    Verified signature
    6b47e00
  2. Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json

    Verified signature
    a5f3d50
  3. Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json

    Verified signature
    6c0a65f
  4. Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt

    Verified signature
    4e4961b

  1. Delete tokenizer/a.py

    Verified signature
    7cd23ce
  2. Upload 4 files

    Verified signature
    6f4fcb8
  3. Create tokenizer/a.py

    Verified signature
    efc0580