Model_45 / tokenizer

Commit History

  1. Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json

    Verified signature
    84d5806
  2. Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json

    Verified signature
    01d815f
  3. Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json

    Verified signature
    033aefe
  4. Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt

    Verified signature
    a191f6c
  5. Upload 8 files

    Verified signature
    3c07850