pyrosfp16 / tokenizer_2

Commit History

  1. Rename tokenizer_2/tokenizer_2_vocab.json to tokenizer_2/vocab.json

    Verified signature
    77ef2ec
  2. Rename tokenizer_2/tokenizer_2_tokenizer_config.json to tokenizer_2/tokenizer_config.json

    Verified signature
    410ab1f
  3. Rename tokenizer_2/tokenizer_2_special_tokens_map.json to tokenizer_2/special_tokens_map.json

    Verified signature
    e6e3f5e
  4. Rename tokenizer_2/tokenizer_2_merges.txt to tokenizer_2/merges.txt

    Verified signature
    8c11c40
  5. Upload 19 files

    Verified signature
    c285248