c7 / tokenizer

Commit History

  1. Update tokenizer/tokenizer_config.json

    Verified signature
    5ace3d3
  2. Update tokenizer/tokenizer_config.json

    Verified signature
    f0d9183
  3. Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt

    Verified signature
    f51022e
  4. Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json

    Verified signature
    0c0f5d6
  5. Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json

    Verified signature
    8efb485
  6. Update tokenizer/tokenizer_config.json

    Verified signature
    4158d35
  7. Upload 3 files

    Verified signature
    1083016
  8. Create tokenizer/tokenizer_config.json

    Verified signature
    57d3393