Commit History

  1. Upload op_tokenizer.py with huggingface_hub

    Verified signature
    8e94991
  2. Delete op_tokenizer.py

    Verified signature
    522cec8
  3. Update tokenizer_config.json

    Verified signature
    747cf01
  4. Update tokenizer_config.json

    Verified signature
    e41a640
  5. Upload tokenizer_config.json with huggingface_hub

    Verified signature
    1d08ebe
  6. Upload op_tokenizer.py with huggingface_hub

    Verified signature
    d7f0c84
  7. Delete OpTokenizer.py

    Verified signature
    d6d1177
  8. Delete tokenizer_config.json

    Verified signature
    6b6739f
  9. Delete tokenizer.py

    Verified signature
    d1dc1a5
  10. Upload tokenizer_config.json with huggingface_hub

    Verified signature
    4cebc18
  11. Upload OpTokenizer.py with huggingface_hub

    Verified signature
    7fc9be7
  12. Delete tokenizer_config.json

    Verified signature
    d74beee
  13. Upload tokenizer_config.json with huggingface_hub

    Verified signature
    43ac539
  14. Upload tokenizer.py with huggingface_hub

    Verified signature
    d392109
  15. Delete tokenizer_config.json

    Verified signature
    428eace
  16. Upload generation_config.json with huggingface_hub

    Verified signature
    87c0363
  17. Upload special_tokens_map.json with huggingface_hub

    Verified signature
    d20811a
  18. Upload tokenizer_config.json with huggingface_hub

    Verified signature
    0b05987
  19. Upload vocab.json with huggingface_hub

    Verified signature
    2e17bcd
  20. Upload pytorch_model.bin with huggingface_hub

    Verified signature
    1a7566b
  21. Upload config.json with huggingface_hub

    Verified signature
    8471176
  22. Upload tokenizer.py with huggingface_hub

    Verified signature
    bce7e2a
  23. initial commit

    Verified signature
    162b38c