Hugging Face's logo

ZombitX64
/
Thaitokenizer

Thai
tokenizers
thai
tokenizer
nlp
subword
Model card Files
xet
 Community
Thaitokenizer

Commit History

  1. Implement feature X to enhance user experience and fix bug Y in module Z

    Nattapong Tapachoom
    7c0f077

  2. Update tokenizer.json and vocab.json for improved formatting and added new token

    Nattapong Tapachoom
    bf83b0d

  1. Add tokenizer configuration file with special tokens and settings

    Nattapong Tapachoom
    12f0d60

  2. Upload tokenizer[1].json

    JonusNattapong
    Verified signature
    7324c3a

  3. Delete tokenizer.json

    JonusNattapong
    Verified signature
    48c9dac

  4. Delete tokenizer_config.json

    JonusNattapong
    Verified signature
    8c74559

  1. Update README.md

    JonusNattapong
    Verified signature
    16fe072

  2. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    2076fd5

  3. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    98984c5

  4. Update README.md

    JonusNattapong
    Verified signature
    ee796af

  5. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    fa02594

  6. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    84ba755

  7. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    46f1427

  8. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    a408e1e

  9. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    7784060

  10. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    1630c96

  11. Upload folder using huggingface_hub

    JonusNattapong
    Verified signature
    55f2143

  12. initial commit

    JonusNattapong
    Verified signature
    27c05b7