Hugging Face's logo

TinyStories-Regional
/
tokenizer-comparisons

Model card Files
xet
 Community
tokenizer-comparisons

Commit History

  1. Rename Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.362.pt to Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.362_[l=6, h=8, e=64].pt

    Jinom
    Verified signature
    c58e01b

  2. Rename Hindi-Specific/Pragna/ckpt_pragna-hindi_val=1.201.pt to Hindi-Specific/Pragna/ckpt_pragna-hindi_val=1.201_[l=6, h=8, e=64].pt

    Jinom
    Verified signature
    bf28995

  1. Rename Hindi-Specific/Ganga/ckpt_ganga-hin_val=0.603.pt to Hindi-Specific/Ganga/ckpt_ganga-hindi_val=0.603.pt

    Jinom
    Verified signature
    f60e2da

  1. Upload ckpt_indicBERT-marathi_val=1.027.pt with huggingface_hub

    Jinom
    Verified signature
    30dbc1b

  2. Upload ckpt_indicBART-marathi_val=0.680.pt with huggingface_hub

    Jinom
    Verified signature
    e14476a

  3. Upload ckpt_sutra-marathi_val=0.627.pt with huggingface_hub

    Jinom
    Verified signature
    40d0418

  1. Rename SUTRA/ckpt_sutra-hindi_val=0.522.pt to SUTRA/ckpt_sutra-hindi_val=0.516.pt

    malharinamdar
    Verified signature
    3c71eff

  2. Delete Hindi-Specific/Ganga/a.txt

    malharinamdar
    Verified signature
    03e43bf

  3. Rename Hindi-Specific/Pragna/ckpt_E_512_hindi.pt to Hindi-Specific/Pragna/ckpt_pragna-hindi_val=0.481.pt

    malharinamdar
    Verified signature
    8784c92

  4. Rename Hindi-Specific/Pragna/ckpt_E_64_hindi.pt to Hindi-Specific/Pragna/ckpt_pragna-hindi_val=1.201.pt

    malharinamdar
    Verified signature
    a5bb39c

  5. Rename Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.344.pt to Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.362.pt

    malharinamdar
    Verified signature
    6fbb973

  6. Rename Hindi-Specific/Ganga/ckpt_E_1024_hindi.pt to Hindi-Specific/Ganga/ckpt_ganga-hin_val=0.603.pt

    malharinamdar
    Verified signature
    fb3d8bf

  7. Rename SUTRA/ckpt_sutra-hindi_val=1.217.pt to SUTRA/ckpt_sutra-hindi_val=1.217_[l=6, h=8, e=64].pt

    Jinom
    Verified signature
    42b63f0

  8. Delete Hindi-Specific/test.txt

    Jinom
    Verified signature
    8d32796

  9. Rename Hindi-Specific/Ganga/ckpt_sutra-hindi_val=1.344.pt to Hindi-Specific/Ganga/ckpt_ganga-hindi_val=1.344.pt

    malharinamdar
    Verified signature
    935e7b6

  10. Upload folder using huggingface_hub

    Jinom
    Verified signature
    0ce81f4

  11. Rename Hindi-Specific/Ganga/ckpt_E_64_hindi.pt to Hindi-Specific/Ganga/ckpt_sutra-hindi_val=1.344.pt

    malharinamdar
    Verified signature
    b481ce2

  12. Rename SUTRA/ckpt_sutra-hindi_val=1.344.pt to SUTRA/ckpt_sutra-hindi_val=1.217.pt

    malharinamdar
    Verified signature
    cb956a4

  13. Rename SUTRA/ckpt_E_64_hindi.pt to SUTRA/ckpt_sutra-hindi_val=1.344.pt

    malharinamdar
    Verified signature
    c78d843

  14. Rename SUTRA/ckpt_E_512_hindi.pt to SUTRA/ckpt_sutra-hindi_val=0.522.pt

    malharinamdar
    Verified signature
    7b83ddc

  15. Upload Hindi-Specific/Ganga/ckpt_E_64_hindi.pt with huggingface_hub

    malharinamdar
    Verified signature
    1fbff6a

  16. Upload Hindi-Specific/Ganga/ckpt_E_1024_hindi.pt with huggingface_hub

    malharinamdar
    Verified signature
    bb7d7c7

  17. Create Ganga/a.txt

    malharinamdar
    Verified signature
    0239bdd

  18. Delete Hindi-Specific/Pragna/a.txt

    malharinamdar
    Verified signature
    7e775e9

  19. Upload Hindi-Specific/Pragna/ckpt_E_512_hindi.pt with huggingface_hub

    malharinamdar
    Verified signature
    000f773

  20. Upload Hindi-Specific/Pragna/ckpt_E_64_hindi.pt with huggingface_hub

    malharinamdar
    Verified signature
    c8aea21

  21. Create Pragna/a.txt

    malharinamdar
    Verified signature
    98681a4

  22. Upload SUTRA/ckpt_E_64_hindi.pt with huggingface_hub

    malharinamdar
    Verified signature
    83716ae

  23. Rename SUTRA/ckpt_E_512.pt to SUTRA/ckpt_E_512_hindi.pt

    malharinamdar
    Verified signature
    d77c25c

  24. Rename SUTRA/ckpt.pt to SUTRA/ckpt_E_512.pt

    malharinamdar
    Verified signature
    84dd28a

  25. Upload SUTRA/ckpt.pt with huggingface_hub

    malharinamdar
    Verified signature
    35d9569

  1. Upload folder using huggingface_hub

    Jinom
    Verified signature
    6b91b07

  2. Upload folder using huggingface_hub

    Jinom
    Verified signature
    d6ebe09

  1. Upload folder using huggingface_hub

    Jinom
    Verified signature
    883934c

  2. Create Tiktoken/test.txt

    Jinom
    Verified signature
    3af82bb

  3. Create Bengali-Specific/test.txt

    Jinom
    Verified signature
    c04387b

  4. Create Marathi-Specific/test.txt

    Jinom
    Verified signature
    7d9dea3

  5. Rename Hindi-Specific to Hindi-Specific/test.txt

    Jinom
    Verified signature
    66afaff

  6. Create Hindi-Specific/

    Jinom
    Verified signature
    ff7222e

  7. Create SUTRA/test.txt

    Jinom
    Verified signature
    00cb9ac

  8. initial commit

    Jinom
    Verified signature
    ab7eb22