Hugging Face's logo

Omarrran
/
Kashmiri_Tokenizers

Kashmiri
kashmiri
tokenizer
nlp
low-resource
arabic-script
dardic
perso-arabic
Model card Files
xet
 Community
Kashmiri_Tokenizers

Commit History

  1. Update README.md

    Omarrran
    Verified signature
    d3b85f8

  2. Update README.md

    Omarrran
    Verified signature
    59ed522

  1. Upload figures/fig7_ablation.png with huggingface_hub

    Omarrran
    Verified signature
    ff2aa66

  2. Upload figures/fig6_diacritic_viz.png with huggingface_hub

    Omarrran
    Verified signature
    4908723

  3. Upload figures/fig5_token_lengths.png with huggingface_hub

    Omarrran
    Verified signature
    b0319e0

  4. Upload figures/fig4_radar.png with huggingface_hub

    Omarrran
    Verified signature
    002f9d2

  5. Upload figures/fig3_six_panel.png with huggingface_hub

    Omarrran
    Verified signature
    2dbefdb

  6. Upload figures/fig2_metric_heatmap.png with huggingface_hub

    Omarrran
    Verified signature
    165fa6e

  7. Upload kashmiri_unigram_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    50f5180

  8. Upload kashmiri_bpe_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    a12382b

  9. Upload kashmiri_bpe_tokenizer/tokenizer.json with huggingface_hub

    Omarrran
    Verified signature
    48629f1

  10. Upload kashmiri_wordpiece_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    d28243a

  11. Upload kashmiri_wordpiece_tokenizer/tokenizer.json with huggingface_hub

    Omarrran
    Verified signature
    d74daa2

  12. Upload kashmiri_word_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    5d03a74

  13. Upload kashmiri_char_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    994ed1b

  14. Upload kashmiri_char_tokenizer/tokenizer_config.json with huggingface_hub

    Omarrran
    Verified signature
    caae7b9

  15. Upload kashmiri_char_tokenizer/tokenizer.json with huggingface_hub

    Omarrran
    Verified signature
    345e690

  16. Upload README.md with huggingface_hub

    Omarrran
    Verified signature
    4fe095e

  1. Upload figures/fig7_ablation.png with huggingface_hub

    Omarrran
    Verified signature
    36ea820

  2. Upload figures/fig6_diacritic_viz.png with huggingface_hub

    Omarrran
    Verified signature
    bf30076

  3. Upload figures/fig5_token_lengths.png with huggingface_hub

    Omarrran
    Verified signature
    824d5ce

  4. Upload figures/fig4_radar.png with huggingface_hub

    Omarrran
    Verified signature
    56ee727

  5. Upload figures/fig3_six_panel.png with huggingface_hub

    Omarrran
    Verified signature
    70d2ac5

  6. Upload figures/fig2_metric_heatmap.png with huggingface_hub

    Omarrran
    Verified signature
    990e400

  7. Upload figures/fig1_corpus_profile.png with huggingface_hub

    Omarrran
    Verified signature
    6fc4180

  8. Upload kashmiri_unigram_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    0cab5d5

  9. Upload kashmiri_unigram_tokenizer/tokenizer_config.json with huggingface_hub

    Omarrran
    Verified signature
    5980847

  10. Upload kashmiri_unigram_tokenizer/unigram.vocab with huggingface_hub

    Omarrran
    Verified signature
    3f08c87

  11. Upload kashmiri_unigram_tokenizer/unigram.model with huggingface_hub

    Omarrran
    Verified signature
    201ccb1

  12. Upload kashmiri_bpe_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    64ab6fd

  13. Upload kashmiri_bpe_tokenizer/tokenizer_config.json with huggingface_hub

    Omarrran
    Verified signature
    0b61c09

  14. Upload kashmiri_bpe_tokenizer/tokenizer.json with huggingface_hub

    Omarrran
    Verified signature
    769b594

  15. Upload kashmiri_wordpiece_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    41b20b0

  16. Upload kashmiri_wordpiece_tokenizer/tokenizer_config.json with huggingface_hub

    Omarrran
    Verified signature
    dfab812

  17. Upload kashmiri_wordpiece_tokenizer/tokenizer.json with huggingface_hub

    Omarrran
    Verified signature
    9f9c439

  18. Upload kashmiri_word_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    fdfa3e6

  19. Upload kashmiri_word_tokenizer/tokenizer_config.json with huggingface_hub

    Omarrran
    Verified signature
    2772882

  20. Upload kashmiri_word_tokenizer/tokenizer.json with huggingface_hub

    Omarrran
    Verified signature
    5737279

  21. Upload kashmiri_char_tokenizer/README.md with huggingface_hub

    Omarrran
    Verified signature
    ea62bb6

  22. Upload kashmiri_char_tokenizer/tokenizer_config.json with huggingface_hub

    Omarrran
    Verified signature
    065a08a

  23. Upload kashmiri_char_tokenizer/tokenizer.json with huggingface_hub

    Omarrran
    Verified signature
    31f5999

  24. Upload README.md with huggingface_hub

    Omarrran
    Verified signature
    7a1f9d3

  25. initial commit

    Omarrran
    Verified signature
    070f415