Hugging Face's logo

flexitok
/
bpe_arb_Arab_16000

Standard Arabic
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_arb_Arab_16000

Commit History

  1. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    19e52cd

  1. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    36f035b

  2. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    85289ae

  3. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    c10b39c

  1. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    7275876

  2. initial commit

    gsaltintas
    Verified signature
    0f5d37d