Hugging Face's logo

flexitok
/
bpe_arb_Arab_64000

Standard Arabic
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_arb_Arab_64000

Commit History

  1. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    62ed02f

  2. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    cf2f30e

  3. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    55ec92d

  4. initial commit

    gsaltintas
    Verified signature
    af6a313