Hugging Face's logo

flexitok
/
bpe_arb_Arab_32000

Standard Arabic
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_arb_Arab_32000

Commit History

  1. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    cdffd19

  2. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    0fe0923

  3. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    1aee77a

  4. initial commit

    gsaltintas
    Verified signature
    002fe10