Hugging Face's logo

flexitok
/
maddition_arb_Arab_360

Standard Arabic
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_arb_Arab_360

Commit History

  1. Upload maddition_360_held_out/flexitok--maddition_arb_Arab_360_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    084b73d

  2. Upload maddition_360_held_out/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    16e8d64

  3. Upload maddition_360_held_out/flexitok--maddition_arb_Arab_360.yaml with huggingface_hub

    gsaltintas
    Verified signature
    5a194ff

  4. Upload maddition_360_held_out/flexitok--maddition_arb_Arab_360_info.json with huggingface_hub

    gsaltintas
    Verified signature
    0c9cb27

  5. Upload maddition_360_held_out/flexitok--maddition_arb_Arab_360_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    46d12dc

  6. Upload maddition_360_held_out/flexitok--maddition_arb_Arab_360_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    25422ea

  1. Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    ee81331

  2. Upload maddition_360_v2/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    d75fb7f

  3. Upload maddition_360_v2/flexitok--maddition_arb_Arab_360.yaml with huggingface_hub

    gsaltintas
    Verified signature
    ccda279

  4. Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_info.json with huggingface_hub

    gsaltintas
    Verified signature
    0838e57

  5. Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    2e45c0d

  6. Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    c66f755

  1. Upload maddition_360/flexitok--maddition_arb_Arab_360_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    67c8c96

  2. Upload maddition_360/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    5c351ec

  3. Upload maddition_360/flexitok--maddition_arb_Arab_360.yaml with huggingface_hub

    gsaltintas
    Verified signature
    3f9eb18

  4. Upload maddition_360/flexitok--maddition_arb_Arab_360_info.json with huggingface_hub

    gsaltintas
    Verified signature
    95e9f58

  5. Upload maddition_360/flexitok--maddition_arb_Arab_360_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    9b23761

  6. Upload maddition_360/flexitok--maddition_arb_Arab_360_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    757f3a2

  7. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    c04681d

  8. initial commit

    gsaltintas
    Verified signature
    0fbf1be