Hugging Face's logo

flexitok
/
maddition_fas_Arab_360

Persian
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_fas_Arab_360

Commit History

  1. Upload maddition_360_held_out/flexitok--maddition_fas_Arab_360_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    e45192e

  2. Upload maddition_360_held_out/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    d516e8a

  3. Upload maddition_360_held_out/flexitok--maddition_fas_Arab_360.yaml with huggingface_hub

    gsaltintas
    Verified signature
    2793e65

  4. Upload maddition_360_held_out/flexitok--maddition_fas_Arab_360_info.json with huggingface_hub

    gsaltintas
    Verified signature
    1450bda

  5. Upload maddition_360_held_out/flexitok--maddition_fas_Arab_360_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    c4582ad

  6. Upload maddition_360_held_out/flexitok--maddition_fas_Arab_360_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    ba08c5d

  1. Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    f60bf5b

  2. Upload maddition_360_v2/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    e0a77d8

  3. Upload maddition_360_v2/flexitok--maddition_fas_Arab_360.yaml with huggingface_hub

    gsaltintas
    Verified signature
    f244cb8

  4. Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_info.json with huggingface_hub

    gsaltintas
    Verified signature
    7135033

  5. Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    b4f54e1

  6. Upload maddition_360_v2/flexitok--maddition_fas_Arab_360_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    de986d3

  1. Upload maddition_360/flexitok--maddition_fas_Arab_360_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    288ac79

  2. Upload maddition_360/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    6ac61d8

  3. Upload maddition_360/flexitok--maddition_fas_Arab_360.yaml with huggingface_hub

    gsaltintas
    Verified signature
    fd3815b

  4. Upload maddition_360/flexitok--maddition_fas_Arab_360_info.json with huggingface_hub

    gsaltintas
    Verified signature
    91cb3cd

  5. Upload maddition_360/flexitok--maddition_fas_Arab_360_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    3f06a66

  6. Upload maddition_360/flexitok--maddition_fas_Arab_360_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    42c9191

  7. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    4512b69

  8. initial commit

    gsaltintas
    Verified signature
    0fef59a