Hugging Face's logo

flexitok
/
bpe_fas_Arab_8000

Persian
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_fas_Arab_8000

Commit History

  1. Upload safe_v2/flexitok--bpe_fas_Arab_8000_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    0060810

  2. Upload safe_v2/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    2632aae

  3. Upload safe_v2/flexitok--bpe_fas_Arab_8000.yaml with huggingface_hub

    gsaltintas
    Verified signature
    e2893a5

  4. Upload safe_v2/flexitok--bpe_fas_Arab_8000_info.json with huggingface_hub

    gsaltintas
    Verified signature
    c63c2e1

  5. Upload safe_v2/flexitok--bpe_fas_Arab_8000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    ec075f3

  6. Upload safe_v2/flexitok--bpe_fas_Arab_8000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    cc3677d

  1. Upload safe/flexitok--bpe_fas_Arab_8000_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    a0215d5

  2. Upload safe/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    f6b5d1a

  3. Upload safe/flexitok--bpe_fas_Arab_8000.yaml with huggingface_hub

    gsaltintas
    Verified signature
    0499765

  4. Upload safe/flexitok--bpe_fas_Arab_8000_info.json with huggingface_hub

    gsaltintas
    Verified signature
    d06dbb7

  5. Upload safe/flexitok--bpe_fas_Arab_8000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    bafbec1

  6. Upload safe/flexitok--bpe_fas_Arab_8000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    96ca471

  1. Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    be9e9a8

  2. Upload fineweb2_hq/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    7bf3deb

  3. Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000.yaml with huggingface_hub

    gsaltintas
    Verified signature
    8f2a6df

  4. Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_info.json with huggingface_hub

    gsaltintas
    Verified signature
    ab28799

  5. Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    c9629cc

  6. Upload fineweb2_hq/flexitok--bpe_fas_Arab_8000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    a691807

  1. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    85a60c6

  2. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    2b7e096

  3. initial commit

    gsaltintas
    Verified signature
    a9c93ce