Hugging Face's logo

flexitok
/
maddition_rus_Cyrl_2000

Russian
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_rus_Cyrl_2000

Commit History

  1. Upload maddition/flexitok--maddition_rus_Cyrl_2000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    d91cd47

  2. Upload maddition/flexitok--maddition_rus_Cyrl_2000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    f3c775a

  3. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    453a155

  4. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    6742cab

  1. Upload maddition/flexitok--maddition_rus_Cyrl_2000_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    ae399ad

  2. Upload maddition/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    81351be

  3. Upload maddition/flexitok--maddition_rus_Cyrl_2000.yaml with huggingface_hub

    gsaltintas
    Verified signature
    acdae66

  4. Upload maddition/flexitok--maddition_rus_Cyrl_2000_info.json with huggingface_hub

    gsaltintas
    Verified signature
    2fdd3a6

  5. Upload maddition/flexitok--maddition_rus_Cyrl_2000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    0cf4da9

  6. Upload maddition/flexitok--maddition_rus_Cyrl_2000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    c659702

  7. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    fb979e8

  8. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    c42a42f

  9. Upload folder using huggingface_hub

    gsaltintas
    Verified signature
    15909e4

  10. initial commit

    gsaltintas
    Verified signature
    0ba655d