Hugging Face's logo

flexitok
/
maddition_digit_2000

Digo
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_digit_2000 / maddition

Commit History

  1. Upload maddition/flexitok--maddition_digit_2000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    3529fcd

  2. Upload maddition/flexitok--maddition_digit_2000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    b461d23

  1. Upload maddition/flexitok--maddition_digit_2000_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    48f9fc6

  2. Upload maddition/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    c75b118

  3. Upload maddition/flexitok--maddition_digit_2000.yaml with huggingface_hub

    gsaltintas
    Verified signature
    5532c98

  4. Upload maddition/flexitok--maddition_digit_2000_info.json with huggingface_hub

    gsaltintas
    Verified signature
    7e59e0f

  5. Upload maddition/flexitok--maddition_digit_2000_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    0c0cd14

  6. Upload maddition/flexitok--maddition_digit_2000_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    1631bf9