Hugging Face's logo

flexitok
/
mod-tokenizers-ltr_5digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
mod-tokenizers-ltr_5digit / mod_tokenizers

Commit History

  1. Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_5digit_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    2d04b0c

  2. Upload mod_tokenizers/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    4ec7ef4

  3. Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_5digit.yaml with huggingface_hub

    gsaltintas
    Verified signature
    64f933c

  4. Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_5digit_info.json with huggingface_hub

    gsaltintas
    Verified signature
    1fde34f

  5. Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_5digit_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    1fc605c

  6. Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_5digit_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    c06401b