Hugging Face's logo

flexitok
/
mod-tokenizers-zero-padded-ltr_2digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
mod-tokenizers-zero-padded-ltr_2digit / mod_tokenizers_zero_padded

Commit History

  1. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_2digit_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    4a0c881

  2. Upload mod_tokenizers_zero_padded/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    4eeaba8

  3. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_2digit.yaml with huggingface_hub

    gsaltintas
    Verified signature
    150d1ac

  4. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_2digit_info.json with huggingface_hub

    gsaltintas
    Verified signature
    25a6afc

  5. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_2digit_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    7d9d5eb

  6. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_2digit_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    d143eea