Hugging Face's logo

flexitok
/
mod-tokenizers-zero-padded-rtl_2digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
mod-tokenizers-zero-padded-rtl_2digit / mod_tokenizers_zero_padded

Commit History

  1. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_2digit_overlap.json with huggingface_hub

    gsaltintas
    Verified signature
    84ec008

  2. Upload mod_tokenizers_zero_padded/participating_tokenizers.json with huggingface_hub

    gsaltintas
    Verified signature
    c74c1f4

  3. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_2digit.yaml with huggingface_hub

    gsaltintas
    Verified signature
    54649d1

  4. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_2digit_info.json with huggingface_hub

    gsaltintas
    Verified signature
    8753341

  5. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_2digit_vocab.json with huggingface_hub

    gsaltintas
    Verified signature
    1b4a842

  6. Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_2digit_super_mapping.json with huggingface_hub

    gsaltintas
    Verified signature
    bdb18e9