Hugging Face's logo

flexitok
/
bpe_ltr_monolithic_moto

Model card Files
xet
 Community
bpe_ltr_monolithic_moto

Commit History

11 days ago

  1. tokenizer_class: PreTrainedTokenizerFast (v4/v5 compatible)

    gsaltintas
    Verified signature
    ea1a8bc

  1. Upload monolithic BPE tokenizer

    gsaltintas
    Verified signature
    fc6c170

  2. Upload monolithic BPE tokenizer

    gsaltintas
    Verified signature
    741c5a5

  3. initial commit

    gsaltintas
    Verified signature
    e67498b