Hugging Face's logo

smtturkan
/
turkish-morph-tokenizer

OpenVINO
Turkish
English
tokenizer
turkish
morphology
qwen3.5
Model card Files
xet
 Community
turkish-morph-tokenizer

Commit History

  1. Set ignore_merges=true + OpenVINO parity check (openvino_tokenizers#780)

    smtturkan
    Verified signature
    76bb50c

  2. Set ignore_merges=true + OpenVINO parity check (openvino_tokenizers#780)

    smtturkan
    Verified signature
    15214af

  3. Set ignore_merges=true + OpenVINO parity check (openvino_tokenizers#780)

    smtturkan
    Verified signature
    5b5fad4

  1. Add links

    smtturkan
    Verified signature
    4864166

  2. Turkish morphology-aware tokenizer for Qwen3.5 (v1)

    smtturkan
    Verified signature
    7f601ce

  3. initial commit

    smtturkan
    Verified signature
    4eafe65