openeurollm/tokenizer-256k
Updated • 3
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
841
Active filters: bpe
O96a/sudanizer-72k
Updated • 1
stukenov/sozkz-morphbpe-100k-kk-v1
Updated • 2
Abhay2310/NexTok-32K
Updated • 25 • 1
j-llm/jtok-eucalyptus-v3
Updated • 1
MadSensiro/MadTokenizer-50K
Token Classification • Updated • 50 • 1
espnet/xeus
Automatic Speech Recognition • Updated • 66 • 151
gsar78/Greek_Tokenizer
Updated • 1
Acct2325449/asset-keywords-tokenizer
Updated • 18
aloobun/IN-Llama-3-Tokenizer
Updated
Saiteja/telugu-bpe
Updated • 5
aayushraina/hindi-bpe-tokenizer
Text Generation • Updated
aayushraina/bpe-hindi
Text Generation • Updated
prithivMLmods/Bpe-vocab-n-OCR
Image-to-Text • 2B • Updated • 38 • 4
mradermacher/Tokenized-OCR-GGUF
2B • Updated • 293 • 1
mradermacher/Tokenized-OCR-i1-GGUF
2B • Updated • 465
FashionFlora/BPEAlbert
Text-to-Speech • Updated
muzaffercky/kurdish-kurmanji-tokenizer
Updated • 49 • 1
mradermacher/Bpe-vocab-n-OCR-GGUF
2B • Updated • 375
mradermacher/Bpe-vocab-n-OCR-i1-GGUF
2B • Updated • 274 • 1
Hailay/geez-tokenizer
Token Classification • Updated
Hengzongshu/Chinse_BBPE_Vocab
Text Classification • Updated
Vipplav/telugu-bpe-23k
Text Generation • Updated
Max1798/my-tokenizer
Updated • 19
amirhofo/Persian-BPE-Tokenizer
Updated
yakul259/english-bpe-tokenizer-60k
Updated
yakul259/finance-bpe-tokenizer-30k
Updated
toksuite/common-pile-comma-v0.1
Text Generation • 2B • Updated • 319
toksuite/meta-llama-Llama-3.2-1B
Text Generation • 2B • Updated • 324
toksuite/microsoft-Phi-3-mini-4k-instruct
Text Generation • 1B • Updated • 315 • 1