mrkwanzaa/functionalizer-100M-fineweb-edu-seed5
Text Generation • 97.7M • Updated • 459
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
1,705
Active filters: tokenizer
mrkwanzaa/functionalizer-100M-github-code-python-seed1
Text Generation • 97.7M • Updated • 609
mrkwanzaa/functionalizer-100M-github-code-python-seed2
Text Generation • 97.7M • Updated • 628
mrkwanzaa/functionalizer-100M-github-code-python-seed3
Text Generation • 97.7M • Updated • 623
mrkwanzaa/functionalizer-100M-github-code-python-seed4
Text Generation • 97.7M • Updated • 621
mrkwanzaa/functionalizer-100M-github-code-python-seed5
Text Generation • 97.7M • Updated • 629
Larsson31/mizo-tokenizer-32k
Text Generation • Updated
wonhui-labs/swt-tokenizer
Token Classification • Updated
konko/bornomala-bengali-tokenizer
Token Classification • Updated
salmanhadli/medical-bpe-16k
Updated • 1
marin-community/marin-tokenizer-tools
Updated • 1
touati-kamel/darja-tokenizer-50m
Feature Extraction • Updated
chorcat/rukh-tokenizer
Updated
upstage/solar-pro4-tokenizer
Updated • 2
Samai-sa/SamAI-Tokenizer
Updated
changmaulee/timemeshin-otm-tokenizer
Updated
nassimjp/LFM2.5-2.6B-Pashto-Zi-b
Text Generation • 3B • Updated • 101
nassimjp/Qwen3-VL-4B-Thinking-Pashto-Zi
Image-Text-to-Text • 4B • Updated • 1.44k
mradermacher/LFM2.5-2.6B-Pashto-Zi-b-GGUF
3B • Updated • 486 • 1
nassimjp/LFM2.5-2.6B-Pashto-Zi-b-GGUF
3B • Updated • 252
nyralabs/PINT
Feature Extraction • 94.4M • Updated • 155 • 1
sayurio/bn-tokenizer-64k
Text Generation • Updated • 1
abcastor/small-llm-superbpe-8000-v2
Updated • 1
mariklolik/AraToken
Updated
interpretable-finetuning/qwen2.5-7b-unaliased
Text Generation • 8B • Updated • 166
interpretable-finetuning/qwen2.5-32b-unaliased
Text Generation • 33B • Updated • 119
KhadijaMir/P1_financial_news_headlines_CharBPETokenizer
Updated
perixai/perix-tokenizer-tr-49k
Updated
coderian/QraXAi-Turkish-Tok-50K
Updated
CharlieH512/km_tokenizer_ctx14_8x1000
10.8M • Updated • 27