fortik11/Tokenizer-Ky-Ru
Text Generation • Updated
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
252
Active filters: tokenizers
ShubhGuptaAI/shubh-biomed-bpe-16k
Updated
KissTheHabit/omni_prism_bpe_256k
Updated
coderian/scribe-tok-5k
Updated • 1
coderian/scribe-tok-50k
Updated • 1
ravisonawane211/insurance-bpe-32k
Updated
VTXAI/vtx-embed-1M-lf2
Feature Extraction • Updated • 22 • 1
VTXAI/vtx-embed-7M-lf2
Feature Extraction • Updated • 38 • 1
konko/bornomala-bengali-tokenizer
Token Classification • Updated
Samai-sa/SamAI-Tokenizer
Updated
abcastor/small-llm-superbpe-8000-v2
Updated • 1
perixai/perix-tokenizer-tr-49k
Updated
coderian/QraXAi-Turkish-Tok-50K
Updated
ugurhandasdemir/hf_tokanizer
Updated
Tonic/MORENA-65k-Tokenizer
Updated
mamelles/MORENA-65k-Tokenizer
Updated
bnaz12/kambaata-bpe-tokenizer
Updated
paodigitalhub/pao-tokenizer
Updated
toklens/fineweb_edu_tokenizers
Updated
henryhale/grouptok-en-sw-af-de-fr-es-zh-128k
Updated
henryhale/grouptok-en-sw-af-de-fr-es-zh-64k
Updated • 1
henryhale/grouptok-en-sw-af-de-fr-es-zh-152k
Updated
henryhale/grouptok-en-sw-af-de-fr-es-zh-200k
Updated
AyushRawat0009/medical-bpe-32k
Updated • 1
henryhale/grouptok-en-sw-af-32k
Updated
somast/somali-bpe-v2
Feature Extraction • Updated • 4
ampixa/yak-tokenizer
Updated
ibizaca/cro-bpe-32k
Updated • 87 • 3
ibizaca/cro-bpe-48k
Updated • 62 • 3
ibizaca/cro-bpe-64k
Updated • 59 • 3