Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
hafeez007
/
balochi-tokenizers
Like
0
Text Generation
balochiml/balochi-dedup-corpus
Baluchi
English
sentencepiece
tokenizer
wordpiece
bpe
balochi
southern-balochi
low-resource-nlp
perso-arabic
nlp
gemma
bert
roberta
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
balochi-tokenizers
/
Tokens
1.99 MB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
hafeez007
Update tokenizer models and README
e899795
verified
5 months ago
Balochi_Labzank.txt
Safe
32.3 kB
Update tokenizer models and README
5 months ago
Tahir Hakim.txt
Safe
32.3 kB
Update tokenizer models and README
5 months ago
liberal capitalism.txt
Safe
41.6 kB
Update tokenizer models and README
5 months ago
tokens_30k_balochi.txt
Safe
55 kB
Update tokenizer models and README
5 months ago
tokens_arabert_v2.txt
Safe
41.2 kB
Update tokenizer models and README
5 months ago
tokens_aragpt2.txt
Safe
120 kB
Update tokenizer models and README
5 months ago
tokens_arbert.txt
Safe
66.2 kB
Update tokenizer models and README
5 months ago
tokens_balochi_30k.txt
Safe
54.2 kB
Update tokenizer models and README
5 months ago
tokens_balochi_bpe.txt
Safe
47 kB
Update tokenizer models and README
5 months ago
tokens_balochi_bpe_128k.txt
Safe
46.9 kB
Update tokenizer models and README
5 months ago
tokens_balochi_bpe_32k.txt
Safe
47.5 kB
Update tokenizer models and README
5 months ago
tokens_balochi_bpe_47k.txt
Safe
47.3 kB
Update tokenizer models and README
5 months ago
tokens_balochi_bpe_64k.txt
Safe
47.2 kB
Update tokenizer models and README
5 months ago
tokens_balochi_bpe_80k.txt
Safe
47 kB
Update tokenizer models and README
5 months ago
tokens_balochi_sentencepiece.txt
Safe
62.1 kB
Update tokenizer models and README
5 months ago
tokens_balochi_sp_128k.txt
Safe
61.9 kB
Update tokenizer models and README
5 months ago
tokens_balochi_sp_32k.txt
Safe
62.5 kB
Update tokenizer models and README
5 months ago
tokens_balochi_sp_47k.txt
Safe
62.3 kB
Update tokenizer models and README
5 months ago
tokens_balochi_sp_64k.txt
Safe
62.1 kB
Update tokenizer models and README
5 months ago
tokens_balochi_sp_80k.txt
Safe
62 kB
Update tokenizer models and README
5 months ago
tokens_balochi_wordpiece.txt
Safe
47.9 kB
Update tokenizer models and README
5 months ago
tokens_balochi_wp_128k.txt
Safe
47.2 kB
Update tokenizer models and README
5 months ago
tokens_balochi_wp_32k.txt
Safe
48.5 kB
Update tokenizer models and README
5 months ago
tokens_balochi_wp_47k.txt
Safe
48.1 kB
Update tokenizer models and README
5 months ago
tokens_balochi_wp_64k.txt
Safe
47.9 kB
Update tokenizer models and README
5 months ago
tokens_balochi_wp_80k.txt
Safe
47.6 kB
Update tokenizer models and README
5 months ago
tokens_bert.txt
Safe
71.7 kB
Update tokenizer models and README
5 months ago
tokens_bert_multilingual.txt
Safe
68.3 kB
Update tokenizer models and README
5 months ago
tokens_camelbert_msa.txt
Safe
72.4 kB
Update tokenizer models and README
5 months ago
tokens_gemma.txt
Safe
73.8 kB
Update tokenizer models and README
5 months ago
tokens_nltk.txt
Safe
46.2 kB
Update tokenizer models and README
5 months ago
tokens_parsbert.txt
Safe
55.4 kB
Update tokenizer models and README
5 months ago
tokens_persian_bpe.txt
Safe
0 Bytes
Update tokenizer models and README
5 months ago
tokens_persianbert_fa.txt
Safe
57 kB
Update tokenizer models and README
5 months ago
tokens_urdubert.txt
Safe
161 kB
Update tokenizer models and README
5 months ago
