Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
OiQ
/
daa-tokenizers
like
0
Follow
OiQ Labs
Arabic
Latin
tokenizer
moroccan-darija
arabic
bpe
unigram
wordpiece
bbpe
benchmark
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
daa-tokenizers
/
plots
Ctrl+K
Ctrl+K
1 contributor
History:
56 commits
Ouaill
Upload plots/external_comparison.png with huggingface_hub
7b89ea4
verified
about 2 months ago
bootstrap_ci_forest.png
Safe
420 kB
xet
Upload plots/bootstrap_ci_forest.png with huggingface_hub
about 2 months ago
cpt_overall_comparison_v2.png
Safe
483 kB
xet
Upload plots/cpt_overall_comparison_v2.png with huggingface_hub
about 2 months ago
cpt_overall_faceted.png
Safe
354 kB
xet
Upload plots/cpt_overall_faceted.png with huggingface_hub
about 2 months ago
cpt_overall_heatmap_v2.png
Safe
233 kB
xet
Upload plots/cpt_overall_heatmap_v2.png with huggingface_hub
about 2 months ago
cpt_overall_trends.png
Safe
437 kB
xet
Upload plots/cpt_overall_trends.png with huggingface_hub
about 2 months ago
exact_match_rate_comparison_v2.png
Safe
478 kB
xet
Upload plots/exact_match_rate_comparison_v2.png with huggingface_hub
about 2 months ago
exact_match_rate_heatmap_v2.png
Safe
207 kB
xet
Upload plots/exact_match_rate_heatmap_v2.png with huggingface_hub
about 2 months ago
exact_match_rate_trends.png
Safe
191 kB
xet
Upload plots/exact_match_rate_trends.png with huggingface_hub
about 2 months ago
external_comparison.png
645 kB
xet
Upload plots/external_comparison.png with huggingface_hub
about 2 months ago
fertility_disparity_comparison_v2.png
Safe
282 kB
xet
Upload plots/fertility_disparity_comparison_v2.png with huggingface_hub
about 2 months ago
fertility_disparity_faceted.png
Safe
231 kB
xet
Upload plots/fertility_disparity_faceted.png with huggingface_hub
about 2 months ago
fertility_disparity_heatmap_v2.png
Safe
321 kB
xet
Upload plots/fertility_disparity_heatmap_v2.png with huggingface_hub
about 2 months ago
fertility_disparity_trends.png
Safe
378 kB
xet
Upload plots/fertility_disparity_trends.png with huggingface_hub
about 2 months ago
fertility_overall_comparison_v2.png
Safe
285 kB
xet
Upload plots/fertility_overall_comparison_v2.png with huggingface_hub
about 2 months ago
fertility_overall_faceted.png
Safe
346 kB
xet
Upload plots/fertility_overall_faceted.png with huggingface_hub
about 2 months ago
fertility_overall_heatmap_v2.png
Safe
213 kB
xet
Upload plots/fertility_overall_heatmap_v2.png with huggingface_hub
about 2 months ago
fertility_overall_trends.png
Safe
560 kB
xet
Upload plots/fertility_overall_trends.png with huggingface_hub
about 2 months ago
morph_consistency_f1_comparison_v2.png
Safe
451 kB
xet
Upload plots/morph_consistency_f1_comparison_v2.png with huggingface_hub
about 2 months ago
morph_consistency_f1_heatmap_v2.png
Safe
241 kB
xet
Upload plots/morph_consistency_f1_heatmap_v2.png with huggingface_hub
about 2 months ago
morph_consistency_f1_trends.png
Safe
478 kB
xet
Upload plots/morph_consistency_f1_trends.png with huggingface_hub
about 2 months ago
morph_edit_distance_ar_comparison_v2.png
Safe
518 kB
xet
Upload plots/morph_edit_distance_ar_comparison_v2.png with huggingface_hub
about 2 months ago
morph_edit_distance_ar_heatmap_v2.png
Safe
231 kB
xet
Upload plots/morph_edit_distance_ar_heatmap_v2.png with huggingface_hub
about 2 months ago
morph_edit_distance_ar_trends.png
Safe
525 kB
xet
Upload plots/morph_edit_distance_ar_trends.png with huggingface_hub
about 2 months ago
oov_disparity_comparison_v2.png
Safe
171 kB
xet
Upload plots/oov_disparity_comparison_v2.png with huggingface_hub
about 2 months ago
script_comparison_v2.png
Safe
751 kB
xet
Upload plots/script_comparison_v2.png with huggingface_hub
about 2 months ago
