MillID leaderboard against GlotLID and fastText

README.md

@@ -27,13 +27,13 @@ averaged with every language weighted equally (macro).
 
 ## Macro F1, every set
 
-| Set | Languages | MillID tiny | MillID medium | MillID large | GlotLID | fastText |
-|---|---|---|---|---|---|---|
-| `test`: every language, passages from documents never seen in training | 1621 | 0.9524 | 0.9576 | 0.9566 | **0.9755** | 0.0659 |
-| `test-common`: the languages all three systems know | 213 | 0.9458 | 0.9527 | 0.9501 | **0.9846** | 0.9173 |
-| `udhr`: the Declaration of Human Rights, languages MillID knows | 358 | 0.8698 | 0.8780 | 0.8755 | **0.8873** | 0.3499 |
-| `udhr-common`: the Declaration, languages all three know | 170 | 0.9489 | 0.9480 | 0.9443 | **0.9659** | 0.9329 |
-| `udhr-all`: the Declaration, every language in it | 429 | 0.7099 | 0.7184 | 0.7153 | **0.7245** | 0.2797 |
+| Set | Languages | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 | GlotLID | fastText |
+|---|---|---|---|---|---|---|---|---|---|
+| `test`: every language, passages from documents never seen in training | 1621 | 0.9524 | 0.9576 | 0.9566 | 0.9554 | 0.9535 | 0.9646 | **0.9755** | 0.0659 |
+| `test-common`: the languages all three systems know | 213 | 0.9458 | 0.9527 | 0.9501 | 0.9513 | 0.9467 | 0.9594 | **0.9846** | 0.9173 |
+| `udhr`: the Declaration of Human Rights, languages MillID knows | 358 | 0.8698 | 0.8780 | 0.8755 | 0.8764 | 0.8704 | 0.8812 | **0.8873** | 0.3499 |
+| `udhr-common`: the Declaration, languages all three know | 170 | 0.9489 | 0.9480 | 0.9443 | 0.9513 | 0.9390 | 0.9529 | **0.9659** | 0.9329 |
+| `udhr-all`: the Declaration, every language in it | 429 | 0.7099 | 0.7184 | 0.7153 | 0.7149 | 0.7121 | 0.7201 | **0.7245** | 0.2797 |
 
 The best score on each set is in bold.
 
@@ -45,8 +45,11 @@ Every language, passages from documents never seen in training.
 |---|---|---|---|---|---|---|---|---|---|
 | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9783 | 0.9978 | 0.9985 | 0.9778 | 0.9765 | 0.9755 | 1.0000 | 1490 of 1621 |
 | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9776 | 0.9977 | 0.9984 | 0.9783 | 0.9752 | 0.9748 | 1.0000 | 1488 of 1621 |
+| [MillID large v1.5](https://huggingface.co/baobabtech/millid-large-v1.5) | 192.6M | 0.9674 | 0.9924 | 0.9956 | 0.9655 | 0.9663 | 0.9646 | 0.9894 | 1478 of 1621 |
 | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.9616 | 0.9910 | 0.9945 | 0.9564 | 0.9614 | 0.9576 | 0.9841 | 1451 of 1621 |
 | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.9602 | 0.9913 | 0.9948 | 0.9559 | 0.9601 | 0.9566 | 0.9844 | 1444 of 1621 |
+| [MillID tiny v1.5](https://huggingface.co/baobabtech/millid-tiny-v1.5) | 2.9M | 0.9587 | 0.9890 | 0.9932 | 0.9550 | 0.9588 | 0.9554 | 0.9825 | 1446 of 1621 |
+| [MillID medium v1.5](https://huggingface.co/baobabtech/millid-medium-v1.5) | 115.0M | 0.9576 | 0.9894 | 0.9937 | 0.9533 | 0.9578 | 0.9535 | 0.9824 | 1439 of 1621 |
 | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.9555 | 0.9884 | 0.9929 | 0.9527 | 0.9553 | 0.9524 | 0.9802 | 1428 of 1621 |
 | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.2515 | 0.2611 | 0.2625 | 0.0521 | 0.1209 | 0.0659 | 0.0000 | 26 of 1621 |
 | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.2511 | 0.2610 | 0.2625 | 0.0520 | 0.1205 | 0.0657 | 0.0000 | 25 of 1621 |
@@ -59,8 +62,11 @@ The languages all three systems know.
 |---|---|---|---|---|---|---|---|---|---|
 | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9749 | 0.9927 | 0.9948 | 0.9923 | 0.9790 | 0.9846 | 0.9983 | 203 of 213 |
 | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9738 | 0.9925 | 0.9946 | 0.9924 | 0.9771 | 0.9835 | 0.9983 | 201 of 213 |
+| [MillID large v1.5](https://huggingface.co/baobabtech/millid-large-v1.5) | 192.6M | 0.9525 | 0.9898 | 0.9938 | 0.9757 | 0.9460 | 0.9594 | 0.9791 | 193 of 213 |
 | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.9425 | 0.9882 | 0.9924 | 0.9732 | 0.9361 | 0.9527 | 0.9738 | 191 of 213 |
+| [MillID tiny v1.5](https://huggingface.co/baobabtech/millid-tiny-v1.5) | 2.9M | 0.9396 | 0.9857 | 0.9909 | 0.9709 | 0.9353 | 0.9513 | 0.9726 | 188 of 213 |
 | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.9401 | 0.9885 | 0.9929 | 0.9706 | 0.9337 | 0.9501 | 0.9735 | 185 of 213 |
+| [MillID medium v1.5](https://huggingface.co/baobabtech/millid-medium-v1.5) | 115.0M | 0.9357 | 0.9855 | 0.9911 | 0.9693 | 0.9301 | 0.9467 | 0.9703 | 186 of 213 |
 | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.9354 | 0.9848 | 0.9904 | 0.9661 | 0.9296 | 0.9458 | 0.9694 | 185 of 213 |
 | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9352 | 0.9710 | 0.9763 | 0.9354 | 0.9201 | 0.9173 | 0.9680 | 166 of 213 |
 | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9339 | 0.9707 | 0.9762 | 0.9357 | 0.9169 | 0.9149 | 0.9680 | 165 of 213 |
@@ -73,8 +79,11 @@ The Declaration of Human Rights, languages MillID knows.
 |---|---|---|---|---|---|---|---|---|---|
 | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.8614 | 0.9294 | 0.9433 | 0.9258 | 0.8844 | 0.8873 | 0.9915 | 291 of 358 |
 | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.8598 | 0.9280 | 0.9421 | 0.9261 | 0.8826 | 0.8865 | 0.9915 | 287 of 358 |
+| [MillID large v1.5](https://huggingface.co/baobabtech/millid-large-v1.5) | 192.6M | 0.8579 | 0.9183 | 0.9309 | 0.9171 | 0.8825 | 0.8812 | 0.9914 | 283 of 358 |
 | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.8524 | 0.9194 | 0.9340 | 0.9187 | 0.8769 | 0.8780 | 0.9910 | 282 of 358 |
+| [MillID tiny v1.5](https://huggingface.co/baobabtech/millid-tiny-v1.5) | 2.9M | 0.8492 | 0.9117 | 0.9257 | 0.9148 | 0.8736 | 0.8764 | 0.9907 | 274 of 358 |
 | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.8502 | 0.9168 | 0.9287 | 0.9120 | 0.8757 | 0.8755 | 0.9912 | 273 of 358 |
+| [MillID medium v1.5](https://huggingface.co/baobabtech/millid-medium-v1.5) | 115.0M | 0.8453 | 0.9224 | 0.9390 | 0.9146 | 0.8688 | 0.8704 | 0.9846 | 275 of 358 |
 | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.8423 | 0.9134 | 0.9274 | 0.9043 | 0.8685 | 0.8698 | 0.9846 | 274 of 358 |
 | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.4629 | 0.4857 | 0.4904 | 0.3152 | 0.4483 | 0.3499 | 0.0000 | 61 of 358 |
 | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.4625 | 0.4857 | 0.4903 | 0.3152 | 0.4479 | 0.3497 | 0.0000 | 60 of 358 |
@@ -87,9 +96,12 @@ The Declaration, languages all three know.
 |---|---|---|---|---|---|---|---|---|---|
 | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9338 | 0.9683 | 0.9736 | 0.9888 | 0.9579 | 0.9659 | 1.0000 | 156 of 170 |
 | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9336 | 0.9678 | 0.9732 | 0.9888 | 0.9576 | 0.9657 | 1.0000 | 155 of 170 |
+| [MillID large v1.5](https://huggingface.co/baobabtech/millid-large-v1.5) | 192.6M | 0.9168 | 0.9630 | 0.9687 | 0.9800 | 0.9436 | 0.9529 | 1.0000 | 152 of 170 |
+| [MillID tiny v1.5](https://huggingface.co/baobabtech/millid-tiny-v1.5) | 2.9M | 0.9123 | 0.9606 | 0.9655 | 0.9794 | 0.9393 | 0.9513 | 1.0000 | 149 of 170 |
 | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.9082 | 0.9581 | 0.9641 | 0.9777 | 0.9371 | 0.9489 | 0.9917 | 151 of 170 |
 | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.9121 | 0.9633 | 0.9688 | 0.9770 | 0.9382 | 0.9480 | 0.9955 | 153 of 170 |
 | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.9075 | 0.9615 | 0.9666 | 0.9735 | 0.9340 | 0.9443 | 0.9924 | 148 of 170 |
+| [MillID medium v1.5](https://huggingface.co/baobabtech/millid-medium-v1.5) | 115.0M | 0.9003 | 0.9630 | 0.9702 | 0.9738 | 0.9284 | 0.9390 | 0.9916 | 146 of 170 |
 | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9195 | 0.9647 | 0.9742 | 0.9474 | 0.9441 | 0.9329 | 1.0000 | 142 of 170 |
 | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9187 | 0.9647 | 0.9741 | 0.9474 | 0.9431 | 0.9323 | 1.0000 | 141 of 170 |
 
@@ -101,247 +113,250 @@ The Declaration, every language in it.
 |---|---|---|---|---|---|---|---|---|---|
 | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.7502 | 0.8145 | 0.8282 | 0.7695 | 0.7529 | 0.7454 | 0.9796 | 277 of 429 |
 | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.7378 | 0.7960 | 0.8079 | 0.7425 | 0.7381 | 0.7245 | 0.9748 | 272 of 429 |
+| [MillID large v1.5](https://huggingface.co/baobabtech/millid-large-v1.5) | 192.6M | 0.7348 | 0.7865 | 0.7973 | 0.7392 | 0.7364 | 0.7201 | 0.9643 | 266 of 429 |
 | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.7301 | 0.7875 | 0.8000 | 0.7415 | 0.7318 | 0.7184 | 0.9672 | 266 of 429 |
 | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.7282 | 0.7853 | 0.7954 | 0.7344 | 0.7307 | 0.7153 | 0.9640 | 254 of 429 |
+| [MillID tiny v1.5](https://huggingface.co/baobabtech/millid-tiny-v1.5) | 2.9M | 0.7274 | 0.7809 | 0.7928 | 0.7340 | 0.7290 | 0.7149 | 0.9649 | 254 of 429 |
+| [MillID medium v1.5](https://huggingface.co/baobabtech/millid-medium-v1.5) | 115.0M | 0.7240 | 0.7900 | 0.8042 | 0.7359 | 0.7250 | 0.7121 | 0.9649 | 259 of 429 |
 | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.7214 | 0.7823 | 0.7943 | 0.7256 | 0.7247 | 0.7099 | 0.9583 | 255 of 429 |
 | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.3964 | 0.4160 | 0.4200 | 0.2479 | 0.3741 | 0.2797 | 0.0000 | 55 of 429 |
 | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.3961 | 0.4160 | 0.4200 | 0.2479 | 0.3737 | 0.2795 | 0.0000 | 54 of 429 |
 
 ## Per language, test
 
-Against GlotLID restricted, the best MillID is better on **151** languages and worse on **564**; against fastText restricted, the best MillID is better on **1616** languages and worse on **0** (F1 differing by more than 0.01), of 1621. Every language is in `leaderboard_test.csv`.
+Against GlotLID restricted, the best MillID is better on **180** languages and worse on **440**; against fastText restricted, the best MillID is better on **1616** languages and worse on **0** (F1 differing by more than 0.01), of 1621. Every language is in `leaderboard_test.csv`.
 
 The 30 languages with the most passages:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `fra_Latn` | French | 1652 | 0.928 | 0.928 | 0.808 | 0.808 | 0.939 | 0.952 | 0.946 |
-| `eng_Latn` | English | 1444 | 0.858 | 0.859 | 0.653 | 0.648 | 0.914 | 0.916 | 0.910 |
-| `spa_Latn` | Spanish | 1136 | 0.951 | 0.951 | 0.574 | 0.574 | 0.928 | 0.942 | 0.944 |
-| `tam_Taml` | Tamil | 754 | 0.993 | 0.993 | 0.965 | 0.965 | 0.999 | 0.997 | 0.998 |
-| `arb_Arab` | Arabic (Modern Standard) | 745 | 0.785 | 0.785 | 0.513 | 0.512 | 0.812 | 0.829 | 0.807 |
-| `por_Latn` | Portuguese | 657 | 0.947 | 0.949 | 0.756 | 0.755 | 0.949 | 0.955 | 0.953 |
-| `kan_Knda` | Kannada | 601 | 0.993 | 0.993 | 0.922 | 0.922 | 0.978 | 0.982 | 0.985 |
-| `zul_Latn` | Zulu | 594 | 0.896 | 0.896 | 0.539 | 0.539 | 0.806 | 0.833 | 0.801 |
-| `swh_Latn` | Swahili | 592 | 0.917 | 0.916 | 0.346 | 0.346 | 0.855 | 0.858 | 0.848 |
-| `mar_Deva` | Marathi | 589 | 0.989 | 0.990 | 0.926 | 0.926 | 0.967 | 0.981 | 0.974 |
-| `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.425 | 0.425 | 0.969 | 0.970 | 0.967 |
-| `hun_Latn` | Hungarian | 576 | 0.999 | 0.999 | 0.232 | 0.232 | 0.978 | 0.990 | 0.991 |
-| `afr_Latn` | Afrikaans | 569 | 0.985 | 0.985 | 0.861 | 0.860 | 0.974 | 0.974 | 0.976 |
-| `tel_Telu` | Telugu | 555 | 0.994 | 0.994 | 0.951 | 0.951 | 0.991 | 0.994 | 0.995 |
-| `nbl_Latn` | South Ndebele | 528 | 0.948 | 0.949 | 0.000 | 0.000 | 0.885 | 0.895 | 0.903 |
-| `rus_Cyrl` | Russian | 528 | 0.949 | 0.949 | 0.462 | 0.462 | 0.913 | 0.925 | 0.945 |
-| `ory_Orya` | Odia (individual language) | 511 | 0.991 | 0.994 | 0.976 | 0.976 | 0.990 | 0.993 | 0.993 |
-| `sot_Latn` | Southern Sotho | 491 | 0.977 | 0.978 | 0.660 | 0.660 | 0.966 | 0.966 | 0.965 |
-| `nso_Latn` | Northern Sotho | 479 | 0.969 | 0.969 | 0.915 | 0.914 | 0.945 | 0.960 | 0.951 |
-| `kua_Latn` | Kuanyama | 476 | 0.986 | 0.986 | 0.000 | 0.000 | 0.959 | 0.979 | 0.960 |
-| `asm_Beng` | Assamese | 467 | 0.999 | 0.999 | 0.990 | 0.990 | 0.993 | 0.994 | 0.994 |
-| `ben_Beng` | Bangla | 466 | 0.997 | 0.997 | 0.718 | 0.718 | 0.963 | 0.980 | 0.972 |
-| `pan_Guru` | Punjabi | 460 | 1.000 | 1.000 | 0.990 | 0.990 | 1.000 | 1.000 | 1.000 |
-| `amh_Ethi` | Amharic | 458 | 1.000 | 1.000 | 0.807 | 0.807 | 0.983 | 0.984 | 0.975 |
-| `tsn_Latn` | Tswana | 456 | 0.961 | 0.961 | 0.652 | 0.652 | 0.930 | 0.939 | 0.934 |
-| `vro_Latn` | Võro | 448 | 0.990 | 0.990 | 0.000 | 0.000 | 0.960 | 0.958 | 0.965 |
-| `gaz_Latn` | Oromo (West Central) | 441 | 0.938 | 0.938 | 0.407 | 0.407 | 0.914 | 0.943 | 0.931 |
-| `som_Latn` | Somali | 439 | 0.994 | 0.994 | 0.487 | 0.487 | 0.985 | 0.988 | 0.990 |
-| `uzn_Latn` | Northern Uzbek | 436 | 0.994 | 0.994 | 0.449 | 0.449 | 0.972 | 0.978 | 0.979 |
-| `tha_Thai` | Thai | 431 | 0.980 | 0.980 | 0.650 | 0.650 | 0.978 | 0.970 | 0.979 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `fra_Latn` | French | 1652 | 0.928 | 0.928 | 0.808 | 0.808 | 0.939 | 0.952 | 0.946 | 0.929 | 0.948 | 0.960 |
+| `eng_Latn` | English | 1444 | 0.858 | 0.859 | 0.653 | 0.648 | 0.914 | 0.916 | 0.910 | 0.917 | 0.904 | 0.934 |
+| `spa_Latn` | Spanish | 1136 | 0.951 | 0.951 | 0.574 | 0.574 | 0.928 | 0.942 | 0.944 | 0.930 | 0.942 | 0.955 |
+| `tam_Taml` | Tamil | 754 | 0.993 | 0.993 | 0.965 | 0.965 | 0.999 | 0.997 | 0.998 | 0.997 | 0.995 | 0.999 |
+| `arb_Arab` | Arabic (Modern Standard) | 745 | 0.785 | 0.785 | 0.513 | 0.512 | 0.812 | 0.829 | 0.807 | 0.814 | 0.814 | 0.833 |
+| `por_Latn` | Portuguese | 657 | 0.947 | 0.949 | 0.756 | 0.755 | 0.949 | 0.955 | 0.953 | 0.947 | 0.940 | 0.965 |
+| `kan_Knda` | Kannada | 601 | 0.993 | 0.993 | 0.922 | 0.922 | 0.978 | 0.982 | 0.985 | 0.969 | 0.963 | 0.965 |
+| `zul_Latn` | Zulu | 594 | 0.896 | 0.896 | 0.539 | 0.539 | 0.806 | 0.833 | 0.801 | 0.846 | 0.816 | 0.878 |
+| `swh_Latn` | Swahili | 592 | 0.917 | 0.916 | 0.346 | 0.346 | 0.855 | 0.858 | 0.848 | 0.848 | 0.824 | 0.870 |
+| `mar_Deva` | Marathi | 589 | 0.989 | 0.990 | 0.926 | 0.926 | 0.967 | 0.981 | 0.974 | 0.965 | 0.969 | 0.976 |
+| `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.425 | 0.425 | 0.969 | 0.970 | 0.967 | 0.965 | 0.964 | 0.978 |
+| `hun_Latn` | Hungarian | 576 | 0.999 | 0.999 | 0.232 | 0.232 | 0.978 | 0.990 | 0.991 | 0.987 | 0.989 | 0.991 |
+| `afr_Latn` | Afrikaans | 569 | 0.985 | 0.985 | 0.861 | 0.860 | 0.974 | 0.974 | 0.976 | 0.967 | 0.978 | 0.979 |
+| `tel_Telu` | Telugu | 555 | 0.994 | 0.994 | 0.951 | 0.951 | 0.991 | 0.994 | 0.995 | 0.991 | 0.990 | 0.988 |
+| `nbl_Latn` | South Ndebele | 528 | 0.948 | 0.949 | 0.000 | 0.000 | 0.885 | 0.895 | 0.903 | 0.903 | 0.906 | 0.927 |
+| `rus_Cyrl` | Russian | 528 | 0.949 | 0.949 | 0.462 | 0.462 | 0.913 | 0.925 | 0.945 | 0.932 | 0.933 | 0.949 |
+| `ory_Orya` | Odia (individual language) | 511 | 0.991 | 0.994 | 0.976 | 0.976 | 0.990 | 0.993 | 0.993 | 0.988 | 0.994 | 0.993 |
+| `sot_Latn` | Southern Sotho | 491 | 0.977 | 0.978 | 0.660 | 0.660 | 0.966 | 0.966 | 0.965 | 0.966 | 0.961 | 0.972 |
+| `nso_Latn` | Northern Sotho | 479 | 0.969 | 0.969 | 0.915 | 0.914 | 0.945 | 0.960 | 0.951 | 0.956 | 0.962 | 0.962 |
+| `kua_Latn` | Kuanyama | 476 | 0.986 | 0.986 | 0.000 | 0.000 | 0.959 | 0.979 | 0.960 | 0.962 | 0.965 | 0.975 |
+| `asm_Beng` | Assamese | 467 | 0.999 | 0.999 | 0.990 | 0.990 | 0.993 | 0.994 | 0.994 | 0.997 | 0.995 | 0.996 |
+| `ben_Beng` | Bangla | 466 | 0.997 | 0.997 | 0.718 | 0.718 | 0.963 | 0.980 | 0.972 | 0.977 | 0.973 | 0.979 |
+| `pan_Guru` | Punjabi | 460 | 1.000 | 1.000 | 0.990 | 0.990 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
+| `amh_Ethi` | Amharic | 458 | 1.000 | 1.000 | 0.807 | 0.807 | 0.983 | 0.984 | 0.975 | 0.981 | 0.984 | 0.986 |
+| `tsn_Latn` | Tswana | 456 | 0.961 | 0.961 | 0.652 | 0.652 | 0.930 | 0.939 | 0.934 | 0.945 | 0.939 | 0.947 |
+| `vro_Latn` | Võro | 448 | 0.990 | 0.990 | 0.000 | 0.000 | 0.960 | 0.958 | 0.965 | 0.947 | 0.958 | 0.973 |
+| `gaz_Latn` | Oromo (West Central) | 441 | 0.938 | 0.938 | 0.407 | 0.407 | 0.914 | 0.943 | 0.931 | 0.910 | 0.921 | 0.928 |
+| `som_Latn` | Somali | 439 | 0.994 | 0.994 | 0.487 | 0.487 | 0.985 | 0.988 | 0.990 | 0.982 | 0.986 | 0.990 |
+| `uzn_Latn` | Northern Uzbek | 436 | 0.994 | 0.994 | 0.449 | 0.449 | 0.972 | 0.978 | 0.979 | 0.976 | 0.979 | 0.982 |
+| `tha_Thai` | Thai | 431 | 0.980 | 0.980 | 0.650 | 0.650 | 0.978 | 0.970 | 0.979 | 0.979 | 0.969 | 0.981 |
 
 Where MillID gains most over GlotLID:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `lbj_Tibt` | Ladakhi | 66 | 0.000 | 0.000 | 0.000 | 0.000 | 0.898 | 0.943 | 0.880 |
-| `ain_Latn` | Ainu | 1 | 0.000 | 0.000 | 0.000 | 0.000 | 0.400 | 0.667 | 0.667 |
-| `ajp_Arab` | South Levantine Arabic | 28 | 0.581 | 0.581 | 0.000 | 0.000 | 0.963 | 0.902 | 0.906 |
-| `und_Laoo` | und | 20 | 0.621 | 0.621 | 0.000 | 0.000 | 0.750 | 0.857 | 0.927 |
-| `und_Deva` | und | 5 | 0.727 | 0.615 | 0.000 | 0.000 | 0.889 | 0.667 | 0.750 |
-| `sgh_Cyrl` | Shughni | 9 | 0.667 | 0.667 | 0.000 | 0.000 | 0.842 | 0.900 | 0.818 |
-| `und_Thaa` | und | 29 | 0.651 | 0.651 | 0.000 | 0.000 | 0.792 | 0.873 | 0.750 |
-| `icr_Latn` | Islander Creole English | 24 | 0.649 | 0.684 | 0.000 | 0.000 | 0.783 | 0.870 | 0.744 |
-| `cek_Latn` | Eastern Khumi Chin | 67 | 0.680 | 0.684 | 0.000 | 0.000 | 0.718 | 0.853 | 0.688 |
-| `neb_Latn` | Toura (Côte d'Ivoire) | 11 | 0.625 | 0.842 | 0.000 | 0.000 | 1.000 | 0.957 | 0.952 |
-| `dag_Latn` | Dagbani | 149 | 0.662 | 0.660 | 0.000 | 0.000 | 0.801 | 0.817 | 0.791 |
-| `und_Syrc` | und | 43 | 0.822 | 0.822 | 0.000 | 0.000 | 0.956 | 0.977 | 0.966 |
-| `tuk_Arab` | Turkmen | 135 | 0.761 | 0.761 | 0.000 | 0.000 | 0.893 | 0.903 | 0.906 |
-| `kby_Latn` | Manga Kanuri | 7 | 0.326 | 0.326 | 0.000 | 0.000 | 0.414 | 0.452 | 0.467 |
-| `orv_Cyrl` | Old Russian | 239 | 0.800 | 0.800 | 0.000 | 0.000 | 0.921 | 0.935 | 0.928 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `lbj_Tibt` | Ladakhi | 66 | 0.000 | 0.000 | 0.000 | 0.000 | 0.898 | 0.943 | 0.880 | 0.943 | 0.971 | 0.923 |
+| `ain_Latn` | Ainu | 1 | 0.000 | 0.000 | 0.000 | 0.000 | 0.400 | 0.667 | 0.667 | 0.667 | 0.400 | 0.667 |
+| `ajp_Arab` | South Levantine Arabic | 28 | 0.581 | 0.581 | 0.000 | 0.000 | 0.963 | 0.902 | 0.906 | 0.946 | 0.750 | 0.902 |
+| `und_Laoo` | und | 20 | 0.621 | 0.621 | 0.000 | 0.000 | 0.750 | 0.857 | 0.927 | 0.923 | 0.865 | 0.788 |
+| `und_Deva` | und | 5 | 0.727 | 0.615 | 0.000 | 0.000 | 0.889 | 0.667 | 0.750 | 0.667 | 0.750 | 0.750 |
+| `und_Thaa` | und | 29 | 0.651 | 0.651 | 0.000 | 0.000 | 0.792 | 0.873 | 0.750 | 0.881 | 0.906 | 0.863 |
+| `sgh_Cyrl` | Shughni | 9 | 0.667 | 0.667 | 0.000 | 0.000 | 0.842 | 0.900 | 0.818 | 0.857 | 0.875 | 0.889 |
+| `icr_Latn` | Islander Creole English | 24 | 0.649 | 0.684 | 0.000 | 0.000 | 0.783 | 0.870 | 0.744 | 0.698 | 0.727 | 0.700 |
+| `und_Geor` | und | 32 | 0.694 | 0.694 | 0.000 | 0.000 | 0.583 | 0.706 | 0.828 | 0.877 | 0.731 | 0.792 |
+| `tdt_Latn` | Tetun Dili | 57 | 0.603 | 0.603 | 0.000 | 0.000 | 0.726 | 0.656 | 0.617 | 0.693 | 0.660 | 0.782 |
+| `cek_Latn` | Eastern Khumi Chin | 67 | 0.680 | 0.684 | 0.000 | 0.000 | 0.718 | 0.853 | 0.688 | 0.785 | 0.830 | 0.825 |
+| `und_Syrc` | und | 43 | 0.822 | 0.822 | 0.000 | 0.000 | 0.956 | 0.977 | 0.966 | 0.966 | 0.977 | 0.989 |
+| `neb_Latn` | Toura (Côte d'Ivoire) | 11 | 0.625 | 0.842 | 0.000 | 0.000 | 1.000 | 0.957 | 0.952 | 0.957 | 1.000 | 1.000 |
+| `dag_Latn` | Dagbani | 149 | 0.662 | 0.660 | 0.000 | 0.000 | 0.801 | 0.817 | 0.791 | 0.767 | 0.780 | 0.814 |
+| `tuk_Arab` | Turkmen | 135 | 0.761 | 0.761 | 0.000 | 0.000 | 0.893 | 0.903 | 0.906 | 0.905 | 0.899 | 0.917 |
 
 Where MillID loses most to GlotLID:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `biu_Latn` | Biete | 7 | 1.000 | 1.000 | 0.000 | 0.000 | 0.500 | 0.667 | 0.667 |
-| `ttj_Latn` | Tooro | 28 | 0.946 | 0.946 | 0.000 | 0.000 | 0.597 | 0.490 | 0.618 |
-| `knc_Arab` | Central Kanuri | 68 | 0.823 | 0.825 | 0.007 | 0.007 | 0.514 | 0.509 | 0.488 |
-| `esi_Latn` | North Alaskan Inupiatun | 9 | 0.783 | 0.783 | 0.000 | 0.000 | 0.222 | 0.500 | 0.400 |
-| `hrv_Latn` | Croatian | 168 | 0.944 | 0.944 | 0.178 | 0.178 | 0.615 | 0.687 | 0.630 |
-| `dks_Latn` | Southeastern Dinka | 3 | 1.000 | 1.000 | 0.000 | 0.000 | 0.667 | 0.750 | 0.600 |
-| `bos_Latn` | Bosnian | 198 | 0.902 | 0.902 | 0.181 | 0.181 | 0.603 | 0.673 | 0.680 |
-| `zsm_Latn` | Standard Malay | 244 | 0.957 | 0.957 | 0.321 | 0.319 | 0.677 | 0.746 | 0.729 |
-| `hak_Hani` | Hakka Chinese | 29 | 0.824 | 0.824 | 0.000 | 0.000 | 0.618 | 0.415 | 0.458 |
-| `nse_Latn` | Nsenga | 12 | 0.750 | 0.750 | 0.000 | 0.000 | 0.545 | 0.500 | 0.500 |
-| `plw_Latn` | Brooke's Point Palawano | 8 | 1.000 | 1.000 | 0.000 | 0.000 | 0.696 | 0.800 | 0.667 |
-| `ccp_Latn` | Chakma | 3 | 1.000 | 1.000 | 0.000 | 0.000 | 0.800 | 0.333 | 0.333 |
-| `tui_Latn` | Tupuri | 4 | 0.667 | 1.000 | 0.000 | 0.000 | 0.800 | 0.750 | 0.600 |
-| `tzm_Tfng` | Central Atlas Tamazight | 157 | 0.816 | 0.816 | 0.569 | 0.569 | 0.572 | 0.620 | 0.611 |
-| `taq_Tfng` | Tamasheq | 104 | 0.718 | 0.718 | 0.000 | 0.000 | 0.524 | 0.535 | 0.523 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `ttj_Latn` | Tooro | 28 | 0.946 | 0.946 | 0.000 | 0.000 | 0.597 | 0.490 | 0.618 | 0.485 | 0.578 | 0.622 |
+| `knc_Arab` | Central Kanuri | 68 | 0.823 | 0.825 | 0.007 | 0.007 | 0.514 | 0.509 | 0.488 | 0.462 | 0.485 | 0.532 |
+| `hrv_Latn` | Croatian | 168 | 0.944 | 0.944 | 0.178 | 0.178 | 0.615 | 0.687 | 0.630 | 0.622 | 0.625 | 0.707 |
+| `esi_Latn` | North Alaskan Inupiatun | 9 | 0.783 | 0.783 | 0.000 | 0.000 | 0.222 | 0.500 | 0.400 | 0.455 | 0.381 | 0.556 |
+| `hak_Hani` | Hakka Chinese | 29 | 0.824 | 0.824 | 0.000 | 0.000 | 0.618 | 0.415 | 0.458 | 0.621 | 0.491 | 0.581 |
+| `bos_Latn` | Bosnian | 198 | 0.902 | 0.902 | 0.181 | 0.181 | 0.603 | 0.673 | 0.680 | 0.649 | 0.607 | 0.700 |
+| `plw_Latn` | Brooke's Point Palawano | 8 | 1.000 | 1.000 | 0.000 | 0.000 | 0.696 | 0.800 | 0.667 | 0.727 | 0.800 | 0.762 |
+| `ccp_Latn` | Chakma | 3 | 1.000 | 1.000 | 0.000 | 0.000 | 0.800 | 0.333 | 0.333 | 0.800 | 0.571 | 0.750 |
+| `taq_Tfng` | Tamasheq | 104 | 0.718 | 0.718 | 0.000 | 0.000 | 0.524 | 0.535 | 0.523 | 0.529 | 0.518 | 0.527 |
+| `mbd_Latn` | Dibabawon Manobo | 14 | 1.000 | 1.000 | 0.000 | 0.000 | 0.667 | 0.757 | 0.824 | 0.596 | 0.757 | 0.800 |
+| `zsm_Latn` | Standard Malay | 244 | 0.957 | 0.957 | 0.321 | 0.319 | 0.677 | 0.746 | 0.729 | 0.770 | 0.763 | 0.781 |
+| `biu_Latn` | Biete | 7 | 1.000 | 1.000 | 0.000 | 0.000 | 0.500 | 0.667 | 0.667 | 0.667 | 0.545 | 0.833 |
+| `ldi_Latn` | Laari | 62 | 0.992 | 0.992 | 0.000 | 0.000 | 0.780 | 0.831 | 0.827 | 0.777 | 0.803 | 0.765 |
+| `tzm_Tfng` | Central Atlas Tamazight | 157 | 0.816 | 0.816 | 0.569 | 0.569 | 0.572 | 0.620 | 0.611 | 0.659 | 0.541 | 0.614 |
+| `nse_Latn` | Nsenga | 12 | 0.750 | 0.750 | 0.000 | 0.000 | 0.545 | 0.500 | 0.500 | 0.600 | 0.526 | 0.500 |
 
 ## Per language, test-common
 
-Against GlotLID restricted, the best MillID is better on **8** languages and worse on **127**; against fastText restricted, the best MillID is better on **99** languages and worse on **37** (F1 differing by more than 0.01), of 213. Every language is in `leaderboard_test-common.csv`.
+Against GlotLID restricted, the best MillID is better on **14** languages and worse on **108**; against fastText restricted, the best MillID is better on **115** languages and worse on **29** (F1 differing by more than 0.01), of 213. Every language is in `leaderboard_test-common.csv`.
 
 The 30 languages with the most passages:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `fra_Latn` | French | 1652 | 0.955 | 0.955 | 0.963 | 0.963 | 0.958 | 0.974 | 0.964 |
-| `eng_Latn` | English | 1444 | 0.876 | 0.877 | 0.857 | 0.857 | 0.936 | 0.941 | 0.932 |
-| `spa_Latn` | Spanish | 1136 | 0.958 | 0.958 | 0.941 | 0.941 | 0.943 | 0.953 | 0.958 |
-| `tam_Taml` | Tamil | 754 | 1.000 | 1.000 | 0.997 | 0.997 | 0.999 | 0.998 | 0.998 |
-| `arb_Arab` | Arabic (Modern Standard) | 745 | 0.886 | 0.886 | 0.957 | 0.954 | 0.877 | 0.905 | 0.892 |
-| `por_Latn` | Portuguese | 657 | 0.954 | 0.956 | 0.950 | 0.949 | 0.958 | 0.963 | 0.960 |
-| `kan_Knda` | Kannada | 601 | 0.994 | 0.994 | 0.999 | 0.999 | 0.982 | 0.987 | 0.991 |
-| `zul_Latn` | Zulu | 594 | 0.904 | 0.904 | 0.970 | 0.970 | 0.845 | 0.871 | 0.830 |
-| `swh_Latn` | Swahili | 592 | 0.954 | 0.953 | 0.945 | 0.945 | 0.902 | 0.897 | 0.902 |
-| `mar_Deva` | Marathi | 589 | 0.989 | 0.990 | 0.987 | 0.987 | 0.971 | 0.981 | 0.974 |
-| `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.986 | 0.986 | 0.983 | 0.984 | 0.983 |
-| `hun_Latn` | Hungarian | 576 | 1.000 | 1.000 | 0.980 | 0.980 | 0.983 | 0.991 | 0.991 |
-| `afr_Latn` | Afrikaans | 569 | 0.985 | 0.985 | 0.986 | 0.986 | 0.978 | 0.976 | 0.982 |
-| `tel_Telu` | Telugu | 555 | 0.998 | 0.998 | 0.999 | 0.999 | 0.999 | 1.000 | 1.000 |
-| `rus_Cyrl` | Russian | 528 | 0.985 | 0.985 | 0.927 | 0.927 | 0.924 | 0.929 | 0.956 |
-| `ory_Orya` | Odia (individual language) | 511 | 0.997 | 1.000 | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 |
-| `sot_Latn` | Southern Sotho | 491 | 0.977 | 0.978 | 0.856 | 0.856 | 0.970 | 0.967 | 0.967 |
-| `nso_Latn` | Northern Sotho | 479 | 0.970 | 0.970 | 0.967 | 0.967 | 0.947 | 0.961 | 0.952 |
-| `asm_Beng` | Assamese | 467 | 0.999 | 0.999 | 0.997 | 0.997 | 0.993 | 0.995 | 0.994 |
-| `ben_Beng` | Bangla | 466 | 0.997 | 0.997 | 0.989 | 0.989 | 0.974 | 0.987 | 0.982 |
-| `pan_Guru` | Punjabi | 460 | 1.000 | 1.000 | 0.990 | 0.990 | 1.000 | 1.000 | 1.000 |
-| `amh_Ethi` | Amharic | 458 | 1.000 | 1.000 | 0.998 | 0.998 | 0.986 | 0.987 | 0.978 |
-| `tsn_Latn` | Tswana | 456 | 0.961 | 0.961 | 0.870 | 0.870 | 0.934 | 0.940 | 0.936 |
-| `gaz_Latn` | Oromo (West Central) | 441 | 0.974 | 0.974 | 0.973 | 0.973 | 0.935 | 0.955 | 0.954 |
-| `som_Latn` | Somali | 439 | 0.995 | 0.995 | 0.991 | 0.991 | 0.989 | 0.992 | 0.992 |
-| `uzn_Latn` | Northern Uzbek | 436 | 0.999 | 0.999 | 0.985 | 0.985 | 0.978 | 0.984 | 0.983 |
-| `tha_Thai` | Thai | 431 | 0.980 | 0.980 | 0.981 | 0.981 | 0.978 | 0.970 | 0.979 |
-| `ydd_Hebr` | Eastern Yiddish | 430 | 1.000 | 1.000 | 0.999 | 0.999 | 0.994 | 0.998 | 0.992 |
-| `tur_Latn` | Turkish | 430 | 0.999 | 0.999 | 0.980 | 0.980 | 0.969 | 0.974 | 0.977 |
-| `nno_Latn` | Norwegian Nynorsk | 427 | 0.985 | 0.985 | 0.954 | 0.954 | 0.894 | 0.919 | 0.915 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `fra_Latn` | French | 1652 | 0.955 | 0.955 | 0.963 | 0.963 | 0.958 | 0.974 | 0.964 | 0.943 | 0.975 | 0.983 |
+| `eng_Latn` | English | 1444 | 0.876 | 0.877 | 0.857 | 0.857 | 0.936 | 0.941 | 0.932 | 0.932 | 0.921 | 0.953 |
+| `spa_Latn` | Spanish | 1136 | 0.958 | 0.958 | 0.941 | 0.941 | 0.943 | 0.953 | 0.958 | 0.937 | 0.957 | 0.972 |
+| `tam_Taml` | Tamil | 754 | 1.000 | 1.000 | 0.997 | 0.997 | 0.999 | 0.998 | 0.998 | 0.997 | 0.995 | 0.999 |
+| `arb_Arab` | Arabic (Modern Standard) | 745 | 0.886 | 0.886 | 0.957 | 0.954 | 0.877 | 0.905 | 0.892 | 0.871 | 0.909 | 0.905 |
+| `por_Latn` | Portuguese | 657 | 0.954 | 0.956 | 0.950 | 0.949 | 0.958 | 0.963 | 0.960 | 0.959 | 0.949 | 0.973 |
+| `kan_Knda` | Kannada | 601 | 0.994 | 0.994 | 0.999 | 0.999 | 0.982 | 0.987 | 0.991 | 0.973 | 0.966 | 0.967 |
+| `zul_Latn` | Zulu | 594 | 0.904 | 0.904 | 0.970 | 0.970 | 0.845 | 0.871 | 0.830 | 0.883 | 0.843 | 0.909 |
+| `swh_Latn` | Swahili | 592 | 0.954 | 0.953 | 0.945 | 0.945 | 0.902 | 0.897 | 0.902 | 0.893 | 0.852 | 0.909 |
+| `mar_Deva` | Marathi | 589 | 0.989 | 0.990 | 0.987 | 0.987 | 0.971 | 0.981 | 0.974 | 0.968 | 0.970 | 0.979 |
+| `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.986 | 0.986 | 0.983 | 0.984 | 0.983 | 0.979 | 0.985 | 0.985 |
+| `hun_Latn` | Hungarian | 576 | 1.000 | 1.000 | 0.980 | 0.980 | 0.983 | 0.991 | 0.991 | 0.989 | 0.991 | 0.993 |
+| `afr_Latn` | Afrikaans | 569 | 0.985 | 0.985 | 0.986 | 0.986 | 0.978 | 0.976 | 0.982 | 0.972 | 0.983 | 0.983 |
+| `tel_Telu` | Telugu | 555 | 0.998 | 0.998 | 0.999 | 0.999 | 0.999 | 1.000 | 1.000 | 0.997 | 0.998 | 0.999 |
+| `rus_Cyrl` | Russian | 528 | 0.985 | 0.985 | 0.927 | 0.927 | 0.924 | 0.929 | 0.956 | 0.945 | 0.939 | 0.956 |
+| `ory_Orya` | Odia (individual language) | 511 | 0.997 | 1.000 | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 0.994 | 0.996 | 0.995 |
+| `sot_Latn` | Southern Sotho | 491 | 0.977 | 0.978 | 0.856 | 0.856 | 0.970 | 0.967 | 0.967 | 0.969 | 0.965 | 0.974 |
+| `nso_Latn` | Northern Sotho | 479 | 0.970 | 0.970 | 0.967 | 0.967 | 0.947 | 0.961 | 0.952 | 0.958 | 0.965 | 0.964 |
+| `asm_Beng` | Assamese | 467 | 0.999 | 0.999 | 0.997 | 0.997 | 0.993 | 0.995 | 0.994 | 0.997 | 0.995 | 0.997 |
+| `ben_Beng` | Bangla | 466 | 0.997 | 0.997 | 0.989 | 0.989 | 0.974 | 0.987 | 0.982 | 0.988 | 0.987 | 0.993 |
+| `pan_Guru` | Punjabi | 460 | 1.000 | 1.000 | 0.990 | 0.990 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
+| `amh_Ethi` | Amharic | 458 | 1.000 | 1.000 | 0.998 | 0.998 | 0.986 | 0.987 | 0.978 | 0.984 | 0.986 | 0.986 |
+| `tsn_Latn` | Tswana | 456 | 0.961 | 0.961 | 0.870 | 0.870 | 0.934 | 0.940 | 0.936 | 0.948 | 0.944 | 0.947 |
+| `gaz_Latn` | Oromo (West Central) | 441 | 0.974 | 0.974 | 0.973 | 0.973 | 0.935 | 0.955 | 0.954 | 0.935 | 0.947 | 0.941 |
+| `som_Latn` | Somali | 439 | 0.995 | 0.995 | 0.991 | 0.991 | 0.989 | 0.992 | 0.992 | 0.984 | 0.990 | 0.991 |
+| `uzn_Latn` | Northern Uzbek | 436 | 0.999 | 0.999 | 0.985 | 0.985 | 0.978 | 0.984 | 0.983 | 0.984 | 0.981 | 0.986 |
+| `tha_Thai` | Thai | 431 | 0.980 | 0.980 | 0.981 | 0.981 | 0.978 | 0.970 | 0.979 | 0.980 | 0.970 | 0.981 |
+| `ydd_Hebr` | Eastern Yiddish | 430 | 1.000 | 1.000 | 0.999 | 0.999 | 0.994 | 0.998 | 0.992 | 0.993 | 0.993 | 0.994 |
+| `tur_Latn` | Turkish | 430 | 0.999 | 0.999 | 0.980 | 0.980 | 0.969 | 0.974 | 0.977 | 0.968 | 0.959 | 0.973 |
+| `nno_Latn` | Norwegian Nynorsk | 427 | 0.985 | 0.985 | 0.954 | 0.954 | 0.894 | 0.919 | 0.915 | 0.913 | 0.903 | 0.927 |
 
 Where MillID gains most over GlotLID:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `ewo_Latn` | Ewondo | 134 | 0.879 | 0.883 | 0.860 | 0.860 | 0.962 | 0.965 | 0.970 |
-| `eng_Latn` | English | 1444 | 0.876 | 0.877 | 0.857 | 0.857 | 0.936 | 0.941 | 0.932 |
-| `arb_Latn` | Standard Arabic | 163 | 0.906 | 0.913 | 0.852 | 0.852 | 0.957 | 0.944 | 0.933 |
-| `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.986 | 0.986 | 0.983 | 0.984 | 0.983 |
-| `fra_Latn` | French | 1652 | 0.955 | 0.955 | 0.963 | 0.963 | 0.958 | 0.974 | 0.964 |
-| `arb_Arab` | Arabic (Modern Standard) | 745 | 0.886 | 0.886 | 0.957 | 0.954 | 0.877 | 0.905 | 0.892 |
-| `knc_Latn` | Central Kanuri | 293 | 0.952 | 0.952 | 0.981 | 0.981 | 0.954 | 0.959 | 0.965 |
-| `bjn_Arab` | Banjar | 116 | 0.834 | 0.987 | 0.453 | 0.960 | 0.987 | 0.983 | 1.000 |
-| `kmb_Latn` | Kimbundu | 119 | 0.992 | 0.992 | 0.963 | 0.963 | 0.983 | 0.983 | 1.000 |
-| `kam_Latn` | Kamba | 272 | 0.972 | 0.974 | 0.863 | 0.863 | 0.982 | 0.980 | 0.974 |
-| `por_Latn` | Portuguese | 657 | 0.954 | 0.956 | 0.950 | 0.949 | 0.958 | 0.963 | 0.960 |
-| `san_Deva` | Sanskrit | 239 | 0.990 | 0.990 | 0.971 | 0.971 | 0.990 | 0.996 | 0.992 |
-| `bug_Latn` | Buginese | 78 | 0.981 | 0.981 | 0.938 | 0.938 | 0.987 | 0.987 | 0.987 |
-| `mlt_Latn` | Maltese | 291 | 0.993 | 0.993 | 0.961 | 0.961 | 0.995 | 0.997 | 0.993 |
-| `tel_Telu` | Telugu | 555 | 0.998 | 0.998 | 0.999 | 0.999 | 0.999 | 1.000 | 1.000 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `ewo_Latn` | Ewondo | 134 | 0.879 | 0.883 | 0.860 | 0.860 | 0.962 | 0.965 | 0.970 | 0.959 | 0.981 | 0.978 |
+| `eng_Latn` | English | 1444 | 0.876 | 0.877 | 0.857 | 0.857 | 0.936 | 0.941 | 0.932 | 0.932 | 0.921 | 0.953 |
+| `arb_Latn` | Standard Arabic | 163 | 0.906 | 0.913 | 0.852 | 0.852 | 0.957 | 0.944 | 0.933 | 0.942 | 0.953 | 0.949 |
+| `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.986 | 0.986 | 0.983 | 0.984 | 0.983 | 0.979 | 0.985 | 0.985 |
+| `fra_Latn` | French | 1652 | 0.955 | 0.955 | 0.963 | 0.963 | 0.958 | 0.974 | 0.964 | 0.943 | 0.975 | 0.983 |
+| `arb_Arab` | Arabic (Modern Standard) | 745 | 0.886 | 0.886 | 0.957 | 0.954 | 0.877 | 0.905 | 0.892 | 0.871 | 0.909 | 0.905 |
+| `por_Latn` | Portuguese | 657 | 0.954 | 0.956 | 0.950 | 0.949 | 0.958 | 0.963 | 0.960 | 0.959 | 0.949 | 0.973 |
+| `hin_Deva` | Hindi | 392 | 0.877 | 0.877 | 0.863 | 0.863 | 0.818 | 0.817 | 0.836 | 0.855 | 0.802 | 0.893 |
+| `fuv_Latn` | Nigerian Fulfulde | 164 | 0.877 | 0.892 | 0.859 | 0.859 | 0.804 | 0.797 | 0.849 | 0.907 | 0.672 | 0.844 |
+| `kam_Latn` | Kamba | 272 | 0.972 | 0.974 | 0.863 | 0.863 | 0.982 | 0.980 | 0.974 | 0.980 | 0.969 | 0.989 |
+| `knc_Latn` | Central Kanuri | 293 | 0.952 | 0.952 | 0.981 | 0.981 | 0.954 | 0.959 | 0.965 | 0.967 | 0.952 | 0.967 |
+| `spa_Latn` | Spanish | 1136 | 0.958 | 0.958 | 0.941 | 0.941 | 0.943 | 0.953 | 0.958 | 0.937 | 0.957 | 0.972 |
+| `bjn_Arab` | Banjar | 116 | 0.834 | 0.987 | 0.453 | 0.960 | 0.987 | 0.983 | 1.000 | 0.992 | 1.000 | 0.996 |
+| `bug_Latn` | Buginese | 78 | 0.981 | 0.981 | 0.938 | 0.938 | 0.987 | 0.987 | 0.987 | 0.981 | 0.994 | 0.994 |
+| `san_Deva` | Sanskrit | 239 | 0.990 | 0.990 | 0.971 | 0.971 | 0.990 | 0.996 | 0.992 | 0.990 | 0.994 | 0.998 |
 
 Where MillID loses most to GlotLID:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `tzm_Tfng` | Central Atlas Tamazight | 157 | 0.934 | 0.934 | 0.751 | 0.751 | 0.633 | 0.645 | 0.643 |
-| `hrv_Latn` | Croatian | 168 | 0.994 | 0.994 | 0.856 | 0.856 | 0.667 | 0.717 | 0.657 |
-| `bos_Latn` | Bosnian | 198 | 1.000 | 1.000 | 0.897 | 0.897 | 0.655 | 0.727 | 0.711 |
-| `knc_Arab` | Central Kanuri | 68 | 0.857 | 0.860 | 0.029 | 0.029 | 0.583 | 0.562 | 0.626 |
-| `zsm_Latn` | Standard Malay | 244 | 0.998 | 0.998 | 0.908 | 0.908 | 0.700 | 0.773 | 0.749 |
-| `taq_Tfng` | Tamasheq | 104 | 0.805 | 0.805 | 0.000 | 0.000 | 0.600 | 0.613 | 0.600 |
-| `ind_Latn` | Indonesian | 335 | 0.991 | 0.991 | 0.887 | 0.887 | 0.768 | 0.807 | 0.806 |
-| `kin_Latn` | Kinyarwanda | 210 | 0.981 | 0.981 | 0.854 | 0.854 | 0.828 | 0.818 | 0.812 |
-| `nob_Latn` | Norwegian Bokmål | 265 | 0.961 | 0.959 | 0.894 | 0.894 | 0.791 | 0.820 | 0.799 |
-| `run_Latn` | Rundi | 291 | 0.985 | 0.985 | 0.855 | 0.855 | 0.837 | 0.843 | 0.845 |
-| `mag_Deva` | Magahi | 97 | 1.000 | 1.000 | 0.772 | 0.772 | 0.856 | 0.905 | 0.897 |
-| `vec_Latn` | Venetian | 49 | 0.861 | 0.861 | 0.620 | 0.620 | 0.745 | 0.766 | 0.696 |
-| `cjk_Latn` | Chokwe | 24 | 1.000 | 1.000 | 0.807 | 0.807 | 0.769 | 0.909 | 0.800 |
-| `min_Latn` | Minangkabau | 55 | 0.991 | 0.991 | 0.333 | 0.333 | 0.901 | 0.904 | 0.860 |
-| `xho_Latn` | Xhosa | 367 | 0.948 | 0.948 | 0.951 | 0.951 | 0.835 | 0.862 | 0.858 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `bos_Latn` | Bosnian | 198 | 1.000 | 1.000 | 0.897 | 0.897 | 0.655 | 0.727 | 0.711 | 0.685 | 0.632 | 0.762 |
+| `tzm_Tfng` | Central Atlas Tamazight | 157 | 0.934 | 0.934 | 0.751 | 0.751 | 0.633 | 0.645 | 0.643 | 0.697 | 0.562 | 0.649 |
+| `hrv_Latn` | Croatian | 168 | 0.994 | 0.994 | 0.856 | 0.856 | 0.667 | 0.717 | 0.657 | 0.659 | 0.670 | 0.757 |
+| `knc_Arab` | Central Kanuri | 68 | 0.857 | 0.860 | 0.029 | 0.029 | 0.583 | 0.562 | 0.626 | 0.522 | 0.532 | 0.598 |
+| `zsm_Latn` | Standard Malay | 244 | 0.998 | 0.998 | 0.908 | 0.908 | 0.700 | 0.773 | 0.749 | 0.789 | 0.769 | 0.809 |
+| `taq_Tfng` | Tamasheq | 104 | 0.805 | 0.805 | 0.000 | 0.000 | 0.600 | 0.613 | 0.600 | 0.654 | 0.604 | 0.604 |
+| `ind_Latn` | Indonesian | 335 | 0.991 | 0.991 | 0.887 | 0.887 | 0.768 | 0.807 | 0.806 | 0.842 | 0.838 | 0.848 |
+| `nob_Latn` | Norwegian Bokmål | 265 | 0.961 | 0.959 | 0.894 | 0.894 | 0.791 | 0.820 | 0.799 | 0.821 | 0.792 | 0.832 |
+| `kin_Latn` | Kinyarwanda | 210 | 0.981 | 0.981 | 0.854 | 0.854 | 0.828 | 0.818 | 0.812 | 0.849 | 0.836 | 0.864 |
+| `run_Latn` | Rundi | 291 | 0.985 | 0.985 | 0.855 | 0.855 | 0.837 | 0.843 | 0.845 | 0.883 | 0.832 | 0.879 |
+| `mag_Deva` | Magahi | 97 | 1.000 | 1.000 | 0.772 | 0.772 | 0.856 | 0.905 | 0.897 | 0.890 | 0.828 | 0.897 |
+| `cjk_Latn` | Chokwe | 24 | 1.000 | 1.000 | 0.807 | 0.807 | 0.769 | 0.909 | 0.800 | 0.857 | 0.884 | 0.837 |
+| `dzo_Tibt` | Dzongkha | 346 | 0.999 | 0.999 | 0.696 | 0.696 | 0.895 | 0.926 | 0.896 | 0.906 | 0.924 | 0.916 |
+| `taq_Latn` | Tamasheq | 106 | 1.000 | 1.000 | 0.838 | 0.838 | 0.896 | 0.909 | 0.929 | 0.902 | 0.922 | 0.922 |
+| `lim_Latn` | Limburgish | 196 | 1.000 | 1.000 | 0.956 | 0.956 | 0.889 | 0.915 | 0.904 | 0.896 | 0.918 | 0.930 |
 
 ## Per language, udhr
 
-Against GlotLID restricted, the best MillID is better on **77** languages and worse on **64**; against fastText restricted, the best MillID is better on **310** languages and worse on **9** (F1 differing by more than 0.01), of 358. Every language is in `leaderboard_udhr.csv`.
+Against GlotLID restricted, the best MillID is better on **86** languages and worse on **48**; against fastText restricted, the best MillID is better on **317** languages and worse on **8** (F1 differing by more than 0.01), of 358. Every language is in `leaderboard_udhr.csv`.
 
 The 30 languages with the most passages:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `roh_Latn` | Romansh | 399 | 0.999 | 0.999 | 0.946 | 0.946 | 0.989 | 0.991 | 0.994 |
-| `oci_Latn` | Occitan | 398 | 0.376 | 0.376 | 0.435 | 0.435 | 0.291 | 0.331 | 0.314 |
-| `cmn_Hani` | Chinese (Mandarin) | 319 | 0.868 | 0.868 | 0.468 | 0.468 | 0.875 | 0.886 | 0.857 |
-| `krl_Latn` | Karelian | 183 | 0.011 | 0.011 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
-| `qug_Latn` | Chimborazo Highland Quichua | 182 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
-| `acu_Latn` | Achuar-Shiwiar | 180 | 0.854 | 0.854 | 0.000 | 0.000 | 0.850 | 0.743 | 0.732 |
-| `hus_Latn` | Huastec | 175 | 0.986 | 0.986 | 0.000 | 0.000 | 0.958 | 0.991 | 0.991 |
-| `hau_Latn` | Hausa | 155 | 1.000 | 1.000 | 0.876 | 0.876 | 0.997 | 0.997 | 0.997 |
-| `auc_Latn` | Waorani | 154 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.050 | 0.000 |
-| `kwi_Latn` | Awa-Cuaiquer | 145 | 0.877 | 0.877 | 0.000 | 0.000 | 0.771 | 0.775 | 0.797 |
-| `jpn_Jpan` | Japanese | 140 | 1.000 | 1.000 | 0.944 | 0.944 | 1.000 | 1.000 | 1.000 |
-| `snn_Latn` | Siona | 136 | 0.514 | 0.514 | 0.000 | 0.000 | 0.393 | 0.773 | 0.621 |
-| `ktu_Latn` | Kituba (Democratic Republic of Congo) | 118 | 0.680 | 0.680 | 0.000 | 0.000 | 0.755 | 0.769 | 0.753 |
-| `lat_Latn` | Latin | 118 | 0.992 | 0.992 | 0.000 | 0.000 | 0.996 | 0.996 | 0.996 |
-| `hat_Latn` | Haitian Creole | 117 | 0.979 | 0.979 | 0.699 | 0.699 | 0.987 | 0.991 | 0.987 |
-| `twi_Latn` | Twi | 116 | 0.996 | 0.996 | 0.399 | 0.396 | 0.996 | 0.987 | 0.983 |
-| `rmn_Latn` | Balkan Romani | 116 | 0.857 | 0.857 | 0.000 | 0.000 | 0.721 | 0.667 | 0.735 |
-| `kmb_Latn` | Kimbundu | 116 | 1.000 | 1.000 | 0.877 | 0.877 | 0.991 | 0.979 | 0.991 |
-| `nya_Latn` | Nyanja | 116 | 1.000 | 1.000 | 0.806 | 0.806 | 0.978 | 0.987 | 0.966 |
-| `chr_Cher` | Cherokee | 115 | 0.663 | 0.663 | 0.000 | 0.000 | 0.670 | 0.715 | 0.729 |
-| `ell_Grek` | Greek | 115 | 1.000 | 1.000 | 1.000 | 1.000 | 0.670 | 0.655 | 0.670 |
-| `lvs_Latn` | Standard Latvian | 115 | 1.000 | 1.000 | 0.991 | 0.991 | 0.996 | 0.996 | 0.996 |
-| `kng_Latn` | Koongo | 115 | 0.193 | 0.193 | 0.457 | 0.457 | 0.101 | 0.047 | 0.101 |
-| `pov_Latn` | Upper Guinea Crioulo | 115 | 0.833 | 0.833 | 0.000 | 0.000 | 0.844 | 0.838 | 0.838 |
-| `por_Latn` | Portuguese | 115 | 0.996 | 0.996 | 0.793 | 0.793 | 0.978 | 0.996 | 0.983 |
-| `cjk_Latn` | Chokwe | 114 | 1.000 | 1.000 | 0.533 | 0.533 | 0.888 | 0.949 | 0.949 |
-| `tha_Thai` | Thai | 114 | 1.000 | 1.000 | 0.996 | 0.996 | 1.000 | 1.000 | 1.000 |
-| `tso_Latn` | Tsonga | 114 | 0.781 | 0.781 | 0.691 | 0.691 | 0.743 | 0.882 | 0.843 |
-| `fas_Arab` | Persian | 114 | 1.000 | 1.000 | 0.934 | 0.934 | 0.982 | 0.991 | 0.973 |
-| `lin_Latn` | Lingala | 110 | 1.000 | 1.000 | 0.986 | 0.986 | 0.974 | 1.000 | 0.969 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `roh_Latn` | Romansh | 399 | 0.999 | 0.999 | 0.946 | 0.946 | 0.989 | 0.991 | 0.994 | 0.994 | 0.994 | 0.998 |
+| `oci_Latn` | Occitan | 398 | 0.376 | 0.376 | 0.435 | 0.435 | 0.291 | 0.331 | 0.314 | 0.277 | 0.295 | 0.338 |
+| `cmn_Hani` | Chinese (Mandarin) | 319 | 0.868 | 0.868 | 0.468 | 0.468 | 0.875 | 0.886 | 0.857 | 0.892 | 0.858 | 0.875 |
+| `krl_Latn` | Karelian | 183 | 0.011 | 0.011 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.032 | 0.000 |
+| `qug_Latn` | Chimborazo Highland Quichua | 182 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.011 | 0.000 | 0.000 |
+| `acu_Latn` | Achuar-Shiwiar | 180 | 0.854 | 0.854 | 0.000 | 0.000 | 0.850 | 0.743 | 0.732 | 0.828 | 0.835 | 0.801 |
+| `hus_Latn` | Huastec | 175 | 0.986 | 0.986 | 0.000 | 0.000 | 0.958 | 0.991 | 0.991 | 0.977 | 0.980 | 0.988 |
+| `hau_Latn` | Hausa | 155 | 1.000 | 1.000 | 0.876 | 0.876 | 0.997 | 0.997 | 0.997 | 0.990 | 0.997 | 1.000 |
+| `auc_Latn` | Waorani | 154 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.050 | 0.000 | 0.000 | 0.013 | 0.025 |
+| `kwi_Latn` | Awa-Cuaiquer | 145 | 0.877 | 0.877 | 0.000 | 0.000 | 0.771 | 0.775 | 0.797 | 0.880 | 0.845 | 0.863 |
+| `jpn_Jpan` | Japanese | 140 | 1.000 | 1.000 | 0.944 | 0.944 | 1.000 | 1.000 | 1.000 | 1.000 | 0.983 | 1.000 |
+| `snn_Latn` | Siona | 136 | 0.514 | 0.514 | 0.000 | 0.000 | 0.393 | 0.773 | 0.621 | 0.630 | 0.770 | 0.467 |
+| `ktu_Latn` | Kituba (Democratic Republic of Congo) | 118 | 0.680 | 0.680 | 0.000 | 0.000 | 0.755 | 0.769 | 0.753 | 0.765 | 0.776 | 0.773 |
+| `lat_Latn` | Latin | 118 | 0.992 | 0.992 | 0.000 | 0.000 | 0.996 | 0.996 | 0.996 | 0.996 | 0.992 | 0.996 |
+| `hat_Latn` | Haitian Creole | 117 | 0.979 | 0.979 | 0.699 | 0.699 | 0.987 | 0.991 | 0.987 | 0.992 | 0.978 | 0.987 |
+| `twi_Latn` | Twi | 116 | 0.996 | 0.996 | 0.399 | 0.396 | 0.996 | 0.987 | 0.983 | 0.983 | 0.991 | 0.991 |
+| `rmn_Latn` | Balkan Romani | 116 | 0.857 | 0.857 | 0.000 | 0.000 | 0.721 | 0.667 | 0.735 | 0.678 | 0.682 | 0.704 |
+| `kmb_Latn` | Kimbundu | 116 | 1.000 | 1.000 | 0.877 | 0.877 | 0.991 | 0.979 | 0.991 | 0.970 | 0.991 | 0.991 |
+| `nya_Latn` | Nyanja | 116 | 1.000 | 1.000 | 0.806 | 0.806 | 0.978 | 0.987 | 0.966 | 0.991 | 0.983 | 0.978 |
+| `chr_Cher` | Cherokee | 115 | 0.663 | 0.663 | 0.000 | 0.000 | 0.670 | 0.715 | 0.729 | 0.670 | 0.777 | 0.945 |
+| `ell_Grek` | Greek | 115 | 1.000 | 1.000 | 1.000 | 1.000 | 0.670 | 0.655 | 0.670 | 0.670 | 0.670 | 0.670 |
+| `lvs_Latn` | Standard Latvian | 115 | 1.000 | 1.000 | 0.991 | 0.991 | 0.996 | 0.996 | 0.996 | 0.987 | 1.000 | 1.000 |
+| `kng_Latn` | Koongo | 115 | 0.193 | 0.193 | 0.457 | 0.457 | 0.101 | 0.047 | 0.101 | 0.076 | 0.062 | 0.047 |
+| `pov_Latn` | Upper Guinea Crioulo | 115 | 0.833 | 0.833 | 0.000 | 0.000 | 0.844 | 0.838 | 0.838 | 0.821 | 0.930 | 0.827 |
+| `por_Latn` | Portuguese | 115 | 0.996 | 0.996 | 0.793 | 0.793 | 0.978 | 0.996 | 0.983 | 0.955 | 1.000 | 1.000 |
+| `cjk_Latn` | Chokwe | 114 | 1.000 | 1.000 | 0.533 | 0.533 | 0.888 | 0.949 | 0.949 | 0.871 | 0.914 | 0.959 |
+| `tha_Thai` | Thai | 114 | 1.000 | 1.000 | 0.996 | 0.996 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 | 1.000 |
+| `tso_Latn` | Tsonga | 114 | 0.781 | 0.781 | 0.691 | 0.691 | 0.743 | 0.882 | 0.843 | 0.860 | 0.761 | 0.774 |
+| `fas_Arab` | Persian | 114 | 1.000 | 1.000 | 0.934 | 0.934 | 0.982 | 0.991 | 0.973 | 0.991 | 0.991 | 0.982 |
+| `lin_Latn` | Lingala | 110 | 1.000 | 1.000 | 0.986 | 0.986 | 0.974 | 1.000 | 0.969 | 0.991 | 0.991 | 0.996 |
 
 Where MillID gains most over GlotLID:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `mic_Latn` | Mi'kmaw | 59 | 0.427 | 0.427 | 0.000 | 0.000 | 0.983 | 1.000 | 1.000 |
-| `tet_Latn` | Tetum | 58 | 0.167 | 0.167 | 0.000 | 0.000 | 0.623 | 0.699 | 0.726 |
-| `fuf_Latn` | Pular | 58 | 0.483 | 0.483 | 0.000 | 0.000 | 0.897 | 0.816 | 0.916 |
-| `skr_Arab` | Saraiki | 63 | 0.500 | 0.500 | 0.000 | 0.000 | 0.800 | 0.923 | 0.855 |
-| `sag_Latn` | Sango | 59 | 0.578 | 0.578 | 0.189 | 0.189 | 0.992 | 0.992 | 0.992 |
-| `bum_Latn` | Bulu | 58 | 0.098 | 0.098 | 0.000 | 0.000 | 0.242 | 0.319 | 0.474 |
-| `zgh_Tfng` | Standard Moroccan Tamazight | 60 | 0.462 | 0.462 | 0.000 | 0.000 | 0.518 | 0.824 | 0.737 |
-| `tzm_Tfng` | Central Atlas Tamazight | 1 | 0.065 | 0.065 | 0.033 | 0.033 | 0.100 | 0.333 | 0.143 |
-| `snn_Latn` | Siona | 136 | 0.514 | 0.514 | 0.000 | 0.000 | 0.393 | 0.773 | 0.621 |
-| `mxv_Latn` | Metlatónoc Mixtec | 58 | 0.000 | 0.000 | 0.000 | 0.000 | 0.098 | 0.215 | 0.034 |
-| `lld_Latn` | Ladin | 59 | 0.731 | 0.731 | 0.000 | 0.000 | 0.946 | 0.899 | 0.816 |
-| `pnb_Arab` | Western Panjabi | 61 | 0.739 | 0.739 | 0.000 | 0.000 | 0.845 | 0.931 | 0.884 |
-| `fkv_Latn` | Kven Finnish | 58 | 0.667 | 0.667 | 0.000 | 0.000 | 0.792 | 0.697 | 0.852 |
-| `tah_Latn` | Tahitian | 57 | 0.812 | 0.812 | 0.966 | 0.966 | 0.944 | 0.973 | 0.982 |
-| `yue_Hani` | Cantonese | 49 | 0.580 | 0.580 | 0.111 | 0.111 | 0.747 | 0.652 | 0.571 |
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `mic_Latn` | Mi'kmaw | 59 | 0.427 | 0.427 | 0.000 | 0.000 | 0.983 | 1.000 | 1.000 | 0.992 | 0.992 | 1.000 |
+| `tet_Latn` | Tetum | 58 | 0.167 | 0.167 | 0.000 | 0.000 | 0.623 | 0.699 | 0.726 | 0.638 | 0.713 | 0.708 |
+| `fuf_Latn` | Pular | 58 | 0.483 | 0.483 | 0.000 | 0.000 | 0.897 | 0.816 | 0.916 | 0.906 | 0.911 | 0.936 |
+| `skr_Arab` | Saraiki | 63 | 0.500 | 0.500 | 0.000 | 0.000 | 0.800 | 0.923 | 0.855 | 0.867 | 0.914 | 0.875 |
+| `sag_Latn` | Sango | 59 | 0.578 | 0.578 | 0.189 | 0.189 | 0.992 | 0.992 | 0.992 | 0.992 | 0.965 | 0.992 |
+| `bum_Latn` | Bulu | 58 | 0.098 | 0.098 | 0.000 | 0.000 | 0.242 | 0.319 | 0.474 | 0.215 | 0.239 | 0.188 |
+| `zgh_Tfng` | Standard Moroccan Tamazight | 60 | 0.462 | 0.462 | 0.000 | 0.000 | 0.518 | 0.824 | 0.737 | 0.750 | 0.788 | 0.652 |
+| `qvh_Latn` | Huamalíes-Dos de Mayo Huánuco Quechua | 58 | 0.154 | 0.154 | 0.000 | 0.000 | 0.159 | 0.215 | 0.098 | 0.468 | 0.098 | 0.215 |
+| `chr_Cher` | Cherokee | 115 | 0.663 | 0.663 | 0.000 | 0.000 | 0.670 | 0.715 | 0.729 | 0.670 | 0.777 | 0.945 |
+| `tzm_Tfng` | Central Atlas Tamazight | 1 | 0.065 | 0.065 | 0.033 | 0.033 | 0.100 | 0.333 | 0.143 | 0.167 | 0.250 | 0.100 |
+| `snn_Latn` | Siona | 136 | 0.514 | 0.514 | 0.000 | 0.000 | 0.393 | 0.773 | 0.621 | 0.630 | 0.770 | 0.467 |
+| `fkv_Latn` | Kven Finnish | 58 | 0.667 | 0.667 | 0.000 | 0.000 | 0.792 | 0.697 | 0.852 | 0.635 | 0.513 | 0.906 |
+| `mxv_Latn` | Metlatónoc Mixtec | 58 | 0.000 | 0.000 | 0.000 | 0.000 | 0.098 | 0.215 | 0.034 | 0.129 | 0.185 | 0.034 |
+| `lld_Latn` | Ladin | 59 | 0.731 | 0.731 | 0.000 | 0.000 | 0.946 | 0.899 | 0.816 | 0.909 | 0.832 | 0.881 |
+| `hak_Hani` | Hakka Chinese | 48 | 0.041 | 0.041 | 0.000 | 0.000 | 0.071 | 0.000 | 0.000 | 0.039 | 0.246 | 0.075 |
 
 Where MillID loses most to GlotLID:
 
-| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
-|---|---|---|---|---|---|---|---|---|---|
-| `dyu_Latn` | Dyula | 58 | 0.434 | 0.434 | 0.015 | 0.015 | 0.000 | 0.000 | 0.000 |
-| `gyr_Latn` | Guarayu | 49 | 0.990 | 0.990 | 0.000 | 0.000 | 0.580 | 0.339 | 0.182 |
-| `ell_Grek` | Greek | 115 | 1.000 | 1.000 | 1.000 | 1.000 | 0.670 | 0.655 | 0.670 |
-| `qvm_Latn` | Margos-Yarowilca-Lauricocha Quechua | 60 | 0.500 | 0.500 | 0.000 | 0.000 | 0.125 | 0.094 | 0.182 |
-| `hin_Deva` | Hindi | 59 | 0.957 | 0.957 | 0.975 | 0.975 | 0.644 | 0.607 | 0.450 |
-| `cpu_Latn` | Pichis Ashéninka | 60 | 0.974 | 0.974 | 0.000 | 0.000 | 0.659 | 0.571 | 0.667 |
-| `ind_Latn` | Indonesian | 60 | 0.903 | 0.903 | 0.565 | 0.565 | 0.614 | 0.674 | 0.644 |
-| `cni_Latn` | Asháninka | 52 | 0.963 | 0.963 | 0.000 | 0.000 | 0.750 | 0.708 | 0.748 |
-| `cbu_Latn` | Candoshi-Shapra | 57 | 0.882 | 0.874 | 0.000 | 0.000 | 0.667 | 0.371 | 0.185 |
-| `qvn_Latn` | North Junín Quechua | 57 | 0.460 | 0.460 | 0.000 | 0.000 | 0.261 | 0.219 | 0.095 |
-| `fuv_Latn` | Nigerian Fulfulde | 108 | 0.681 | 0.689 | 0.475 | 0.475 | 0.510 | 0.405 | 0.519 |
-| `koi_Cyrl` | Komi-Permyak | 57 | 1.000 | 1.000 | 0.000 | 0.000 | 0.719 | 0.837 | 0.849 |
-| `bho_Deva` | Bhojpuri | 56 | 0.933 | 0.933 | 0.832 | 0.832 | 0.787 | 0.643 | 0.697 |
-| `hrv_Latn` | Croatian | 58 | 0.727 | 0.727 | 0.474 | 0.474 | 0.497 | 0.537 | 0.583 |
-| `kea_Latn` | Kabuverdianu | 58 | 0.935 | 0.935 | 0.125 | 0.124 | 0.811 | 0.794 | 0.800 |
-
-The models: [MillID tiny](https://huggingface.co/baobabtech/millid-tiny), [MillID medium](https://huggingface.co/baobabtech/millid-medium), [MillID large](https://huggingface.co/baobabtech/millid-large).
+| Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large | MillID tiny v1.5 | MillID medium v1.5 | MillID large v1.5 |
+|---|---|---|---|---|---|---|---|---|---|---|---|---|
+| `dyu_Latn` | Dyula | 58 | 0.434 | 0.434 | 0.015 | 0.015 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
+| `gyr_Latn` | Guarayu | 49 | 0.990 | 0.990 | 0.000 | 0.000 | 0.580 | 0.339 | 0.182 | 0.537 | 0.185 | 0.393 |
+| `ell_Grek` | Greek | 115 | 1.000 | 1.000 | 1.000 | 1.000 | 0.670 | 0.655 | 0.670 | 0.670 | 0.670 | 0.670 |
+| `cpu_Latn` | Pichis Ashéninka | 60 | 0.974 | 0.974 | 0.000 | 0.000 | 0.659 | 0.571 | 0.667 | 0.729 | 0.442 | 0.571 |
+| `hin_Deva` | Hindi | 59 | 0.957 | 0.957 | 0.975 | 0.975 | 0.644 | 0.607 | 0.450 | 0.723 | 0.710 | 0.727 |
+| `cbu_Latn` | Candoshi-Shapra | 57 | 0.882 | 0.874 | 0.000 | 0.000 | 0.667 | 0.371 | 0.185 | 0.500 | 0.411 | 0.557 |
+| `qvn_Latn` | North Junín Quechua | 57 | 0.460 | 0.460 | 0.000 | 0.000 | 0.261 | 0.219 | 0.095 | 0.219 | 0.068 | 0.034 |
+| `cni_Latn` | Asháninka | 52 | 0.963 | 0.963 | 0.000 | 0.000 | 0.750 | 0.708 | 0.748 | 0.773 | 0.684 | 0.717 |
+| `koi_Cyrl` | Komi-Permyak | 57 | 1.000 | 1.000 | 0.000 | 0.000 | 0.719 | 0.837 | 0.849 | 0.837 | 0.849 | 0.849 |
+| `hrv_Latn` | Croatian | 58 | 0.727 | 0.727 | 0.474 | 0.474 | 0.497 | 0.537 | 0.583 | 0.500 | 0.521 | 0.559 |
+| `qvm_Latn` | Margos-Yarowilca-Lauricocha Quechua | 60 | 0.500 | 0.500 | 0.000 | 0.000 | 0.125 | 0.094 | 0.182 | 0.356 | 0.033 | 0.356 |
+| `ind_Latn` | Indonesian | 60 | 0.903 | 0.903 | 0.565 | 0.565 | 0.614 | 0.674 | 0.644 | 0.768 | 0.742 | 0.645 |
+| `rmn_Latn` | Balkan Romani | 116 | 0.857 | 0.857 | 0.000 | 0.000 | 0.721 | 0.667 | 0.735 | 0.678 | 0.682 | 0.704 |
+| `maz_Latn` | Central Mazahua | 59 | 0.939 | 0.939 | 0.000 | 0.000 | 0.725 | 0.742 | 0.823 | 0.789 | 0.766 | 0.814 |
+| `shp_Latn` | Shipibo-Conibo | 62 | 0.912 | 0.912 | 0.000 | 0.000 | 0.558 | 0.410 | 0.808 | 0.469 | 0.452 | 0.607 |
+
+The models: [MillID tiny](https://huggingface.co/baobabtech/millid-tiny), [MillID medium](https://huggingface.co/baobabtech/millid-medium), [MillID large](https://huggingface.co/baobabtech/millid-large), [MillID tiny v1.5](https://huggingface.co/baobabtech/millid-tiny-v1.5), [MillID medium v1.5](https://huggingface.co/baobabtech/millid-medium-v1.5), [MillID large v1.5](https://huggingface.co/baobabtech/millid-large-v1.5).

leaderboard_overall.csv

@@ -34,3 +34,18 @@ test-common,MillID large,baobabtech/millid-large,192.6M,0.9401365388485533,0.988
 udhr,MillID large,baobabtech/millid-large,192.6M,0.8501627287712921,0.9168181241810728,0.928652943911408,0.9119599467677029,0.8756693668405147,0.8755434870560866,0.9912273951519814,273,358
 udhr-common,MillID large,baobabtech/millid-large,192.6M,0.9074727120067171,0.9614609571788413,0.9665827036104114,0.9734869274166918,0.9340443413049637,0.9443039665233331,0.9924238076106295,148,170
 udhr-all,MillID large,baobabtech/millid-large,192.6M,0.7281613148463237,0.7852514209173515,0.7953879013865257,0.7343781921576387,0.7307450660347418,0.7152922540753559,0.9640287769784173,254,429
+test,MillID tiny v1.5,baobabtech/millid-tiny-v1.5,2.9M,0.9587247805328816,0.9890484971341278,0.9932401213781161,0.9549770065582561,0.9588167712047285,0.9553762683202616,0.9824561403508771,1446,1621
+test-common,MillID tiny v1.5,baobabtech/millid-tiny-v1.5,2.9M,0.9395947180209607,0.9856649689614069,0.9908664489062959,0.970922775379856,0.9353270477650256,0.951259698841108,0.9726495726495726,188,213
+udhr,MillID tiny v1.5,baobabtech/millid-tiny-v1.5,2.9M,0.8492328500781944,0.911703791369035,0.9256519717655015,0.914803800630921,0.8736275490421017,0.8764285216392155,0.9906542056074767,274,358
+udhr-common,MillID tiny v1.5,baobabtech/millid-tiny-v1.5,2.9M,0.9123425692695214,0.9606213266162889,0.9654911838790932,0.9794271783100589,0.9393117513722192,0.9512636942896991,1.0,149,170
+udhr-all,MillID tiny v1.5,baobabtech/millid-tiny-v1.5,2.9M,0.7273648770951743,0.7808710132860297,0.7928175795532708,0.7340309394117082,0.7290411714617072,0.7148579318843858,0.9649122807017544,254,429
+test,MillID medium v1.5,baobabtech/millid-medium-v1.5,115.0M,0.9575592842187637,0.9894064710020355,0.9936563700617297,0.9533057182844771,0.957795228936456,0.9535414152154522,0.9823874755381604,1439,1621
+test-common,MillID medium v1.5,baobabtech/millid-medium-v1.5,115.0M,0.9357400498475161,0.985494682415592,0.9911296190225553,0.9693373446332887,0.9301139180681923,0.9467462692735156,0.9702602230483272,186,213
+udhr,MillID medium v1.5,baobabtech/millid-medium-v1.5,115.0M,0.8453019992391901,0.9223973963396593,0.9389661439621286,0.9146460443129042,0.8687651165993733,0.87036932500799,0.9845569018769303,275,358
+udhr-common,MillID medium v1.5,baobabtech/millid-medium-v1.5,115.0M,0.9002518891687658,0.9629722921914358,0.9701931150293871,0.9738075955416304,0.9283847515638696,0.9389938762973807,0.9915966386554621,146,170
+udhr-all,MillID medium v1.5,baobabtech/millid-medium-v1.5,115.0M,0.72399811751077,0.7900300474242479,0.8042211200810918,0.7358829743260015,0.7249834772554209,0.7121266253368457,0.9649122807017544,259,429
+test,MillID large v1.5,baobabtech/millid-large-v1.5,192.6M,0.9674118905598961,0.9924242739582336,0.9955503015721713,0.9655219790304682,0.9662728030347064,0.9646355846561194,0.9893617021276596,1478,1621
+test-common,MillID large v1.5,baobabtech/millid-large-v1.5,192.6M,0.952505534312739,0.989829249036333,0.993761320185148,0.9756915726411073,0.946030279290983,0.9594091462508073,0.9790794979079497,193,213
+udhr,MillID large v1.5,baobabtech/millid-large-v1.5,192.6M,0.85785536159601,0.9182974766473646,0.9308931062175071,0.9171072333156591,0.8824937737402124,0.8812295192906267,0.9914161508989096,283,358
+udhr-common,MillID large v1.5,baobabtech/millid-large-v1.5,192.6M,0.9167926112510495,0.9629722921914358,0.9686817800167926,0.9800375512974252,0.9436021694458361,0.9528568922894297,1.0,152,170
+udhr-all,MillID large v1.5,baobabtech/millid-large-v1.5,192.6M,0.734750027151287,0.7865184809759983,0.7973065923324766,0.7392238103714293,0.7364400256386854,0.7200574273845932,0.9642857142857142,266,429

leaderboard_test-common.csv

@@ -1,214 +1,214 @@
-label,language,support,GlotLID,GlotLID restricted,fastText,fastText restricted,MillID tiny,MillID medium,MillID large,best MillID,best MillID model,gain over GlotLID restricted,gain over fastText restricted
-fra_Latn,French,1652,0.9548,0.9548,0.9632,0.9632,0.9583,0.9737,0.9636,0.9737,MillID medium,0.0189,0.0105
-eng_Latn,English,1444,0.876,0.8768,0.8574,0.8571,0.9357,0.9414,0.9321,0.9414,MillID medium,0.0646,0.0843
-spa_Latn,Spanish,1136,0.9583,0.9583,0.9407,0.9407,0.9434,0.953,0.9575,0.9575,MillID large,-0.0008,0.0168
-tam_Taml,Tamil,754,1.0,1.0,0.9973,0.9973,0.9993,0.998,0.998,0.9993,MillID tiny,-0.0007,0.002
-arb_Arab,Arabic (Modern Standard),745,0.8864,0.8864,0.9573,0.9542,0.8774,0.905,0.8919,0.905,MillID medium,0.0186,-0.0492
-por_Latn,Portuguese,657,0.9538,0.9562,0.95,0.9493,0.9581,0.9628,0.9601,0.9628,MillID medium,0.0066,0.0135
-kan_Knda,Kannada,601,0.9941,0.9941,0.9992,0.9992,0.9822,0.9865,0.9908,0.9908,MillID large,-0.0033,-0.0084
-zul_Latn,Zulu,594,0.9042,0.9042,0.9704,0.9704,0.8449,0.8713,0.8295,0.8713,MillID medium,-0.0329,-0.0991
-swh_Latn,Swahili,592,0.9536,0.9528,0.9454,0.9454,0.9021,0.8967,0.9019,0.9021,MillID tiny,-0.0507,-0.0433
-mar_Deva,Marathi,589,0.9888,0.9897,0.9871,0.9871,0.9705,0.9811,0.9744,0.9811,MillID medium,-0.0086,-0.006
-tso_Latn,Tsonga,581,0.956,0.956,0.9861,0.9861,0.9834,0.9843,0.9834,0.9843,MillID medium,0.0283,-0.0018
-hun_Latn,Hungarian,576,1.0,1.0,0.9804,0.9804,0.9826,0.9913,0.9913,0.9913,MillID medium,-0.0087,0.0109
-afr_Latn,Afrikaans,569,0.9849,0.9849,0.9858,0.9858,0.9781,0.976,0.9816,0.9816,MillID large,-0.0033,-0.0042
-tel_Telu,Telugu,555,0.9982,0.9982,0.9991,0.9991,0.9991,1.0,1.0,1.0,MillID medium,0.0018,0.0009
-rus_Cyrl,Russian,528,0.9846,0.9846,0.9271,0.9271,0.9242,0.9291,0.9557,0.9557,MillID large,-0.0289,0.0286
-ory_Orya,Odia (individual language),511,0.9971,1.0,0.9961,0.9961,0.9961,0.9961,0.9961,0.9961,MillID tiny,-0.0039,0.0
-sot_Latn,Southern Sotho,491,0.9774,0.9784,0.8562,0.8562,0.9703,0.9665,0.9671,0.9703,MillID tiny,-0.0081,0.1141
-nso_Latn,Northern Sotho,479,0.9695,0.9695,0.9673,0.9673,0.9471,0.9614,0.9521,0.9614,MillID medium,-0.0081,-0.0059
-asm_Beng,Assamese,467,0.9989,0.9989,0.9968,0.9968,0.9925,0.9946,0.9936,0.9946,MillID medium,-0.0043,-0.0022
-ben_Beng,Bangla,466,0.9968,0.9968,0.9894,0.9894,0.9737,0.9871,0.9817,0.9871,MillID medium,-0.0097,-0.0023
-pan_Guru,Punjabi,460,1.0,1.0,0.9901,0.9901,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0099
-amh_Ethi,Amharic,458,1.0,1.0,0.9978,0.9978,0.9857,0.9869,0.9781,0.9869,MillID medium,-0.0131,-0.0109
-tsn_Latn,Tswana,456,0.9605,0.9605,0.8698,0.8698,0.9336,0.9397,0.9365,0.9397,MillID medium,-0.0208,0.0699
-gaz_Latn,Oromo (West Central),441,0.9744,0.9744,0.9733,0.9733,0.9349,0.9552,0.9541,0.9552,MillID medium,-0.0192,-0.0181
-som_Latn,Somali,439,0.9954,0.9954,0.9909,0.9909,0.9885,0.992,0.992,0.992,MillID medium,-0.0034,0.0011
-uzn_Latn,Northern Uzbek,436,0.9989,0.9989,0.9849,0.9849,0.9779,0.9838,0.9825,0.9838,MillID medium,-0.0151,-0.0011
-tha_Thai,Thai,431,0.9799,0.9799,0.9811,0.9811,0.9775,0.9701,0.9787,0.9787,MillID large,-0.0012,-0.0024
-ydd_Hebr,Eastern Yiddish,430,1.0,1.0,0.9988,0.9988,0.9942,0.9977,0.9918,0.9977,MillID medium,-0.0023,-0.0011
-tur_Latn,Turkish,430,0.9988,0.9988,0.9803,0.9803,0.9685,0.9742,0.9766,0.9766,MillID large,-0.0222,-0.0037
-nno_Latn,Norwegian Nynorsk,427,0.9845,0.9845,0.9542,0.9542,0.8945,0.9189,0.9147,0.9189,MillID medium,-0.0656,-0.0353
-smo_Latn,Samoan,426,0.9988,0.9988,0.9372,0.9372,0.9929,0.9917,0.9976,0.9976,MillID large,-0.0012,0.0604
-pap_Latn,Papiamento,423,0.9988,0.9988,0.9742,0.9731,0.9623,0.9709,0.9712,0.9712,MillID large,-0.0276,-0.0019
-ckb_Arab,Central Kurdish,421,0.9769,0.9769,0.9952,0.9952,0.9695,0.9619,0.9316,0.9695,MillID tiny,-0.0074,-0.0257
-pbt_Arab,Southern Pashto,419,0.9988,0.9988,0.9782,0.977,0.9844,0.994,0.9892,0.994,MillID medium,-0.0048,0.017
-ekk_Latn,Estonian,419,0.9929,0.9929,0.9857,0.9857,0.9721,0.9806,0.9732,0.9806,MillID medium,-0.0123,-0.0051
-sna_Latn,Shona,415,1.0,1.0,0.9831,0.9831,0.9766,0.9779,0.9716,0.9779,MillID medium,-0.0221,-0.0052
-luo_Latn,Luo (Kenya and Tanzania),415,1.0,1.0,0.9564,0.9564,0.9791,0.9841,0.9853,0.9853,MillID large,-0.0147,0.0289
-tgk_Cyrl,Tajik,413,1.0,1.0,0.983,0.983,0.9927,0.9927,0.9927,0.9927,MillID tiny,-0.0073,0.0097
-bod_Tibt,Tibetan,406,0.9988,0.9988,0.8191,0.8191,0.932,0.9503,0.9403,0.9503,MillID medium,-0.0485,0.1312
-lug_Latn,Ganda,405,0.9863,0.9876,0.979,0.979,0.9684,0.9748,0.9735,0.9748,MillID medium,-0.0128,-0.0042
-fas_Arab,Persian,396,0.9859,0.9859,0.9439,0.9439,0.9301,0.9342,0.9516,0.9516,MillID large,-0.0343,0.0077
-ell_Grek,Greek,394,0.9987,0.9987,0.97,0.97,0.9493,0.9086,0.9423,0.9493,MillID tiny,-0.0494,-0.0207
-hin_Deva,Hindi,392,0.8768,0.8768,0.863,0.863,0.8179,0.8171,0.8358,0.8358,MillID large,-0.041,-0.0272
-lus_Latn,Mizo,391,0.9974,0.9974,0.9897,0.9897,0.9739,0.9738,0.9764,0.9764,MillID large,-0.021,-0.0133
-dyu_Latn,Dyula,390,1.0,1.0,0.8223,0.8223,0.9564,0.9729,0.9703,0.9729,MillID medium,-0.0271,0.1506
-slk_Latn,Slovak,374,0.9987,0.9987,0.9714,0.9714,0.9418,0.9486,0.9404,0.9486,MillID medium,-0.0501,-0.0228
-ron_Latn,Romanian,369,0.9959,0.9959,0.9759,0.9759,0.9712,0.9755,0.9632,0.9755,MillID medium,-0.0204,-0.0004
-kal_Latn,Kalaallisut,369,0.9986,0.9986,0.9932,0.9932,0.9946,0.9986,0.9986,0.9986,MillID medium,0.0,0.0054
-azb_Arab,South Azerbaijani,369,0.9959,0.9959,0.9711,0.9711,0.9583,0.9622,0.9565,0.9622,MillID medium,-0.0337,-0.0089
-fin_Latn,Finnish,368,1.0,1.0,0.9946,0.9946,0.9358,0.9548,0.8949,0.9548,MillID medium,-0.0452,-0.0398
-hau_Latn,Hausa,367,0.9932,0.9932,0.9851,0.9837,0.9694,0.9753,0.9767,0.9767,MillID large,-0.0165,-0.007
-xho_Latn,Xhosa,367,0.9481,0.9481,0.9511,0.9511,0.8352,0.8617,0.8584,0.8617,MillID medium,-0.0864,-0.0894
-kng_Latn,Koongo,362,1.0,1.0,0.9718,0.9718,0.9432,0.9322,0.9525,0.9525,MillID large,-0.0475,-0.0193
-twi_Latn,Twi,359,0.9916,0.9902,0.9684,0.9684,0.9759,0.9744,0.9688,0.9759,MillID tiny,-0.0143,0.0075
-deu_Latn,German,356,0.9972,0.9972,0.9889,0.9889,0.9688,0.9597,0.9434,0.9688,MillID tiny,-0.0284,-0.0201
-guj_Gujr,Gujarati,354,1.0,1.0,0.9842,0.9842,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0158
-dik_Latn,Southwestern Dinka,350,1.0,1.0,0.99,0.99,0.9826,0.9957,0.9884,0.9957,MillID medium,-0.0043,0.0057
-lua_Latn,Luba-Lulua,346,0.9971,0.9971,0.9633,0.9633,0.9719,0.9809,0.9898,0.9898,MillID large,-0.0073,0.0265
-dzo_Tibt,Dzongkha,346,0.9986,0.9986,0.6958,0.6958,0.8946,0.9265,0.8964,0.9265,MillID medium,-0.0721,0.2307
-che_Cyrl,Chechen,345,1.0,1.0,0.984,0.984,0.9734,0.9898,0.9942,0.9942,MillID large,-0.0058,0.0102
-fij_Latn,Fijian,344,1.0,1.0,0.9884,0.9884,0.9971,0.9942,0.9927,0.9971,MillID tiny,-0.0029,0.0087
-ita_Latn,Italian,342,0.9838,0.9838,0.949,0.949,0.9278,0.9259,0.9517,0.9517,MillID large,-0.0321,0.0027
-mya_Mymr,Burmese,342,1.0,1.0,0.9897,0.9897,0.9792,0.9912,0.9838,0.9912,MillID medium,-0.0088,0.0015
-kaz_Cyrl,Kazakh,340,1.0,1.0,0.9926,0.9926,0.9807,0.9852,0.9881,0.9881,MillID large,-0.0119,-0.0045
-tir_Ethi,Tigrinya,339,0.9881,0.9985,0.9956,0.9956,0.9853,0.9745,0.976,0.9853,MillID tiny,-0.0132,-0.0103
-mal_Mlym,Malayalam,338,1.0,1.0,0.994,0.994,1.0,0.9985,1.0,1.0,MillID tiny,0.0,0.006
-hat_Latn,Haitian Creole,338,0.997,0.997,0.9774,0.9774,0.9851,0.982,0.9956,0.9956,MillID large,-0.0014,0.0182
-ceb_Latn,Cebuano,338,1.0,1.0,0.9926,0.9926,0.9758,0.9851,0.9713,0.9851,MillID medium,-0.0149,-0.0075
-vie_Latn,Vietnamese,338,1.0,1.0,0.9836,0.9836,0.9521,0.9521,0.9711,0.9711,MillID large,-0.0289,-0.0125
-slv_Latn,Slovenian,338,0.9927,0.9927,0.9653,0.9653,0.9501,0.9669,0.9577,0.9669,MillID medium,-0.0258,0.0016
-lao_Laoo,Lao,335,1.0,1.0,0.991,0.991,0.9955,0.9985,0.9955,0.9985,MillID medium,-0.0015,0.0075
-chv_Cyrl,Chuvash,335,1.0,1.0,0.9926,0.9926,0.994,0.9955,0.997,0.997,MillID large,-0.003,0.0044
-ind_Latn,Indonesian,335,0.9911,0.9911,0.8873,0.8873,0.7677,0.8067,0.8058,0.8067,MillID medium,-0.1844,-0.0806
-uig_Arab,Uyghur,334,1.0,1.0,0.9911,0.9911,0.994,0.9925,0.9955,0.9955,MillID large,-0.0045,0.0044
-oci_Latn,Occitan,333,0.9911,0.9911,0.9619,0.9619,0.9515,0.954,0.9552,0.9552,MillID large,-0.0359,-0.0067
-mkd_Cyrl,Macedonian,331,1.0,1.0,0.9924,0.9924,0.9686,0.9685,0.9607,0.9686,MillID tiny,-0.0314,-0.0238
-lit_Latn,Lithuanian,330,0.9955,0.9955,0.974,0.974,0.9755,0.9848,0.9909,0.9909,MillID large,-0.0046,0.0169
-swe_Latn,Swedish,328,0.9717,0.9717,0.9767,0.9767,0.9288,0.9538,0.963,0.963,MillID large,-0.0087,-0.0137
-snd_Arab,Sindhi,325,1.0,1.0,0.9848,0.9833,0.9845,0.9938,0.9954,0.9954,MillID large,-0.0046,0.0121
-kat_Geor,Georgian,324,1.0,1.0,0.9859,0.9859,0.9829,0.9892,0.9876,0.9892,MillID medium,-0.0108,0.0033
-jpn_Jpan,Japanese,323,0.9969,0.9969,0.8684,0.8684,0.9713,0.9746,0.9763,0.9763,MillID large,-0.0206,0.1079
-ssw_Latn,Swati,322,0.9684,0.97,0.9721,0.9721,0.9382,0.9525,0.9492,0.9525,MillID medium,-0.0175,-0.0196
-ukr_Cyrl,Ukrainian,322,1.0,1.0,0.9783,0.9783,0.9583,0.9762,0.9664,0.9762,MillID medium,-0.0238,-0.0021
-szl_Latn,Silesian,320,0.9969,0.9969,0.9254,0.9254,0.9615,0.9688,0.9668,0.9688,MillID medium,-0.0281,0.0434
-cat_Latn,Catalan,318,0.9845,0.9845,0.9528,0.9528,0.9551,0.9662,0.9554,0.9662,MillID medium,-0.0183,0.0134
-ayr_Latn,Central Aymara,309,1.0,1.0,0.9752,0.9752,0.9935,0.9935,0.9935,0.9935,MillID tiny,-0.0065,0.0183
-yor_Latn,Yoruba,308,0.9984,0.9984,0.9683,0.9683,0.9886,0.9885,0.9885,0.9886,MillID tiny,-0.0098,0.0203
-ewe_Latn,Ewe,308,1.0,1.0,0.9852,0.9852,0.9885,0.9869,0.9935,0.9935,MillID large,-0.0065,0.0083
-roh_Latn,Romansh,307,1.0,1.0,0.9742,0.9742,0.9854,0.9854,0.9869,0.9869,MillID large,-0.0131,0.0127
-mni_Beng,Manipuri,304,1.0,1.0,0.9499,0.9499,0.941,0.9573,0.9535,0.9573,MillID medium,-0.0427,0.0074
-tpi_Latn,Tok Pisin,302,0.9983,0.9983,0.9867,0.9867,0.9933,0.9967,0.9934,0.9967,MillID medium,-0.0016,0.01
-lvs_Latn,Standard Latvian,298,0.995,0.995,0.9472,0.9472,0.9626,0.9696,0.9746,0.9746,MillID large,-0.0204,0.0274
-ton_Latn,Tongan,298,1.0,1.0,0.0,0.0,0.9966,0.9915,0.9949,0.9966,MillID tiny,-0.0034,0.9966
-epo_Latn,Esperanto,294,0.9983,0.9983,0.9882,0.9882,0.9759,0.9724,0.988,0.988,MillID large,-0.0103,-0.0002
-knc_Latn,Central Kanuri,293,0.9517,0.9517,0.9811,0.9811,0.9541,0.9594,0.9648,0.9648,MillID large,0.0131,-0.0163
-run_Latn,Rundi,291,0.9848,0.9848,0.8545,0.8545,0.8372,0.8425,0.8454,0.8454,MillID large,-0.1394,-0.0091
-mlt_Latn,Maltese,291,0.9932,0.9932,0.9614,0.9614,0.9948,0.9966,0.9931,0.9966,MillID medium,0.0034,0.0352
-bho_Deva,Bhojpuri,290,0.9983,0.9983,0.8732,0.8732,0.9387,0.9453,0.9302,0.9453,MillID medium,-0.053,0.0721
-bak_Cyrl,Bashkir,289,1.0,1.0,0.9846,0.9846,0.9879,0.9842,0.9861,0.9879,MillID tiny,-0.0121,0.0033
-kmr_Latn,Northern Kurdish,289,1.0,1.0,0.9747,0.9747,0.942,0.9718,0.942,0.9718,MillID medium,-0.0282,-0.0029
-bul_Cyrl,Bulgarian,289,1.0,1.0,0.9827,0.9827,0.941,0.9532,0.9666,0.9666,MillID large,-0.0334,-0.0161
-cmn_Hani,Chinese (Mandarin),288,0.9663,0.9663,0.4884,0.4884,0.8978,0.8913,0.8889,0.8978,MillID tiny,-0.0685,0.4094
-bam_Latn,Bambara,287,0.9983,0.9983,0.7923,0.7923,0.9535,0.9615,0.955,0.9615,MillID medium,-0.0368,0.1692
-abk_Cyrl,Abkhazian,285,1.0,1.0,1.0,1.0,1.0,0.9982,1.0,1.0,MillID tiny,0.0,0.0
-bxr_Cyrl,Russia Buriat,277,1.0,1.0,0.9387,0.9387,0.9798,0.9726,0.9835,0.9835,MillID large,-0.0165,0.0448
-isl_Latn,Icelandic,276,1.0,1.0,0.7886,0.7886,0.9616,0.9683,0.9567,0.9683,MillID medium,-0.0317,0.1797
-lmo_Latn,Lombard,276,0.9875,0.9875,0.9097,0.9081,0.9011,0.9199,0.8998,0.9199,MillID medium,-0.0676,0.0118
-npi_Deva,Nepali,273,0.9908,0.9927,0.9745,0.9745,0.9594,0.9703,0.9551,0.9703,MillID medium,-0.0224,-0.0042
-kam_Latn,Kamba,272,0.9716,0.9736,0.8625,0.8625,0.9815,0.9795,0.9741,0.9815,MillID tiny,0.0079,0.119
-quy_Latn,Ayacucho Quechua,271,0.9246,0.9331,0.9794,0.9794,0.9203,0.9289,0.9267,0.9289,MillID medium,-0.0042,-0.0505
-srp_Cyrl,Serbian,269,1.0,1.0,0.9834,0.9834,0.9681,0.9774,0.9725,0.9774,MillID medium,-0.0226,-0.006
-nob_Latn,Norwegian Bokmål,265,0.9612,0.9594,0.8942,0.8942,0.7906,0.8195,0.7992,0.8195,MillID medium,-0.1399,-0.0747
-kor_Hang,Korean,265,1.0,1.0,0.8237,0.8237,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1763
-tum_Latn,Tumbuka,265,0.9962,0.9962,0.9662,0.9662,0.955,0.9569,0.9691,0.9691,MillID large,-0.0271,0.0029
-khk_Cyrl,Halh Mongolian,262,1.0,1.0,0.9205,0.9205,0.9751,0.9735,0.9886,0.9886,MillID large,-0.0114,0.0681
-nya_Latn,Nyanja,262,0.9786,0.9786,0.9259,0.9259,0.9364,0.9553,0.9502,0.9553,MillID medium,-0.0233,0.0294
-nld_Latn,Dutch,259,0.9719,0.9719,0.9597,0.9597,0.9428,0.9435,0.9558,0.9558,MillID large,-0.0161,-0.0039
-ltg_Latn,Latgalian,259,0.9981,0.9981,0.9647,0.9647,0.9572,0.9674,0.9608,0.9674,MillID medium,-0.0307,0.0027
-ibo_Latn,Igbo,257,0.9981,0.9981,0.9922,0.9922,0.9843,0.9922,0.9942,0.9942,MillID large,-0.0039,0.002
-bis_Latn,Bislama,257,1.0,1.0,0.9681,0.9681,0.9941,0.9882,0.9862,0.9941,MillID tiny,-0.0059,0.026
-urd_Arab,Urdu,257,1.0,1.0,0.9345,0.9345,0.9625,0.9704,0.9747,0.9747,MillID large,-0.0253,0.0402
-pol_Latn,Polish,254,0.9844,0.9844,0.92,0.92,0.9569,0.9644,0.957,0.9644,MillID medium,-0.02,0.0444
-eus_Latn,Basque,254,0.9922,0.9922,0.9862,0.9862,0.9821,0.9841,0.984,0.9841,MillID medium,-0.0081,-0.0021
-ilo_Latn,Iloko,252,1.0,1.0,0.9735,0.9735,0.99,0.986,0.9921,0.9921,MillID large,-0.0079,0.0186
-ltz_Latn,Luxembourgish,251,1.0,1.0,0.9544,0.9544,0.9757,0.9839,0.9817,0.9839,MillID medium,-0.0161,0.0295
-pcm_Latn,Nigerian Pidgin,251,0.838,0.8559,0.5015,0.5407,0.8228,0.8344,0.7974,0.8344,MillID medium,-0.0215,0.2937
-arn_Latn,Mapuche,250,1.0,1.0,0.9585,0.9585,0.996,0.994,1.0,1.0,MillID large,0.0,0.0415
-plt_Latn,Malagasy (Plateau),248,0.998,0.998,0.9818,0.9818,0.9773,0.9836,0.9795,0.9836,MillID medium,-0.0144,0.0018
-lij_Latn,Ligurian,245,0.998,0.998,0.8571,0.8571,0.9454,0.9552,0.9362,0.9552,MillID medium,-0.0428,0.0981
-ast_Latn,Asturian,244,0.9702,0.9702,0.9333,0.9333,0.9231,0.9189,0.9389,0.9389,MillID large,-0.0313,0.0056
-zsm_Latn,Standard Malay,244,0.998,0.998,0.9079,0.9079,0.7002,0.7726,0.7485,0.7726,MillID medium,-0.2254,-0.1353
-nia_Latn,Nias,242,1.0,1.0,0.9876,0.9876,0.9855,0.9938,0.9897,0.9938,MillID medium,-0.0062,0.0062
-dan_Latn,Danish,242,0.9499,0.9499,0.9623,0.9623,0.8589,0.8766,0.8884,0.8884,MillID large,-0.0615,-0.0739
-kir_Cyrl,Kyrgyz,242,1.0,1.0,0.9279,0.9279,0.9772,0.9835,0.9854,0.9854,MillID large,-0.0146,0.0575
-tah_Latn,Tahitian,242,1.0,1.0,0.9917,0.9917,0.9854,0.9855,0.9979,0.9979,MillID large,-0.0021,0.0062
-san_Deva,Sanskrit,239,0.9895,0.9895,0.9705,0.9705,0.9895,0.9958,0.9916,0.9958,MillID medium,0.0063,0.0253
-fao_Latn,Faroese,237,1.0,1.0,0.4808,0.4808,0.9615,0.9727,0.9524,0.9727,MillID medium,-0.0273,0.4919
-sag_Latn,Sango,237,1.0,1.0,0.985,0.985,0.9915,0.9958,1.0,1.0,MillID large,0.0,0.015
-mai_Deva,Maithili,234,0.9957,0.9957,0.9196,0.9196,0.9476,0.9386,0.9382,0.9476,MillID tiny,-0.0481,0.028
-sin_Sinh,Sinhala,232,1.0,1.0,0.9978,0.9978,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0022
-gug_Latn,Paraguayan Guaraní,228,0.9956,0.9956,0.933,0.933,0.9822,0.9648,0.9663,0.9822,MillID tiny,-0.0134,0.0492
-tuk_Latn,Turkmen,227,0.9978,0.9978,0.9821,0.9821,0.9821,0.98,0.9867,0.9867,MillID large,-0.0111,0.0046
-gla_Latn,Scottish Gaelic,223,0.9955,0.9955,0.9818,0.9818,0.9888,0.9911,0.9821,0.9911,MillID medium,-0.0044,0.0093
-bem_Latn,Bemba,222,0.9841,0.9818,0.9643,0.9643,0.9679,0.9725,0.9652,0.9725,MillID medium,-0.0093,0.0082
-fur_Latn,Friulian,221,0.9955,0.9955,0.9138,0.9074,0.939,0.9528,0.9488,0.9528,MillID medium,-0.0427,0.0454
-kac_Latn,Kachin,216,1.0,1.0,0.986,0.986,0.9977,1.0,1.0,1.0,MillID medium,0.0,0.014
-glg_Latn,Galician,215,0.9663,0.9663,0.9316,0.9316,0.9262,0.9406,0.9147,0.9406,MillID medium,-0.0257,0.009
-lin_Latn,Lingala,215,0.9953,0.9953,0.9838,0.9838,0.9604,0.9624,0.9561,0.9624,MillID medium,-0.0329,-0.0214
-wol_Latn,Wolof,214,0.9953,0.9953,0.9555,0.9579,0.9691,0.9762,0.9763,0.9763,MillID large,-0.019,0.0184
-als_Latn,Albanian (Tosk),213,1.0,1.0,0.9812,0.9812,0.9687,0.9561,0.9637,0.9687,MillID tiny,-0.0313,-0.0125
-kin_Latn,Kinyarwanda,210,0.9807,0.9807,0.8535,0.8535,0.8282,0.8178,0.8124,0.8282,MillID tiny,-0.1525,-0.0253
-alt_Cyrl,Southern Altai,208,1.0,1.0,0.8966,0.8966,0.955,0.9655,0.9781,0.9781,MillID large,-0.0219,0.0815
-kea_Latn,Kabuverdianu,205,0.9976,0.9976,0.8736,0.8736,0.963,0.9662,0.9602,0.9662,MillID medium,-0.0314,0.0926
-heb_Hebr,Hebrew,203,1.0,1.0,0.9975,0.9975,0.9727,0.9901,0.9854,0.9901,MillID medium,-0.0099,-0.0074
-gle_Latn,Irish,203,1.0,1.0,0.9826,0.9826,0.9851,0.9926,0.9826,0.9926,MillID medium,-0.0074,0.01
-ban_Latn,Balinese,202,1.0,1.0,0.9223,0.9223,0.9671,0.9596,0.959,0.9671,MillID tiny,-0.0329,0.0448
-tat_Cyrl,Tatar,201,1.0,1.0,0.9685,0.9685,0.9724,0.9755,0.9726,0.9755,MillID medium,-0.0245,0.007
-nus_Latn,Nuer,199,1.0,1.0,0.9898,0.9898,0.9924,0.995,0.9924,0.995,MillID medium,-0.005,0.0052
-bos_Latn,Bosnian,198,1.0,1.0,0.8967,0.8967,0.6552,0.7268,0.7112,0.7268,MillID medium,-0.2732,-0.1699
-hne_Deva,Chhattisgarhi,198,0.9851,0.9851,0.9016,0.9016,0.9391,0.9618,0.9482,0.9618,MillID medium,-0.0233,0.0602
-lim_Latn,Limburgish,196,1.0,1.0,0.9556,0.9556,0.8895,0.9155,0.9036,0.9155,MillID medium,-0.0845,-0.0401
-yue_Hani,Cantonese,194,0.8983,0.9014,0.2588,0.2588,0.8917,0.8791,0.8587,0.8917,MillID tiny,-0.0097,0.6329
-war_Latn,Waray,193,1.0,1.0,0.9511,0.9511,0.9431,0.9488,0.9511,0.9511,MillID large,-0.0489,0.0
-kik_Latn,Kikuyu,193,1.0,1.0,0.8478,0.8478,0.9713,0.9738,0.9735,0.9738,MillID medium,-0.0262,0.126
-crh_Latn,Crimean Tatar,189,1.0,1.0,0.9786,0.9786,0.9785,0.9842,0.9759,0.9842,MillID medium,-0.0158,0.0056
-cym_Latn,Welsh,189,1.0,1.0,0.9867,0.9867,0.9947,0.992,0.9867,0.9947,MillID tiny,-0.0053,0.008
-khm_Khmr,Khmer,187,1.0,1.0,1.0,1.0,0.9947,0.974,0.9947,0.9947,MillID tiny,-0.0053,-0.0053
-azj_Latn,North Azerbaijani,187,0.9973,0.9973,0.9787,0.9787,0.9811,0.9756,0.9786,0.9811,MillID tiny,-0.0162,0.0024
-ces_Latn,Czech,183,1.0,1.0,0.9683,0.9683,0.9201,0.9201,0.911,0.9201,MillID tiny,-0.0799,-0.0482
-fon_Latn,Fon,180,1.0,1.0,0.9535,0.9535,0.9916,0.9888,0.9888,0.9916,MillID tiny,-0.0084,0.0381
-hye_Armn,Armenian,178,1.0,1.0,0.977,0.977,1.0,1.0,0.9972,1.0,MillID tiny,0.0,0.023
-shn_Mymr,Shan,174,1.0,1.0,0.9854,0.9854,0.9942,1.0,0.9913,1.0,MillID medium,0.0,0.0146
-scn_Latn,Sicilian,172,1.0,1.0,0.9243,0.9243,0.9739,0.9825,0.9795,0.9825,MillID medium,-0.0175,0.0582
-gom_Deva,Goan Konkani,170,0.9798,0.9798,0.9524,0.9524,0.9459,0.9741,0.948,0.9741,MillID medium,-0.0057,0.0217
-hrv_Latn,Croatian,168,0.9941,0.9941,0.8563,0.8563,0.6667,0.7172,0.6566,0.7172,MillID medium,-0.2769,-0.1391
-kab_Latn,Kabyle,165,1.0,1.0,0.9558,0.9558,0.9426,0.9515,0.9693,0.9693,MillID large,-0.0307,0.0135
-fuv_Latn,Nigerian Fulfulde,164,0.8767,0.8919,0.8587,0.8587,0.8043,0.7971,0.8493,0.8493,MillID large,-0.0426,-0.0094
-arb_Latn,Standard Arabic,163,0.906,0.9133,0.8522,0.8522,0.9568,0.9441,0.9333,0.9568,MillID tiny,0.0435,0.1046
-mri_Latn,Māori,162,1.0,1.0,0.6639,0.6639,0.972,0.9969,0.9938,0.9969,MillID medium,-0.0031,0.333
-udm_Cyrl,Udmurt,159,1.0,1.0,0.8244,0.8244,0.9662,0.9843,0.9745,0.9843,MillID medium,-0.0157,0.1599
-krc_Cyrl,Karachay-Balkar,159,1.0,1.0,0.8778,0.8778,0.9779,0.9841,0.9779,0.9841,MillID medium,-0.0159,0.1063
-jav_Latn,Javanese,158,0.9937,0.9937,0.9313,0.9313,0.9574,0.9267,0.9412,0.9574,MillID tiny,-0.0363,0.0261
-tzm_Tfng,Central Atlas Tamazight,157,0.9345,0.9345,0.7512,0.7512,0.6328,0.6452,0.6426,0.6452,MillID medium,-0.2893,-0.106
-bel_Cyrl,Belarusian,157,1.0,1.0,0.9937,0.9937,0.9809,0.9904,0.9806,0.9904,MillID medium,-0.0096,-0.0033
-bjn_Latn,Banjar,153,0.9967,0.9967,0.8688,0.8688,0.9385,0.9377,0.9463,0.9463,MillID large,-0.0504,0.0775
-oss_Cyrl,Ossetic,152,1.0,1.0,1.0,1.0,0.9834,0.9867,0.9735,0.9867,MillID medium,-0.0133,-0.0133
-sun_Latn,Sundanese,143,1.0,1.0,0.9467,0.9467,0.9577,0.979,0.9754,0.979,MillID medium,-0.021,0.0323
-srd_Latn,Sardinian,139,1.0,1.0,0.9363,0.9363,0.9712,0.9893,0.9749,0.9893,MillID medium,-0.0107,0.053
-fil_Latn,Filipino,137,0.9815,0.9815,0.9926,0.9926,0.947,0.9354,0.9363,0.947,MillID tiny,-0.0345,-0.0456
-ady_Cyrl,Adyghe,135,1.0,1.0,0.9814,0.9814,0.9925,0.9925,0.985,0.9925,MillID tiny,-0.0075,0.0111
-diq_Latn,Dimli (individual language),134,1.0,1.0,0.9333,0.9333,0.9042,0.9502,0.9318,0.9502,MillID medium,-0.0498,0.0169
-ewo_Latn,Ewondo,134,0.8787,0.8833,0.8596,0.8596,0.9624,0.9653,0.9699,0.9699,MillID large,0.0866,0.1103
-mos_Latn,Mossi,133,1.0,1.0,0.9811,0.9811,0.9773,0.9771,0.9771,0.9773,MillID tiny,-0.0227,-0.0038
-xmf_Geor,Mingrelian,132,1.0,1.0,0.963,0.963,0.9624,0.9732,0.9736,0.9736,MillID large,-0.0264,0.0106
-kbp_Latn,Kabiyè,130,1.0,1.0,0.9766,0.9766,0.9811,0.9923,1.0,1.0,MillID large,0.0,0.0234
-pag_Latn,Pangasinan,122,0.9959,0.9959,0.959,0.959,0.95,0.9437,0.9528,0.9528,MillID large,-0.0431,-0.0062
-sat_Olck,Santali,122,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-kmb_Latn,Kimbundu,119,0.9917,0.9917,0.9633,0.9633,0.9833,0.9833,1.0,1.0,MillID large,0.0083,0.0367
-kas_Arab,Kashmiri,118,1.0,1.0,0.9784,0.9784,1.0,0.9915,0.9958,1.0,MillID tiny,0.0,0.0216
-bjn_Arab,Banjar,116,0.8342,0.9869,0.4533,0.9596,0.9872,0.9831,1.0,1.0,MillID large,0.0131,0.0404
-ace_Latn,Acehnese,113,1.0,1.0,0.8943,0.88,0.9778,0.9867,0.9865,0.9867,MillID medium,-0.0133,0.1067
-nav_Latn,Navajo,113,1.0,1.0,0.968,0.968,0.9911,0.9867,0.9911,0.9911,MillID tiny,-0.0089,0.0231
-taq_Latn,Tamasheq,106,1.0,1.0,0.8377,0.8377,0.8958,0.9091,0.9289,0.9289,MillID large,-0.0711,0.0912
-taq_Tfng,Tamasheq,104,0.8046,0.8046,0.0,0.0,0.6,0.6129,0.6,0.6129,MillID medium,-0.1917,0.6129
-umb_Latn,Umbundu,100,0.995,0.995,0.8972,0.8972,0.9849,0.9798,0.9798,0.9849,MillID tiny,-0.0101,0.0877
-mag_Deva,Magahi,97,1.0,1.0,0.7723,0.7723,0.8557,0.9053,0.8969,0.9053,MillID medium,-0.0947,0.133
-awa_Deva,Awadhi,91,0.963,0.963,0.7571,0.7571,0.8827,0.8764,0.895,0.895,MillID large,-0.068,0.1379
-bug_Latn,Buginese,78,0.9811,0.9811,0.9375,0.9375,0.987,0.987,0.987,0.987,MillID tiny,0.0059,0.0495
-knc_Arab,Central Kanuri,68,0.8571,0.8595,0.029,0.029,0.5833,0.5625,0.6263,0.6263,MillID large,-0.2332,0.5973
-min_Latn,Minangkabau,55,0.991,0.991,0.3333,0.3333,0.9009,0.9038,0.86,0.9038,MillID medium,-0.0872,0.5705
-vec_Latn,Venetian,49,0.8605,0.8605,0.6202,0.6202,0.7451,0.7664,0.6957,0.7664,MillID medium,-0.0941,0.1462
-kas_Deva,Kashmiri,47,0.7027,0.7027,0.5867,0.5867,0.6173,0.6905,0.6923,0.6923,MillID large,-0.0104,0.1056
-cjk_Latn,Chokwe,24,1.0,1.0,0.807,0.807,0.7692,0.9091,0.8,0.9091,MillID medium,-0.0909,0.1021
+label,language,support,GlotLID,GlotLID restricted,fastText,fastText restricted,MillID tiny,MillID medium,MillID large,MillID tiny v1.5,MillID medium v1.5,MillID large v1.5,best MillID,best MillID model,gain over GlotLID restricted,gain over fastText restricted
+fra_Latn,French,1652,0.9548,0.9548,0.9632,0.9632,0.9583,0.9737,0.9636,0.943,0.9747,0.9831,0.9831,MillID large v1.5,0.0283,0.0199
+eng_Latn,English,1444,0.876,0.8768,0.8574,0.8571,0.9357,0.9414,0.9321,0.9324,0.9212,0.9525,0.9525,MillID large v1.5,0.0757,0.0954
+spa_Latn,Spanish,1136,0.9583,0.9583,0.9407,0.9407,0.9434,0.953,0.9575,0.937,0.9574,0.9719,0.9719,MillID large v1.5,0.0136,0.0312
+tam_Taml,Tamil,754,1.0,1.0,0.9973,0.9973,0.9993,0.998,0.998,0.9973,0.9953,0.9987,0.9993,MillID tiny,-0.0007,0.002
+arb_Arab,Arabic (Modern Standard),745,0.8864,0.8864,0.9573,0.9542,0.8774,0.905,0.8919,0.8712,0.9095,0.9046,0.9095,MillID medium v1.5,0.0231,-0.0447
+por_Latn,Portuguese,657,0.9538,0.9562,0.95,0.9493,0.9581,0.9628,0.9601,0.9589,0.9491,0.9731,0.9731,MillID large v1.5,0.0169,0.0238
+kan_Knda,Kannada,601,0.9941,0.9941,0.9992,0.9992,0.9822,0.9865,0.9908,0.9726,0.9656,0.9665,0.9908,MillID large,-0.0033,-0.0084
+zul_Latn,Zulu,594,0.9042,0.9042,0.9704,0.9704,0.8449,0.8713,0.8295,0.883,0.8432,0.9094,0.9094,MillID large v1.5,0.0052,-0.061
+swh_Latn,Swahili,592,0.9536,0.9528,0.9454,0.9454,0.9021,0.8967,0.9019,0.893,0.8522,0.9094,0.9094,MillID large v1.5,-0.0434,-0.036
+mar_Deva,Marathi,589,0.9888,0.9897,0.9871,0.9871,0.9705,0.9811,0.9744,0.9683,0.9697,0.9785,0.9811,MillID medium,-0.0086,-0.006
+tso_Latn,Tsonga,581,0.956,0.956,0.9861,0.9861,0.9834,0.9843,0.9834,0.9789,0.9852,0.9852,0.9852,MillID medium v1.5,0.0292,-0.0009
+hun_Latn,Hungarian,576,1.0,1.0,0.9804,0.9804,0.9826,0.9913,0.9913,0.9886,0.9912,0.993,0.993,MillID large v1.5,-0.007,0.0126
+afr_Latn,Afrikaans,569,0.9849,0.9849,0.9858,0.9858,0.9781,0.976,0.9816,0.9716,0.9833,0.9831,0.9833,MillID medium v1.5,-0.0016,-0.0025
+tel_Telu,Telugu,555,0.9982,0.9982,0.9991,0.9991,0.9991,1.0,1.0,0.9973,0.9982,0.9991,1.0,MillID medium,0.0018,0.0009
+rus_Cyrl,Russian,528,0.9846,0.9846,0.9271,0.9271,0.9242,0.9291,0.9557,0.9453,0.9389,0.9557,0.9557,MillID large,-0.0289,0.0286
+ory_Orya,Odia (individual language),511,0.9971,1.0,0.9961,0.9961,0.9961,0.9961,0.9961,0.9941,0.9961,0.9951,0.9961,MillID tiny,-0.0039,0.0
+sot_Latn,Southern Sotho,491,0.9774,0.9784,0.8562,0.8562,0.9703,0.9665,0.9671,0.9694,0.9652,0.9737,0.9737,MillID large v1.5,-0.0047,0.1175
+nso_Latn,Northern Sotho,479,0.9695,0.9695,0.9673,0.9673,0.9471,0.9614,0.9521,0.9579,0.9648,0.9635,0.9648,MillID medium v1.5,-0.0047,-0.0025
+asm_Beng,Assamese,467,0.9989,0.9989,0.9968,0.9968,0.9925,0.9946,0.9936,0.9968,0.9947,0.9968,0.9968,MillID tiny v1.5,-0.0021,0.0
+ben_Beng,Bangla,466,0.9968,0.9968,0.9894,0.9894,0.9737,0.9871,0.9817,0.9882,0.987,0.9925,0.9925,MillID large v1.5,-0.0043,0.0031
+pan_Guru,Punjabi,460,1.0,1.0,0.9901,0.9901,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0099
+amh_Ethi,Amharic,458,1.0,1.0,0.9978,0.9978,0.9857,0.9869,0.9781,0.9835,0.9856,0.9857,0.9869,MillID medium,-0.0131,-0.0109
+tsn_Latn,Tswana,456,0.9605,0.9605,0.8698,0.8698,0.9336,0.9397,0.9365,0.9475,0.9442,0.9467,0.9475,MillID tiny v1.5,-0.013,0.0777
+gaz_Latn,Oromo (West Central),441,0.9744,0.9744,0.9733,0.9733,0.9349,0.9552,0.9541,0.9354,0.9466,0.9413,0.9552,MillID medium,-0.0192,-0.0181
+som_Latn,Somali,439,0.9954,0.9954,0.9909,0.9909,0.9885,0.992,0.992,0.9839,0.9897,0.9909,0.992,MillID medium,-0.0034,0.0011
+uzn_Latn,Northern Uzbek,436,0.9989,0.9989,0.9849,0.9849,0.9779,0.9838,0.9825,0.9839,0.9814,0.9861,0.9861,MillID large v1.5,-0.0128,0.0012
+tha_Thai,Thai,431,0.9799,0.9799,0.9811,0.9811,0.9775,0.9701,0.9787,0.9799,0.9701,0.9811,0.9811,MillID large v1.5,0.0012,0.0
+ydd_Hebr,Eastern Yiddish,430,1.0,1.0,0.9988,0.9988,0.9942,0.9977,0.9918,0.993,0.993,0.9942,0.9977,MillID medium,-0.0023,-0.0011
+tur_Latn,Turkish,430,0.9988,0.9988,0.9803,0.9803,0.9685,0.9742,0.9766,0.968,0.959,0.9731,0.9766,MillID large,-0.0222,-0.0037
+nno_Latn,Norwegian Nynorsk,427,0.9845,0.9845,0.9542,0.9542,0.8945,0.9189,0.9147,0.9132,0.9035,0.9273,0.9273,MillID large v1.5,-0.0572,-0.0269
+smo_Latn,Samoan,426,0.9988,0.9988,0.9372,0.9372,0.9929,0.9917,0.9976,0.9905,0.9929,0.9977,0.9977,MillID large v1.5,-0.0011,0.0605
+pap_Latn,Papiamento,423,0.9988,0.9988,0.9742,0.9731,0.9623,0.9709,0.9712,0.9784,0.975,0.9809,0.9809,MillID large v1.5,-0.0179,0.0078
+ckb_Arab,Central Kurdish,421,0.9769,0.9769,0.9952,0.9952,0.9695,0.9619,0.9316,0.9554,0.9632,0.9757,0.9757,MillID large v1.5,-0.0012,-0.0195
+pbt_Arab,Southern Pashto,419,0.9988,0.9988,0.9782,0.977,0.9844,0.994,0.9892,0.9855,0.9855,0.9881,0.994,MillID medium,-0.0048,0.017
+ekk_Latn,Estonian,419,0.9929,0.9929,0.9857,0.9857,0.9721,0.9806,0.9732,0.9709,0.9732,0.9782,0.9806,MillID medium,-0.0123,-0.0051
+sna_Latn,Shona,415,1.0,1.0,0.9831,0.9831,0.9766,0.9779,0.9716,0.9817,0.9758,0.973,0.9817,MillID tiny v1.5,-0.0183,-0.0014
+luo_Latn,Luo (Kenya and Tanzania),415,1.0,1.0,0.9564,0.9564,0.9791,0.9841,0.9853,0.9879,0.9791,0.989,0.989,MillID large v1.5,-0.011,0.0326
+tgk_Cyrl,Tajik,413,1.0,1.0,0.983,0.983,0.9927,0.9927,0.9927,0.9951,0.9927,0.9915,0.9951,MillID tiny v1.5,-0.0049,0.0121
+bod_Tibt,Tibetan,406,0.9988,0.9988,0.8191,0.8191,0.932,0.9503,0.9403,0.9354,0.9417,0.9433,0.9503,MillID medium,-0.0485,0.1312
+lug_Latn,Ganda,405,0.9863,0.9876,0.979,0.979,0.9684,0.9748,0.9735,0.9682,0.9589,0.9862,0.9862,MillID large v1.5,-0.0014,0.0072
+fas_Arab,Persian,396,0.9859,0.9859,0.9439,0.9439,0.9301,0.9342,0.9516,0.945,0.9342,0.9287,0.9516,MillID large,-0.0343,0.0077
+ell_Grek,Greek,394,0.9987,0.9987,0.97,0.97,0.9493,0.9086,0.9423,0.901,0.9423,0.9322,0.9493,MillID tiny,-0.0494,-0.0207
+hin_Deva,Hindi,392,0.8768,0.8768,0.863,0.863,0.8179,0.8171,0.8358,0.8552,0.8024,0.8932,0.8932,MillID large v1.5,0.0164,0.0302
+lus_Latn,Mizo,391,0.9974,0.9974,0.9897,0.9897,0.9739,0.9738,0.9764,0.9831,0.9818,0.9778,0.9831,MillID tiny v1.5,-0.0143,-0.0066
+dyu_Latn,Dyula,390,1.0,1.0,0.8223,0.8223,0.9564,0.9729,0.9703,0.9658,0.9681,0.9832,0.9832,MillID large v1.5,-0.0168,0.1609
+slk_Latn,Slovak,374,0.9987,0.9987,0.9714,0.9714,0.9418,0.9486,0.9404,0.9515,0.9361,0.966,0.966,MillID large v1.5,-0.0327,-0.0054
+ron_Latn,Romanian,369,0.9959,0.9959,0.9759,0.9759,0.9712,0.9755,0.9632,0.9672,0.9607,0.9685,0.9755,MillID medium,-0.0204,-0.0004
+kal_Latn,Kalaallisut,369,0.9986,0.9986,0.9932,0.9932,0.9946,0.9986,0.9986,0.9986,0.9986,0.9973,0.9986,MillID medium,0.0,0.0054
+azb_Arab,South Azerbaijani,369,0.9959,0.9959,0.9711,0.9711,0.9583,0.9622,0.9565,0.9586,0.9489,0.9653,0.9653,MillID large v1.5,-0.0306,-0.0058
+fin_Latn,Finnish,368,1.0,1.0,0.9946,0.9946,0.9358,0.9548,0.8949,0.9291,0.9445,0.9444,0.9548,MillID medium,-0.0452,-0.0398
+hau_Latn,Hausa,367,0.9932,0.9932,0.9851,0.9837,0.9694,0.9753,0.9767,0.971,0.9723,0.9835,0.9835,MillID large v1.5,-0.0097,-0.0002
+xho_Latn,Xhosa,367,0.9481,0.9481,0.9511,0.9511,0.8352,0.8617,0.8584,0.8953,0.8612,0.8994,0.8994,MillID large v1.5,-0.0487,-0.0517
+kng_Latn,Koongo,362,1.0,1.0,0.9718,0.9718,0.9432,0.9322,0.9525,0.9446,0.9417,0.9568,0.9568,MillID large v1.5,-0.0432,-0.015
+twi_Latn,Twi,359,0.9916,0.9902,0.9684,0.9684,0.9759,0.9744,0.9688,0.9773,0.9701,0.9745,0.9773,MillID tiny v1.5,-0.0129,0.0089
+deu_Latn,German,356,0.9972,0.9972,0.9889,0.9889,0.9688,0.9597,0.9434,0.9802,0.9551,0.9657,0.9802,MillID tiny v1.5,-0.017,-0.0087
+guj_Gujr,Gujarati,354,1.0,1.0,0.9842,0.9842,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0158
+dik_Latn,Southwestern Dinka,350,1.0,1.0,0.99,0.99,0.9826,0.9957,0.9884,0.9928,0.9957,0.9928,0.9957,MillID medium,-0.0043,0.0057
+lua_Latn,Luba-Lulua,346,0.9971,0.9971,0.9633,0.9633,0.9719,0.9809,0.9898,0.9794,0.9794,0.9868,0.9898,MillID large,-0.0073,0.0265
+dzo_Tibt,Dzongkha,346,0.9986,0.9986,0.6958,0.6958,0.8946,0.9265,0.8964,0.9061,0.924,0.9163,0.9265,MillID medium,-0.0721,0.2307
+che_Cyrl,Chechen,345,1.0,1.0,0.984,0.984,0.9734,0.9898,0.9942,0.9778,0.9913,0.9927,0.9942,MillID large,-0.0058,0.0102
+fij_Latn,Fijian,344,1.0,1.0,0.9884,0.9884,0.9971,0.9942,0.9927,0.9883,0.9927,0.9927,0.9971,MillID tiny,-0.0029,0.0087
+ita_Latn,Italian,342,0.9838,0.9838,0.949,0.949,0.9278,0.9259,0.9517,0.9216,0.9422,0.9388,0.9517,MillID large,-0.0321,0.0027
+mya_Mymr,Burmese,342,1.0,1.0,0.9897,0.9897,0.9792,0.9912,0.9838,0.9745,0.9414,0.9837,0.9912,MillID medium,-0.0088,0.0015
+kaz_Cyrl,Kazakh,340,1.0,1.0,0.9926,0.9926,0.9807,0.9852,0.9881,0.9836,0.9896,0.9882,0.9896,MillID medium v1.5,-0.0104,-0.003
+tir_Ethi,Tigrinya,339,0.9881,0.9985,0.9956,0.9956,0.9853,0.9745,0.976,0.9824,0.9824,0.9825,0.9853,MillID tiny,-0.0132,-0.0103
+mal_Mlym,Malayalam,338,1.0,1.0,0.994,0.994,1.0,0.9985,1.0,1.0,1.0,0.9985,1.0,MillID tiny,0.0,0.006
+hat_Latn,Haitian Creole,338,0.997,0.997,0.9774,0.9774,0.9851,0.982,0.9956,0.9865,0.9537,0.9925,0.9956,MillID large,-0.0014,0.0182
+ceb_Latn,Cebuano,338,1.0,1.0,0.9926,0.9926,0.9758,0.9851,0.9713,0.9807,0.9789,0.985,0.9851,MillID medium,-0.0149,-0.0075
+vie_Latn,Vietnamese,338,1.0,1.0,0.9836,0.9836,0.9521,0.9521,0.9711,0.9519,0.9568,0.9742,0.9742,MillID large v1.5,-0.0258,-0.0094
+slv_Latn,Slovenian,338,0.9927,0.9927,0.9653,0.9653,0.9501,0.9669,0.9577,0.96,0.9448,0.9759,0.9759,MillID large v1.5,-0.0168,0.0106
+lao_Laoo,Lao,335,1.0,1.0,0.991,0.991,0.9955,0.9985,0.9955,0.997,0.9985,1.0,1.0,MillID large v1.5,0.0,0.009
+chv_Cyrl,Chuvash,335,1.0,1.0,0.9926,0.9926,0.994,0.9955,0.997,0.9985,0.9955,0.9955,0.9985,MillID tiny v1.5,-0.0015,0.0059
+ind_Latn,Indonesian,335,0.9911,0.9911,0.8873,0.8873,0.7677,0.8067,0.8058,0.8419,0.8378,0.8479,0.8479,MillID large v1.5,-0.1432,-0.0394
+uig_Arab,Uyghur,334,1.0,1.0,0.9911,0.9911,0.994,0.9925,0.9955,0.9955,0.9985,0.9985,0.9985,MillID medium v1.5,-0.0015,0.0074
+oci_Latn,Occitan,333,0.9911,0.9911,0.9619,0.9619,0.9515,0.954,0.9552,0.9574,0.9446,0.956,0.9574,MillID tiny v1.5,-0.0337,-0.0045
+mkd_Cyrl,Macedonian,331,1.0,1.0,0.9924,0.9924,0.9686,0.9685,0.9607,0.9727,0.9688,0.9669,0.9727,MillID tiny v1.5,-0.0273,-0.0197
+lit_Latn,Lithuanian,330,0.9955,0.9955,0.974,0.974,0.9755,0.9848,0.9909,0.9676,0.9817,0.9909,0.9909,MillID large,-0.0046,0.0169
+swe_Latn,Swedish,328,0.9717,0.9717,0.9767,0.9767,0.9288,0.9538,0.963,0.9588,0.9555,0.9594,0.963,MillID large,-0.0087,-0.0137
+snd_Arab,Sindhi,325,1.0,1.0,0.9848,0.9833,0.9845,0.9938,0.9954,0.9891,0.9877,0.9939,0.9954,MillID large,-0.0046,0.0121
+kat_Geor,Georgian,324,1.0,1.0,0.9859,0.9859,0.9829,0.9892,0.9876,0.9954,0.9876,0.9938,0.9954,MillID tiny v1.5,-0.0046,0.0095
+jpn_Jpan,Japanese,323,0.9969,0.9969,0.8684,0.8684,0.9713,0.9746,0.9763,0.9746,0.9718,0.9762,0.9763,MillID large,-0.0206,0.1079
+ssw_Latn,Swati,322,0.9684,0.97,0.9721,0.9721,0.9382,0.9525,0.9492,0.9537,0.9445,0.9522,0.9537,MillID tiny v1.5,-0.0163,-0.0184
+ukr_Cyrl,Ukrainian,322,1.0,1.0,0.9783,0.9783,0.9583,0.9762,0.9664,0.9617,0.9592,0.9633,0.9762,MillID medium,-0.0238,-0.0021
+szl_Latn,Silesian,320,0.9969,0.9969,0.9254,0.9254,0.9615,0.9688,0.9668,0.9556,0.965,0.9796,0.9796,MillID large v1.5,-0.0173,0.0542
+cat_Latn,Catalan,318,0.9845,0.9845,0.9528,0.9528,0.9551,0.9662,0.9554,0.9497,0.9553,0.9683,0.9683,MillID large v1.5,-0.0162,0.0155
+ayr_Latn,Central Aymara,309,1.0,1.0,0.9752,0.9752,0.9935,0.9935,0.9935,0.9886,0.9919,0.9951,0.9951,MillID large v1.5,-0.0049,0.0199
+yor_Latn,Yoruba,308,0.9984,0.9984,0.9683,0.9683,0.9886,0.9885,0.9885,0.987,0.9935,0.9852,0.9935,MillID medium v1.5,-0.0049,0.0252
+ewe_Latn,Ewe,308,1.0,1.0,0.9852,0.9852,0.9885,0.9869,0.9935,0.9902,0.9935,0.9951,0.9951,MillID large v1.5,-0.0049,0.0099
+roh_Latn,Romansh,307,1.0,1.0,0.9742,0.9742,0.9854,0.9854,0.9869,0.9789,0.9837,0.9902,0.9902,MillID large v1.5,-0.0098,0.016
+mni_Beng,Manipuri,304,1.0,1.0,0.9499,0.9499,0.941,0.9573,0.9535,0.9501,0.9559,0.959,0.959,MillID large v1.5,-0.041,0.0091
+tpi_Latn,Tok Pisin,302,0.9983,0.9983,0.9867,0.9867,0.9933,0.9967,0.9934,0.9934,0.9884,0.9983,0.9983,MillID large v1.5,0.0,0.0116
+lvs_Latn,Standard Latvian,298,0.995,0.995,0.9472,0.9472,0.9626,0.9696,0.9746,0.9603,0.9781,0.9763,0.9781,MillID medium v1.5,-0.0169,0.0309
+ton_Latn,Tongan,298,1.0,1.0,0.0,0.0,0.9966,0.9915,0.9949,0.9966,0.9898,0.9949,0.9966,MillID tiny,-0.0034,0.9966
+epo_Latn,Esperanto,294,0.9983,0.9983,0.9882,0.9882,0.9759,0.9724,0.988,0.976,0.9793,0.9828,0.988,MillID large,-0.0103,-0.0002
+knc_Latn,Central Kanuri,293,0.9517,0.9517,0.9811,0.9811,0.9541,0.9594,0.9648,0.9666,0.9517,0.9666,0.9666,MillID tiny v1.5,0.0149,-0.0145
+run_Latn,Rundi,291,0.9848,0.9848,0.8545,0.8545,0.8372,0.8425,0.8454,0.8832,0.8323,0.8787,0.8832,MillID tiny v1.5,-0.1016,0.0287
+mlt_Latn,Maltese,291,0.9932,0.9932,0.9614,0.9614,0.9948,0.9966,0.9931,0.9948,0.9931,0.9914,0.9966,MillID medium,0.0034,0.0352
+bho_Deva,Bhojpuri,290,0.9983,0.9983,0.8732,0.8732,0.9387,0.9453,0.9302,0.9556,0.9378,0.9522,0.9556,MillID tiny v1.5,-0.0427,0.0824
+bak_Cyrl,Bashkir,289,1.0,1.0,0.9846,0.9846,0.9879,0.9842,0.9861,0.9825,0.9792,0.9895,0.9895,MillID large v1.5,-0.0105,0.0049
+kmr_Latn,Northern Kurdish,289,1.0,1.0,0.9747,0.9747,0.942,0.9718,0.942,0.9791,0.951,0.9606,0.9791,MillID tiny v1.5,-0.0209,0.0044
+bul_Cyrl,Bulgarian,289,1.0,1.0,0.9827,0.9827,0.941,0.9532,0.9666,0.9636,0.9703,0.9704,0.9704,MillID large v1.5,-0.0296,-0.0123
+cmn_Hani,Chinese (Mandarin),288,0.9663,0.9663,0.4884,0.4884,0.8978,0.8913,0.8889,0.9149,0.8662,0.9133,0.9149,MillID tiny v1.5,-0.0514,0.4265
+bam_Latn,Bambara,287,0.9983,0.9983,0.7923,0.7923,0.9535,0.9615,0.955,0.9521,0.958,0.9826,0.9826,MillID large v1.5,-0.0157,0.1903
+abk_Cyrl,Abkhazian,285,1.0,1.0,1.0,1.0,1.0,0.9982,1.0,0.9965,0.9948,1.0,1.0,MillID tiny,0.0,0.0
+bxr_Cyrl,Russia Buriat,277,1.0,1.0,0.9387,0.9387,0.9798,0.9726,0.9835,0.9726,0.9835,0.9835,0.9835,MillID large,-0.0165,0.0448
+isl_Latn,Icelandic,276,1.0,1.0,0.7886,0.7886,0.9616,0.9683,0.9567,0.949,0.935,0.963,0.9683,MillID medium,-0.0317,0.1797
+lmo_Latn,Lombard,276,0.9875,0.9875,0.9097,0.9081,0.9011,0.9199,0.8998,0.9149,0.9074,0.9316,0.9316,MillID large v1.5,-0.0559,0.0235
+npi_Deva,Nepali,273,0.9908,0.9927,0.9745,0.9745,0.9594,0.9703,0.9551,0.9649,0.9724,0.9743,0.9743,MillID large v1.5,-0.0184,-0.0002
+kam_Latn,Kamba,272,0.9716,0.9736,0.8625,0.8625,0.9815,0.9795,0.9741,0.9795,0.9685,0.9889,0.9889,MillID large v1.5,0.0153,0.1264
+quy_Latn,Ayacucho Quechua,271,0.9246,0.9331,0.9794,0.9794,0.9203,0.9289,0.9267,0.9398,0.8708,0.9095,0.9398,MillID tiny v1.5,0.0067,-0.0396
+srp_Cyrl,Serbian,269,1.0,1.0,0.9834,0.9834,0.9681,0.9774,0.9725,0.974,0.9703,0.9704,0.9774,MillID medium,-0.0226,-0.006
+nob_Latn,Norwegian Bokmål,265,0.9612,0.9594,0.8942,0.8942,0.7906,0.8195,0.7992,0.8207,0.7919,0.8321,0.8321,MillID large v1.5,-0.1273,-0.0621
+kor_Hang,Korean,265,1.0,1.0,0.8237,0.8237,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1763
+tum_Latn,Tumbuka,265,0.9962,0.9962,0.9662,0.9662,0.955,0.9569,0.9691,0.9773,0.9653,0.975,0.9773,MillID tiny v1.5,-0.0189,0.0111
+khk_Cyrl,Halh Mongolian,262,1.0,1.0,0.9205,0.9205,0.9751,0.9735,0.9886,0.9774,0.9812,0.9905,0.9905,MillID large v1.5,-0.0095,0.07
+nya_Latn,Nyanja,262,0.9786,0.9786,0.9259,0.9259,0.9364,0.9553,0.9502,0.9518,0.9451,0.9509,0.9553,MillID medium,-0.0233,0.0294
+nld_Latn,Dutch,259,0.9719,0.9719,0.9597,0.9597,0.9428,0.9435,0.9558,0.9363,0.9497,0.9583,0.9583,MillID large v1.5,-0.0136,-0.0014
+ltg_Latn,Latgalian,259,0.9981,0.9981,0.9647,0.9647,0.9572,0.9674,0.9608,0.9656,0.9806,0.9865,0.9865,MillID large v1.5,-0.0116,0.0218
+ibo_Latn,Igbo,257,0.9981,0.9981,0.9922,0.9922,0.9843,0.9922,0.9942,0.9922,0.9902,0.9922,0.9942,MillID large,-0.0039,0.002
+bis_Latn,Bislama,257,1.0,1.0,0.9681,0.9681,0.9941,0.9882,0.9862,0.9862,0.9922,0.9843,0.9941,MillID tiny,-0.0059,0.026
+urd_Arab,Urdu,257,1.0,1.0,0.9345,0.9345,0.9625,0.9704,0.9747,0.9622,0.9683,0.9705,0.9747,MillID large,-0.0253,0.0402
+pol_Latn,Polish,254,0.9844,0.9844,0.92,0.92,0.9569,0.9644,0.957,0.9565,0.9647,0.9706,0.9706,MillID large v1.5,-0.0138,0.0506
+eus_Latn,Basque,254,0.9922,0.9922,0.9862,0.9862,0.9821,0.9841,0.984,0.9782,0.9921,0.9881,0.9921,MillID medium v1.5,-0.0001,0.0059
+ilo_Latn,Iloko,252,1.0,1.0,0.9735,0.9735,0.99,0.986,0.9921,0.9901,0.9901,0.992,0.9921,MillID large,-0.0079,0.0186
+ltz_Latn,Luxembourgish,251,1.0,1.0,0.9544,0.9544,0.9757,0.9839,0.9817,0.9742,0.9782,0.994,0.994,MillID large v1.5,-0.006,0.0396
+pcm_Latn,Nigerian Pidgin,251,0.838,0.8559,0.5015,0.5407,0.8228,0.8344,0.7974,0.8228,0.7566,0.8119,0.8344,MillID medium,-0.0215,0.2937
+arn_Latn,Mapuche,250,1.0,1.0,0.9585,0.9585,0.996,0.994,1.0,0.992,0.998,0.998,1.0,MillID large,0.0,0.0415
+plt_Latn,Malagasy (Plateau),248,0.998,0.998,0.9818,0.9818,0.9773,0.9836,0.9795,0.9691,0.9919,0.9878,0.9919,MillID medium v1.5,-0.0061,0.0101
+lij_Latn,Ligurian,245,0.998,0.998,0.8571,0.8571,0.9454,0.9552,0.9362,0.9379,0.954,0.9542,0.9552,MillID medium,-0.0428,0.0981
+ast_Latn,Asturian,244,0.9702,0.9702,0.9333,0.9333,0.9231,0.9189,0.9389,0.9188,0.9463,0.973,0.973,MillID large v1.5,0.0028,0.0397
+zsm_Latn,Standard Malay,244,0.998,0.998,0.9079,0.9079,0.7002,0.7726,0.7485,0.7891,0.7692,0.8087,0.8087,MillID large v1.5,-0.1893,-0.0992
+nia_Latn,Nias,242,1.0,1.0,0.9876,0.9876,0.9855,0.9938,0.9897,0.9979,0.9917,0.9979,0.9979,MillID tiny v1.5,-0.0021,0.0103
+dan_Latn,Danish,242,0.9499,0.9499,0.9623,0.9623,0.8589,0.8766,0.8884,0.8874,0.8598,0.88,0.8884,MillID large,-0.0615,-0.0739
+kir_Cyrl,Kyrgyz,242,1.0,1.0,0.9279,0.9279,0.9772,0.9835,0.9854,0.9733,0.9727,0.9917,0.9917,MillID large v1.5,-0.0083,0.0638
+tah_Latn,Tahitian,242,1.0,1.0,0.9917,0.9917,0.9854,0.9855,0.9979,0.9833,0.9876,0.9938,0.9979,MillID large,-0.0021,0.0062
+san_Deva,Sanskrit,239,0.9895,0.9895,0.9705,0.9705,0.9895,0.9958,0.9916,0.9895,0.9937,0.9979,0.9979,MillID large v1.5,0.0084,0.0274
+fao_Latn,Faroese,237,1.0,1.0,0.4808,0.4808,0.9615,0.9727,0.9524,0.975,0.9401,0.9745,0.975,MillID tiny v1.5,-0.025,0.4942
+sag_Latn,Sango,237,1.0,1.0,0.985,0.985,0.9915,0.9958,1.0,0.9936,0.9979,1.0,1.0,MillID large,0.0,0.015
+mai_Deva,Maithili,234,0.9957,0.9957,0.9196,0.9196,0.9476,0.9386,0.9382,0.9258,0.9442,0.9448,0.9476,MillID tiny,-0.0481,0.028
+sin_Sinh,Sinhala,232,1.0,1.0,0.9978,0.9978,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0022
+gug_Latn,Paraguayan Guaraní,228,0.9956,0.9956,0.933,0.933,0.9822,0.9648,0.9663,0.9686,0.9689,0.9664,0.9822,MillID tiny,-0.0134,0.0492
+tuk_Latn,Turkmen,227,0.9978,0.9978,0.9821,0.9821,0.9821,0.98,0.9867,0.9799,0.9845,0.989,0.989,MillID large v1.5,-0.0088,0.0069
+gla_Latn,Scottish Gaelic,223,0.9955,0.9955,0.9818,0.9818,0.9888,0.9911,0.9821,0.9888,0.98,0.9797,0.9911,MillID medium,-0.0044,0.0093
+bem_Latn,Bemba,222,0.9841,0.9818,0.9643,0.9643,0.9679,0.9725,0.9652,0.9729,0.9726,0.9773,0.9773,MillID large v1.5,-0.0045,0.013
+fur_Latn,Friulian,221,0.9955,0.9955,0.9138,0.9074,0.939,0.9528,0.9488,0.9484,0.9346,0.9535,0.9535,MillID large v1.5,-0.042,0.0461
+kac_Latn,Kachin,216,1.0,1.0,0.986,0.986,0.9977,1.0,1.0,0.9977,1.0,0.9954,1.0,MillID medium,0.0,0.014
+glg_Latn,Galician,215,0.9663,0.9663,0.9316,0.9316,0.9262,0.9406,0.9147,0.9517,0.896,0.9455,0.9517,MillID tiny v1.5,-0.0146,0.0201
+lin_Latn,Lingala,215,0.9953,0.9953,0.9838,0.9838,0.9604,0.9624,0.9561,0.9789,0.9789,0.9791,0.9791,MillID large v1.5,-0.0162,-0.0047
+wol_Latn,Wolof,214,0.9953,0.9953,0.9555,0.9579,0.9691,0.9762,0.9763,0.969,0.969,0.9763,0.9763,MillID large,-0.019,0.0184
+als_Latn,Albanian (Tosk),213,1.0,1.0,0.9812,0.9812,0.9687,0.9561,0.9637,0.976,0.8773,0.9687,0.976,MillID tiny v1.5,-0.024,-0.0052
+kin_Latn,Kinyarwanda,210,0.9807,0.9807,0.8535,0.8535,0.8282,0.8178,0.8124,0.8491,0.8361,0.864,0.864,MillID large v1.5,-0.1167,0.0105
+alt_Cyrl,Southern Altai,208,1.0,1.0,0.8966,0.8966,0.955,0.9655,0.9781,0.9653,0.9831,0.9903,0.9903,MillID large v1.5,-0.0097,0.0937
+kea_Latn,Kabuverdianu,205,0.9976,0.9976,0.8736,0.8736,0.963,0.9662,0.9602,0.958,0.9388,0.9655,0.9662,MillID medium,-0.0314,0.0926
+heb_Hebr,Hebrew,203,1.0,1.0,0.9975,0.9975,0.9727,0.9901,0.9854,0.9752,0.9646,0.9804,0.9901,MillID medium,-0.0099,-0.0074
+gle_Latn,Irish,203,1.0,1.0,0.9826,0.9826,0.9851,0.9926,0.9826,0.9776,0.9776,0.9878,0.9926,MillID medium,-0.0074,0.01
+ban_Latn,Balinese,202,1.0,1.0,0.9223,0.9223,0.9671,0.9596,0.959,0.9695,0.9645,0.9695,0.9695,MillID tiny v1.5,-0.0305,0.0472
+tat_Cyrl,Tatar,201,1.0,1.0,0.9685,0.9685,0.9724,0.9755,0.9726,0.9776,0.9592,0.9826,0.9826,MillID large v1.5,-0.0174,0.0141
+nus_Latn,Nuer,199,1.0,1.0,0.9898,0.9898,0.9924,0.995,0.9924,0.9925,1.0,0.9949,1.0,MillID medium v1.5,0.0,0.0102
+bos_Latn,Bosnian,198,1.0,1.0,0.8967,0.8967,0.6552,0.7268,0.7112,0.6852,0.6323,0.7622,0.7622,MillID large v1.5,-0.2378,-0.1345
+hne_Deva,Chhattisgarhi,198,0.9851,0.9851,0.9016,0.9016,0.9391,0.9618,0.9482,0.9381,0.9538,0.9548,0.9618,MillID medium,-0.0233,0.0602
+lim_Latn,Limburgish,196,1.0,1.0,0.9556,0.9556,0.8895,0.9155,0.9036,0.896,0.918,0.9305,0.9305,MillID large v1.5,-0.0695,-0.0251
+yue_Hani,Cantonese,194,0.8983,0.9014,0.2588,0.2588,0.8917,0.8791,0.8587,0.8937,0.8609,0.8929,0.8937,MillID tiny v1.5,-0.0077,0.6349
+war_Latn,Waray,193,1.0,1.0,0.9511,0.9511,0.9431,0.9488,0.9511,0.9462,0.9516,0.957,0.957,MillID large v1.5,-0.043,0.0059
+kik_Latn,Kikuyu,193,1.0,1.0,0.8478,0.8478,0.9713,0.9738,0.9735,0.9922,0.9843,0.9895,0.9922,MillID tiny v1.5,-0.0078,0.1444
+crh_Latn,Crimean Tatar,189,1.0,1.0,0.9786,0.9786,0.9785,0.9842,0.9759,0.9711,0.9567,0.984,0.9842,MillID medium,-0.0158,0.0056
+cym_Latn,Welsh,189,1.0,1.0,0.9867,0.9867,0.9947,0.992,0.9867,0.9893,0.9894,0.9894,0.9947,MillID tiny,-0.0053,0.008
+khm_Khmr,Khmer,187,1.0,1.0,1.0,1.0,0.9947,0.974,0.9947,1.0,0.9894,0.9947,1.0,MillID tiny v1.5,0.0,0.0
+azj_Latn,North Azerbaijani,187,0.9973,0.9973,0.9787,0.9787,0.9811,0.9756,0.9786,0.9731,0.9731,0.9866,0.9866,MillID large v1.5,-0.0107,0.0079
+ces_Latn,Czech,183,1.0,1.0,0.9683,0.9683,0.9201,0.9201,0.911,0.9389,0.9268,0.9451,0.9451,MillID large v1.5,-0.0549,-0.0232
+fon_Latn,Fon,180,1.0,1.0,0.9535,0.9535,0.9916,0.9888,0.9888,0.9833,0.9832,0.9917,0.9917,MillID large v1.5,-0.0083,0.0382
+hye_Armn,Armenian,178,1.0,1.0,0.977,0.977,1.0,1.0,0.9972,1.0,0.9972,1.0,1.0,MillID tiny,0.0,0.023
+shn_Mymr,Shan,174,1.0,1.0,0.9854,0.9854,0.9942,1.0,0.9913,1.0,0.9971,1.0,1.0,MillID medium,0.0,0.0146
+scn_Latn,Sicilian,172,1.0,1.0,0.9243,0.9243,0.9739,0.9825,0.9795,0.9767,0.9741,0.9883,0.9883,MillID large v1.5,-0.0117,0.064
+gom_Deva,Goan Konkani,170,0.9798,0.9798,0.9524,0.9524,0.9459,0.9741,0.948,0.948,0.9711,0.9602,0.9741,MillID medium,-0.0057,0.0217
+hrv_Latn,Croatian,168,0.9941,0.9941,0.8563,0.8563,0.6667,0.7172,0.6566,0.6588,0.67,0.7571,0.7571,MillID large v1.5,-0.237,-0.0992
+kab_Latn,Kabyle,165,1.0,1.0,0.9558,0.9558,0.9426,0.9515,0.9693,0.9354,0.9387,0.9541,0.9693,MillID large,-0.0307,0.0135
+fuv_Latn,Nigerian Fulfulde,164,0.8767,0.8919,0.8587,0.8587,0.8043,0.7971,0.8493,0.9073,0.672,0.8443,0.9073,MillID tiny v1.5,0.0154,0.0486
+arb_Latn,Standard Arabic,163,0.906,0.9133,0.8522,0.8522,0.9568,0.9441,0.9333,0.9419,0.9527,0.9494,0.9568,MillID tiny,0.0435,0.1046
+mri_Latn,Māori,162,1.0,1.0,0.6639,0.6639,0.972,0.9969,0.9938,0.9969,0.9939,0.9907,0.9969,MillID medium,-0.0031,0.333
+udm_Cyrl,Udmurt,159,1.0,1.0,0.8244,0.8244,0.9662,0.9843,0.9745,0.9779,0.9905,0.9843,0.9905,MillID medium v1.5,-0.0095,0.1661
+krc_Cyrl,Karachay-Balkar,159,1.0,1.0,0.8778,0.8778,0.9779,0.9841,0.9779,0.9748,0.9776,0.984,0.9841,MillID medium,-0.0159,0.1063
+jav_Latn,Javanese,158,0.9937,0.9937,0.9313,0.9313,0.9574,0.9267,0.9412,0.9551,0.9369,0.9677,0.9677,MillID large v1.5,-0.026,0.0364
+tzm_Tfng,Central Atlas Tamazight,157,0.9345,0.9345,0.7512,0.7512,0.6328,0.6452,0.6426,0.6973,0.5617,0.6491,0.6973,MillID tiny v1.5,-0.2372,-0.0539
+bel_Cyrl,Belarusian,157,1.0,1.0,0.9937,0.9937,0.9809,0.9904,0.9806,0.9841,0.984,0.984,0.9904,MillID medium,-0.0096,-0.0033
+bjn_Latn,Banjar,153,0.9967,0.9967,0.8688,0.8688,0.9385,0.9377,0.9463,0.9369,0.9236,0.9568,0.9568,MillID large v1.5,-0.0399,0.088
+oss_Cyrl,Ossetic,152,1.0,1.0,1.0,1.0,0.9834,0.9867,0.9735,0.9868,0.9799,0.98,0.9868,MillID tiny v1.5,-0.0132,-0.0132
+sun_Latn,Sundanese,143,1.0,1.0,0.9467,0.9467,0.9577,0.979,0.9754,0.9677,0.993,0.9756,0.993,MillID medium v1.5,-0.007,0.0463
+srd_Latn,Sardinian,139,1.0,1.0,0.9363,0.9363,0.9712,0.9893,0.9749,0.9751,0.9856,0.9749,0.9893,MillID medium,-0.0107,0.053
+fil_Latn,Filipino,137,0.9815,0.9815,0.9926,0.9926,0.947,0.9354,0.9363,0.9466,0.952,0.9779,0.9779,MillID large v1.5,-0.0036,-0.0147
+ady_Cyrl,Adyghe,135,1.0,1.0,0.9814,0.9814,0.9925,0.9925,0.985,0.9963,1.0,0.9963,1.0,MillID medium v1.5,0.0,0.0186
+diq_Latn,Dimli (individual language),134,1.0,1.0,0.9333,0.9333,0.9042,0.9502,0.9318,0.9339,0.9278,0.9261,0.9502,MillID medium,-0.0498,0.0169
+ewo_Latn,Ewondo,134,0.8787,0.8833,0.8596,0.8596,0.9624,0.9653,0.9699,0.9591,0.9814,0.9776,0.9814,MillID medium v1.5,0.0981,0.1218
+mos_Latn,Mossi,133,1.0,1.0,0.9811,0.9811,0.9773,0.9771,0.9771,0.9774,0.9769,0.9886,0.9886,MillID large v1.5,-0.0114,0.0075
+xmf_Geor,Mingrelian,132,1.0,1.0,0.963,0.963,0.9624,0.9732,0.9736,0.9848,0.9699,0.981,0.9848,MillID tiny v1.5,-0.0152,0.0218
+kbp_Latn,Kabiyè,130,1.0,1.0,0.9766,0.9766,0.9811,0.9923,1.0,1.0,0.9884,0.9886,1.0,MillID large,0.0,0.0234
+pag_Latn,Pangasinan,122,0.9959,0.9959,0.959,0.959,0.95,0.9437,0.9528,0.9573,0.9661,0.9791,0.9791,MillID large v1.5,-0.0168,0.0201
+sat_Olck,Santali,122,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+kmb_Latn,Kimbundu,119,0.9917,0.9917,0.9633,0.9633,0.9833,0.9833,1.0,0.9833,0.9876,0.9917,1.0,MillID large,0.0083,0.0367
+kas_Arab,Kashmiri,118,1.0,1.0,0.9784,0.9784,1.0,0.9915,0.9958,0.9957,0.9916,0.9957,1.0,MillID tiny,0.0,0.0216
+bjn_Arab,Banjar,116,0.8342,0.9869,0.4533,0.9596,0.9872,0.9831,1.0,0.9915,1.0,0.9957,1.0,MillID large,0.0131,0.0404
+ace_Latn,Acehnese,113,1.0,1.0,0.8943,0.88,0.9778,0.9867,0.9865,0.9776,0.9821,0.9867,0.9867,MillID medium,-0.0133,0.1067
+nav_Latn,Navajo,113,1.0,1.0,0.968,0.968,0.9911,0.9867,0.9911,1.0,0.982,0.9956,1.0,MillID tiny v1.5,0.0,0.032
+taq_Latn,Tamasheq,106,1.0,1.0,0.8377,0.8377,0.8958,0.9091,0.9289,0.9016,0.9216,0.9223,0.9289,MillID large,-0.0711,0.0912
+taq_Tfng,Tamasheq,104,0.8046,0.8046,0.0,0.0,0.6,0.6129,0.6,0.654,0.6042,0.6042,0.654,MillID tiny v1.5,-0.1506,0.654
+umb_Latn,Umbundu,100,0.995,0.995,0.8972,0.8972,0.9849,0.9798,0.9798,0.98,0.995,0.9901,0.995,MillID medium v1.5,0.0,0.0978
+mag_Deva,Magahi,97,1.0,1.0,0.7723,0.7723,0.8557,0.9053,0.8969,0.89,0.8279,0.8969,0.9053,MillID medium,-0.0947,0.133
+awa_Deva,Awadhi,91,0.963,0.963,0.7571,0.7571,0.8827,0.8764,0.895,0.8977,0.9123,0.9357,0.9357,MillID large v1.5,-0.0273,0.1786
+bug_Latn,Buginese,78,0.9811,0.9811,0.9375,0.9375,0.987,0.987,0.987,0.9806,0.9935,0.9935,0.9935,MillID medium v1.5,0.0124,0.056
+knc_Arab,Central Kanuri,68,0.8571,0.8595,0.029,0.029,0.5833,0.5625,0.6263,0.5217,0.5319,0.5979,0.6263,MillID large,-0.2332,0.5973
+min_Latn,Minangkabau,55,0.991,0.991,0.3333,0.3333,0.9009,0.9038,0.86,0.8947,0.8468,0.9346,0.9346,MillID large v1.5,-0.0564,0.6013
+vec_Latn,Venetian,49,0.8605,0.8605,0.6202,0.6202,0.7451,0.7664,0.6957,0.7664,0.7921,0.8367,0.8367,MillID large v1.5,-0.0238,0.2165
+kas_Deva,Kashmiri,47,0.7027,0.7027,0.5867,0.5867,0.6173,0.6905,0.6923,0.557,0.6512,0.6824,0.6923,MillID large,-0.0104,0.1056
+cjk_Latn,Chokwe,24,1.0,1.0,0.807,0.807,0.7692,0.9091,0.8,0.8571,0.8837,0.8372,0.9091,MillID medium,-0.0909,0.1021

leaderboard_udhr.csv

@@ -1,359 +1,359 @@
-label,language,support,GlotLID,GlotLID restricted,fastText,fastText restricted,MillID tiny,MillID medium,MillID large,best MillID,best MillID model,gain over GlotLID restricted,gain over fastText restricted
-roh_Latn,Romansh,399,0.9987,0.9987,0.9455,0.9455,0.9887,0.9912,0.9937,0.9937,MillID large,-0.005,0.0482
-oci_Latn,Occitan,398,0.3755,0.3755,0.4355,0.4355,0.2912,0.3312,0.3136,0.3312,MillID medium,-0.0443,-0.1043
-cmn_Hani,Chinese (Mandarin),319,0.8681,0.8681,0.4676,0.4676,0.8748,0.886,0.8571,0.886,MillID medium,0.0179,0.4184
-krl_Latn,Karelian,183,0.0109,0.0109,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.0109,0.0
-qug_Latn,Chimborazo Highland Quichua,182,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
-acu_Latn,Achuar-Shiwiar,180,0.8535,0.8535,0.0,0.0,0.85,0.7431,0.7324,0.85,MillID tiny,-0.0035,0.85
-hus_Latn,Huastec,175,0.9855,0.9855,0.0,0.0,0.9583,0.9914,0.9914,0.9914,MillID medium,0.0059,0.9914
-hau_Latn,Hausa,155,1.0,1.0,0.8757,0.8757,0.9968,0.9968,0.9968,0.9968,MillID tiny,-0.0032,0.1211
-auc_Latn,Waorani,154,0.0,0.0,0.0,0.0,0.0,0.0503,0.0,0.0503,MillID medium,0.0503,0.0503
-kwi_Latn,Awa-Cuaiquer,145,0.8769,0.8769,0.0,0.0,0.7712,0.775,0.7967,0.7967,MillID large,-0.0802,0.7967
-jpn_Jpan,Japanese,140,1.0,1.0,0.9437,0.9437,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0563
-snn_Latn,Siona,136,0.5137,0.5137,0.0,0.0,0.3931,0.7731,0.6207,0.7731,MillID medium,0.2594,0.7731
-ktu_Latn,Kituba (Democratic Republic of Congo),118,0.6803,0.6803,0.0,0.0,0.7546,0.7687,0.7528,0.7687,MillID medium,0.0884,0.7687
-lat_Latn,Latin,118,0.9915,0.9915,0.0,0.0,0.9957,0.9958,0.9958,0.9958,MillID medium,0.0043,0.9958
-hat_Latn,Haitian Creole,117,0.9785,0.9785,0.6988,0.6988,0.9872,0.9914,0.9871,0.9914,MillID medium,0.0129,0.2926
-twi_Latn,Twi,116,0.9957,0.9957,0.3993,0.3959,0.9957,0.9871,0.9829,0.9957,MillID tiny,0.0,0.5998
-rmn_Latn,Balkan Romani,116,0.8571,0.8571,0.0,0.0,0.7213,0.6667,0.7351,0.7351,MillID large,-0.122,0.7351
-kmb_Latn,Kimbundu,116,1.0,1.0,0.8775,0.8775,0.9914,0.9787,0.9914,0.9914,MillID tiny,-0.0086,0.1139
-nya_Latn,Nyanja,116,1.0,1.0,0.8056,0.8056,0.9784,0.9871,0.9655,0.9871,MillID medium,-0.0129,0.1815
-chr_Cher,Cherokee,115,0.6628,0.6628,0.0,0.0,0.6705,0.7151,0.7293,0.7293,MillID large,0.0665,0.7293
-ell_Grek,Greek,115,1.0,1.0,1.0,1.0,0.6705,0.655,0.6705,0.6705,MillID tiny,-0.3295,-0.3295
-lvs_Latn,Standard Latvian,115,1.0,1.0,0.9914,0.9914,0.9957,0.9957,0.9957,0.9957,MillID tiny,-0.0043,0.0043
-kng_Latn,Koongo,115,0.1928,0.1928,0.4571,0.4571,0.1014,0.0469,0.1014,0.1014,MillID tiny,-0.0914,-0.3557
-pov_Latn,Upper Guinea Crioulo,115,0.8325,0.8325,0.0,0.0,0.8442,0.8384,0.8384,0.8442,MillID tiny,0.0117,0.8442
-por_Latn,Portuguese,115,0.9957,0.9957,0.7931,0.7931,0.9784,0.9957,0.9826,0.9957,MillID medium,0.0,0.2026
-cjk_Latn,Chokwe,114,1.0,1.0,0.5327,0.5327,0.8878,0.9493,0.9493,0.9493,MillID medium,-0.0507,0.4166
-tha_Thai,Thai,114,1.0,1.0,0.9956,0.9956,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0044
-tso_Latn,Tsonga,114,0.7807,0.7807,0.6909,0.6909,0.7432,0.8824,0.8426,0.8824,MillID medium,0.1017,0.1915
-fas_Arab,Persian,114,1.0,1.0,0.9344,0.9344,0.9821,0.9912,0.973,0.9912,MillID medium,-0.0088,0.0568
-lin_Latn,Lingala,110,1.0,1.0,0.9864,0.9864,0.9735,1.0,0.9692,1.0,MillID medium,0.0,0.0136
-fuv_Latn,Nigerian Fulfulde,108,0.6813,0.6885,0.4747,0.4747,0.5096,0.4051,0.519,0.519,MillID large,-0.1695,0.0443
-urd_Arab,Urdu,108,0.986,0.986,0.6353,0.6353,0.9907,0.9953,0.9953,0.9953,MillID medium,0.0093,0.36
-umb_Latn,Umbundu,107,0.9906,0.9906,0.9083,0.9083,0.9091,0.8737,0.8854,0.9091,MillID tiny,-0.0815,0.0008
-mal_Mlym,Malayalam,100,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-ron_Latn,Romanian,97,1.0,1.0,0.8727,0.8727,1.0,0.9949,0.9949,1.0,MillID tiny,0.0,0.1273
-ven_Latn,Venda,89,1.0,1.0,0.0,0.0,1.0,1.0,0.9944,1.0,MillID tiny,0.0,1.0
-spa_Latn,Spanish,78,0.9872,0.9872,0.5571,0.5571,0.956,0.9872,0.987,0.9872,MillID medium,0.0,0.4301
-hye_Armn,Armenian,70,1.0,1.0,0.9855,0.9855,0.9855,0.9928,0.9855,0.9928,MillID medium,-0.0072,0.0073
-tam_Taml,Tamil,68,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-deu_Latn,German,67,1.0,1.0,0.9571,0.9571,1.0,1.0,0.9925,1.0,MillID tiny,0.0,0.0429
-tiv_Latn,Tiv,67,1.0,1.0,0.0,0.0,1.0,0.9926,1.0,1.0,MillID tiny,0.0,1.0
-pam_Latn,Pampanga,66,1.0,1.0,0.0,0.0,0.9925,1.0,1.0,1.0,MillID medium,0.0,1.0
-sun_Latn,Sundanese,66,0.9924,0.9924,0.7692,0.7692,0.9606,0.9767,0.9924,0.9924,MillID large,0.0,0.2232
-knc_Latn,Central Kanuri,64,1.0,1.0,0.4384,0.4384,0.9921,1.0,1.0,1.0,MillID medium,0.0,0.5616
-njo_Latn,Ao Naga,64,0.9921,0.9921,0.0,0.0,0.9922,0.9922,1.0,1.0,MillID large,0.0079,1.0
-skr_Arab,Saraiki,63,0.5,0.5,0.0,0.0,0.8,0.9231,0.8545,0.9231,MillID medium,0.4231,0.9231
-smo_Latn,Samoan,63,1.0,1.0,0.7922,0.7922,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2078
-mcf_Latn,Matsés,62,0.992,0.992,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.008,1.0
-shp_Latn,Shipibo-Conibo,62,0.9123,0.9123,0.0,0.0,0.5581,0.4103,0.8077,0.8077,MillID large,-0.1046,0.8077
-cbi_Latn,Chachi,62,0.9919,0.9919,0.0,0.0,0.976,1.0,0.9919,1.0,MillID medium,0.0081,1.0
-gla_Latn,Scottish Gaelic,62,0.9836,0.9836,0.9587,0.9587,0.992,0.976,0.9919,0.992,MillID tiny,0.0084,0.0333
-nob_Latn,Norwegian Bokmål,62,0.9764,0.9764,0.992,0.992,0.9606,0.9516,0.9365,0.9606,MillID tiny,-0.0158,-0.0314
-ace_Latn,Acehnese,61,0.9917,0.9917,0.5357,0.5357,0.9756,0.9833,0.9917,0.9917,MillID large,0.0,0.456
-swe_Latn,Swedish,61,1.0,1.0,1.0,1.0,0.9917,1.0,1.0,1.0,MillID medium,0.0,0.0
-amr_Latn,Amarakaeri,61,0.976,0.976,0.0,0.0,0.9833,1.0,1.0,1.0,MillID medium,0.024,1.0
-pnb_Arab,Western Panjabi,61,0.7394,0.7394,0.0,0.0,0.8451,0.9313,0.8841,0.9313,MillID medium,0.1919,0.9313
-boa_Latn,Bora,61,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-sey_Latn,Secoya,61,0.5744,0.5888,0.0,0.0,0.3959,0.5839,0.5714,0.5839,MillID medium,-0.0049,0.5839
-dan_Latn,Danish,61,0.9833,0.9833,0.9677,0.9677,0.9587,0.9587,0.9516,0.9587,MillID tiny,-0.0246,-0.009
-fin_Latn,Finnish,61,1.0,1.0,0.2998,0.2998,0.9919,0.9836,0.9661,0.9919,MillID tiny,-0.0081,0.6921
-udu_Latn,Uduk,60,1.0,1.0,0.0,0.0,0.9917,1.0,1.0,1.0,MillID medium,0.0,1.0
-cbr_Latn,Cashibo-Cacataibo,60,1.0,1.0,0.0,0.0,1.0,0.9917,0.9917,1.0,MillID tiny,0.0,1.0
-cab_Latn,Garifuna,60,0.9831,0.9831,0.0,0.0,0.9917,1.0,1.0,1.0,MillID medium,0.0169,1.0
-zgh_Tfng,Standard Moroccan Tamazight,60,0.4615,0.4615,0.0,0.0,0.5185,0.8235,0.7368,0.8235,MillID medium,0.362,0.8235
-ban_Latn,Balinese,60,1.0,1.0,0.5607,0.5607,0.9916,0.9831,0.9744,0.9916,MillID tiny,-0.0084,0.4309
-arl_Latn,Arabela,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-afr_Latn,Afrikaans,60,1.0,1.0,0.944,0.944,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.056
-war_Latn,Waray,60,0.9917,0.9917,0.944,0.944,0.9748,1.0,1.0,1.0,MillID medium,0.0083,0.056
-mad_Latn,Madurese,60,0.9748,0.9748,0.0,0.0,0.9752,0.9655,0.9752,0.9752,MillID tiny,0.0004,0.9752
-mcd_Latn,Sharanahua,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-ind_Latn,Indonesian,60,0.9027,0.9027,0.5652,0.5652,0.6136,0.6739,0.6444,0.6739,MillID medium,-0.2288,0.1087
-jav_Latn,Javanese,60,0.9916,0.9916,0.513,0.513,0.9833,0.9672,0.9593,0.9833,MillID tiny,-0.0083,0.4703
-jiv_Latn,Shuar,60,0.8027,0.8027,0.0,0.0,0.7703,0.7066,0.7317,0.7703,MillID tiny,-0.0324,0.7703
-wol_Latn,Wolof,60,1.0,1.0,0.2362,0.2362,0.9836,0.9836,0.9916,0.9916,MillID large,-0.0084,0.7554
-gjn_Latn,Gonja,60,0.9831,0.9831,0.0,0.0,0.9831,0.9916,0.9831,0.9916,MillID medium,0.0085,0.9916
-quy_Latn,Ayacucho Quechua,60,0.7763,0.7763,0.1039,0.1039,0.7117,0.6747,0.76,0.76,MillID large,-0.0163,0.6561
-ekk_Latn,Estonian,60,1.0,1.0,0.3448,0.3448,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.6552
-ctd_Latn,Tedim Chin,60,0.6957,0.7234,0.0,0.0,0.5185,0.7879,0.8,0.8,MillID large,0.0766,0.8
-ton_Latn,Tongan,60,0.9917,0.9917,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0083,1.0
-bug_Latn,Buginese,60,1.0,1.0,0.5742,0.5742,0.9916,0.9655,0.9565,0.9916,MillID tiny,-0.0084,0.4174
-bod_Tibt,Tibetan,60,0.9009,0.9009,0.8992,0.8992,0.9661,0.9748,0.9672,0.9748,MillID medium,0.0739,0.0756
-vie_Latn,Vietnamese,60,1.0,1.0,0.9524,0.9524,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0476
-zam_Latn,Miahuatlán Zapotec,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
-gaz_Latn,Oromo (West Central),60,0.9752,0.9752,0.5381,0.5381,0.9831,0.9916,0.9744,0.9916,MillID medium,0.0164,0.4535
-cpu_Latn,Pichis Ashéninka,60,0.9744,0.9744,0.0,0.0,0.6593,0.5714,0.6667,0.6667,MillID large,-0.3077,0.6667
-sna_Latn,Shona,60,0.9917,0.9917,0.5729,0.5729,0.9833,0.9836,1.0,1.0,MillID large,0.0083,0.4271
-cym_Latn,Welsh,60,1.0,1.0,0.8108,0.8108,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1892
-qvm_Latn,Margos-Yarowilca-Lauricocha Quechua,60,0.5,0.5,0.0,0.0,0.125,0.0938,0.1818,0.1818,MillID large,-0.3182,0.1818
-fil_Latn,Filipino,60,1.0,1.0,0.553,0.553,0.9831,0.9916,0.9916,0.9916,MillID medium,-0.0084,0.4386
-tbz_Latn,Ditammari,60,0.3784,0.3784,0.0,0.0,0.0,0.3333,0.2609,0.3333,MillID medium,-0.0451,0.3333
-cot_Latn,Caquinte,60,0.9916,0.9916,0.0,0.0,0.9916,0.9831,1.0,1.0,MillID large,0.0084,1.0
-tca_Latn,Ticuna,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-ayr_Latn,Central Aymara,59,1.0,1.0,0.716,0.716,0.8992,1.0,0.9916,1.0,MillID medium,0.0,0.284
-tur_Latn,Turkish,59,0.9916,0.9916,0.59,0.59,0.9421,0.9833,0.9916,0.9916,MillID large,0.0,0.4016
-uig_Latn,Uyghur,59,0.9833,0.9752,0.0,0.0,1.0,0.9916,1.0,1.0,MillID tiny,0.0248,1.0
-bis_Latn,Bislama,59,1.0,1.0,0.7516,0.7516,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2484
-bcl_Latn,Central Bikol,59,0.9916,0.9916,0.0,0.0,0.9916,0.9916,1.0,1.0,MillID large,0.0084,1.0
-bos_Latn,Bosnian,59,0.3121,0.3121,0.1979,0.1979,0.1803,0.2281,0.237,0.237,MillID large,-0.0751,0.0391
-bre_Latn,Breton,59,0.9915,0.9915,0.0,0.0,0.9916,1.0,0.9833,1.0,MillID medium,0.0085,1.0
-tly_Latn,Talysh,59,0.9915,0.9915,0.0,0.0,0.9915,0.9915,1.0,1.0,MillID large,0.0085,1.0
-ceb_Latn,Cebuano,59,1.0,1.0,0.6146,0.6146,0.9916,0.9833,0.9833,0.9916,MillID tiny,-0.0084,0.377
-tob_Latn,Toba,59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-top_Latn,Papantla Totonac,59,0.9916,0.9916,0.0,0.0,0.9828,0.9833,0.9831,0.9833,MillID medium,-0.0083,0.9833
-tuk_Latn,Turkmen,59,1.0,1.0,0.9672,0.9672,0.9739,0.9916,1.0,1.0,MillID large,0.0,0.0328
-tsz_Latn,Purepecha,59,0.9655,0.9744,0.0,0.0,0.9739,0.9915,0.9915,0.9915,MillID medium,0.0171,0.9915
-fur_Latn,Friulian,59,1.0,1.0,0.6082,0.6051,0.9748,1.0,0.9748,1.0,MillID medium,0.0,0.3949
-gaa_Latn,Ga,59,0.9916,0.9833,0.0,0.0,0.9916,0.9916,0.9752,0.9916,MillID tiny,0.0083,0.9916
-gag_Latn,Gagauz,59,0.9915,0.9915,0.0,0.0,0.9565,0.9828,0.9915,0.9915,MillID large,0.0,0.9915
-gsw_Latn,Swiss German,59,0.9915,0.9915,0.0,0.0,0.7097,0.8081,0.9649,0.9649,MillID large,-0.0266,0.9649
-pol_Latn,Polish,59,1.0,1.0,0.7296,0.7296,0.9831,0.9655,0.9915,0.9915,MillID large,-0.0085,0.2619
-qva_Latn,Ambo-Pasco Quechua,59,0.0328,0.0328,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.0328,0.0
-eus_Latn,Basque,59,1.0,1.0,0.8923,0.8923,0.9219,0.9672,0.9752,0.9752,MillID large,-0.0248,0.0829
-qwh_Latn,Huaylas Ancash Quechua,59,0.6545,0.6545,0.0,0.0,0.3982,0.4955,0.5698,0.5698,MillID large,-0.0847,0.5698
-srp_Latn,Serbian,59,0.45,0.45,0.0,0.0,0.3689,0.4754,0.4167,0.4754,MillID medium,0.0254,0.4754
-ssw_Latn,Swati,59,1.0,1.0,0.9516,0.9516,0.9916,1.0,1.0,1.0,MillID medium,0.0,0.0484
-cnr_Latn,Serbian (Montenegro),59,0.0303,0.0303,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.0303,0.0
-srp_Cyrl,Serbian,59,0.9915,0.9915,0.9915,0.9915,0.9828,0.9828,0.9915,0.9915,MillID large,0.0,0.0
-slv_Latn,Slovenian,59,0.9752,0.9752,0.8027,0.8027,0.9474,0.9483,0.9587,0.9587,MillID large,-0.0165,0.156
-cof_Latn,Colorado,59,0.9273,0.9369,0.0,0.0,0.9655,1.0,0.9915,1.0,MillID medium,0.0631,1.0
-cos_Latn,Corsican,59,0.9915,0.9915,0.0,0.0,0.9915,0.9916,0.9831,0.9916,MillID medium,0.0001,0.9916
-cjs_Cyrl,Shor,59,0.9369,0.9369,0.0,0.0,0.9464,0.9649,0.9649,0.9649,MillID medium,0.028,0.9649
-fij_Latn,Fijian,59,1.0,1.0,0.9752,0.9752,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0248
-rar_Latn,Rarotongan,59,1.0,1.0,0.0,0.0,0.9916,1.0,1.0,1.0,MillID medium,0.0,1.0
-sin_Sinh,Sinhala,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-sag_Latn,Sango,59,0.5783,0.5783,0.1892,0.1892,0.9915,0.9915,0.9915,0.9915,MillID tiny,0.4132,0.8023
-ewe_Latn,Ewe,59,1.0,1.0,0.6517,0.6517,1.0,1.0,0.9833,1.0,MillID tiny,0.0,0.3483
-dzo_Tibt,Dzongkha,59,0.9134,0.9134,0.8571,0.8571,0.9667,0.9748,0.9655,0.9748,MillID medium,0.0614,0.1177
-dga_Latn,Southern Dagaare,59,0.9915,1.0,0.0,0.0,0.9365,0.9915,0.9667,0.9915,MillID medium,-0.0085,0.9915
-crh_Latn,Crimean Tatar,59,1.0,1.0,0.8551,0.8551,0.9833,0.9916,0.9672,0.9916,MillID medium,-0.0084,0.1365
-mar_Deva,Marathi,59,1.0,1.0,1.0,1.0,1.0,0.9916,0.9916,1.0,MillID tiny,0.0,0.0
-maz_Latn,Central Mazahua,59,0.9391,0.9391,0.0,0.0,0.725,0.7421,0.8227,0.8227,MillID large,-0.1164,0.8227
-nav_Latn,Navajo,59,1.0,1.0,0.7024,0.7024,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2976
-mor_Latn,Moro,59,0.9915,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0085,1.0
-min_Latn,Minangkabau,59,0.9916,0.9916,0.127,0.127,1.0,0.9915,1.0,1.0,MillID tiny,0.0084,0.873
-mlt_Latn,Maltese,59,1.0,1.0,0.8939,0.8939,0.9916,1.0,1.0,1.0,MillID medium,0.0,0.1061
-men_Latn,Mende,59,0.9916,0.9916,0.0,0.0,0.9516,0.9916,0.9752,0.9916,MillID medium,0.0,0.9916
-mic_Latn,Mi'kmaw,59,0.4267,0.4267,0.0,0.0,0.9828,1.0,1.0,1.0,MillID medium,0.5733,1.0
-hns_Latn,Caribbean Hindustani,59,0.9369,0.9369,0.0,0.0,0.9649,0.9739,0.9915,0.9915,MillID large,0.0546,0.9915
-hsb_Latn,Upper Sorbian,59,1.0,1.0,0.0,0.0,0.9828,1.0,0.9739,1.0,MillID medium,0.0,1.0
-hun_Latn,Hungarian,59,1.0,1.0,0.3224,0.3224,1.0,0.9916,1.0,1.0,MillID tiny,0.0,0.6776
-nzi_Latn,Nzima,59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-ote_Latn,Mezquital Otomi,59,0.0,0.0,0.0,0.0,0.0,0.0656,0.0656,0.0656,MillID medium,0.0656,0.0656
-hin_Deva,Hindi,59,0.9573,0.9573,0.9752,0.9752,0.6444,0.6067,0.45,0.6444,MillID tiny,-0.3129,-0.3308
-not_Latn,Nomatsiguenga,59,0.9915,0.9915,0.0,0.0,1.0,0.9915,0.9915,1.0,MillID tiny,0.0085,1.0
-nba_Latn,Nyemba,59,0.0,0.0,0.0,0.0,0.0323,0.0,0.0,0.0323,MillID tiny,0.0323,0.0323
-kqn_Latn,Kaonde,59,1.0,1.0,0.0,0.0,0.9915,0.9916,0.9833,0.9916,MillID medium,-0.0084,0.9916
-kbr_Latn,Kafa,59,0.9915,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0085,1.0
-kbp_Latn,Kabiyè,59,1.0,1.0,0.3893,0.3893,0.9291,0.9593,0.9752,0.9752,MillID large,-0.0248,0.5859
-ltz_Latn,Luxembourgish,59,0.9915,0.9915,0.648,0.648,0.9916,0.9916,1.0,1.0,MillID large,0.0085,0.352
-lld_Latn,Ladin,59,0.7312,0.7312,0.0,0.0,0.9464,0.8991,0.8155,0.9464,MillID tiny,0.2152,0.9464
-kin_Latn,Kinyarwanda,59,0.8868,0.8868,0.8571,0.8571,0.8889,0.9412,0.8929,0.9412,MillID medium,0.0544,0.0841
-khm_Khmr,Khmer,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-kdh_Latn,Tem,59,0.8654,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0085,1.0
-wln_Latn,Walloon,59,0.655,0.655,0.0,0.0,0.6552,0.6667,0.6705,0.6705,MillID large,0.0155,0.6705
-xsm_Latn,Kasem,59,0.9915,0.9915,0.0,0.0,0.8544,0.9268,0.9649,0.9649,MillID large,-0.0266,0.9649
-yua_Latn,Yucateco,59,1.0,1.0,0.0,0.0,0.9593,1.0,1.0,1.0,MillID medium,0.0,1.0
-ydd_Hebr,Eastern Yiddish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-als_Latn,Albanian (Tosk),59,1.0,1.0,0.7329,0.7329,1.0,0.9828,0.9828,1.0,MillID tiny,0.0,0.2671
-ame_Latn,Yanesha',59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-ajg_Latn,Aja (Benin),59,0.9916,0.9916,0.0,0.0,0.8741,0.9593,0.9219,0.9593,MillID medium,-0.0323,0.9593
-ada_Latn,Adangme,59,0.9365,0.9365,0.0,0.0,1.0,0.9752,0.9752,1.0,MillID tiny,0.0635,1.0
-xho_Latn,Xhosa,58,1.0,1.0,0.8529,0.8529,0.9381,0.9204,0.8972,0.9381,MillID tiny,-0.0619,0.0852
-vmw_Latn,Makhuwa,58,0.9825,0.9913,0.0,0.0,0.9825,0.9825,0.9735,0.9825,MillID tiny,-0.0088,0.9825
-arn_Latn,Mapuche,58,0.8952,0.9057,0.8175,0.8175,0.9483,0.9744,0.958,0.9744,MillID medium,0.0687,0.1569
-arb_Arab,Arabic (Modern Standard),58,1.0,1.0,1.0,1.0,0.9259,0.9259,0.9455,0.9455,MillID large,-0.0545,-0.0545
-ami_Latn,Amis,58,0.0,0.0,0.0,0.0,0.0,0.0339,0.129,0.129,MillID large,0.129,0.129
-nbl_Latn,South Ndebele,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0333,0.0333,MillID large,0.0333,0.0333
-mkd_Cyrl,Macedonian,58,1.0,1.0,1.0,1.0,0.9831,0.9748,1.0,1.0,MillID large,0.0,0.0
-ndo_Latn,Ndonga,58,0.958,0.958,0.0,0.0,0.9661,0.9431,0.9748,0.9748,MillID large,0.0168,0.9748
-mxv_Latn,Metlatónoc Mixtec,58,0.0,0.0,0.0,0.0,0.0984,0.2154,0.0339,0.2154,MillID medium,0.2154,0.2154
-kal_Latn,Kalaallisut,58,1.0,1.0,0.76,0.76,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.24
-kor_Hang,Korean,58,1.0,1.0,0.8923,0.8923,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1077
-kri_Latn,Krio,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-yap_Latn,Yapese,58,1.0,1.0,0.0,0.0,0.9825,0.9915,1.0,1.0,MillID large,0.0,1.0
-kha_Latn,Khasi,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-kir_Cyrl,Kyrgyz,58,1.0,1.0,0.6237,0.6237,0.9915,1.0,1.0,1.0,MillID medium,0.0,0.3763
-loz_Latn,Lozi,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-kmr_Latn,Northern Kurdish,58,1.0,1.0,0.7582,0.7582,0.955,0.9825,0.9735,0.9825,MillID medium,-0.0175,0.2243
-lit_Latn,Lithuanian,58,1.0,1.0,0.8112,0.8112,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1888
-kea_Latn,Kabuverdianu,58,0.9355,0.9355,0.125,0.1244,0.8112,0.7945,0.8,0.8112,MillID tiny,-0.1243,0.6868
-lij_Latn,Ligurian,58,0.8593,0.8593,0.4872,0.4872,0.9431,0.9587,0.8227,0.9587,MillID medium,0.0994,0.4715
-lad_Latn,Ladino,58,1.0,1.0,0.0,0.0,0.9558,0.9913,0.9828,0.9913,MillID medium,-0.0087,0.9913
-lua_Latn,Luba-Lulua,58,0.7391,0.7391,0.6386,0.6386,0.7708,0.55,0.5316,0.7708,MillID tiny,0.0317,0.1322
-kan_Knda,Kannada,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-kat_Geor,Georgian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-kaz_Cyrl,Kazakh,58,1.0,1.0,0.4444,0.4444,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.5556
-mfq_Latn,Moba,58,1.0,1.0,0.0,0.0,1.0,1.0,0.9744,1.0,MillID tiny,0.0,1.0
-isl_Latn,Icelandic,58,1.0,1.0,0.8345,0.8345,0.9913,0.9455,0.9455,0.9913,MillID tiny,-0.0087,0.1568
-kab_Latn,Kabyle,58,0.9913,0.9913,0.9831,0.9748,0.9825,0.9915,0.9913,0.9915,MillID medium,0.0002,0.0167
-kaa_Cyrl,Kara-Kalpak,58,1.0,1.0,0.0,0.0,1.0,0.9915,1.0,1.0,MillID tiny,0.0,1.0
-ina_Latn,Interlingua,58,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0,1.0
-ilo_Latn,Iloko,58,0.9913,0.9913,0.8593,0.8593,1.0,1.0,1.0,1.0,MillID tiny,0.0087,0.1407
-ita_Latn,Italian,58,1.0,1.0,0.6629,0.6629,1.0,0.9825,0.9828,1.0,MillID tiny,0.0,0.3371
-mam_Latn,Mam,58,0.9455,0.9455,0.0,0.0,0.9174,1.0,0.955,1.0,MillID medium,0.0545,1.0
-mah_Latn,Marshallese,58,1.0,1.0,0.0,0.0,1.0,0.9915,0.9915,1.0,MillID tiny,0.0,1.0
-mai_Deva,Maithili,58,1.0,1.0,1.0,1.0,0.9587,0.8593,0.8923,0.9587,MillID tiny,-0.0413,-0.0413
-lus_Latn,Mizo,58,1.0,0.9915,0.3986,0.3986,0.9915,1.0,1.0,1.0,MillID medium,0.0085,0.6014
-lue_Latn,Luvale,58,0.9913,0.9913,0.0,0.0,0.9587,0.9831,0.9508,0.9831,MillID medium,-0.0082,0.9831
-quc_Latn,Kʼicheʼ,58,0.9174,0.9174,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0826,1.0
-qvc_Latn,Cajamarca Quechua,58,0.9062,0.9062,0.0,0.0,0.8444,0.7891,0.6824,0.8444,MillID tiny,-0.0618,0.8444
-qvh_Latn,Huamalíes-Dos de Mayo Huánuco Quechua,58,0.1538,0.1538,0.0,0.0,0.1587,0.2154,0.0984,0.2154,MillID medium,0.0616,0.2154
-epo_Latn,Esperanto,58,1.0,1.0,0.4234,0.4234,0.9913,0.9825,0.9825,0.9913,MillID tiny,-0.0087,0.5679
-fon_Latn,Fon,58,0.9913,0.9913,0.4979,0.4979,0.782,0.9649,0.8929,0.9649,MillID medium,-0.0264,0.467
-fkv_Latn,Kven Finnish,58,0.6667,0.6667,0.0,0.0,0.7917,0.6966,0.8515,0.8515,MillID large,0.1848,0.8515
-fry_Latn,Western Frisian,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-fra_Latn,French,58,0.9915,0.9915,0.9134,0.9134,0.958,0.9655,0.9655,0.9655,MillID medium,-0.026,0.0521
-run_Latn,Rundi,58,0.8992,0.8992,0.8,0.8,0.906,0.9391,0.9016,0.9391,MillID medium,0.0399,0.1391
-crs_Latn,Seselwa Creole French,58,1.0,1.0,0.0,0.0,0.9739,0.9744,0.9655,0.9744,MillID medium,-0.0256,0.9744
-sco_Latn,Scots,58,0.9735,0.9735,0.0,0.0,0.9739,0.9825,0.9735,0.9825,MillID medium,0.009,0.9825
-rus_Cyrl,Russian,58,0.9667,0.9667,0.7838,0.7838,0.9831,0.9573,0.9661,0.9831,MillID tiny,0.0164,0.1993
-fuf_Latn,Pular,58,0.4828,0.4828,0.0,0.0,0.8972,0.8163,0.9159,0.9159,MillID large,0.4331,0.9159
-glg_Latn,Galician,58,1.0,1.0,0.8286,0.8286,0.9744,0.9913,0.9667,0.9913,MillID medium,-0.0087,0.1627
-guj_Gujr,Gujarati,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-guc_Latn,Wayuu,58,1.0,1.0,0.0,0.0,0.9748,0.9667,1.0,1.0,MillID large,0.0,1.0
-pan_Guru,Punjabi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-pap_Latn,Papiamento,58,0.9915,0.9915,0.725,0.725,0.9825,1.0,1.0,1.0,MillID medium,0.0085,0.275
-pcd_Latn,Picard,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
-glv_Latn,Manx,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-huu_Latn,Murui Huitoto,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-hrv_Latn,Croatian,58,0.7273,0.7273,0.4737,0.4737,0.4974,0.5371,0.5828,0.5828,MillID large,-0.1445,0.1091
-hnj_Latn,Hmong Njua,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
-ibo_Latn,Igbo,58,1.0,1.0,0.8227,0.8227,1.0,0.9915,1.0,1.0,MillID tiny,0.0,0.1773
-hil_Latn,Hiligaynon,58,1.0,1.0,0.0,0.0,1.0,0.9739,0.9825,1.0,MillID tiny,0.0,1.0
-heb_Hebr,Hebrew,58,1.0,1.0,1.0,1.0,1.0,0.9913,0.9913,1.0,MillID tiny,0.0,0.0
-haw_Latn,Hawaiian,58,0.9735,0.9735,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0265,1.0
-nso_Latn,Northern Sotho,58,1.0,1.0,0.9508,0.9508,1.0,1.0,0.9915,1.0,MillID tiny,0.0,0.0492
-nno_Latn,Norwegian Nynorsk,58,1.0,1.0,0.9748,0.9748,0.9739,0.9744,0.9643,0.9744,MillID medium,-0.0256,-0.0004
-nld_Latn,Dutch,58,1.0,1.0,0.703,0.703,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.297
-niu_Latn,Niuean,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-nds_Latn,Low German,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-uzn_Cyrl,Northern Uzbek,58,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0,1.0
-ast_Latn,Asturian,58,1.0,1.0,0.7484,0.7484,0.955,0.9825,0.9735,0.9825,MillID medium,-0.0175,0.2341
-tyv_Cyrl,Tuvinian,58,0.9915,0.9915,0.0,0.0,1.0,0.9915,0.9915,1.0,MillID tiny,0.0085,1.0
-tsn_Latn,Tswana,58,0.9915,0.9915,0.9134,0.9134,1.0,1.0,0.9915,1.0,MillID tiny,0.0085,0.0866
-bci_Latn,Baoulé,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-bel_Cyrl,Belarusian,58,1.0,1.0,0.8345,0.8345,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1655
-bba_Latn,Baatonum,58,0.9913,1.0,0.0,0.0,0.9744,0.9913,0.9828,0.9913,MillID medium,-0.0087,0.9913
-azj_Latn,North Azerbaijani,58,0.9915,0.9915,0.5949,0.5949,0.9915,0.9915,1.0,1.0,MillID large,0.0085,0.4051
-ben_Beng,Bangla,58,1.0,1.0,1.0,1.0,1.0,1.0,0.9913,1.0,MillID tiny,0.0,0.0
-uzn_Latn,Northern Uzbek,58,0.9915,0.9915,0.4056,0.4056,0.9587,0.928,0.8992,0.9587,MillID tiny,-0.0328,0.5531
-vec_Latn,Venetian,58,1.0,1.0,0.8056,0.8056,0.9915,0.9828,0.9667,0.9915,MillID tiny,-0.0085,0.1859
-vep_Latn,Veps,58,1.0,1.0,0.0,0.0,0.9744,0.9913,1.0,1.0,MillID large,0.0,1.0
-zul_Latn,Zulu,58,0.9744,0.9744,0.6073,0.6073,0.8909,0.9107,0.8119,0.9107,MillID medium,-0.0637,0.3034
-tzo_Latn,Tzotzil,58,0.9913,0.9913,0.0,0.0,0.9735,0.9735,0.9735,0.9735,MillID tiny,-0.0178,0.9735
-ukr_Cyrl,Ukrainian,58,1.0,1.0,0.9667,0.9667,0.9913,1.0,0.9735,1.0,MillID medium,0.0,0.0333
-uig_Arab,Uyghur,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-swh_Latn,Swahili,58,0.9825,0.9825,0.5088,0.5088,0.8491,0.9455,0.8785,0.9455,MillID medium,-0.037,0.4367
-tel_Telu,Telugu,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-tet_Latn,Tetum,58,0.1667,0.1667,0.0,0.0,0.6234,0.6986,0.726,0.726,MillID large,0.5593,0.726
-tir_Ethi,Tigrinya,58,1.0,1.0,0.9915,0.9915,1.0,0.9915,1.0,1.0,MillID tiny,0.0,0.0085
-cat_Latn,Catalan,58,1.0,1.0,0.6905,0.6905,0.9828,0.9667,0.9831,0.9831,MillID large,-0.0169,0.2926
-bum_Latn,Bulu,58,0.0984,0.0984,0.0,0.0,0.2424,0.3188,0.4737,0.4737,MillID large,0.3753,0.4737
-bul_Cyrl,Bulgarian,58,1.0,1.0,1.0,1.0,0.9744,0.9913,0.9915,0.9915,MillID large,-0.0085,-0.0085
-cnh_Latn,Hakha Chin,58,0.9915,0.9915,0.0,0.0,0.9344,0.9828,1.0,1.0,MillID large,0.0085,1.0
-ces_Latn,Czech,58,1.0,1.0,0.9508,0.9508,1.0,0.9915,0.9828,1.0,MillID tiny,0.0,0.0492
-chk_Latn,Chuukese,58,1.0,1.0,0.0,0.0,0.9915,1.0,1.0,1.0,MillID medium,0.0,1.0
-sus_Latn,Susu,58,0.9748,0.9748,0.0,0.0,0.9369,0.9643,0.9474,0.9643,MillID medium,-0.0105,0.9643
-srr_Latn,Serer,58,0.9831,0.9831,0.0,0.0,0.9825,1.0,0.9825,1.0,MillID medium,0.0169,1.0
-suk_Latn,Sukuma,58,0.9828,0.9828,0.0,0.0,0.9828,0.9825,0.9913,0.9913,MillID large,0.0085,0.9913
-sme_Latn,Northern Sami,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-eng_Latn,English,58,1.0,1.0,0.5979,0.5979,0.9123,0.9744,0.9573,0.9744,MillID medium,-0.0256,0.3765
-dyu_Latn,Dyula,58,0.4337,0.4337,0.0154,0.0154,0.0,0.0,0.0,0.0,MillID tiny,-0.4337,-0.0154
-tpi_Latn,Tok Pisin,58,1.0,1.0,0.9831,0.9831,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0169
-zyb_Latn,Yongbei Zhuang,57,0.9828,0.9744,0.0,0.0,1.0,0.9744,0.9913,1.0,MillID tiny,0.0256,1.0
-bam_Latn,Bambara,57,0.7519,0.7519,0.1992,0.1969,0.7786,0.6267,0.6145,0.7786,MillID tiny,0.0267,0.5817
-bem_Latn,Bemba,57,1.0,1.0,0.4385,0.4385,0.9912,0.9828,0.9649,0.9912,MillID tiny,-0.0088,0.5527
-toj_Latn,Tojolabal,57,1.0,1.0,0.0,0.0,0.9912,0.9913,1.0,1.0,MillID large,0.0,1.0
-toi_Latn,Tonga (Zambia),57,1.0,1.0,0.0,0.0,0.9828,0.9636,0.9913,0.9913,MillID large,-0.0087,0.9913
-tdt_Latn,Tetun Dili,57,0.6115,0.6115,0.0,0.0,0.2532,0.4884,0.5176,0.5176,MillID large,-0.0939,0.5176
-cbt_Latn,Chayahuita,57,0.9913,0.9913,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0087,1.0
-tah_Latn,Tahitian,57,0.8125,0.8125,0.9661,0.9661,0.9444,0.973,0.9821,0.9821,MillID large,0.1696,0.016
-cha_Latn,Chamorro,57,0.9245,0.9245,0.0,0.0,1.0,0.9825,1.0,1.0,MillID tiny,0.0755,1.0
-sot_Latn,Southern Sotho,57,1.0,1.0,0.7863,0.7863,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2137
-som_Latn,Somali,57,1.0,1.0,0.6994,0.6994,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.3006
-cfm_Latn,Falam Chin,57,0.9821,0.9821,0.0,0.0,0.9913,0.9828,1.0,1.0,MillID large,0.0179,1.0
-tat_Cyrl,Tatar,57,1.0,1.0,0.5938,0.5938,1.0,0.9912,0.9912,1.0,MillID tiny,0.0,0.4062
-cak_Latn,Kaqchikel,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-tgk_Cyrl,Tajik,57,1.0,1.0,0.623,0.623,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.377
-abk_Cyrl,Abkhazian,57,1.0,1.0,0.9913,0.9913,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0087
-tuk_Cyrl,Turkmen,57,1.0,1.0,0.0,0.0,1.0,0.973,0.9912,1.0,MillID tiny,0.0,1.0
-pon_Latn,Pohnpeian,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-pau_Latn,Palauan,57,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0,1.0
-pis_Latn,Pijin,57,0.9913,0.9913,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0087,1.0
-quz_Latn,Cusco Quechua,57,0.8947,0.906,0.0,0.0,0.8174,0.8829,0.887,0.887,MillID large,-0.019,0.887
-fat_Latn,Fanti,57,0.9913,0.9913,0.0,0.0,1.0,0.9744,0.9828,1.0,MillID tiny,0.0087,1.0
-kjh_Cyrl,Khakas,57,0.9913,0.9913,0.0,0.0,0.9828,1.0,0.9913,1.0,MillID medium,0.0087,1.0
-khk_Cyrl,Halh Mongolian,57,0.9912,0.9912,0.8976,0.8976,1.0,1.0,1.0,1.0,MillID tiny,0.0088,0.1024
-kek_Latn,Kekchí,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-mri_Latn,Māori,57,1.0,1.0,0.3826,0.3813,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.6187
-agr_Latn,Aguaruna,57,0.9739,0.9739,0.0,0.0,0.9913,0.9655,0.9492,0.9913,MillID tiny,0.0174,0.9913
-aii_Syrc,Assyrian Neo-Aramaic,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
-koi_Cyrl,Komi-Permyak,57,1.0,1.0,0.0,0.0,0.7191,0.8367,0.8485,0.8485,MillID large,-0.1515,0.8485
-yor_Latn,Yoruba,57,0.9913,0.9913,0.7808,0.7808,1.0,0.9913,1.0,1.0,MillID tiny,0.0087,0.2192
-lao_Laoo,Lao,57,1.0,1.0,1.0,1.0,1.0,1.0,0.9912,1.0,MillID tiny,0.0,0.0
-cbu_Latn,Candoshi-Shapra,57,0.8824,0.8738,0.0,0.0,0.6667,0.3714,0.1846,0.6667,MillID tiny,-0.2071,0.6667
-qvn_Latn,North Junín Quechua,57,0.4595,0.4595,0.0,0.0,0.2609,0.2188,0.0952,0.2609,MillID tiny,-0.1986,0.2609
-quh_Latn,South Bolivian Quechua,57,0.9369,0.9649,0.0,0.0,0.9655,0.9828,0.9661,0.9828,MillID medium,0.0179,0.9828
-qxn_Latn,Northern Conchucos Ancash Quechua,57,0.0345,0.0345,0.0,0.0,0.0339,0.0345,0.0,0.0345,MillID medium,0.0,0.0345
-fao_Latn,Faroese,57,1.0,1.0,0.7473,0.7473,1.0,0.9913,0.9913,1.0,MillID tiny,0.0,0.2527
-sid_Latn,Sidamo,57,0.9268,0.9268,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0732,1.0
-sah_Cyrl,Yakut,57,0.958,0.958,0.0,0.0,1.0,0.9913,1.0,1.0,MillID tiny,0.042,1.0
-dag_Latn,Dagbani,57,0.9739,0.9739,0.0,0.0,0.9739,0.9825,0.9412,0.9825,MillID medium,0.0086,0.9825
-rup_Latn,Aromanian,57,1.0,1.0,0.0,0.0,0.9913,0.9913,0.9913,0.9913,MillID tiny,-0.0087,0.9913
-div_Thaa,Divehi,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-pbb_Latn,Páez,56,0.7126,0.7126,0.0,0.0,0.5455,0.8485,0.8454,0.8485,MillID medium,0.1359,0.8485
-gle_Latn,Irish,56,0.9825,0.9825,1.0,1.0,1.0,0.9912,0.9912,1.0,MillID tiny,0.0175,0.0
-bho_Deva,Bhojpuri,56,0.9333,0.9333,0.8317,0.8317,0.7872,0.6429,0.6966,0.7872,MillID tiny,-0.1461,-0.0445
-slk_Latn,Slovak,56,1.0,1.0,0.9256,0.9256,0.9912,0.9821,0.9912,0.9912,MillID tiny,-0.0088,0.0656
-ura_Latn,Urarina,56,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-azj_Cyrl,North Azerbaijani,56,1.0,1.0,0.0,0.0,1.0,0.9912,1.0,1.0,MillID tiny,0.0,1.0
-shn_Mymr,Shan,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
-ady_Cyrl,Adyghe,56,0.9818,0.9818,0.6707,0.6707,0.9725,0.991,0.9818,0.991,MillID medium,0.0092,0.3203
-mya_Mymr,Burmese,56,1.0,1.0,0.6707,0.6707,0.9818,0.991,1.0,1.0,MillID large,0.0,0.3293
-mos_Latn,Mossi,56,1.0,1.0,0.855,0.855,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.145
-lun_Latn,Lunda,56,0.991,0.991,0.0,0.0,1.0,1.0,0.9912,1.0,MillID tiny,0.009,1.0
-pcm_Latn,Nigerian Pidgin,56,0.9402,0.9412,0.8627,0.955,0.9912,0.9825,1.0,1.0,MillID large,0.0588,0.045
-yrk_Cyrl,Nenets,55,0.972,0.972,0.0,0.0,0.972,0.9815,0.9815,0.9815,MillID medium,0.0095,0.9815
-mnw_Mymr,Mon,55,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-yad_Latn,Yagua,55,0.9815,0.9815,0.0,0.0,0.9908,1.0,1.0,1.0,MillID medium,0.0185,1.0
-dyo_Latn,Jola-Fonyi,55,0.9908,1.0,0.0,0.0,0.9908,0.9815,0.9818,0.9908,MillID tiny,-0.0092,0.9908
-san_Deva,Sanskrit,55,0.9908,0.9908,0.973,0.973,0.9908,0.9908,0.9815,0.9908,MillID tiny,0.0,0.0178
-npi_Deva,Nepali,55,0.9908,0.9908,0.9565,0.9565,1.0,1.0,1.0,1.0,MillID tiny,0.0092,0.0435
-ido_Latn,Ido,55,1.0,1.0,0.0,0.0,0.9908,0.9815,0.955,0.9908,MillID tiny,-0.0092,0.9908
-tem_Latn,Timne,55,1.0,1.0,0.0,0.0,1.0,0.991,1.0,1.0,MillID tiny,0.0,1.0
-kbd_Cyrl,Kabardian,55,0.9735,0.9735,0.0,0.0,0.9735,0.991,0.9821,0.991,MillID medium,0.0175,0.991
-koo_Latn,Konzo,54,0.9615,0.9615,0.0,0.0,0.9515,0.9714,1.0,1.0,MillID large,0.0385,1.0
-dje_Latn,Zarma,54,0.9412,0.9515,0.0,0.0,0.9412,0.8866,0.875,0.9412,MillID tiny,-0.0103,0.9412
-mag_Deva,Magahi,53,0.9444,0.9444,0.6323,0.6323,0.8333,0.7963,0.7928,0.8333,MillID tiny,-0.1111,0.201
-plt_Latn,Malagasy (Plateau),53,1.0,0.9907,0.955,0.955,1.0,1.0,1.0,1.0,MillID tiny,0.0093,0.045
-cni_Latn,Asháninka,52,0.963,0.963,0.0,0.0,0.75,0.7075,0.7482,0.75,MillID tiny,-0.213,0.75
-yao_Latn,Yao,52,0.9903,0.9903,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0097,1.0
-idu_Latn,Idoma,51,0.8791,0.9375,0.0,0.0,0.7407,0.9278,0.7711,0.9278,MillID medium,-0.0097,0.9278
-alt_Cyrl,Southern Altai,51,0.9623,0.9623,0.6986,0.6986,0.9714,0.9903,0.9903,0.9903,MillID medium,0.028,0.2917
-amh_Ethi,Amharic,51,1.0,1.0,0.8409,0.8409,1.0,0.9901,1.0,1.0,MillID tiny,0.0,0.1591
-kde_Latn,Makonde,51,0.9703,0.9703,0.0,0.0,0.8958,0.9184,0.8913,0.9184,MillID medium,-0.0519,0.9184
-mto_Latn,Totontepec Mixe,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
-miq_Latn,Mískito,51,1.0,1.0,0.0,0.0,1.0,1.0,0.9808,1.0,MillID tiny,0.0,1.0
-zdj_Latn,Ngazidja Comorian,50,0.9796,0.9899,0.0,0.0,0.9901,1.0,1.0,1.0,MillID medium,0.0101,1.0
-nyn_Latn,Nyankole,50,0.9796,0.9796,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0204,1.0
-yue_Hani,Cantonese,49,0.5797,0.5797,0.1108,0.1108,0.7473,0.6522,0.5714,0.7473,MillID tiny,0.1676,0.6365
-lug_Latn,Ganda,49,1.0,1.0,0.359,0.359,0.9796,0.9897,1.0,1.0,MillID large,0.0,0.641
-eve_Cyrl,Even,49,0.8864,0.8864,0.0,0.0,1.0,0.9897,1.0,1.0,MillID tiny,0.1136,1.0
-gyr_Latn,Guarayu,49,0.9897,0.9897,0.0,0.0,0.5797,0.339,0.1818,0.5797,MillID tiny,-0.41,0.5797
-gug_Latn,Paraguayan Guaraní,49,1.0,1.0,0.2367,0.2367,0.98,0.9515,0.9899,0.9899,MillID large,-0.0101,0.7532
-wuu_Hani,Wu Chinese,48,0.5562,0.5529,0.0,0.0,0.5875,0.6277,0.5874,0.6277,MillID medium,0.0748,0.6277
-nan_Hani,Min Nan Chinese,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
-hak_Hani,Hakka Chinese,48,0.0408,0.0408,0.0,0.0,0.0714,0.0,0.0,0.0714,MillID tiny,0.0306,0.0714
-bin_Latn,Bini,47,0.9318,0.9318,0.0,0.0,0.9438,0.9892,1.0,1.0,MillID large,0.0682,1.0
-lia_Latn,West-Central Limba,45,1.0,1.0,0.0,0.0,0.9888,0.9888,1.0,1.0,MillID large,0.0,1.0
-ike_Cans,Eastern Canadian Inuktitut,44,0.9778,0.9778,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0222,1.0
-oss_Cyrl,Ossetic,44,1.0,1.0,0.9778,0.9778,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0222
-ojb_Cans,Northwestern Ojibwa,43,0.9639,0.9639,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0361,1.0
-cbs_Latn,Cashinahua,43,0.9647,0.9647,0.0,0.0,0.9882,0.9885,1.0,1.0,MillID large,0.0353,1.0
-ese_Latn,Ese Ejja,35,0.9855,0.9855,0.0,0.0,1.0,0.9855,1.0,1.0,MillID tiny,0.0145,1.0
-tzh_Latn,Tzeltal,25,0.9804,0.9804,0.0,0.0,0.9434,0.9434,0.9615,0.9615,MillID large,-0.0189,0.9615
-chv_Cyrl,Chuvash,25,1.0,1.0,0.9434,0.9434,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0566
-taj_Deva,Eastern Tamang,1,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
-tzm_Tfng,Central Atlas Tamazight,1,0.0645,0.0645,0.0328,0.0328,0.1,0.3333,0.1429,0.3333,MillID medium,0.2688,0.3005
+label,language,support,GlotLID,GlotLID restricted,fastText,fastText restricted,MillID tiny,MillID medium,MillID large,MillID tiny v1.5,MillID medium v1.5,MillID large v1.5,best MillID,best MillID model,gain over GlotLID restricted,gain over fastText restricted
+roh_Latn,Romansh,399,0.9987,0.9987,0.9455,0.9455,0.9887,0.9912,0.9937,0.9937,0.9937,0.9975,0.9975,MillID large v1.5,-0.0012,0.052
+oci_Latn,Occitan,398,0.3755,0.3755,0.4355,0.4355,0.2912,0.3312,0.3136,0.2771,0.2955,0.3382,0.3382,MillID large v1.5,-0.0373,-0.0973
+cmn_Hani,Chinese (Mandarin),319,0.8681,0.8681,0.4676,0.4676,0.8748,0.886,0.8571,0.8921,0.858,0.875,0.8921,MillID tiny v1.5,0.024,0.4245
+krl_Latn,Karelian,183,0.0109,0.0109,0.0,0.0,0.0,0.0,0.0,0.0,0.0323,0.0,0.0323,MillID medium v1.5,0.0214,0.0323
+qug_Latn,Chimborazo Highland Quichua,182,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0109,0.0,0.0,0.0109,MillID tiny v1.5,0.0109,0.0109
+acu_Latn,Achuar-Shiwiar,180,0.8535,0.8535,0.0,0.0,0.85,0.7431,0.7324,0.828,0.8348,0.8013,0.85,MillID tiny,-0.0035,0.85
+hus_Latn,Huastec,175,0.9855,0.9855,0.0,0.0,0.9583,0.9914,0.9914,0.9766,0.9796,0.9884,0.9914,MillID medium,0.0059,0.9914
+hau_Latn,Hausa,155,1.0,1.0,0.8757,0.8757,0.9968,0.9968,0.9968,0.9904,0.9968,1.0,1.0,MillID large v1.5,0.0,0.1243
+auc_Latn,Waorani,154,0.0,0.0,0.0,0.0,0.0,0.0503,0.0,0.0,0.0129,0.0255,0.0503,MillID medium,0.0503,0.0503
+kwi_Latn,Awa-Cuaiquer,145,0.8769,0.8769,0.0,0.0,0.7712,0.775,0.7967,0.8803,0.8446,0.8627,0.8803,MillID tiny v1.5,0.0034,0.8803
+jpn_Jpan,Japanese,140,1.0,1.0,0.9437,0.9437,1.0,1.0,1.0,1.0,0.9825,1.0,1.0,MillID tiny,0.0,0.0563
+snn_Latn,Siona,136,0.5137,0.5137,0.0,0.0,0.3931,0.7731,0.6207,0.6305,0.7698,0.4667,0.7731,MillID medium,0.2594,0.7731
+ktu_Latn,Kituba (Democratic Republic of Congo),118,0.6803,0.6803,0.0,0.0,0.7546,0.7687,0.7528,0.7653,0.7758,0.773,0.7758,MillID medium v1.5,0.0955,0.7758
+lat_Latn,Latin,118,0.9915,0.9915,0.0,0.0,0.9957,0.9958,0.9958,0.9957,0.9915,0.9957,0.9958,MillID medium,0.0043,0.9958
+hat_Latn,Haitian Creole,117,0.9785,0.9785,0.6988,0.6988,0.9872,0.9914,0.9871,0.9915,0.9782,0.9871,0.9915,MillID tiny v1.5,0.013,0.2927
+twi_Latn,Twi,116,0.9957,0.9957,0.3993,0.3959,0.9957,0.9871,0.9829,0.9831,0.9914,0.9914,0.9957,MillID tiny,0.0,0.5998
+rmn_Latn,Balkan Romani,116,0.8571,0.8571,0.0,0.0,0.7213,0.6667,0.7351,0.678,0.6818,0.7039,0.7351,MillID large,-0.122,0.7351
+kmb_Latn,Kimbundu,116,1.0,1.0,0.8775,0.8775,0.9914,0.9787,0.9914,0.9702,0.9914,0.9914,0.9914,MillID tiny,-0.0086,0.1139
+nya_Latn,Nyanja,116,1.0,1.0,0.8056,0.8056,0.9784,0.9871,0.9655,0.9913,0.9828,0.9784,0.9913,MillID tiny v1.5,-0.0087,0.1857
+chr_Cher,Cherokee,115,0.6628,0.6628,0.0,0.0,0.6705,0.7151,0.7293,0.6705,0.7766,0.945,0.945,MillID large v1.5,0.2822,0.945
+ell_Grek,Greek,115,1.0,1.0,1.0,1.0,0.6705,0.655,0.6705,0.6705,0.6705,0.6705,0.6705,MillID tiny,-0.3295,-0.3295
+lvs_Latn,Standard Latvian,115,1.0,1.0,0.9914,0.9914,0.9957,0.9957,0.9957,0.9868,1.0,1.0,1.0,MillID medium v1.5,0.0,0.0086
+kng_Latn,Koongo,115,0.1928,0.1928,0.4571,0.4571,0.1014,0.0469,0.1014,0.0758,0.0625,0.0469,0.1014,MillID tiny,-0.0914,-0.3557
+pov_Latn,Upper Guinea Crioulo,115,0.8325,0.8325,0.0,0.0,0.8442,0.8384,0.8384,0.8205,0.9302,0.8265,0.9302,MillID medium v1.5,0.0977,0.9302
+por_Latn,Portuguese,115,0.9957,0.9957,0.7931,0.7931,0.9784,0.9957,0.9826,0.9554,1.0,1.0,1.0,MillID medium v1.5,0.0043,0.2069
+cjk_Latn,Chokwe,114,1.0,1.0,0.5327,0.5327,0.8878,0.9493,0.9493,0.8713,0.9143,0.9589,0.9589,MillID large v1.5,-0.0411,0.4262
+tha_Thai,Thai,114,1.0,1.0,0.9956,0.9956,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0044
+tso_Latn,Tsonga,114,0.7807,0.7807,0.6909,0.6909,0.7432,0.8824,0.8426,0.86,0.7609,0.7742,0.8824,MillID medium,0.1017,0.1915
+fas_Arab,Persian,114,1.0,1.0,0.9344,0.9344,0.9821,0.9912,0.973,0.9912,0.9912,0.9821,0.9912,MillID medium,-0.0088,0.0568
+lin_Latn,Lingala,110,1.0,1.0,0.9864,0.9864,0.9735,1.0,0.9692,0.991,0.991,0.9955,1.0,MillID medium,0.0,0.0136
+fuv_Latn,Nigerian Fulfulde,108,0.6813,0.6885,0.4747,0.4747,0.5096,0.4051,0.519,0.6588,0.3504,0.5732,0.6588,MillID tiny v1.5,-0.0297,0.1841
+urd_Arab,Urdu,108,0.986,0.986,0.6353,0.6353,0.9907,0.9953,0.9953,0.9907,0.9859,0.9811,0.9953,MillID medium,0.0093,0.36
+umb_Latn,Umbundu,107,0.9906,0.9906,0.9083,0.9083,0.9091,0.8737,0.8854,0.9662,0.8511,0.9612,0.9662,MillID tiny v1.5,-0.0244,0.0579
+mal_Mlym,Malayalam,100,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+ron_Latn,Romanian,97,1.0,1.0,0.8727,0.8727,1.0,0.9949,0.9949,0.9949,0.9948,0.9948,1.0,MillID tiny,0.0,0.1273
+ven_Latn,Venda,89,1.0,1.0,0.0,0.0,1.0,1.0,0.9944,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+spa_Latn,Spanish,78,0.9872,0.9872,0.5571,0.5571,0.956,0.9872,0.987,0.974,0.9744,0.9935,0.9935,MillID large v1.5,0.0063,0.4364
+hye_Armn,Armenian,70,1.0,1.0,0.9855,0.9855,0.9855,0.9928,0.9855,1.0,0.9855,0.9928,1.0,MillID tiny v1.5,0.0,0.0145
+tam_Taml,Tamil,68,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+deu_Latn,German,67,1.0,1.0,0.9571,0.9571,1.0,1.0,0.9925,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0429
+tiv_Latn,Tiv,67,1.0,1.0,0.0,0.0,1.0,0.9926,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+pam_Latn,Pampanga,66,1.0,1.0,0.0,0.0,0.9925,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0,1.0
+sun_Latn,Sundanese,66,0.9924,0.9924,0.7692,0.7692,0.9606,0.9767,0.9924,0.9924,0.9925,1.0,1.0,MillID large v1.5,0.0076,0.2308
+knc_Latn,Central Kanuri,64,1.0,1.0,0.4384,0.4384,0.9921,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0,0.5616
+njo_Latn,Ao Naga,64,0.9921,0.9921,0.0,0.0,0.9922,0.9922,1.0,1.0,1.0,0.9846,1.0,MillID large,0.0079,1.0
+skr_Arab,Saraiki,63,0.5,0.5,0.0,0.0,0.8,0.9231,0.8545,0.8673,0.9138,0.875,0.9231,MillID medium,0.4231,0.9231
+smo_Latn,Samoan,63,1.0,1.0,0.7922,0.7922,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2078
+mcf_Latn,Matsés,62,0.992,0.992,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.008,1.0
+shp_Latn,Shipibo-Conibo,62,0.9123,0.9123,0.0,0.0,0.5581,0.4103,0.8077,0.4691,0.4524,0.6067,0.8077,MillID large,-0.1046,0.8077
+cbi_Latn,Chachi,62,0.9919,0.9919,0.0,0.0,0.976,1.0,0.9919,0.9841,1.0,0.9919,1.0,MillID medium,0.0081,1.0
+gla_Latn,Scottish Gaelic,62,0.9836,0.9836,0.9587,0.9587,0.992,0.976,0.9919,0.9919,1.0,1.0,1.0,MillID medium v1.5,0.0164,0.0413
+nob_Latn,Norwegian Bokmål,62,0.9764,0.9764,0.992,0.992,0.9606,0.9516,0.9365,0.9134,0.8955,0.9593,0.9606,MillID tiny,-0.0158,-0.0314
+ace_Latn,Acehnese,61,0.9917,0.9917,0.5357,0.5357,0.9756,0.9833,0.9917,1.0,0.9748,0.9917,1.0,MillID tiny v1.5,0.0083,0.4643
+swe_Latn,Swedish,61,1.0,1.0,1.0,1.0,0.9917,1.0,1.0,0.9917,1.0,1.0,1.0,MillID medium,0.0,0.0
+amr_Latn,Amarakaeri,61,0.976,0.976,0.0,0.0,0.9833,1.0,1.0,0.9919,0.9833,0.9833,1.0,MillID medium,0.024,1.0
+pnb_Arab,Western Panjabi,61,0.7394,0.7394,0.0,0.0,0.8451,0.9313,0.8841,0.8824,0.9104,0.8841,0.9313,MillID medium,0.1919,0.9313
+boa_Latn,Bora,61,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+sey_Latn,Secoya,61,0.5744,0.5888,0.0,0.0,0.3959,0.5839,0.5714,0.5799,0.5538,0.5263,0.5839,MillID medium,-0.0049,0.5839
+dan_Latn,Danish,61,0.9833,0.9833,0.9677,0.9677,0.9587,0.9587,0.9516,0.9431,0.9231,0.9516,0.9587,MillID tiny,-0.0246,-0.009
+fin_Latn,Finnish,61,1.0,1.0,0.2998,0.2998,0.9919,0.9836,0.9661,1.0,0.9431,0.9752,1.0,MillID tiny v1.5,0.0,0.7002
+udu_Latn,Uduk,60,1.0,1.0,0.0,0.0,0.9917,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0,1.0
+cbr_Latn,Cashibo-Cacataibo,60,1.0,1.0,0.0,0.0,1.0,0.9917,0.9917,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+cab_Latn,Garifuna,60,0.9831,0.9831,0.0,0.0,0.9917,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0169,1.0
+zgh_Tfng,Standard Moroccan Tamazight,60,0.4615,0.4615,0.0,0.0,0.5185,0.8235,0.7368,0.75,0.7879,0.6517,0.8235,MillID medium,0.362,0.8235
+ban_Latn,Balinese,60,1.0,1.0,0.5607,0.5607,0.9916,0.9831,0.9744,0.9744,0.9916,0.9833,0.9916,MillID tiny,-0.0084,0.4309
+arl_Latn,Arabela,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+afr_Latn,Afrikaans,60,1.0,1.0,0.944,0.944,1.0,1.0,1.0,0.9916,1.0,1.0,1.0,MillID tiny,0.0,0.056
+war_Latn,Waray,60,0.9917,0.9917,0.944,0.944,0.9748,1.0,1.0,0.9836,0.9917,1.0,1.0,MillID medium,0.0083,0.056
+mad_Latn,Madurese,60,0.9748,0.9748,0.0,0.0,0.9752,0.9655,0.9752,0.9833,0.9565,0.9833,0.9833,MillID tiny v1.5,0.0085,0.9833
+mcd_Latn,Sharanahua,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+ind_Latn,Indonesian,60,0.9027,0.9027,0.5652,0.5652,0.6136,0.6739,0.6444,0.7677,0.7423,0.6452,0.7677,MillID tiny v1.5,-0.135,0.2025
+jav_Latn,Javanese,60,0.9916,0.9916,0.513,0.513,0.9833,0.9672,0.9593,0.9833,0.944,0.9833,0.9833,MillID tiny,-0.0083,0.4703
+jiv_Latn,Shuar,60,0.8027,0.8027,0.0,0.0,0.7703,0.7066,0.7317,0.8227,0.7797,0.7284,0.8227,MillID tiny v1.5,0.02,0.8227
+wol_Latn,Wolof,60,1.0,1.0,0.2362,0.2362,0.9836,0.9836,0.9916,0.9917,0.9916,0.9833,0.9917,MillID tiny v1.5,-0.0083,0.7555
+gjn_Latn,Gonja,60,0.9831,0.9831,0.0,0.0,0.9831,0.9916,0.9831,0.9916,0.9744,0.9833,0.9916,MillID medium,0.0085,0.9916
+quy_Latn,Ayacucho Quechua,60,0.7763,0.7763,0.1039,0.1039,0.7117,0.6747,0.76,0.6744,0.7246,0.6835,0.76,MillID large,-0.0163,0.6561
+ekk_Latn,Estonian,60,1.0,1.0,0.3448,0.3448,1.0,1.0,1.0,0.9917,0.9916,1.0,1.0,MillID tiny,0.0,0.6552
+ctd_Latn,Tedim Chin,60,0.6957,0.7234,0.0,0.0,0.5185,0.7879,0.8,0.6047,0.7292,0.7755,0.8,MillID large,0.0766,0.8
+ton_Latn,Tongan,60,0.9917,0.9917,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0083,1.0
+bug_Latn,Buginese,60,1.0,1.0,0.5742,0.5742,0.9916,0.9655,0.9565,0.9298,0.9916,0.9916,0.9916,MillID tiny,-0.0084,0.4174
+bod_Tibt,Tibetan,60,0.9009,0.9009,0.8992,0.8992,0.9661,0.9748,0.9672,0.9748,0.9748,0.9483,0.9748,MillID medium,0.0739,0.0756
+vie_Latn,Vietnamese,60,1.0,1.0,0.9524,0.9524,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0476
+zam_Latn,Miahuatlán Zapotec,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
+gaz_Latn,Oromo (West Central),60,0.9752,0.9752,0.5381,0.5381,0.9831,0.9916,0.9744,0.958,1.0,0.9917,1.0,MillID medium v1.5,0.0248,0.4619
+cpu_Latn,Pichis Ashéninka,60,0.9744,0.9744,0.0,0.0,0.6593,0.5714,0.6667,0.7292,0.4416,0.5714,0.7292,MillID tiny v1.5,-0.2452,0.7292
+sna_Latn,Shona,60,0.9917,0.9917,0.5729,0.5729,0.9833,0.9836,1.0,0.9756,0.9752,0.9836,1.0,MillID large,0.0083,0.4271
+cym_Latn,Welsh,60,1.0,1.0,0.8108,0.8108,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1892
+qvm_Latn,Margos-Yarowilca-Lauricocha Quechua,60,0.5,0.5,0.0,0.0,0.125,0.0938,0.1818,0.3562,0.0328,0.3562,0.3562,MillID tiny v1.5,-0.1438,0.3562
+fil_Latn,Filipino,60,1.0,1.0,0.553,0.553,0.9831,0.9916,0.9916,1.0,0.9836,0.9917,1.0,MillID tiny v1.5,0.0,0.447
+tbz_Latn,Ditammari,60,0.3784,0.3784,0.0,0.0,0.0,0.3333,0.2609,0.0,0.3333,0.209,0.3333,MillID medium,-0.0451,0.3333
+cot_Latn,Caquinte,60,0.9916,0.9916,0.0,0.0,0.9916,0.9831,1.0,0.9916,0.9916,0.9916,1.0,MillID large,0.0084,1.0
+tca_Latn,Ticuna,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+ayr_Latn,Central Aymara,59,1.0,1.0,0.716,0.716,0.8992,1.0,0.9916,0.9916,0.9831,0.9587,1.0,MillID medium,0.0,0.284
+tur_Latn,Turkish,59,0.9916,0.9916,0.59,0.59,0.9421,0.9833,0.9916,0.9833,0.9286,0.9916,0.9916,MillID large,0.0,0.4016
+uig_Latn,Uyghur,59,0.9833,0.9752,0.0,0.0,1.0,0.9916,1.0,0.9833,0.9916,1.0,1.0,MillID tiny,0.0248,1.0
+bis_Latn,Bislama,59,1.0,1.0,0.7516,0.7516,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2484
+bcl_Latn,Central Bikol,59,0.9916,0.9916,0.0,0.0,0.9916,0.9916,1.0,0.9915,0.9831,0.9916,1.0,MillID large,0.0084,1.0
+bos_Latn,Bosnian,59,0.3121,0.3121,0.1979,0.1979,0.1803,0.2281,0.237,0.2,0.1205,0.1913,0.237,MillID large,-0.0751,0.0391
+bre_Latn,Breton,59,0.9915,0.9915,0.0,0.0,0.9916,1.0,0.9833,0.9831,0.9833,1.0,1.0,MillID medium,0.0085,1.0
+tly_Latn,Talysh,59,0.9915,0.9915,0.0,0.0,0.9915,0.9915,1.0,0.9915,0.9915,0.9915,1.0,MillID large,0.0085,1.0
+ceb_Latn,Cebuano,59,1.0,1.0,0.6146,0.6146,0.9916,0.9833,0.9833,0.9916,0.9831,1.0,1.0,MillID large v1.5,0.0,0.3854
+tob_Latn,Toba,59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+top_Latn,Papantla Totonac,59,0.9916,0.9916,0.0,0.0,0.9828,0.9833,0.9831,0.958,0.9916,1.0,1.0,MillID large v1.5,0.0084,1.0
+tuk_Latn,Turkmen,59,1.0,1.0,0.9672,0.9672,0.9739,0.9916,1.0,0.9828,1.0,1.0,1.0,MillID large,0.0,0.0328
+tsz_Latn,Purepecha,59,0.9655,0.9744,0.0,0.0,0.9739,0.9915,0.9915,0.9739,0.9655,1.0,1.0,MillID large v1.5,0.0256,1.0
+fur_Latn,Friulian,59,1.0,1.0,0.6082,0.6051,0.9748,1.0,0.9748,0.9667,0.9916,1.0,1.0,MillID medium,0.0,0.3949
+gaa_Latn,Ga,59,0.9916,0.9833,0.0,0.0,0.9916,0.9916,0.9752,0.9752,0.9916,0.9672,0.9916,MillID tiny,0.0083,0.9916
+gag_Latn,Gagauz,59,0.9915,0.9915,0.0,0.0,0.9565,0.9828,0.9915,0.9828,0.9828,0.9915,0.9915,MillID large,0.0,0.9915
+gsw_Latn,Swiss German,59,0.9915,0.9915,0.0,0.0,0.7097,0.8081,0.9649,0.8462,0.75,0.9273,0.9649,MillID large,-0.0266,0.9649
+pol_Latn,Polish,59,1.0,1.0,0.7296,0.7296,0.9831,0.9655,0.9915,0.9916,0.9916,0.9833,0.9916,MillID tiny v1.5,-0.0084,0.262
+qva_Latn,Ambo-Pasco Quechua,59,0.0328,0.0328,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.0328,0.0
+eus_Latn,Basque,59,1.0,1.0,0.8923,0.8923,0.9219,0.9672,0.9752,0.9219,0.944,0.9833,0.9833,MillID large v1.5,-0.0167,0.091
+qwh_Latn,Huaylas Ancash Quechua,59,0.6545,0.6545,0.0,0.0,0.3982,0.4955,0.5698,0.494,0.3945,0.5306,0.5698,MillID large,-0.0847,0.5698
+srp_Latn,Serbian,59,0.45,0.45,0.0,0.0,0.3689,0.4754,0.4167,0.3486,0.4882,0.4074,0.4882,MillID medium v1.5,0.0382,0.4882
+ssw_Latn,Swati,59,1.0,1.0,0.9516,0.9516,0.9916,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0,0.0484
+cnr_Latn,Serbian (Montenegro),59,0.0303,0.0303,0.0,0.0,0.0,0.0,0.0,0.0,0.0323,0.0,0.0323,MillID medium v1.5,0.002,0.0323
+srp_Cyrl,Serbian,59,0.9915,0.9915,0.9915,0.9915,0.9828,0.9828,0.9915,0.9915,0.9915,0.9915,0.9915,MillID large,0.0,0.0
+slv_Latn,Slovenian,59,0.9752,0.9752,0.8027,0.8027,0.9474,0.9483,0.9587,0.9661,0.9593,0.9831,0.9831,MillID large v1.5,0.0079,0.1804
+cof_Latn,Colorado,59,0.9273,0.9369,0.0,0.0,0.9655,1.0,0.9915,1.0,0.9831,0.9831,1.0,MillID medium,0.0631,1.0
+cos_Latn,Corsican,59,0.9915,0.9915,0.0,0.0,0.9915,0.9916,0.9831,1.0,1.0,0.9831,1.0,MillID tiny v1.5,0.0085,1.0
+cjs_Cyrl,Shor,59,0.9369,0.9369,0.0,0.0,0.9464,0.9649,0.9649,0.9558,0.9649,0.9739,0.9739,MillID large v1.5,0.037,0.9739
+fij_Latn,Fijian,59,1.0,1.0,0.9752,0.9752,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0248
+rar_Latn,Rarotongan,59,1.0,1.0,0.0,0.0,0.9916,1.0,1.0,1.0,0.9916,1.0,1.0,MillID medium,0.0,1.0
+sin_Sinh,Sinhala,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+sag_Latn,Sango,59,0.5783,0.5783,0.1892,0.1892,0.9915,0.9915,0.9915,0.9915,0.9649,0.9915,0.9915,MillID tiny,0.4132,0.8023
+ewe_Latn,Ewe,59,1.0,1.0,0.6517,0.6517,1.0,1.0,0.9833,0.9916,1.0,1.0,1.0,MillID tiny,0.0,0.3483
+dzo_Tibt,Dzongkha,59,0.9134,0.9134,0.8571,0.8571,0.9667,0.9748,0.9655,0.9748,0.9748,0.9508,0.9748,MillID medium,0.0614,0.1177
+dga_Latn,Southern Dagaare,59,0.9915,1.0,0.0,0.0,0.9365,0.9915,0.9667,1.0,0.9916,0.9831,1.0,MillID tiny v1.5,0.0,1.0
+crh_Latn,Crimean Tatar,59,1.0,1.0,0.8551,0.8551,0.9833,0.9916,0.9672,0.9916,0.9365,0.9833,0.9916,MillID medium,-0.0084,0.1365
+mar_Deva,Marathi,59,1.0,1.0,1.0,1.0,1.0,0.9916,0.9916,1.0,0.9915,1.0,1.0,MillID tiny,0.0,0.0
+maz_Latn,Central Mazahua,59,0.9391,0.9391,0.0,0.0,0.725,0.7421,0.8227,0.7891,0.7662,0.8138,0.8227,MillID large,-0.1164,0.8227
+nav_Latn,Navajo,59,1.0,1.0,0.7024,0.7024,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2976
+mor_Latn,Moro,59,0.9915,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0085,1.0
+min_Latn,Minangkabau,59,0.9916,0.9916,0.127,0.127,1.0,0.9915,1.0,0.9916,1.0,1.0,1.0,MillID tiny,0.0084,0.873
+mlt_Latn,Maltese,59,1.0,1.0,0.8939,0.8939,0.9916,1.0,1.0,1.0,0.9916,1.0,1.0,MillID medium,0.0,0.1061
+men_Latn,Mende,59,0.9916,0.9916,0.0,0.0,0.9516,0.9916,0.9752,1.0,0.9916,0.9916,1.0,MillID tiny v1.5,0.0084,1.0
+mic_Latn,Mi'kmaw,59,0.4267,0.4267,0.0,0.0,0.9828,1.0,1.0,0.9915,0.9915,1.0,1.0,MillID medium,0.5733,1.0
+hns_Latn,Caribbean Hindustani,59,0.9369,0.9369,0.0,0.0,0.9649,0.9739,0.9915,0.9273,0.9828,0.9739,0.9915,MillID large,0.0546,0.9915
+hsb_Latn,Upper Sorbian,59,1.0,1.0,0.0,0.0,0.9828,1.0,0.9739,1.0,0.9828,0.9915,1.0,MillID medium,0.0,1.0
+hun_Latn,Hungarian,59,1.0,1.0,0.3224,0.3224,1.0,0.9916,1.0,1.0,1.0,0.9833,1.0,MillID tiny,0.0,0.6776
+nzi_Latn,Nzima,59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,0.9916,1.0,MillID tiny,0.0,1.0
+ote_Latn,Mezquital Otomi,59,0.0,0.0,0.0,0.0,0.0,0.0656,0.0656,0.1538,0.0645,0.0656,0.1538,MillID tiny v1.5,0.1538,0.1538
+hin_Deva,Hindi,59,0.9573,0.9573,0.9752,0.9752,0.6444,0.6067,0.45,0.7234,0.7097,0.7273,0.7273,MillID large v1.5,-0.23,-0.2479
+not_Latn,Nomatsiguenga,59,0.9915,0.9915,0.0,0.0,1.0,0.9915,0.9915,0.9831,0.9915,1.0,1.0,MillID tiny,0.0085,1.0
+nba_Latn,Nyemba,59,0.0,0.0,0.0,0.0,0.0323,0.0,0.0,0.0328,0.0,0.0,0.0328,MillID tiny v1.5,0.0328,0.0328
+kqn_Latn,Kaonde,59,1.0,1.0,0.0,0.0,0.9915,0.9916,0.9833,0.9831,1.0,0.9831,1.0,MillID medium v1.5,0.0,1.0
+kbr_Latn,Kafa,59,0.9915,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,1.0,0.9916,1.0,MillID tiny,0.0085,1.0
+kbp_Latn,Kabiyè,59,1.0,1.0,0.3893,0.3893,0.9291,0.9593,0.9752,0.7815,0.9672,0.9672,0.9752,MillID large,-0.0248,0.5859
+ltz_Latn,Luxembourgish,59,0.9915,0.9915,0.648,0.648,0.9916,0.9916,1.0,0.9915,0.9831,1.0,1.0,MillID large,0.0085,0.352
+lld_Latn,Ladin,59,0.7312,0.7312,0.0,0.0,0.9464,0.8991,0.8155,0.9091,0.8317,0.8807,0.9464,MillID tiny,0.2152,0.9464
+kin_Latn,Kinyarwanda,59,0.8868,0.8868,0.8571,0.8571,0.8889,0.9412,0.8929,0.8039,0.8814,0.8727,0.9412,MillID medium,0.0544,0.0841
+khm_Khmr,Khmer,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+kdh_Latn,Tem,59,0.8654,0.9915,0.0,0.0,1.0,1.0,1.0,0.9916,1.0,1.0,1.0,MillID tiny,0.0085,1.0
+wln_Latn,Walloon,59,0.655,0.655,0.0,0.0,0.6552,0.6667,0.6705,0.6118,0.6552,0.6591,0.6705,MillID large,0.0155,0.6705
+xsm_Latn,Kasem,59,0.9915,0.9915,0.0,0.0,0.8544,0.9268,0.9649,0.9273,0.9298,0.9492,0.9649,MillID large,-0.0266,0.9649
+yua_Latn,Yucateco,59,1.0,1.0,0.0,0.0,0.9593,1.0,1.0,0.9833,0.9672,1.0,1.0,MillID medium,0.0,1.0
+ydd_Hebr,Eastern Yiddish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9916,1.0,1.0,MillID tiny,0.0,0.0
+als_Latn,Albanian (Tosk),59,1.0,1.0,0.7329,0.7329,1.0,0.9828,0.9828,0.9915,0.8119,0.9739,1.0,MillID tiny,0.0,0.2671
+ame_Latn,Yanesha',59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+ajg_Latn,Aja (Benin),59,0.9916,0.9916,0.0,0.0,0.8741,0.9593,0.9219,0.9219,0.9421,0.9833,0.9833,MillID large v1.5,-0.0083,0.9833
+ada_Latn,Adangme,59,0.9365,0.9365,0.0,0.0,1.0,0.9752,0.9752,0.9916,0.9516,0.9672,1.0,MillID tiny,0.0635,1.0
+xho_Latn,Xhosa,58,1.0,1.0,0.8529,0.8529,0.9381,0.9204,0.8972,0.9402,0.906,0.9474,0.9474,MillID large v1.5,-0.0526,0.0945
+vmw_Latn,Makhuwa,58,0.9825,0.9913,0.0,0.0,0.9825,0.9825,0.9735,0.9825,0.9825,0.9825,0.9825,MillID tiny,-0.0088,0.9825
+arn_Latn,Mapuche,58,0.8952,0.9057,0.8175,0.8175,0.9483,0.9744,0.958,0.9739,0.958,0.9913,0.9913,MillID large v1.5,0.0856,0.1738
+arb_Arab,Arabic (Modern Standard),58,1.0,1.0,1.0,1.0,0.9259,0.9259,0.9455,0.8846,0.9735,0.9358,0.9735,MillID medium v1.5,-0.0265,-0.0265
+ami_Latn,Amis,58,0.0,0.0,0.0,0.0,0.0,0.0339,0.129,0.0,0.0,0.0984,0.129,MillID large,0.129,0.129
+nbl_Latn,South Ndebele,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0333,0.0,0.0,0.0,0.0333,MillID large,0.0333,0.0333
+mkd_Cyrl,Macedonian,58,1.0,1.0,1.0,1.0,0.9831,0.9748,1.0,0.9915,0.9831,0.9915,1.0,MillID large,0.0,0.0
+ndo_Latn,Ndonga,58,0.958,0.958,0.0,0.0,0.9661,0.9431,0.9748,0.95,0.958,0.9587,0.9748,MillID large,0.0168,0.9748
+mxv_Latn,Metlatónoc Mixtec,58,0.0,0.0,0.0,0.0,0.0984,0.2154,0.0339,0.129,0.1846,0.0339,0.2154,MillID medium,0.2154,0.2154
+kal_Latn,Kalaallisut,58,1.0,1.0,0.76,0.76,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.24
+kor_Hang,Korean,58,1.0,1.0,0.8923,0.8923,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1077
+kri_Latn,Krio,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,MillID tiny,0.0,1.0
+yap_Latn,Yapese,58,1.0,1.0,0.0,0.0,0.9825,0.9915,1.0,0.9913,0.9915,0.9915,1.0,MillID large,0.0,1.0
+kha_Latn,Khasi,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,MillID tiny,0.0,1.0
+kir_Cyrl,Kyrgyz,58,1.0,1.0,0.6237,0.6237,0.9915,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0,0.3763
+loz_Latn,Lozi,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+kmr_Latn,Northern Kurdish,58,1.0,1.0,0.7582,0.7582,0.955,0.9825,0.9735,1.0,0.9358,0.9455,1.0,MillID tiny v1.5,0.0,0.2418
+lit_Latn,Lithuanian,58,1.0,1.0,0.8112,0.8112,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,MillID tiny,0.0,0.1888
+kea_Latn,Kabuverdianu,58,0.9355,0.9355,0.125,0.1244,0.8112,0.7945,0.8,0.7917,0.9134,0.7733,0.9134,MillID medium v1.5,-0.0221,0.789
+lij_Latn,Ligurian,58,0.8593,0.8593,0.4872,0.4872,0.9431,0.9587,0.8227,0.9831,0.8657,0.9508,0.9831,MillID tiny v1.5,0.1238,0.4959
+lad_Latn,Ladino,58,1.0,1.0,0.0,0.0,0.9558,0.9913,0.9828,0.9643,0.9649,1.0,1.0,MillID large v1.5,0.0,1.0
+lua_Latn,Luba-Lulua,58,0.7391,0.7391,0.6386,0.6386,0.7708,0.55,0.5316,0.7097,0.7174,0.7033,0.7708,MillID tiny,0.0317,0.1322
+kan_Knda,Kannada,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+kat_Geor,Georgian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+kaz_Cyrl,Kazakh,58,1.0,1.0,0.4444,0.4444,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.5556
+mfq_Latn,Moba,58,1.0,1.0,0.0,0.0,1.0,1.0,0.9744,1.0,0.9913,1.0,1.0,MillID tiny,0.0,1.0
+isl_Latn,Icelandic,58,1.0,1.0,0.8345,0.8345,0.9913,0.9455,0.9455,0.8738,0.9159,0.8846,0.9913,MillID tiny,-0.0087,0.1568
+kab_Latn,Kabyle,58,0.9913,0.9913,0.9831,0.9748,0.9825,0.9915,0.9913,0.9259,0.955,0.9913,0.9915,MillID medium,0.0002,0.0167
+kaa_Cyrl,Kara-Kalpak,58,1.0,1.0,0.0,0.0,1.0,0.9915,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+ina_Latn,Interlingua,58,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,0.9913,0.9913,1.0,1.0,MillID medium,0.0,1.0
+ilo_Latn,Iloko,58,0.9913,0.9913,0.8593,0.8593,1.0,1.0,1.0,0.9831,0.9828,1.0,1.0,MillID tiny,0.0087,0.1407
+ita_Latn,Italian,58,1.0,1.0,0.6629,0.6629,1.0,0.9825,0.9828,0.9913,1.0,0.9735,1.0,MillID tiny,0.0,0.3371
+mam_Latn,Mam,58,0.9455,0.9455,0.0,0.0,0.9174,1.0,0.955,0.8846,0.9735,0.9913,1.0,MillID medium,0.0545,1.0
+mah_Latn,Marshallese,58,1.0,1.0,0.0,0.0,1.0,0.9915,0.9915,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+mai_Deva,Maithili,58,1.0,1.0,1.0,1.0,0.9587,0.8593,0.8923,0.9355,0.9667,0.9508,0.9667,MillID medium v1.5,-0.0333,-0.0333
+lus_Latn,Mizo,58,1.0,0.9915,0.3986,0.3986,0.9915,1.0,1.0,0.9913,0.9915,0.9913,1.0,MillID medium,0.0085,0.6014
+lue_Latn,Luvale,58,0.9913,0.9913,0.0,0.0,0.9587,0.9831,0.9508,0.9748,0.9748,0.9667,0.9831,MillID medium,-0.0082,0.9831
+quc_Latn,Kʼicheʼ,58,0.9174,0.9174,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0826,1.0
+qvc_Latn,Cajamarca Quechua,58,0.9062,0.9062,0.0,0.0,0.8444,0.7891,0.6824,0.648,0.8085,0.8169,0.8444,MillID tiny,-0.0618,0.8444
+qvh_Latn,Huamalíes-Dos de Mayo Huánuco Quechua,58,0.1538,0.1538,0.0,0.0,0.1587,0.2154,0.0984,0.4675,0.0984,0.2154,0.4675,MillID tiny v1.5,0.3137,0.4675
+epo_Latn,Esperanto,58,1.0,1.0,0.4234,0.4234,0.9913,0.9825,0.9825,0.9913,0.9825,0.9913,0.9913,MillID tiny,-0.0087,0.5679
+fon_Latn,Fon,58,0.9913,0.9913,0.4979,0.4979,0.782,0.9649,0.8929,0.9492,0.9744,0.9667,0.9744,MillID medium v1.5,-0.0169,0.4765
+fkv_Latn,Kven Finnish,58,0.6667,0.6667,0.0,0.0,0.7917,0.6966,0.8515,0.6353,0.5128,0.9057,0.9057,MillID large v1.5,0.239,0.9057
+fry_Latn,Western Frisian,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+fra_Latn,French,58,0.9915,0.9915,0.9134,0.9134,0.958,0.9655,0.9655,0.8544,0.9739,0.9739,0.9739,MillID medium v1.5,-0.0176,0.0605
+run_Latn,Rundi,58,0.8992,0.8992,0.8,0.8,0.906,0.9391,0.9016,0.8571,0.8793,0.9032,0.9391,MillID medium,0.0399,0.1391
+crs_Latn,Seselwa Creole French,58,1.0,1.0,0.0,0.0,0.9739,0.9744,0.9655,0.9915,0.9831,0.9915,0.9915,MillID tiny v1.5,-0.0085,0.9915
+sco_Latn,Scots,58,0.9735,0.9735,0.0,0.0,0.9739,0.9825,0.9735,0.9825,0.9735,0.9825,0.9825,MillID medium,0.009,0.9825
+rus_Cyrl,Russian,58,0.9667,0.9667,0.7838,0.7838,0.9831,0.9573,0.9661,0.9748,0.9655,0.9655,0.9831,MillID tiny,0.0164,0.1993
+fuf_Latn,Pular,58,0.4828,0.4828,0.0,0.0,0.8972,0.8163,0.9159,0.9057,0.9107,0.9358,0.9358,MillID large v1.5,0.453,0.9358
+glg_Latn,Galician,58,1.0,1.0,0.8286,0.8286,0.9744,0.9913,0.9667,0.9828,0.9744,0.9915,0.9915,MillID large v1.5,-0.0085,0.1629
+guj_Gujr,Gujarati,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+guc_Latn,Wayuu,58,1.0,1.0,0.0,0.0,0.9748,0.9667,1.0,0.9831,1.0,0.9831,1.0,MillID large,0.0,1.0
+pan_Guru,Punjabi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+pap_Latn,Papiamento,58,0.9915,0.9915,0.725,0.725,0.9825,1.0,1.0,1.0,0.9748,0.9915,1.0,MillID medium,0.0085,0.275
+pcd_Latn,Picard,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
+glv_Latn,Manx,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+huu_Latn,Murui Huitoto,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,MillID tiny,0.0,1.0
+hrv_Latn,Croatian,58,0.7273,0.7273,0.4737,0.4737,0.4974,0.5371,0.5828,0.5,0.5208,0.5591,0.5828,MillID large,-0.1445,0.1091
+hnj_Latn,Hmong Njua,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
+ibo_Latn,Igbo,58,1.0,1.0,0.8227,0.8227,1.0,0.9915,1.0,1.0,0.9915,1.0,1.0,MillID tiny,0.0,0.1773
+hil_Latn,Hiligaynon,58,1.0,1.0,0.0,0.0,1.0,0.9739,0.9825,0.9913,0.9825,0.9913,1.0,MillID tiny,0.0,1.0
+heb_Hebr,Hebrew,58,1.0,1.0,1.0,1.0,1.0,0.9913,0.9913,0.9825,0.9735,1.0,1.0,MillID tiny,0.0,0.0
+haw_Latn,Hawaiian,58,0.9735,0.9735,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0265,1.0
+nso_Latn,Northern Sotho,58,1.0,1.0,0.9508,0.9508,1.0,1.0,0.9915,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0492
+nno_Latn,Norwegian Nynorsk,58,1.0,1.0,0.9748,0.9748,0.9739,0.9744,0.9643,0.9558,0.955,0.9913,0.9913,MillID large v1.5,-0.0087,0.0165
+nld_Latn,Dutch,58,1.0,1.0,0.703,0.703,1.0,1.0,1.0,0.9915,0.9748,1.0,1.0,MillID tiny,0.0,0.297
+niu_Latn,Niuean,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+nds_Latn,Low German,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+uzn_Cyrl,Northern Uzbek,58,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,0.9913,1.0,1.0,1.0,MillID medium,0.0,1.0
+ast_Latn,Asturian,58,1.0,1.0,0.7484,0.7484,0.955,0.9825,0.9735,0.9735,0.9464,1.0,1.0,MillID large v1.5,0.0,0.2516
+tyv_Cyrl,Tuvinian,58,0.9915,0.9915,0.0,0.0,1.0,0.9915,0.9915,1.0,0.9915,1.0,1.0,MillID tiny,0.0085,1.0
+tsn_Latn,Tswana,58,0.9915,0.9915,0.9134,0.9134,1.0,1.0,0.9915,1.0,1.0,1.0,1.0,MillID tiny,0.0085,0.0866
+bci_Latn,Baoulé,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,MillID tiny,0.0,1.0
+bel_Cyrl,Belarusian,58,1.0,1.0,0.8345,0.8345,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1655
+bba_Latn,Baatonum,58,0.9913,1.0,0.0,0.0,0.9744,0.9913,0.9828,0.9913,0.9913,0.9831,0.9913,MillID medium,-0.0087,0.9913
+azj_Latn,North Azerbaijani,58,0.9915,0.9915,0.5949,0.5949,0.9915,0.9915,1.0,0.9915,0.9831,0.9915,1.0,MillID large,0.0085,0.4051
+ben_Beng,Bangla,58,1.0,1.0,1.0,1.0,1.0,1.0,0.9913,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+uzn_Latn,Northern Uzbek,58,0.9915,0.9915,0.4056,0.4056,0.9587,0.928,0.8992,0.9667,1.0,0.9355,1.0,MillID medium v1.5,0.0085,0.5944
+vec_Latn,Venetian,58,1.0,1.0,0.8056,0.8056,0.9915,0.9828,0.9667,1.0,0.9915,1.0,1.0,MillID tiny v1.5,0.0,0.1944
+vep_Latn,Veps,58,1.0,1.0,0.0,0.0,0.9744,0.9913,1.0,0.9825,0.9913,1.0,1.0,MillID large,0.0,1.0
+zul_Latn,Zulu,58,0.9744,0.9744,0.6073,0.6073,0.8909,0.9107,0.8119,0.9189,0.8929,0.9573,0.9573,MillID large v1.5,-0.0171,0.35
+tzo_Latn,Tzotzil,58,0.9913,0.9913,0.0,0.0,0.9735,0.9735,0.9735,0.9643,0.9735,0.9913,0.9913,MillID large v1.5,0.0,0.9913
+ukr_Cyrl,Ukrainian,58,1.0,1.0,0.9667,0.9667,0.9913,1.0,0.9735,1.0,1.0,1.0,1.0,MillID medium,0.0,0.0333
+uig_Arab,Uyghur,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+swh_Latn,Swahili,58,0.9825,0.9825,0.5088,0.5088,0.8491,0.9455,0.8785,0.9074,0.8544,0.8785,0.9455,MillID medium,-0.037,0.4367
+tel_Telu,Telugu,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+tet_Latn,Tetum,58,0.1667,0.1667,0.0,0.0,0.6234,0.6986,0.726,0.6377,0.7134,0.7075,0.726,MillID large,0.5593,0.726
+tir_Ethi,Tigrinya,58,1.0,1.0,0.9915,0.9915,1.0,0.9915,1.0,0.9915,0.8169,0.9831,1.0,MillID tiny,0.0,0.0085
+cat_Latn,Catalan,58,1.0,1.0,0.6905,0.6905,0.9828,0.9667,0.9831,0.9748,1.0,1.0,1.0,MillID medium v1.5,0.0,0.3095
+bum_Latn,Bulu,58,0.0984,0.0984,0.0,0.0,0.2424,0.3188,0.4737,0.2154,0.2388,0.1875,0.4737,MillID large,0.3753,0.4737
+bul_Cyrl,Bulgarian,58,1.0,1.0,1.0,1.0,0.9744,0.9913,0.9915,0.9828,0.9828,0.9828,0.9915,MillID large,-0.0085,-0.0085
+cnh_Latn,Hakha Chin,58,0.9915,0.9915,0.0,0.0,0.9344,0.9828,1.0,0.9915,0.9748,0.9915,1.0,MillID large,0.0085,1.0
+ces_Latn,Czech,58,1.0,1.0,0.9508,0.9508,1.0,0.9915,0.9828,0.9825,0.9913,1.0,1.0,MillID tiny,0.0,0.0492
+chk_Latn,Chuukese,58,1.0,1.0,0.0,0.0,0.9915,1.0,1.0,0.9915,1.0,0.9915,1.0,MillID medium,0.0,1.0
+sus_Latn,Susu,58,0.9748,0.9748,0.0,0.0,0.9369,0.9643,0.9474,0.955,0.955,0.9915,0.9915,MillID large v1.5,0.0167,0.9915
+srr_Latn,Serer,58,0.9831,0.9831,0.0,0.0,0.9825,1.0,0.9825,1.0,0.9913,0.9831,1.0,MillID medium,0.0169,1.0
+suk_Latn,Sukuma,58,0.9828,0.9828,0.0,0.0,0.9828,0.9825,0.9913,0.9828,0.9739,1.0,1.0,MillID large v1.5,0.0172,1.0
+sme_Latn,Northern Sami,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+eng_Latn,English,58,1.0,1.0,0.5979,0.5979,0.9123,0.9744,0.9573,0.9748,0.9273,0.9831,0.9831,MillID large v1.5,-0.0169,0.3852
+dyu_Latn,Dyula,58,0.4337,0.4337,0.0154,0.0154,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.4337,-0.0154
+tpi_Latn,Tok Pisin,58,1.0,1.0,0.9831,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0169
+zyb_Latn,Yongbei Zhuang,57,0.9828,0.9744,0.0,0.0,1.0,0.9744,0.9913,0.8769,0.8906,0.9744,1.0,MillID tiny,0.0256,1.0
+bam_Latn,Bambara,57,0.7519,0.7519,0.1992,0.1969,0.7786,0.6267,0.6145,0.8244,0.6405,0.7027,0.8244,MillID tiny v1.5,0.0725,0.6275
+bem_Latn,Bemba,57,1.0,1.0,0.4385,0.4385,0.9912,0.9828,0.9649,0.9913,0.9739,1.0,1.0,MillID large v1.5,0.0,0.5615
+toj_Latn,Tojolabal,57,1.0,1.0,0.0,0.0,0.9912,0.9913,1.0,0.9825,0.9912,1.0,1.0,MillID large,0.0,1.0
+toi_Latn,Tonga (Zambia),57,1.0,1.0,0.0,0.0,0.9828,0.9636,0.9913,0.9825,1.0,0.9643,1.0,MillID medium v1.5,0.0,1.0
+tdt_Latn,Tetun Dili,57,0.6115,0.6115,0.0,0.0,0.2532,0.4884,0.5176,0.4565,0.4054,0.4819,0.5176,MillID large,-0.0939,0.5176
+cbt_Latn,Chayahuita,57,0.9913,0.9913,0.0,0.0,0.9913,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0087,1.0
+tah_Latn,Tahitian,57,0.8125,0.8125,0.9661,0.9661,0.9444,0.973,0.9821,0.973,0.9821,0.9735,0.9821,MillID large,0.1696,0.016
+cha_Latn,Chamorro,57,0.9245,0.9245,0.0,0.0,1.0,0.9825,1.0,0.9913,0.9913,1.0,1.0,MillID tiny,0.0755,1.0
+sot_Latn,Southern Sotho,57,1.0,1.0,0.7863,0.7863,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2137
+som_Latn,Somali,57,1.0,1.0,0.6994,0.6994,1.0,1.0,1.0,1.0,0.9913,1.0,1.0,MillID tiny,0.0,0.3006
+cfm_Latn,Falam Chin,57,0.9821,0.9821,0.0,0.0,0.9913,0.9828,1.0,0.9912,0.9821,0.9739,1.0,MillID large,0.0179,1.0
+tat_Cyrl,Tatar,57,1.0,1.0,0.5938,0.5938,1.0,0.9912,0.9912,1.0,0.9912,1.0,1.0,MillID tiny,0.0,0.4062
+cak_Latn,Kaqchikel,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,0.9912,0.9913,0.9913,1.0,MillID tiny,0.0,1.0
+tgk_Cyrl,Tajik,57,1.0,1.0,0.623,0.623,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.377
+abk_Cyrl,Abkhazian,57,1.0,1.0,0.9913,0.9913,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0087
+tuk_Cyrl,Turkmen,57,1.0,1.0,0.0,0.0,1.0,0.973,0.9912,1.0,0.973,0.973,1.0,MillID tiny,0.0,1.0
+pon_Latn,Pohnpeian,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+pau_Latn,Palauan,57,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,1.0,1.0,1.0,1.0,MillID medium,0.0,1.0
+pis_Latn,Pijin,57,0.9913,0.9913,0.0,0.0,1.0,1.0,1.0,1.0,0.9913,0.9913,1.0,MillID tiny,0.0087,1.0
+quz_Latn,Cusco Quechua,57,0.8947,0.906,0.0,0.0,0.8174,0.8829,0.887,0.8,0.7519,0.8462,0.887,MillID large,-0.019,0.887
+fat_Latn,Fanti,57,0.9913,0.9913,0.0,0.0,1.0,0.9744,0.9828,1.0,1.0,0.9913,1.0,MillID tiny,0.0087,1.0
+kjh_Cyrl,Khakas,57,0.9913,0.9913,0.0,0.0,0.9828,1.0,0.9913,0.9744,0.9913,0.9913,1.0,MillID medium,0.0087,1.0
+khk_Cyrl,Halh Mongolian,57,0.9912,0.9912,0.8976,0.8976,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0088,0.1024
+kek_Latn,Kekchí,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+mri_Latn,Māori,57,1.0,1.0,0.3826,0.3813,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.6187
+agr_Latn,Aguaruna,57,0.9739,0.9739,0.0,0.0,0.9913,0.9655,0.9492,0.9565,0.95,0.9744,0.9913,MillID tiny,0.0174,0.9913
+aii_Syrc,Assyrian Neo-Aramaic,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
+koi_Cyrl,Komi-Permyak,57,1.0,1.0,0.0,0.0,0.7191,0.8367,0.8485,0.8367,0.8485,0.8485,0.8485,MillID large,-0.1515,0.8485
+yor_Latn,Yoruba,57,0.9913,0.9913,0.7808,0.7808,1.0,0.9913,1.0,1.0,0.9913,0.9913,1.0,MillID tiny,0.0087,0.2192
+lao_Laoo,Lao,57,1.0,1.0,1.0,1.0,1.0,1.0,0.9912,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+cbu_Latn,Candoshi-Shapra,57,0.8824,0.8738,0.0,0.0,0.6667,0.3714,0.1846,0.5,0.411,0.557,0.6667,MillID tiny,-0.2071,0.6667
+qvn_Latn,North Junín Quechua,57,0.4595,0.4595,0.0,0.0,0.2609,0.2188,0.0952,0.2188,0.0678,0.0339,0.2609,MillID tiny,-0.1986,0.2609
+quh_Latn,South Bolivian Quechua,57,0.9369,0.9649,0.0,0.0,0.9655,0.9828,0.9661,0.9655,0.9421,0.9661,0.9828,MillID medium,0.0179,0.9828
+qxn_Latn,Northern Conchucos Ancash Quechua,57,0.0345,0.0345,0.0,0.0,0.0339,0.0345,0.0,0.129,0.0,0.0,0.129,MillID tiny v1.5,0.0945,0.129
+fao_Latn,Faroese,57,1.0,1.0,0.7473,0.7473,1.0,0.9913,0.9913,1.0,1.0,0.9828,1.0,MillID tiny,0.0,0.2527
+sid_Latn,Sidamo,57,0.9268,0.9268,0.0,0.0,1.0,1.0,1.0,0.9825,1.0,0.9825,1.0,MillID tiny,0.0732,1.0
+sah_Cyrl,Yakut,57,0.958,0.958,0.0,0.0,1.0,0.9913,1.0,1.0,0.9828,1.0,1.0,MillID tiny,0.042,1.0
+dag_Latn,Dagbani,57,0.9739,0.9739,0.0,0.0,0.9739,0.9825,0.9412,0.9573,0.9649,0.9828,0.9828,MillID large v1.5,0.0089,0.9828
+rup_Latn,Aromanian,57,1.0,1.0,0.0,0.0,0.9913,0.9913,0.9913,1.0,0.9913,0.9913,1.0,MillID tiny v1.5,0.0,1.0
+div_Thaa,Divehi,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+pbb_Latn,Páez,56,0.7126,0.7126,0.0,0.0,0.5455,0.8485,0.8454,0.6977,0.8333,0.8247,0.8485,MillID medium,0.1359,0.8485
+gle_Latn,Irish,56,0.9825,0.9825,1.0,1.0,1.0,0.9912,0.9912,1.0,1.0,1.0,1.0,MillID tiny,0.0175,0.0
+bho_Deva,Bhojpuri,56,0.9333,0.9333,0.8317,0.8317,0.7872,0.6429,0.6966,0.8515,0.5385,0.7416,0.8515,MillID tiny v1.5,-0.0818,0.0198
+slk_Latn,Slovak,56,1.0,1.0,0.9256,0.9256,0.9912,0.9821,0.9912,0.9825,0.9912,1.0,1.0,MillID large v1.5,0.0,0.0744
+ura_Latn,Urarina,56,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,0.991,1.0,MillID tiny,0.0,1.0
+azj_Cyrl,North Azerbaijani,56,1.0,1.0,0.0,0.0,1.0,0.9912,1.0,1.0,1.0,0.9912,1.0,MillID tiny,0.0,1.0
+shn_Mymr,Shan,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
+ady_Cyrl,Adyghe,56,0.9818,0.9818,0.6707,0.6707,0.9725,0.991,0.9818,0.963,1.0,1.0,1.0,MillID medium v1.5,0.0182,0.3293
+mya_Mymr,Burmese,56,1.0,1.0,0.6707,0.6707,0.9818,0.991,1.0,1.0,0.9725,1.0,1.0,MillID large,0.0,0.3293
+mos_Latn,Mossi,56,1.0,1.0,0.855,0.855,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.145
+lun_Latn,Lunda,56,0.991,0.991,0.0,0.0,1.0,1.0,0.9912,0.991,1.0,1.0,1.0,MillID tiny,0.009,1.0
+pcm_Latn,Nigerian Pidgin,56,0.9402,0.9412,0.8627,0.955,0.9912,0.9825,1.0,1.0,0.991,1.0,1.0,MillID large,0.0588,0.045
+yrk_Cyrl,Nenets,55,0.972,0.972,0.0,0.0,0.972,0.9815,0.9815,0.9815,0.9815,0.9815,0.9815,MillID medium,0.0095,0.9815
+mnw_Mymr,Mon,55,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+yad_Latn,Yagua,55,0.9815,0.9815,0.0,0.0,0.9908,1.0,1.0,0.963,1.0,1.0,1.0,MillID medium,0.0185,1.0
+dyo_Latn,Jola-Fonyi,55,0.9908,1.0,0.0,0.0,0.9908,0.9815,0.9818,0.9908,0.9815,0.955,0.9908,MillID tiny,-0.0092,0.9908
+san_Deva,Sanskrit,55,0.9908,0.9908,0.973,0.973,0.9908,0.9908,0.9815,0.9815,0.9908,0.9908,0.9908,MillID tiny,0.0,0.0178
+npi_Deva,Nepali,55,0.9908,0.9908,0.9565,0.9565,1.0,1.0,1.0,1.0,0.9908,1.0,1.0,MillID tiny,0.0092,0.0435
+ido_Latn,Ido,55,1.0,1.0,0.0,0.0,0.9908,0.9815,0.955,0.9636,0.9725,1.0,1.0,MillID large v1.5,0.0,1.0
+tem_Latn,Timne,55,1.0,1.0,0.0,0.0,1.0,0.991,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+kbd_Cyrl,Kabardian,55,0.9735,0.9735,0.0,0.0,0.9735,0.991,0.9821,0.9649,1.0,1.0,1.0,MillID medium v1.5,0.0265,1.0
+koo_Latn,Konzo,54,0.9615,0.9615,0.0,0.0,0.9515,0.9714,1.0,0.9714,0.9412,0.9714,1.0,MillID large,0.0385,1.0
+dje_Latn,Zarma,54,0.9412,0.9515,0.0,0.0,0.9412,0.8866,0.875,0.898,0.898,0.9412,0.9412,MillID tiny,-0.0103,0.9412
+mag_Deva,Magahi,53,0.9444,0.9444,0.6323,0.6323,0.8333,0.7963,0.7928,0.8679,0.7121,0.8491,0.8679,MillID tiny v1.5,-0.0765,0.2356
+plt_Latn,Malagasy (Plateau),53,1.0,0.9907,0.955,0.955,1.0,1.0,1.0,0.9907,1.0,1.0,1.0,MillID tiny,0.0093,0.045
+cni_Latn,Asháninka,52,0.963,0.963,0.0,0.0,0.75,0.7075,0.7482,0.7727,0.6842,0.7172,0.7727,MillID tiny v1.5,-0.1903,0.7727
+yao_Latn,Yao,52,0.9903,0.9903,0.0,0.0,1.0,1.0,1.0,0.9811,1.0,1.0,1.0,MillID tiny,0.0097,1.0
+idu_Latn,Idoma,51,0.8791,0.9375,0.0,0.0,0.7407,0.9278,0.7711,0.6027,0.8182,0.9263,0.9278,MillID medium,-0.0097,0.9278
+alt_Cyrl,Southern Altai,51,0.9623,0.9623,0.6986,0.6986,0.9714,0.9903,0.9903,0.9903,0.9903,1.0,1.0,MillID large v1.5,0.0377,0.3014
+amh_Ethi,Amharic,51,1.0,1.0,0.8409,0.8409,1.0,0.9901,1.0,0.9901,0.6579,0.9697,1.0,MillID tiny,0.0,0.1591
+kde_Latn,Makonde,51,0.9703,0.9703,0.0,0.0,0.8958,0.9184,0.8913,0.9278,0.9278,0.8667,0.9278,MillID tiny v1.5,-0.0425,0.9278
+mto_Latn,Totontepec Mixe,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
+miq_Latn,Mískito,51,1.0,1.0,0.0,0.0,1.0,1.0,0.9808,1.0,1.0,0.9903,1.0,MillID tiny,0.0,1.0
+zdj_Latn,Ngazidja Comorian,50,0.9796,0.9899,0.0,0.0,0.9901,1.0,1.0,1.0,0.9615,1.0,1.0,MillID medium,0.0101,1.0
+nyn_Latn,Nyankole,50,0.9796,0.9796,0.0,0.0,1.0,1.0,1.0,1.0,0.9899,1.0,1.0,MillID tiny,0.0204,1.0
+yue_Hani,Cantonese,49,0.5797,0.5797,0.1108,0.1108,0.7473,0.6522,0.5714,0.7342,0.6476,0.7071,0.7473,MillID tiny,0.1676,0.6365
+lug_Latn,Ganda,49,1.0,1.0,0.359,0.359,0.9796,0.9897,1.0,0.9899,1.0,1.0,1.0,MillID large,0.0,0.641
+eve_Cyrl,Even,49,0.8864,0.8864,0.0,0.0,1.0,0.9897,1.0,1.0,0.9684,1.0,1.0,MillID tiny,0.1136,1.0
+gyr_Latn,Guarayu,49,0.9897,0.9897,0.0,0.0,0.5797,0.339,0.1818,0.5373,0.1852,0.3934,0.5797,MillID tiny,-0.41,0.5797
+gug_Latn,Paraguayan Guaraní,49,1.0,1.0,0.2367,0.2367,0.98,0.9515,0.9899,0.9515,0.9333,0.98,0.9899,MillID large,-0.0101,0.7532
+wuu_Hani,Wu Chinese,48,0.5562,0.5529,0.0,0.0,0.5875,0.6277,0.5874,0.6144,0.5455,0.5481,0.6277,MillID medium,0.0748,0.6277
+nan_Hani,Min Nan Chinese,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
+hak_Hani,Hakka Chinese,48,0.0408,0.0408,0.0,0.0,0.0714,0.0,0.0,0.0392,0.2462,0.0755,0.2462,MillID medium v1.5,0.2054,0.2462
+bin_Latn,Bini,47,0.9318,0.9318,0.0,0.0,0.9438,0.9892,1.0,0.9892,0.9438,1.0,1.0,MillID large,0.0682,1.0
+lia_Latn,West-Central Limba,45,1.0,1.0,0.0,0.0,0.9888,0.9888,1.0,1.0,1.0,0.989,1.0,MillID large,0.0,1.0
+ike_Cans,Eastern Canadian Inuktitut,44,0.9778,0.9778,0.0,0.0,1.0,1.0,1.0,1.0,0.9888,1.0,1.0,MillID tiny,0.0222,1.0
+oss_Cyrl,Ossetic,44,1.0,1.0,0.9778,0.9778,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0222
+ojb_Cans,Northwestern Ojibwa,43,0.9639,0.9639,0.0,0.0,1.0,1.0,1.0,1.0,0.9762,1.0,1.0,MillID tiny,0.0361,1.0
+cbs_Latn,Cashinahua,43,0.9647,0.9647,0.0,0.0,0.9882,0.9885,1.0,0.9882,1.0,1.0,1.0,MillID large,0.0353,1.0
+ese_Latn,Ese Ejja,35,0.9855,0.9855,0.0,0.0,1.0,0.9855,1.0,1.0,1.0,0.9855,1.0,MillID tiny,0.0145,1.0
+tzh_Latn,Tzeltal,25,0.9804,0.9804,0.0,0.0,0.9434,0.9434,0.9615,0.9259,1.0,0.9804,1.0,MillID medium v1.5,0.0196,1.0
+chv_Cyrl,Chuvash,25,1.0,1.0,0.9434,0.9434,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0566
+taj_Deva,Eastern Tamang,1,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
+tzm_Tfng,Central Atlas Tamazight,1,0.0645,0.0645,0.0328,0.0328,0.1,0.3333,0.1429,0.1667,0.25,0.1,0.3333,MillID medium,0.2688,0.3005