byamasupatrick commited on
Commit
14ea361
·
verified ·
1 Parent(s): 0ada30c

MillID tiny, step 106000

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +304 -0
  2. config.json +65 -0
  3. labels.json +3320 -0
  4. millid.py +1529 -0
  5. model.safetensors +3 -0
  6. reports/summary.json +511 -0
  7. reports/test-common/fasttext@millid_per_language.csv +214 -0
  8. reports/test-common/fasttext@millid_summary.json +22 -0
  9. reports/test-common/fasttext_per_language.csv +214 -0
  10. reports/test-common/fasttext_summary.json +22 -0
  11. reports/test-common/glotlid@millid_per_language.csv +214 -0
  12. reports/test-common/glotlid@millid_summary.json +22 -0
  13. reports/test-common/glotlid_per_language.csv +214 -0
  14. reports/test-common/glotlid_summary.json +22 -0
  15. reports/test-common/leaderboard.csv +214 -0
  16. reports/test-common/millid_per_language.csv +214 -0
  17. reports/test-common/millid_summary.json +22 -0
  18. reports/test/fasttext@millid_per_language.csv +1622 -0
  19. reports/test/fasttext@millid_summary.json +22 -0
  20. reports/test/fasttext_per_language.csv +1622 -0
  21. reports/test/fasttext_summary.json +22 -0
  22. reports/test/glotlid@millid_per_language.csv +1622 -0
  23. reports/test/glotlid@millid_summary.json +22 -0
  24. reports/test/glotlid_per_language.csv +1622 -0
  25. reports/test/glotlid_summary.json +22 -0
  26. reports/test/leaderboard.csv +0 -0
  27. reports/test/millid_per_language.csv +0 -0
  28. reports/test/millid_summary.json +22 -0
  29. reports/udhr-all/fasttext@millid_per_language.csv +430 -0
  30. reports/udhr-all/fasttext@millid_summary.json +17 -0
  31. reports/udhr-all/fasttext_per_language.csv +430 -0
  32. reports/udhr-all/fasttext_summary.json +17 -0
  33. reports/udhr-all/glotlid@millid_per_language.csv +430 -0
  34. reports/udhr-all/glotlid@millid_summary.json +17 -0
  35. reports/udhr-all/glotlid_per_language.csv +430 -0
  36. reports/udhr-all/glotlid_summary.json +17 -0
  37. reports/udhr-all/leaderboard.csv +430 -0
  38. reports/udhr-all/millid_per_language.csv +430 -0
  39. reports/udhr-all/millid_summary.json +17 -0
  40. reports/udhr-common/fasttext@millid_per_language.csv +171 -0
  41. reports/udhr-common/fasttext@millid_summary.json +17 -0
  42. reports/udhr-common/fasttext_per_language.csv +171 -0
  43. reports/udhr-common/fasttext_summary.json +17 -0
  44. reports/udhr-common/glotlid@millid_per_language.csv +171 -0
  45. reports/udhr-common/glotlid@millid_summary.json +17 -0
  46. reports/udhr-common/glotlid_per_language.csv +171 -0
  47. reports/udhr-common/glotlid_summary.json +17 -0
  48. reports/udhr-common/leaderboard.csv +171 -0
  49. reports/udhr-common/millid_per_language.csv +171 -0
  50. reports/udhr-common/millid_summary.json +17 -0
README.md ADDED
@@ -0,0 +1,304 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ pipeline_tag: text-classification
4
+ tags:
5
+ - language-identification
6
+ datasets:
7
+ - baobabtech/millid-dataset
8
+ ---
9
+
10
+ # MillID tiny: MultiLingual Language IDentifier
11
+
12
+ A byte-level, encoder-only transformer that names the language of a passage: **1641 language-script
13
+ labels** (ISO 639-3 + script, e.g. `eng_Latn`, `amh_Ethi`). 2.9M parameters, trained from
14
+ scratch on [baobabtech/millid-dataset](https://huggingface.co/datasets/baobabtech/millid-dataset).
15
+
16
+ ```python
17
+ from millid import MillID # millid.py, in this repository
18
+
19
+ model = MillID.from_pretrained("baobabtech/millid-tiny-v1.5")
20
+ model.predict(["Lave men ou ak savon anvan ou manje."], k=3)
21
+ ```
22
+
23
+ ## Architecture
24
+
25
+ UTF-8 bytes (after Unicode NFKC), each embedded as byte + Unicode script + byte-in-character + hashed character
26
+ 2-, 3- and 4-grams (4,096 buckets) -> depthwise convolution stem (kernel 5) -> strided
27
+ convolution, 1 bytes per token -> 3 pre-norm blocks (RMSNorm, attention with RoPE,
28
+ 3 heads, SwiGLU; d=192) -> masked mean pooling -> language head, each language's vector the sum of
29
+ its own, its language's and its script's. Up to 256 bytes per passage. See `ARCHITECTURE.md`.
30
+
31
+ ## Evaluation against GlotLID and fastText
32
+
33
+ `validation` chose the checkpoint; `test` is split by document from training; `udhr` is the Universal Declaration
34
+ of Human Rights, labelled by its translators, over the languages MillID knows, and `udhr-all` over all of them.
35
+ `glotlid` is [GlotLID](https://huggingface.co/cis-lmu/glotlid) as it is; `glotlid@millid` is GlotLID restricted to
36
+ MillID's labels, the like-for-like comparison. GlotLID's own labels came from training on data that includes UDHR
37
+ and labelled FinePDFs and FineWeb-2, so its scores on `udhr` and on those sources are optimistic. `fasttext` is
38
+ Meta's [fastText language identifier](https://huggingface.co/facebook/fasttext-language-identification) (NLLB,
39
+ 218 labels), its answers mapped onto MillID's spelling (Simplified and Traditional Han as `Hani`, `pes`/`prs` as
40
+ `fas`, `est` as `ekk`). It cannot answer most of the 1,600 languages here, so `test-common` and `udhr-common`
41
+ score every model on the passages whose language all of them know: the head-to-head on equal terms.
42
+
43
+ | Set | Model | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages |
44
+ |---|---|---|---|---|---|---|---|---|---|
45
+ | validation | millid | 0.9578 | 0.9889 | 0.9933 | 0.9539 | 0.9591 | 0.9551 | 0.9822 | 1626 |
46
+ | test | millid | 0.9587 | 0.9890 | 0.9932 | 0.9550 | 0.9588 | 0.9554 | 0.9825 | 1621 |
47
+ | test | glotlid | 0.9776 | 0.9977 | 0.9984 | 0.9783 | 0.9752 | 0.9748 | 1.0000 | 1621 |
48
+ | test | glotlid@millid | 0.9783 | 0.9978 | 0.9985 | 0.9778 | 0.9765 | 0.9755 | 1.0000 | 1621 |
49
+ | test | fasttext | 0.2511 | 0.2610 | 0.2625 | 0.0520 | 0.1205 | 0.0657 | 0.0000 | 1621 |
50
+ | test | fasttext@millid | 0.2515 | 0.2611 | 0.2625 | 0.0521 | 0.1209 | 0.0659 | 0.0000 | 1621 |
51
+ | test-common | millid | 0.9396 | 0.9857 | 0.9909 | 0.9709 | 0.9353 | 0.9513 | 0.9726 | 213 |
52
+ | test-common | glotlid | 0.9738 | 0.9925 | 0.9946 | 0.9924 | 0.9771 | 0.9835 | 0.9983 | 213 |
53
+ | test-common | glotlid@millid | 0.9749 | 0.9927 | 0.9948 | 0.9923 | 0.9790 | 0.9846 | 0.9983 | 213 |
54
+ | test-common | fasttext | 0.9339 | 0.9707 | 0.9762 | 0.9357 | 0.9169 | 0.9149 | 0.9680 | 213 |
55
+ | test-common | fasttext@millid | 0.9352 | 0.9710 | 0.9763 | 0.9354 | 0.9201 | 0.9173 | 0.9680 | 213 |
56
+ | udhr | millid | 0.8492 | 0.9117 | 0.9257 | 0.9148 | 0.8736 | 0.8764 | 0.9907 | 358 |
57
+ | udhr | glotlid | 0.8598 | 0.9280 | 0.9421 | 0.9261 | 0.8826 | 0.8865 | 0.9915 | 358 |
58
+ | udhr | glotlid@millid | 0.8614 | 0.9294 | 0.9433 | 0.9258 | 0.8844 | 0.8873 | 0.9915 | 358 |
59
+ | udhr | fasttext | 0.4625 | 0.4857 | 0.4903 | 0.3152 | 0.4479 | 0.3497 | 0.0000 | 358 |
60
+ | udhr | fasttext@millid | 0.4629 | 0.4857 | 0.4904 | 0.3152 | 0.4483 | 0.3499 | 0.0000 | 358 |
61
+ | udhr-common | millid | 0.9123 | 0.9606 | 0.9655 | 0.9794 | 0.9393 | 0.9513 | 1.0000 | 170 |
62
+ | udhr-common | glotlid | 0.9336 | 0.9678 | 0.9732 | 0.9888 | 0.9576 | 0.9657 | 1.0000 | 170 |
63
+ | udhr-common | glotlid@millid | 0.9338 | 0.9683 | 0.9736 | 0.9888 | 0.9579 | 0.9659 | 1.0000 | 170 |
64
+ | udhr-common | fasttext | 0.9187 | 0.9647 | 0.9741 | 0.9474 | 0.9431 | 0.9323 | 1.0000 | 170 |
65
+ | udhr-common | fasttext@millid | 0.9195 | 0.9647 | 0.9742 | 0.9474 | 0.9441 | 0.9329 | 1.0000 | 170 |
66
+ | udhr-all | millid | 0.7274 | 0.7809 | 0.7928 | 0.7340 | 0.7290 | 0.7149 | 0.9649 | 429 |
67
+ | udhr-all | glotlid | 0.7502 | 0.8145 | 0.8282 | 0.7695 | 0.7529 | 0.7454 | 0.9796 | 429 |
68
+ | udhr-all | glotlid@millid | 0.7378 | 0.7960 | 0.8079 | 0.7425 | 0.7381 | 0.7245 | 0.9748 | 429 |
69
+ | udhr-all | fasttext | 0.3961 | 0.4160 | 0.4200 | 0.2479 | 0.3737 | 0.2795 | 0.0000 | 429 |
70
+ | udhr-all | fasttext@millid | 0.3964 | 0.4160 | 0.4200 | 0.2479 | 0.3741 | 0.2797 | 0.0000 | 429 |
71
+
72
+ Top-1 accuracy by passage length:
73
+
74
+ | Set | Model | short | sentence | paragraph |
75
+ |---|---|---|---|---|
76
+ | validation | millid | 0.9312 | 0.9788 | 0.9850 |
77
+ | test | millid | 0.9333 | 0.9797 | 0.9833 |
78
+ | test | glotlid | 0.9664 | 0.9853 | 0.9911 |
79
+ | test | glotlid@millid | 0.9674 | 0.9858 | 0.9912 |
80
+ | test | fasttext | 0.2760 | 0.2501 | 0.1958 |
81
+ | test | fasttext@millid | 0.2764 | 0.2506 | 0.1959 |
82
+ | test-common | millid | 0.9125 | 0.9685 | 0.9725 |
83
+ | test-common | glotlid | 0.9594 | 0.9876 | 0.9947 |
84
+ | test-common | glotlid@millid | 0.9609 | 0.9885 | 0.9949 |
85
+ | test-common | fasttext | 0.9112 | 0.9562 | 0.9651 |
86
+ | test-common | fasttext@millid | 0.9125 | 0.9581 | 0.9655 |
87
+
88
+ ### Leaderboard: test
89
+
90
+ MillID's F1 against the others', language by language: against GlotLID restricted to MillID's labels, MillID is better on **103** languages, worse on **869** and within 0.01 on 649; against fastText restricted to MillID's labels, MillID is better on **1616** languages, worse on **0** and within 0.01 on 5. The full table, with precision and recall, is
91
+ `reports/test/leaderboard.csv`.
92
+
93
+ The 20 languages with the most passages:
94
+
95
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
96
+ |---|---|---|---|---|---|---|---|
97
+ | `fra_Latn` | French | 1652 | 0.929 | 0.928 | 0.928 | 0.808 | 0.808 |
98
+ | `eng_Latn` | English | 1444 | 0.917 | 0.858 | 0.859 | 0.653 | 0.648 |
99
+ | `spa_Latn` | Spanish | 1136 | 0.931 | 0.950 | 0.950 | 0.574 | 0.574 |
100
+ | `tam_Taml` | Tamil | 754 | 0.997 | 0.993 | 0.993 | 0.965 | 0.965 |
101
+ | `arb_Arab` | Arabic (Modern Standard) | 745 | 0.814 | 0.785 | 0.785 | 0.513 | 0.512 |
102
+ | `por_Latn` | Portuguese | 657 | 0.947 | 0.947 | 0.949 | 0.756 | 0.755 |
103
+ | `kan_Knda` | Kannada | 601 | 0.969 | 0.993 | 0.993 | 0.922 | 0.922 |
104
+ | `zul_Latn` | Zulu | 594 | 0.846 | 0.896 | 0.896 | 0.539 | 0.539 |
105
+ | `swh_Latn` | Swahili | 592 | 0.848 | 0.918 | 0.916 | 0.346 | 0.346 |
106
+ | `mar_Deva` | Marathi | 589 | 0.965 | 0.989 | 0.990 | 0.926 | 0.926 |
107
+ | `tso_Latn` | Tsonga | 581 | 0.965 | 0.956 | 0.956 | 0.426 | 0.426 |
108
+ | `hun_Latn` | Hungarian | 576 | 0.987 | 0.999 | 0.999 | 0.232 | 0.232 |
109
+ | `afr_Latn` | Afrikaans | 569 | 0.967 | 0.985 | 0.985 | 0.861 | 0.860 |
110
+ | `tel_Telu` | Telugu | 555 | 0.991 | 0.994 | 0.994 | 0.951 | 0.951 |
111
+ | `rus_Cyrl` | Russian | 528 | 0.932 | 0.949 | 0.949 | 0.462 | 0.462 |
112
+ | `nbl_Latn` | South Ndebele | 528 | 0.903 | 0.948 | 0.949 | 0.000 | 0.000 |
113
+ | `ory_Orya` | Odia (individual language) | 511 | 0.988 | 0.991 | 0.994 | 0.976 | 0.976 |
114
+ | `sot_Latn` | Southern Sotho | 491 | 0.966 | 0.977 | 0.978 | 0.660 | 0.660 |
115
+ | `nso_Latn` | Northern Sotho | 479 | 0.956 | 0.968 | 0.968 | 0.915 | 0.914 |
116
+ | `kua_Latn` | Kuanyama | 476 | 0.962 | 0.986 | 0.986 | 0.000 | 0.000 |
117
+
118
+ Where MillID gains most over GlotLID:
119
+
120
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
121
+ |---|---|---|---|---|---|---|---|
122
+ | `lbj_Tibt` | Ladakhi | 66 | 0.943 | 0.000 | 0.000 | 0.000 | 0.000 |
123
+ | `ain_Latn` | Ainu | 1 | 0.667 | 0.000 | 0.000 | 0.000 | 0.000 |
124
+ | `ajp_Arab` | South Levantine Arabic | 28 | 0.945 | 0.581 | 0.581 | 0.000 | 0.000 |
125
+ | `und_Laoo` | und | 20 | 0.923 | 0.621 | 0.621 | 0.000 | 0.000 |
126
+ | `und_Thaa` | und | 29 | 0.881 | 0.651 | 0.651 | 0.000 | 0.000 |
127
+ | `sgh_Cyrl` | Shughni | 9 | 0.857 | 0.667 | 0.667 | 0.000 | 0.000 |
128
+ | `und_Geor` | und | 32 | 0.877 | 0.694 | 0.694 | 0.000 | 0.000 |
129
+ | `tuk_Arab` | Turkmen | 135 | 0.905 | 0.761 | 0.761 | 0.000 | 0.000 |
130
+ | `und_Syrc` | und | 43 | 0.966 | 0.822 | 0.822 | 0.000 | 0.000 |
131
+ | `gmh_Latn` | Middle High German | 177 | 0.922 | 0.786 | 0.786 | 0.000 | 0.000 |
132
+ | `orv_Cyrl` | Old Russian | 239 | 0.931 | 0.800 | 0.800 | 0.000 | 0.000 |
133
+ | `und_Kana` | und | 136 | 0.982 | 0.862 | 0.862 | 0.000 | 0.000 |
134
+ | `und_Yiii` | und | 38 | 1.000 | 0.894 | 0.884 | 0.000 | 0.000 |
135
+ | `neb_Latn` | Toura (Côte d'Ivoire) | 11 | 0.957 | 0.625 | 0.842 | 0.000 | 0.000 |
136
+ | `dag_Latn` | Dagbani | 149 | 0.767 | 0.662 | 0.660 | 0.000 | 0.000 |
137
+
138
+ Where MillID loses most to GlotLID:
139
+
140
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
141
+ |---|---|---|---|---|---|---|---|
142
+ | `mus_Latn` | Muscogee | 2 | 0.333 | 1.000 | 1.000 | 0.000 | 0.000 |
143
+ | `ttj_Latn` | Tooro | 28 | 0.485 | 0.945 | 0.945 | 0.000 | 0.000 |
144
+ | `mbd_Latn` | Dibabawon Manobo | 14 | 0.596 | 1.000 | 1.000 | 0.000 | 0.000 |
145
+ | `knc_Arab` | Central Kanuri | 68 | 0.462 | 0.823 | 0.825 | 0.007 | 0.007 |
146
+ | `biu_Latn` | Biete | 7 | 0.667 | 1.000 | 1.000 | 0.000 | 0.000 |
147
+ | `dks_Latn` | Southeastern Dinka | 3 | 0.667 | 1.000 | 1.000 | 0.000 | 0.000 |
148
+ | `esi_Latn` | North Alaskan Inupiatun | 9 | 0.455 | 0.783 | 0.783 | 0.000 | 0.000 |
149
+ | `hrv_Latn` | Croatian | 168 | 0.622 | 0.944 | 0.944 | 0.178 | 0.178 |
150
+ | `plw_Latn` | Brooke's Point Palawano | 8 | 0.727 | 1.000 | 1.000 | 0.000 | 0.000 |
151
+ | `bos_Latn` | Bosnian | 198 | 0.649 | 0.902 | 0.902 | 0.181 | 0.181 |
152
+ | `xbr_Latn` | Kambera | 8 | 0.750 | 1.000 | 1.000 | 0.000 | 0.000 |
153
+ | `nyf_Latn` | Giryama | 10 | 0.645 | 0.952 | 0.870 | 0.000 | 0.000 |
154
+ | `ldi_Latn` | Laari | 62 | 0.777 | 0.992 | 0.992 | 0.000 | 0.000 |
155
+ | `hak_Hani` | Hakka Chinese | 29 | 0.621 | 0.824 | 0.824 | 0.000 | 0.000 |
156
+ | `ccp_Latn` | Chakma | 3 | 0.800 | 1.000 | 1.000 | 0.000 | 0.000 |
157
+
158
+ ### Leaderboard: udhr
159
+
160
+ MillID's F1 against the others', language by language: against GlotLID restricted to MillID's labels, MillID is better on **52** languages, worse on **105** and within 0.01 on 201; against fastText restricted to MillID's labels, MillID is better on **303** languages, worse on **15** and within 0.01 on 40. The full table, with precision and recall, is
161
+ `reports/udhr/leaderboard.csv`.
162
+
163
+ The 20 languages with the most passages:
164
+
165
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
166
+ |---|---|---|---|---|---|---|---|
167
+ | `roh_Latn` | Romansh | 399 | 0.994 | 0.999 | 0.999 | 0.945 | 0.945 |
168
+ | `oci_Latn` | Occitan | 398 | 0.277 | 0.376 | 0.376 | 0.436 | 0.436 |
169
+ | `cmn_Hani` | Chinese (Mandarin) | 319 | 0.892 | 0.868 | 0.868 | 0.468 | 0.468 |
170
+ | `krl_Latn` | Karelian | 183 | 0.000 | 0.011 | 0.011 | 0.000 | 0.000 |
171
+ | `qug_Latn` | Chimborazo Highland Quichua | 182 | 0.011 | 0.000 | 0.000 | 0.000 | 0.000 |
172
+ | `acu_Latn` | Achuar-Shiwiar | 180 | 0.828 | 0.854 | 0.854 | 0.000 | 0.000 |
173
+ | `hus_Latn` | Huastec | 175 | 0.977 | 0.986 | 0.986 | 0.000 | 0.000 |
174
+ | `hau_Latn` | Hausa | 155 | 0.990 | 1.000 | 1.000 | 0.876 | 0.876 |
175
+ | `auc_Latn` | Waorani | 154 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
176
+ | `kwi_Latn` | Awa-Cuaiquer | 145 | 0.880 | 0.877 | 0.877 | 0.000 | 0.000 |
177
+ | `jpn_Jpan` | Japanese | 140 | 1.000 | 1.000 | 1.000 | 0.944 | 0.944 |
178
+ | `snn_Latn` | Siona | 136 | 0.631 | 0.514 | 0.514 | 0.000 | 0.000 |
179
+ | `ktu_Latn` | Kituba (Democratic Republic of Congo) | 118 | 0.765 | 0.680 | 0.680 | 0.000 | 0.000 |
180
+ | `lat_Latn` | Latin | 118 | 0.996 | 0.991 | 0.991 | 0.000 | 0.000 |
181
+ | `hat_Latn` | Haitian Creole | 117 | 0.991 | 0.979 | 0.979 | 0.699 | 0.699 |
182
+ | `nya_Latn` | Nyanja | 116 | 0.991 | 1.000 | 1.000 | 0.806 | 0.806 |
183
+ | `kmb_Latn` | Kimbundu | 116 | 0.970 | 1.000 | 1.000 | 0.877 | 0.877 |
184
+ | `rmn_Latn` | Balkan Romani | 116 | 0.678 | 0.857 | 0.857 | 0.000 | 0.000 |
185
+ | `twi_Latn` | Twi | 116 | 0.983 | 0.996 | 0.996 | 0.399 | 0.396 |
186
+ | `chr_Cher` | Cherokee | 115 | 0.671 | 0.663 | 0.663 | 0.000 | 0.000 |
187
+
188
+ Where MillID gains most over GlotLID:
189
+
190
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
191
+ |---|---|---|---|---|---|---|---|
192
+ | `mic_Latn` | Mi'kmaw | 59 | 0.991 | 0.427 | 0.427 | 0.000 | 0.000 |
193
+ | `tet_Latn` | Tetum | 58 | 0.638 | 0.167 | 0.167 | 0.000 | 0.000 |
194
+ | `fuf_Latn` | Pular | 58 | 0.906 | 0.483 | 0.483 | 0.000 | 0.000 |
195
+ | `sag_Latn` | Sango | 59 | 0.991 | 0.578 | 0.578 | 0.189 | 0.189 |
196
+ | `skr_Arab` | Saraiki | 63 | 0.867 | 0.500 | 0.500 | 0.000 | 0.000 |
197
+ | `qvh_Latn` | Huamalíes-Dos de Mayo Huánuco Quechua | 58 | 0.468 | 0.154 | 0.154 | 0.000 | 0.000 |
198
+ | `zgh_Tfng` | Standard Moroccan Tamazight | 60 | 0.750 | 0.462 | 0.462 | 0.000 | 0.000 |
199
+ | `lld_Latn` | Ladin | 59 | 0.909 | 0.731 | 0.731 | 0.000 | 0.000 |
200
+ | `tah_Latn` | Tahitian | 57 | 0.973 | 0.813 | 0.813 | 0.966 | 0.966 |
201
+ | `yue_Hani` | Cantonese | 49 | 0.734 | 0.580 | 0.580 | 0.111 | 0.111 |
202
+ | `ote_Latn` | Mezquital Otomi | 59 | 0.154 | 0.000 | 0.000 | 0.000 | 0.000 |
203
+ | `pnb_Arab` | Western Panjabi | 61 | 0.882 | 0.739 | 0.739 | 0.000 | 0.000 |
204
+ | `mxv_Latn` | Metlatónoc Mixtec | 58 | 0.129 | 0.000 | 0.000 | 0.000 | 0.000 |
205
+ | `lij_Latn` | Ligurian | 58 | 0.983 | 0.859 | 0.859 | 0.487 | 0.487 |
206
+ | `bum_Latn` | Bulu | 58 | 0.215 | 0.098 | 0.098 | 0.000 | 0.000 |
207
+
208
+ Where MillID loses most to GlotLID:
209
+
210
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
211
+ |---|---|---|---|---|---|---|---|
212
+ | `gyr_Latn` | Guarayu | 49 | 0.537 | 0.990 | 0.990 | 0.000 | 0.000 |
213
+ | `shp_Latn` | Shipibo-Conibo | 62 | 0.469 | 0.912 | 0.912 | 0.000 | 0.000 |
214
+ | `dyu_Latn` | Dyula | 58 | 0.000 | 0.434 | 0.434 | 0.015 | 0.015 |
215
+ | `tbz_Latn` | Ditammari | 60 | 0.000 | 0.378 | 0.378 | 0.000 | 0.000 |
216
+ | `cbu_Latn` | Candoshi-Shapra | 57 | 0.500 | 0.882 | 0.874 | 0.000 | 0.000 |
217
+ | `idu_Latn` | Idoma | 51 | 0.603 | 0.879 | 0.938 | 0.000 | 0.000 |
218
+ | `ell_Grek` | Greek | 115 | 0.671 | 1.000 | 1.000 | 1.000 | 1.000 |
219
+ | `qvc_Latn` | Cajamarca Quechua | 58 | 0.648 | 0.906 | 0.906 | 0.000 | 0.000 |
220
+ | `cpu_Latn` | Pichis Ashéninka | 60 | 0.729 | 0.974 | 0.974 | 0.000 | 0.000 |
221
+ | `qvn_Latn` | North Junín Quechua | 57 | 0.219 | 0.459 | 0.459 | 0.000 | 0.000 |
222
+ | `hin_Deva` | Hindi | 59 | 0.723 | 0.957 | 0.957 | 0.975 | 0.975 |
223
+ | `hrv_Latn` | Croatian | 58 | 0.500 | 0.727 | 0.727 | 0.474 | 0.474 |
224
+ | `kbp_Latn` | Kabiyè | 59 | 0.781 | 1.000 | 1.000 | 0.389 | 0.389 |
225
+ | `cni_Latn` | Asháninka | 52 | 0.773 | 0.963 | 0.963 | 0.000 | 0.000 |
226
+ | `rmn_Latn` | Balkan Romani | 116 | 0.678 | 0.857 | 0.857 | 0.000 | 0.000 |
227
+
228
+ ### Leaderboard: test-common
229
+
230
+ MillID's F1 against the others', language by language: against GlotLID restricted to MillID's labels, MillID is better on **6** languages, worse on **154** and within 0.01 on 53; against fastText restricted to MillID's labels, MillID is better on **85** languages, worse on **51** and within 0.01 on 77. The full table, with precision and recall, is
231
+ `reports/test-common/leaderboard.csv`.
232
+
233
+ The 20 languages with the most passages:
234
+
235
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
236
+ |---|---|---|---|---|---|---|---|
237
+ | `fra_Latn` | French | 1652 | 0.943 | 0.955 | 0.955 | 0.963 | 0.963 |
238
+ | `eng_Latn` | English | 1444 | 0.932 | 0.876 | 0.877 | 0.857 | 0.857 |
239
+ | `spa_Latn` | Spanish | 1136 | 0.937 | 0.958 | 0.958 | 0.941 | 0.941 |
240
+ | `tam_Taml` | Tamil | 754 | 0.997 | 1.000 | 1.000 | 0.997 | 0.997 |
241
+ | `arb_Arab` | Arabic (Modern Standard) | 745 | 0.871 | 0.886 | 0.886 | 0.957 | 0.954 |
242
+ | `por_Latn` | Portuguese | 657 | 0.959 | 0.954 | 0.956 | 0.950 | 0.949 |
243
+ | `kan_Knda` | Kannada | 601 | 0.973 | 0.994 | 0.994 | 0.999 | 0.999 |
244
+ | `zul_Latn` | Zulu | 594 | 0.883 | 0.904 | 0.904 | 0.970 | 0.970 |
245
+ | `swh_Latn` | Swahili | 592 | 0.893 | 0.954 | 0.953 | 0.945 | 0.945 |
246
+ | `mar_Deva` | Marathi | 589 | 0.968 | 0.989 | 0.990 | 0.987 | 0.987 |
247
+ | `tso_Latn` | Tsonga | 581 | 0.979 | 0.956 | 0.956 | 0.986 | 0.986 |
248
+ | `hun_Latn` | Hungarian | 576 | 0.989 | 1.000 | 1.000 | 0.980 | 0.980 |
249
+ | `afr_Latn` | Afrikaans | 569 | 0.972 | 0.985 | 0.985 | 0.986 | 0.986 |
250
+ | `tel_Telu` | Telugu | 555 | 0.997 | 0.998 | 0.998 | 0.999 | 0.999 |
251
+ | `rus_Cyrl` | Russian | 528 | 0.945 | 0.985 | 0.985 | 0.927 | 0.927 |
252
+ | `ory_Orya` | Odia (individual language) | 511 | 0.994 | 0.997 | 1.000 | 0.996 | 0.996 |
253
+ | `sot_Latn` | Southern Sotho | 491 | 0.969 | 0.977 | 0.978 | 0.856 | 0.856 |
254
+ | `nso_Latn` | Northern Sotho | 479 | 0.958 | 0.970 | 0.970 | 0.967 | 0.967 |
255
+ | `asm_Beng` | Assamese | 467 | 0.997 | 0.999 | 0.999 | 0.997 | 0.997 |
256
+ | `ben_Beng` | Bangla | 466 | 0.988 | 0.997 | 0.997 | 0.989 | 0.989 |
257
+
258
+ Where MillID gains most over GlotLID:
259
+
260
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
261
+ |---|---|---|---|---|---|---|---|
262
+ | `ewo_Latn` | Ewondo | 134 | 0.959 | 0.879 | 0.883 | 0.860 | 0.860 |
263
+ | `eng_Latn` | English | 1444 | 0.932 | 0.876 | 0.877 | 0.857 | 0.857 |
264
+ | `arb_Latn` | Standard Arabic | 163 | 0.942 | 0.906 | 0.913 | 0.852 | 0.852 |
265
+ | `tso_Latn` | Tsonga | 581 | 0.979 | 0.956 | 0.956 | 0.986 | 0.986 |
266
+ | `fuv_Latn` | Nigerian Fulfulde | 164 | 0.907 | 0.877 | 0.892 | 0.859 | 0.859 |
267
+ | `knc_Latn` | Central Kanuri | 293 | 0.967 | 0.952 | 0.952 | 0.981 | 0.981 |
268
+ | `quy_Latn` | Ayacucho Quechua | 271 | 0.940 | 0.925 | 0.933 | 0.979 | 0.979 |
269
+ | `kam_Latn` | Kamba | 272 | 0.980 | 0.972 | 0.974 | 0.862 | 0.862 |
270
+ | `bjn_Arab` | Banjar | 116 | 0.991 | 0.834 | 0.987 | 0.453 | 0.960 |
271
+ | `por_Latn` | Portuguese | 657 | 0.959 | 0.954 | 0.956 | 0.950 | 0.949 |
272
+ | `mlt_Latn` | Maltese | 291 | 0.995 | 0.993 | 0.993 | 0.961 | 0.961 |
273
+ | `san_Deva` | Sanskrit | 239 | 0.990 | 0.989 | 0.989 | 0.970 | 0.970 |
274
+ | `hye_Armn` | Armenian | 178 | 1.000 | 1.000 | 1.000 | 0.977 | 0.977 |
275
+ | `guj_Gujr` | Gujarati | 354 | 1.000 | 1.000 | 1.000 | 0.984 | 0.984 |
276
+ | `mal_Mlym` | Malayalam | 338 | 1.000 | 1.000 | 1.000 | 0.994 | 0.994 |
277
+
278
+ Where MillID loses most to GlotLID:
279
+
280
+ | Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted | fastText F1 | fastText F1, restricted |
281
+ |---|---|---|---|---|---|---|---|
282
+ | `knc_Arab` | Central Kanuri | 68 | 0.522 | 0.857 | 0.860 | 0.029 | 0.029 |
283
+ | `hrv_Latn` | Croatian | 168 | 0.659 | 0.994 | 0.994 | 0.856 | 0.856 |
284
+ | `bos_Latn` | Bosnian | 198 | 0.685 | 1.000 | 1.000 | 0.897 | 0.897 |
285
+ | `tzm_Tfng` | Central Atlas Tamazight | 157 | 0.697 | 0.935 | 0.935 | 0.751 | 0.751 |
286
+ | `zsm_Latn` | Standard Malay | 244 | 0.789 | 0.998 | 0.998 | 0.908 | 0.908 |
287
+ | `taq_Tfng` | Tamasheq | 104 | 0.654 | 0.805 | 0.805 | 0.000 | 0.000 |
288
+ | `ind_Latn` | Indonesian | 335 | 0.842 | 0.991 | 0.991 | 0.887 | 0.887 |
289
+ | `kas_Deva` | Kashmiri | 47 | 0.557 | 0.703 | 0.703 | 0.587 | 0.587 |
290
+ | `cjk_Latn` | Chokwe | 24 | 0.857 | 1.000 | 1.000 | 0.807 | 0.807 |
291
+ | `nob_Latn` | Norwegian Bokmål | 265 | 0.821 | 0.961 | 0.959 | 0.894 | 0.894 |
292
+ | `kin_Latn` | Kinyarwanda | 210 | 0.849 | 0.981 | 0.981 | 0.854 | 0.854 |
293
+ | `mag_Deva` | Magahi | 97 | 0.890 | 1.000 | 1.000 | 0.772 | 0.772 |
294
+ | `lim_Latn` | Limburgish | 196 | 0.896 | 1.000 | 1.000 | 0.956 | 0.956 |
295
+ | `run_Latn` | Rundi | 291 | 0.883 | 0.985 | 0.985 | 0.854 | 0.854 |
296
+ | `taq_Latn` | Tamasheq | 106 | 0.902 | 1.000 | 1.000 | 0.838 | 0.838 |
297
+
298
+ Per-language precision, recall (sensitivity), F1 and specificity for every model are in `reports/<set>/`.
299
+
300
+ ## Training
301
+
302
+ 1,943,957 passages, best validation macro F1 at step 106000, 0.6 hours.
303
+ Languages sampled in proportion to n^0.3; 25% of passages cut to a 20 to 80 character
304
+ snippet; batch 512, AdamW at 0.001, cosine schedule, label smoothing 0.1.
config.json ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": {
3
+ "num_labels": 1641,
4
+ "max_len": 256,
5
+ "d_model": 192,
6
+ "n_layers": 3,
7
+ "n_heads": 3,
8
+ "dropout": 0.1,
9
+ "conv_kernel": 5,
10
+ "downsample": 1,
11
+ "ngram_buckets": 4096,
12
+ "script_buckets": 512,
13
+ "rope_theta": 10000.0,
14
+ "vocab_size": 259,
15
+ "modalities": [
16
+ "text"
17
+ ],
18
+ "model_type": "millid-byte-encoder"
19
+ },
20
+ "training": {
21
+ "dataset": "baobabtech/millid-dataset",
22
+ "preset": "tiny",
23
+ "max_len": 256,
24
+ "steps": 120000,
25
+ "batch_size": 512,
26
+ "lr": 0.001,
27
+ "warmup": 2000,
28
+ "weight_decay": 0.01,
29
+ "dropout": 0.1,
30
+ "label_smoothing": 0.1,
31
+ "alpha": 0.3,
32
+ "short_p": 0.25,
33
+ "eval_every": 2000,
34
+ "eval_per_label": 20,
35
+ "patience": 12000,
36
+ "commercial_only": false,
37
+ "extra": [],
38
+ "compare_glotlid": true,
39
+ "compare_fasttext": true,
40
+ "final_eval": "all",
41
+ "output_dir": "millid-out",
42
+ "push_to": "baobabtech/millid-tiny-v1.5",
43
+ "public": false,
44
+ "seed": 7,
45
+ "log_every": 100,
46
+ "threads": 0,
47
+ "workers": -1,
48
+ "compile": true,
49
+ "gpus": 0,
50
+ "wandb_project": "millid",
51
+ "wandb_entity": "mscsr000324-must",
52
+ "wandb_run_name": "millid-tiny-v1.5",
53
+ "wandb_tags": [
54
+ "tiny",
55
+ "v1.5"
56
+ ],
57
+ "no_wandb": false
58
+ },
59
+ "best_step": 106000,
60
+ "parameters": 2927145,
61
+ "gpus": 1,
62
+ "train_passages": 1943957,
63
+ "trained_labels": 1641,
64
+ "seconds": 1999
65
+ }
labels.json ADDED
@@ -0,0 +1,3320 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "scheme": "ISO 639-3 language + '_' + ISO 15924 script, e.g. eng_Latn, amh_Ethi",
3
+ "text_encoding": "Unicode NFKC, whitespace collapsed, then UTF-8 bytes",
4
+ "labels": [
5
+ "aai_Latn",
6
+ "aak_Latn",
7
+ "aau_Latn",
8
+ "aaz_Latn",
9
+ "aba_Latn",
10
+ "abk_Cyrl",
11
+ "abn_Latn",
12
+ "abq_Cyrl",
13
+ "abs_Latn",
14
+ "abt_Latn",
15
+ "abx_Latn",
16
+ "aby_Latn",
17
+ "abz_Latn",
18
+ "aca_Latn",
19
+ "acd_Latn",
20
+ "ace_Latn",
21
+ "acf_Latn",
22
+ "ach_Latn",
23
+ "acm_Arab",
24
+ "acn_Latn",
25
+ "acr_Latn",
26
+ "acu_Latn",
27
+ "ada_Latn",
28
+ "ade_Latn",
29
+ "adh_Latn",
30
+ "adi_Latn",
31
+ "adj_Latn",
32
+ "ady_Cyrl",
33
+ "adz_Latn",
34
+ "aeb_Arab",
35
+ "aeb_Latn",
36
+ "aer_Latn",
37
+ "aeu_Latn",
38
+ "aey_Latn",
39
+ "afr_Latn",
40
+ "agd_Latn",
41
+ "agg_Latn",
42
+ "agm_Latn",
43
+ "agn_Latn",
44
+ "agr_Latn",
45
+ "agt_Latn",
46
+ "agu_Latn",
47
+ "agx_Cyrl",
48
+ "ahk_Latn",
49
+ "aia_Latn",
50
+ "aii_Syrc",
51
+ "ain_Latn",
52
+ "ajg_Latn",
53
+ "aji_Latn",
54
+ "ajp_Arab",
55
+ "akb_Latn",
56
+ "ake_Latn",
57
+ "akh_Latn",
58
+ "akp_Latn",
59
+ "aln_Latn",
60
+ "alp_Latn",
61
+ "alq_Latn",
62
+ "als_Latn",
63
+ "alt_Cyrl",
64
+ "aly_Latn",
65
+ "alz_Latn",
66
+ "ame_Latn",
67
+ "amf_Latn",
68
+ "amh_Ethi",
69
+ "ami_Latn",
70
+ "amk_Latn",
71
+ "amm_Latn",
72
+ "amn_Latn",
73
+ "amp_Latn",
74
+ "amr_Latn",
75
+ "amu_Latn",
76
+ "amx_Latn",
77
+ "ang_Latn",
78
+ "ann_Latn",
79
+ "anp_Deva",
80
+ "anv_Latn",
81
+ "any_Latn",
82
+ "aoi_Latn",
83
+ "aoj_Latn",
84
+ "aom_Latn",
85
+ "aoz_Latn",
86
+ "apb_Latn",
87
+ "apc_Arab",
88
+ "ape_Latn",
89
+ "apn_Latn",
90
+ "apr_Latn",
91
+ "apt_Latn",
92
+ "apu_Latn",
93
+ "apw_Latn",
94
+ "apy_Latn",
95
+ "apz_Latn",
96
+ "arb_Arab",
97
+ "arb_Latn",
98
+ "are_Latn",
99
+ "arg_Latn",
100
+ "arl_Latn",
101
+ "arn_Latn",
102
+ "arp_Latn",
103
+ "arq_Arab",
104
+ "ars_Arab",
105
+ "ary_Arab",
106
+ "arz_Arab",
107
+ "asm_Beng",
108
+ "asm_Latn",
109
+ "aso_Latn",
110
+ "ast_Latn",
111
+ "ata_Latn",
112
+ "atb_Latn",
113
+ "atd_Latn",
114
+ "atg_Latn",
115
+ "ati_Latn",
116
+ "atj_Latn",
117
+ "att_Latn",
118
+ "auc_Latn",
119
+ "aui_Latn",
120
+ "auy_Latn",
121
+ "ava_Cyrl",
122
+ "avk_Latn",
123
+ "avt_Latn",
124
+ "avu_Latn",
125
+ "awa_Deva",
126
+ "awb_Latn",
127
+ "awx_Latn",
128
+ "ayp_Arab",
129
+ "ayr_Latn",
130
+ "azb_Arab",
131
+ "azg_Latn",
132
+ "azj_Cyrl",
133
+ "azj_Latn",
134
+ "azz_Latn",
135
+ "bak_Cyrl",
136
+ "bam_Latn",
137
+ "ban_Latn",
138
+ "bao_Latn",
139
+ "bar_Latn",
140
+ "bas_Latn",
141
+ "bba_Latn",
142
+ "bbb_Latn",
143
+ "bbc_Latn",
144
+ "bbr_Latn",
145
+ "bcc_Arab",
146
+ "bch_Latn",
147
+ "bci_Latn",
148
+ "bcl_Latn",
149
+ "bco_Latn",
150
+ "bcw_Latn",
151
+ "bdd_Latn",
152
+ "bdh_Latn",
153
+ "bdq_Latn",
154
+ "bea_Latn",
155
+ "bef_Latn",
156
+ "bel_Cyrl",
157
+ "bem_Latn",
158
+ "ben_Beng",
159
+ "ben_Latn",
160
+ "beq_Latn",
161
+ "bew_Latn",
162
+ "bfd_Latn",
163
+ "bgr_Latn",
164
+ "bgs_Latn",
165
+ "bgt_Latn",
166
+ "bgz_Latn",
167
+ "bhg_Latn",
168
+ "bhl_Latn",
169
+ "bho_Deva",
170
+ "bhw_Latn",
171
+ "bib_Latn",
172
+ "big_Latn",
173
+ "bim_Latn",
174
+ "bin_Latn",
175
+ "bis_Latn",
176
+ "biu_Latn",
177
+ "biv_Latn",
178
+ "bjn_Arab",
179
+ "bjn_Latn",
180
+ "bjp_Latn",
181
+ "bjr_Latn",
182
+ "bjv_Latn",
183
+ "bkd_Latn",
184
+ "bkq_Latn",
185
+ "bku_Latn",
186
+ "bla_Latn",
187
+ "blh_Latn",
188
+ "blk_Mymr",
189
+ "blt_Latn",
190
+ "blw_Latn",
191
+ "blz_Latn",
192
+ "bmh_Latn",
193
+ "bmk_Latn",
194
+ "bmq_Latn",
195
+ "bmr_Latn",
196
+ "bmu_Latn",
197
+ "bno_Latn",
198
+ "bnp_Latn",
199
+ "boa_Latn",
200
+ "bod_Tibt",
201
+ "boj_Latn",
202
+ "bon_Latn",
203
+ "bos_Latn",
204
+ "box_Latn",
205
+ "bpr_Latn",
206
+ "bps_Latn",
207
+ "bpy_Beng",
208
+ "bqc_Latn",
209
+ "bqp_Latn",
210
+ "bre_Latn",
211
+ "brh_Arab",
212
+ "bru_Latn",
213
+ "brx_Deva",
214
+ "bsn_Latn",
215
+ "bsp_Latn",
216
+ "bsq_Latn",
217
+ "bss_Latn",
218
+ "btd_Latn",
219
+ "bth_Latn",
220
+ "bts_Latn",
221
+ "btx_Latn",
222
+ "bud_Latn",
223
+ "bug_Latn",
224
+ "buk_Latn",
225
+ "bul_Cyrl",
226
+ "bum_Latn",
227
+ "bus_Latn",
228
+ "bvd_Latn",
229
+ "bvr_Latn",
230
+ "bvz_Latn",
231
+ "bwd_Latn",
232
+ "bwu_Latn",
233
+ "bxh_Latn",
234
+ "bxr_Cyrl",
235
+ "byr_Latn",
236
+ "byx_Latn",
237
+ "bzd_Latn",
238
+ "bzh_Latn",
239
+ "bzi_Thai",
240
+ "bzj_Latn",
241
+ "caa_Latn",
242
+ "cab_Latn",
243
+ "cac_Latn",
244
+ "caf_Latn",
245
+ "cag_Latn",
246
+ "cak_Latn",
247
+ "cao_Latn",
248
+ "cap_Latn",
249
+ "caq_Latn",
250
+ "car_Latn",
251
+ "cas_Latn",
252
+ "cat_Latn",
253
+ "cav_Latn",
254
+ "cax_Latn",
255
+ "cbc_Latn",
256
+ "cbi_Latn",
257
+ "cbk_Latn",
258
+ "cbr_Latn",
259
+ "cbs_Latn",
260
+ "cbt_Latn",
261
+ "cbu_Latn",
262
+ "cbv_Latn",
263
+ "cce_Latn",
264
+ "cco_Latn",
265
+ "ccp_Latn",
266
+ "ceb_Latn",
267
+ "ceg_Latn",
268
+ "cek_Latn",
269
+ "ces_Latn",
270
+ "cfm_Latn",
271
+ "cgc_Latn",
272
+ "cha_Latn",
273
+ "chd_Latn",
274
+ "che_Cyrl",
275
+ "chf_Latn",
276
+ "chk_Latn",
277
+ "cho_Latn",
278
+ "chq_Latn",
279
+ "chr_Cher",
280
+ "chu_Cyrl",
281
+ "chv_Cyrl",
282
+ "chw_Latn",
283
+ "chz_Latn",
284
+ "cjk_Latn",
285
+ "cjp_Latn",
286
+ "cjs_Cyrl",
287
+ "cjv_Latn",
288
+ "ckb_Arab",
289
+ "ckm_Latn",
290
+ "cko_Latn",
291
+ "ckt_Cyrl",
292
+ "clu_Latn",
293
+ "cme_Latn",
294
+ "cmn_Hani",
295
+ "cmo_Latn",
296
+ "cnh_Latn",
297
+ "cni_Latn",
298
+ "cnk_Latn",
299
+ "cnr_Latn",
300
+ "cnw_Latn",
301
+ "coe_Latn",
302
+ "cof_Latn",
303
+ "cok_Latn",
304
+ "con_Latn",
305
+ "cop_Copt",
306
+ "cor_Latn",
307
+ "cos_Latn",
308
+ "cot_Latn",
309
+ "cpb_Latn",
310
+ "cpc_Latn",
311
+ "cpu_Latn",
312
+ "cpy_Latn",
313
+ "crh_Cyrl",
314
+ "crh_Latn",
315
+ "crj_Cans",
316
+ "crk_Cans",
317
+ "crk_Latn",
318
+ "crl_Cans",
319
+ "crm_Cans",
320
+ "crn_Latn",
321
+ "crs_Latn",
322
+ "crx_Latn",
323
+ "csb_Latn",
324
+ "csw_Latn",
325
+ "csy_Latn",
326
+ "cta_Latn",
327
+ "ctd_Latn",
328
+ "cto_Latn",
329
+ "ctp_Latn",
330
+ "ctu_Latn",
331
+ "cub_Latn",
332
+ "cui_Latn",
333
+ "cuk_Latn",
334
+ "cul_Latn",
335
+ "cut_Latn",
336
+ "cux_Latn",
337
+ "cwe_Latn",
338
+ "cwt_Latn",
339
+ "cya_Latn",
340
+ "cym_Latn",
341
+ "czt_Latn",
342
+ "daa_Latn",
343
+ "dad_Latn",
344
+ "daf_Latn",
345
+ "dag_Latn",
346
+ "dah_Latn",
347
+ "dak_Latn",
348
+ "dan_Latn",
349
+ "dar_Cyrl",
350
+ "ddg_Latn",
351
+ "ded_Latn",
352
+ "des_Latn",
353
+ "deu_Latn",
354
+ "dga_Latn",
355
+ "dgc_Latn",
356
+ "dgi_Latn",
357
+ "dgr_Latn",
358
+ "dgz_Latn",
359
+ "dhm_Latn",
360
+ "dhv_Latn",
361
+ "dig_Latn",
362
+ "dik_Latn",
363
+ "diq_Latn",
364
+ "diu_Latn",
365
+ "div_Thaa",
366
+ "dje_Latn",
367
+ "djk_Latn",
368
+ "djr_Latn",
369
+ "dks_Latn",
370
+ "dng_Cyrl",
371
+ "dnj_Latn",
372
+ "dnw_Latn",
373
+ "dob_Latn",
374
+ "doi_Deva",
375
+ "dop_Latn",
376
+ "dos_Latn",
377
+ "drg_Latn",
378
+ "dru_Latn",
379
+ "dsb_Latn",
380
+ "dtp_Latn",
381
+ "dts_Latn",
382
+ "dua_Latn",
383
+ "duo_Latn",
384
+ "dur_Latn",
385
+ "dwr_Latn",
386
+ "dww_Latn",
387
+ "dyi_Latn",
388
+ "dyo_Latn",
389
+ "dyu_Latn",
390
+ "dzo_Tibt",
391
+ "ebk_Latn",
392
+ "efi_Latn",
393
+ "ekk_Latn",
394
+ "eko_Latn",
395
+ "ell_Grek",
396
+ "emi_Latn",
397
+ "eml_Latn",
398
+ "emp_Latn",
399
+ "enb_Latn",
400
+ "eng_Latn",
401
+ "enl_Latn",
402
+ "enm_Latn",
403
+ "enq_Latn",
404
+ "epo_Latn",
405
+ "eri_Latn",
406
+ "ese_Latn",
407
+ "esi_Latn",
408
+ "esk_Latn",
409
+ "ess_Latn",
410
+ "esu_Latn",
411
+ "etr_Latn",
412
+ "eus_Latn",
413
+ "eve_Cyrl",
414
+ "ewe_Latn",
415
+ "ewo_Latn",
416
+ "ext_Latn",
417
+ "eza_Latn",
418
+ "faa_Latn",
419
+ "fai_Latn",
420
+ "fal_Latn",
421
+ "fan_Latn",
422
+ "fao_Latn",
423
+ "far_Latn",
424
+ "fas_Arab",
425
+ "fat_Latn",
426
+ "ffm_Latn",
427
+ "fij_Latn",
428
+ "fil_Latn",
429
+ "fin_Latn",
430
+ "fit_Latn",
431
+ "fkv_Latn",
432
+ "fon_Latn",
433
+ "for_Latn",
434
+ "fra_Latn",
435
+ "frd_Latn",
436
+ "fro_Latn",
437
+ "frp_Latn",
438
+ "frr_Latn",
439
+ "fry_Latn",
440
+ "fub_Latn",
441
+ "fue_Latn",
442
+ "fuf_Latn",
443
+ "fuh_Latn",
444
+ "fur_Latn",
445
+ "fuv_Arab",
446
+ "fuv_Latn",
447
+ "gaa_Latn",
448
+ "gag_Cyrl",
449
+ "gag_Latn",
450
+ "gah_Latn",
451
+ "gai_Latn",
452
+ "gam_Latn",
453
+ "gaw_Latn",
454
+ "gaz_Latn",
455
+ "gbi_Latn",
456
+ "gbo_Latn",
457
+ "gcf_Latn",
458
+ "gcr_Latn",
459
+ "gde_Latn",
460
+ "gdg_Latn",
461
+ "gdn_Latn",
462
+ "gdr_Latn",
463
+ "geb_Latn",
464
+ "gfk_Latn",
465
+ "ghs_Latn",
466
+ "gil_Latn",
467
+ "gjn_Latn",
468
+ "gkn_Latn",
469
+ "gla_Latn",
470
+ "gle_Latn",
471
+ "glg_Latn",
472
+ "glk_Arab",
473
+ "glv_Latn",
474
+ "gmh_Latn",
475
+ "gmv_Ethi",
476
+ "gmv_Latn",
477
+ "gnb_Latn",
478
+ "gnd_Latn",
479
+ "gng_Latn",
480
+ "gnn_Latn",
481
+ "gnw_Latn",
482
+ "gof_Ethi",
483
+ "gof_Latn",
484
+ "gog_Latn",
485
+ "goh_Latn",
486
+ "gom_Deva",
487
+ "gom_Latn",
488
+ "gor_Latn",
489
+ "gos_Latn",
490
+ "got_Goth",
491
+ "gqr_Latn",
492
+ "grc_Grek",
493
+ "grt_Beng",
494
+ "gso_Latn",
495
+ "gsw_Latn",
496
+ "gub_Latn",
497
+ "guc_Latn",
498
+ "gug_Latn",
499
+ "guh_Latn",
500
+ "gui_Latn",
501
+ "guj_Gujr",
502
+ "guj_Latn",
503
+ "guk_Ethi",
504
+ "gul_Latn",
505
+ "gum_Latn",
506
+ "gun_Latn",
507
+ "guo_Latn",
508
+ "guq_Latn",
509
+ "gur_Latn",
510
+ "guw_Latn",
511
+ "gux_Latn",
512
+ "guz_Latn",
513
+ "gvc_Latn",
514
+ "gvf_Latn",
515
+ "gvl_Latn",
516
+ "gvn_Latn",
517
+ "gwi_Latn",
518
+ "gym_Latn",
519
+ "gyr_Latn",
520
+ "hac_Arab",
521
+ "hae_Latn",
522
+ "hag_Latn",
523
+ "hak_Hani",
524
+ "hak_Latn",
525
+ "hat_Latn",
526
+ "hau_Latn",
527
+ "hav_Latn",
528
+ "haw_Latn",
529
+ "hay_Latn",
530
+ "hbo_Hebr",
531
+ "hch_Latn",
532
+ "heb_Hebr",
533
+ "heg_Latn",
534
+ "heh_Latn",
535
+ "her_Latn",
536
+ "hif_Latn",
537
+ "hig_Latn",
538
+ "hil_Latn",
539
+ "hin_Deva",
540
+ "hin_Latn",
541
+ "hix_Latn",
542
+ "hla_Latn",
543
+ "hmo_Latn",
544
+ "hmr_Latn",
545
+ "hne_Deva",
546
+ "hnj_Latn",
547
+ "hnn_Latn",
548
+ "hns_Latn",
549
+ "hop_Latn",
550
+ "hot_Latn",
551
+ "hra_Latn",
552
+ "hrv_Latn",
553
+ "hrx_Latn",
554
+ "hsb_Latn",
555
+ "hto_Latn",
556
+ "hub_Latn",
557
+ "hui_Latn",
558
+ "hun_Latn",
559
+ "hus_Latn",
560
+ "huu_Latn",
561
+ "huv_Latn",
562
+ "hvn_Latn",
563
+ "hwc_Latn",
564
+ "hye_Armn",
565
+ "hyw_Armn",
566
+ "ian_Latn",
567
+ "iba_Latn",
568
+ "ibg_Latn",
569
+ "ibo_Latn",
570
+ "icr_Latn",
571
+ "ido_Latn",
572
+ "idu_Latn",
573
+ "ifb_Latn",
574
+ "ife_Latn",
575
+ "ifk_Latn",
576
+ "ifu_Latn",
577
+ "ify_Latn",
578
+ "ige_Latn",
579
+ "ign_Latn",
580
+ "ike_Cans",
581
+ "ikk_Latn",
582
+ "ikt_Latn",
583
+ "ikw_Latn",
584
+ "ile_Latn",
585
+ "ilo_Latn",
586
+ "imo_Latn",
587
+ "ina_Latn",
588
+ "inb_Latn",
589
+ "ind_Latn",
590
+ "inh_Cyrl",
591
+ "ino_Latn",
592
+ "iou_Latn",
593
+ "ipi_Latn",
594
+ "irk_Latn",
595
+ "isd_Latn",
596
+ "ish_Latn",
597
+ "isl_Latn",
598
+ "iso_Latn",
599
+ "ita_Latn",
600
+ "itv_Latn",
601
+ "ium_Latn",
602
+ "ivv_Latn",
603
+ "iws_Latn",
604
+ "ixl_Latn",
605
+ "izr_Latn",
606
+ "izz_Latn",
607
+ "jac_Latn",
608
+ "jae_Latn",
609
+ "jam_Latn",
610
+ "jav_Latn",
611
+ "jbo_Latn",
612
+ "jbu_Latn",
613
+ "jic_Latn",
614
+ "jiv_Latn",
615
+ "jpn_Jpan",
616
+ "jra_Latn",
617
+ "jvn_Latn",
618
+ "kaa_Cyrl",
619
+ "kaa_Latn",
620
+ "kab_Latn",
621
+ "kac_Latn",
622
+ "kal_Latn",
623
+ "kam_Latn",
624
+ "kan_Knda",
625
+ "kan_Latn",
626
+ "kao_Latn",
627
+ "kaq_Latn",
628
+ "kas_Arab",
629
+ "kas_Deva",
630
+ "kat_Geor",
631
+ "kaz_Cyrl",
632
+ "kbc_Latn",
633
+ "kbd_Cyrl",
634
+ "kbh_Latn",
635
+ "kbm_Latn",
636
+ "kbp_Latn",
637
+ "kbq_Latn",
638
+ "kbr_Latn",
639
+ "kby_Latn",
640
+ "kca_Cyrl",
641
+ "kcg_Latn",
642
+ "kck_Latn",
643
+ "kdc_Latn",
644
+ "kde_Latn",
645
+ "kdh_Latn",
646
+ "kdi_Latn",
647
+ "kdl_Latn",
648
+ "kea_Latn",
649
+ "kek_Latn",
650
+ "ken_Latn",
651
+ "keo_Latn",
652
+ "kew_Latn",
653
+ "kez_Latn",
654
+ "kff_Telu",
655
+ "kgf_Latn",
656
+ "kgk_Latn",
657
+ "kgp_Latn",
658
+ "kha_Latn",
659
+ "khk_Cyrl",
660
+ "khm_Khmr",
661
+ "khs_Latn",
662
+ "khz_Latn",
663
+ "kij_Latn",
664
+ "kik_Latn",
665
+ "kin_Latn",
666
+ "kir_Cyrl",
667
+ "kiu_Latn",
668
+ "kix_Latn",
669
+ "kjb_Latn",
670
+ "kje_Latn",
671
+ "kjh_Cyrl",
672
+ "kjs_Latn",
673
+ "kkc_Latn",
674
+ "kki_Latn",
675
+ "kkj_Latn",
676
+ "kkl_Latn",
677
+ "klt_Latn",
678
+ "klv_Latn",
679
+ "kmb_Latn",
680
+ "kmg_Latn",
681
+ "kmh_Latn",
682
+ "kmk_Latn",
683
+ "kmm_Latn",
684
+ "kmo_Latn",
685
+ "kmr_Cyrl",
686
+ "kmr_Latn",
687
+ "kms_Latn",
688
+ "kmu_Latn",
689
+ "kmy_Latn",
690
+ "knc_Arab",
691
+ "knc_Latn",
692
+ "kne_Latn",
693
+ "knf_Latn",
694
+ "kng_Latn",
695
+ "knj_Latn",
696
+ "knk_Latn",
697
+ "knv_Latn",
698
+ "koi_Cyrl",
699
+ "koo_Latn",
700
+ "kor_Hang",
701
+ "kos_Latn",
702
+ "kpe_Latn",
703
+ "kpf_Latn",
704
+ "kpg_Latn",
705
+ "kpj_Latn",
706
+ "kpr_Latn",
707
+ "kpv_Cyrl",
708
+ "kpw_Latn",
709
+ "kpx_Latn",
710
+ "kpz_Latn",
711
+ "kqc_Latn",
712
+ "kqe_Latn",
713
+ "kqf_Latn",
714
+ "kqn_Latn",
715
+ "kqp_Latn",
716
+ "kqw_Latn",
717
+ "krc_Cyrl",
718
+ "kri_Latn",
719
+ "krj_Latn",
720
+ "krl_Latn",
721
+ "kru_Deva",
722
+ "ksc_Latn",
723
+ "ksd_Latn",
724
+ "ksh_Latn",
725
+ "ksp_Latn",
726
+ "ksr_Latn",
727
+ "kss_Latn",
728
+ "ksw_Mymr",
729
+ "ktj_Latn",
730
+ "kto_Latn",
731
+ "ktu_Latn",
732
+ "ktz_Latn",
733
+ "kua_Latn",
734
+ "kud_Latn",
735
+ "kue_Latn",
736
+ "kum_Cyrl",
737
+ "kup_Latn",
738
+ "kus_Latn",
739
+ "kvg_Latn",
740
+ "kvn_Latn",
741
+ "kwd_Latn",
742
+ "kwf_Latn",
743
+ "kwi_Latn",
744
+ "kwj_Latn",
745
+ "kwn_Latn",
746
+ "kwy_Latn",
747
+ "kxc_Ethi",
748
+ "kxw_Latn",
749
+ "kyc_Latn",
750
+ "kyf_Latn",
751
+ "kyg_Latn",
752
+ "kyq_Latn",
753
+ "kyu_Kali",
754
+ "kyz_Latn",
755
+ "kze_Latn",
756
+ "kzj_Latn",
757
+ "lac_Latn",
758
+ "lad_Hebr",
759
+ "lad_Latn",
760
+ "lai_Latn",
761
+ "laj_Latn",
762
+ "lam_Latn",
763
+ "lao_Laoo",
764
+ "lat_Latn",
765
+ "lbb_Latn",
766
+ "lbe_Cyrl",
767
+ "lbj_Tibt",
768
+ "lbk_Latn",
769
+ "lcm_Latn",
770
+ "lcp_Thai",
771
+ "ldi_Latn",
772
+ "lee_Latn",
773
+ "lef_Latn",
774
+ "leh_Latn",
775
+ "leu_Latn",
776
+ "lew_Latn",
777
+ "lex_Latn",
778
+ "lez_Cyrl",
779
+ "lfn_Cyrl",
780
+ "lfn_Latn",
781
+ "lgg_Latn",
782
+ "lgl_Latn",
783
+ "lhu_Latn",
784
+ "lia_Latn",
785
+ "lid_Latn",
786
+ "lif_Deva",
787
+ "lif_Limb",
788
+ "lij_Latn",
789
+ "lim_Latn",
790
+ "lin_Latn",
791
+ "lip_Latn",
792
+ "lis_Lisu",
793
+ "lit_Latn",
794
+ "liv_Latn",
795
+ "ljp_Latn",
796
+ "lki_Arab",
797
+ "lld_Latn",
798
+ "llg_Latn",
799
+ "lmk_Latn",
800
+ "lmo_Latn",
801
+ "lmp_Latn",
802
+ "lnd_Latn",
803
+ "log_Latn",
804
+ "loq_Latn",
805
+ "loz_Latn",
806
+ "lrc_Arab",
807
+ "lsi_Latn",
808
+ "lsm_Latn",
809
+ "ltg_Latn",
810
+ "ltz_Latn",
811
+ "lua_Latn",
812
+ "lub_Latn",
813
+ "luc_Latn",
814
+ "lue_Latn",
815
+ "lug_Latn",
816
+ "lun_Latn",
817
+ "luo_Latn",
818
+ "lus_Latn",
819
+ "lvs_Latn",
820
+ "lwg_Latn",
821
+ "lwo_Latn",
822
+ "lww_Latn",
823
+ "lzh_Hani",
824
+ "maa_Latn",
825
+ "mad_Latn",
826
+ "mag_Deva",
827
+ "mah_Latn",
828
+ "mai_Deva",
829
+ "maj_Latn",
830
+ "mak_Latn",
831
+ "mal_Latn",
832
+ "mal_Mlym",
833
+ "mam_Latn",
834
+ "maq_Latn",
835
+ "mar_Deva",
836
+ "mar_Latn",
837
+ "mas_Latn",
838
+ "mau_Latn",
839
+ "mav_Latn",
840
+ "maz_Latn",
841
+ "mbb_Latn",
842
+ "mbc_Latn",
843
+ "mbd_Latn",
844
+ "mbf_Latn",
845
+ "mbh_Latn",
846
+ "mbi_Latn",
847
+ "mbj_Latn",
848
+ "mbl_Latn",
849
+ "mbs_Latn",
850
+ "mbt_Latn",
851
+ "mca_Latn",
852
+ "mcb_Latn",
853
+ "mcd_Latn",
854
+ "mcf_Latn",
855
+ "mck_Latn",
856
+ "mco_Latn",
857
+ "mcp_Latn",
858
+ "mcq_Latn",
859
+ "mcu_Latn",
860
+ "mdf_Cyrl",
861
+ "mdy_Ethi",
862
+ "med_Latn",
863
+ "mee_Latn",
864
+ "mej_Latn",
865
+ "mek_Latn",
866
+ "men_Latn",
867
+ "meq_Latn",
868
+ "mer_Latn",
869
+ "meu_Latn",
870
+ "mfe_Latn",
871
+ "mfi_Latn",
872
+ "mfq_Latn",
873
+ "mfy_Latn",
874
+ "mfz_Latn",
875
+ "mgh_Latn",
876
+ "mgr_Latn",
877
+ "mhi_Latn",
878
+ "mhl_Latn",
879
+ "mhr_Cyrl",
880
+ "mhx_Latn",
881
+ "mib_Latn",
882
+ "mic_Latn",
883
+ "mie_Latn",
884
+ "mif_Latn",
885
+ "mig_Latn",
886
+ "mih_Latn",
887
+ "mil_Latn",
888
+ "mim_Latn",
889
+ "min_Latn",
890
+ "mio_Latn",
891
+ "mip_Latn",
892
+ "miq_Latn",
893
+ "mir_Latn",
894
+ "mit_Latn",
895
+ "miy_Latn",
896
+ "miz_Latn",
897
+ "mjc_Latn",
898
+ "mjw_Latn",
899
+ "mkd_Cyrl",
900
+ "mkl_Latn",
901
+ "mkn_Latn",
902
+ "mks_Latn",
903
+ "mlh_Latn",
904
+ "mlp_Latn",
905
+ "mlt_Latn",
906
+ "mlu_Latn",
907
+ "mmn_Latn",
908
+ "mmo_Latn",
909
+ "mmx_Latn",
910
+ "mna_Latn",
911
+ "mnb_Latn",
912
+ "mni_Beng",
913
+ "mni_Latn",
914
+ "mni_Mtei",
915
+ "mnk_Latn",
916
+ "mns_Cyrl",
917
+ "mnw_Mymr",
918
+ "mnx_Latn",
919
+ "mny_Latn",
920
+ "mog_Latn",
921
+ "moh_Latn",
922
+ "mop_Latn",
923
+ "mor_Latn",
924
+ "mos_Latn",
925
+ "mox_Latn",
926
+ "mph_Latn",
927
+ "mpm_Latn",
928
+ "mpp_Latn",
929
+ "mps_Latn",
930
+ "mpt_Latn",
931
+ "mpx_Latn",
932
+ "mqb_Latn",
933
+ "mqj_Latn",
934
+ "mqy_Latn",
935
+ "mri_Latn",
936
+ "mrj_Cyrl",
937
+ "mrq_Latn",
938
+ "mrw_Latn",
939
+ "msb_Latn",
940
+ "msk_Latn",
941
+ "msy_Latn",
942
+ "mta_Latn",
943
+ "mti_Latn",
944
+ "mto_Latn",
945
+ "mtp_Latn",
946
+ "muh_Latn",
947
+ "mui_Latn",
948
+ "mup_Deva",
949
+ "mur_Latn",
950
+ "mus_Latn",
951
+ "mux_Latn",
952
+ "muy_Latn",
953
+ "mva_Latn",
954
+ "mvn_Latn",
955
+ "mvp_Latn",
956
+ "mwc_Latn",
957
+ "mwl_Latn",
958
+ "mwn_Latn",
959
+ "mwp_Latn",
960
+ "mwq_Latn",
961
+ "mwv_Latn",
962
+ "mww_Latn",
963
+ "mxb_Latn",
964
+ "mxp_Latn",
965
+ "mxq_Latn",
966
+ "mxt_Latn",
967
+ "mxv_Latn",
968
+ "mya_Mymr",
969
+ "myk_Latn",
970
+ "myu_Latn",
971
+ "myv_Cyrl",
972
+ "myw_Latn",
973
+ "myx_Latn",
974
+ "myy_Latn",
975
+ "mza_Latn",
976
+ "mzh_Latn",
977
+ "mzk_Latn",
978
+ "mzn_Arab",
979
+ "mzw_Latn",
980
+ "mzz_Latn",
981
+ "naf_Latn",
982
+ "nah_Latn",
983
+ "nak_Latn",
984
+ "nan_Hani",
985
+ "nan_Latn",
986
+ "nap_Latn",
987
+ "naq_Latn",
988
+ "nas_Latn",
989
+ "nav_Latn",
990
+ "nba_Latn",
991
+ "nbe_Latn",
992
+ "nbl_Latn",
993
+ "nbq_Latn",
994
+ "nbu_Latn",
995
+ "nca_Latn",
996
+ "nch_Latn",
997
+ "ncj_Latn",
998
+ "ncl_Latn",
999
+ "ncq_Laoo",
1000
+ "ncu_Latn",
1001
+ "ncx_Latn",
1002
+ "ndc_Latn",
1003
+ "nde_Latn",
1004
+ "ndh_Latn",
1005
+ "ndo_Latn",
1006
+ "nds_Latn",
1007
+ "neb_Latn",
1008
+ "new_Deva",
1009
+ "nfa_Latn",
1010
+ "nfr_Latn",
1011
+ "ngl_Latn",
1012
+ "ngp_Latn",
1013
+ "ngu_Latn",
1014
+ "nhe_Latn",
1015
+ "nhg_Latn",
1016
+ "nhi_Latn",
1017
+ "nho_Latn",
1018
+ "nhr_Latn",
1019
+ "nhu_Latn",
1020
+ "nhw_Latn",
1021
+ "nhx_Latn",
1022
+ "nhy_Latn",
1023
+ "nia_Latn",
1024
+ "nif_Latn",
1025
+ "nii_Latn",
1026
+ "nij_Latn",
1027
+ "nim_Latn",
1028
+ "nin_Latn",
1029
+ "niu_Latn",
1030
+ "niy_Latn",
1031
+ "njb_Latn",
1032
+ "njm_Latn",
1033
+ "njn_Latn",
1034
+ "njo_Latn",
1035
+ "njz_Latn",
1036
+ "nko_Latn",
1037
+ "nld_Latn",
1038
+ "nlg_Latn",
1039
+ "nmf_Latn",
1040
+ "nmo_Latn",
1041
+ "nmz_Latn",
1042
+ "nnb_Latn",
1043
+ "nno_Latn",
1044
+ "nnq_Latn",
1045
+ "nnw_Latn",
1046
+ "noa_Latn",
1047
+ "nob_Latn",
1048
+ "nod_Thai",
1049
+ "nog_Cyrl",
1050
+ "non_Latn",
1051
+ "nop_Latn",
1052
+ "not_Latn",
1053
+ "nou_Latn",
1054
+ "nov_Latn",
1055
+ "nph_Latn",
1056
+ "npi_Deva",
1057
+ "npi_Latn",
1058
+ "npl_Latn",
1059
+ "npy_Latn",
1060
+ "nqo_Nkoo",
1061
+ "nre_Latn",
1062
+ "nrf_Latn",
1063
+ "nrm_Latn",
1064
+ "nse_Latn",
1065
+ "nsm_Latn",
1066
+ "nsn_Latn",
1067
+ "nso_Latn",
1068
+ "nss_Latn",
1069
+ "nsu_Latn",
1070
+ "ntp_Latn",
1071
+ "ntr_Latn",
1072
+ "ntu_Latn",
1073
+ "nuj_Latn",
1074
+ "nus_Latn",
1075
+ "nuy_Latn",
1076
+ "nvm_Latn",
1077
+ "nwi_Latn",
1078
+ "nya_Latn",
1079
+ "nyf_Latn",
1080
+ "nyn_Latn",
1081
+ "nyo_Latn",
1082
+ "nyu_Latn",
1083
+ "nyy_Latn",
1084
+ "nzi_Latn",
1085
+ "nzm_Latn",
1086
+ "obo_Latn",
1087
+ "oci_Latn",
1088
+ "ogo_Latn",
1089
+ "ojb_Cans",
1090
+ "ojb_Latn",
1091
+ "oke_Latn",
1092
+ "okv_Latn",
1093
+ "old_Latn",
1094
+ "olo_Latn",
1095
+ "omw_Latn",
1096
+ "ong_Latn",
1097
+ "ons_Latn",
1098
+ "opm_Latn",
1099
+ "orv_Cyrl",
1100
+ "ory_Latn",
1101
+ "ory_Orya",
1102
+ "oss_Cyrl",
1103
+ "ota_Arab",
1104
+ "ote_Latn",
1105
+ "otm_Latn",
1106
+ "oto_Latn",
1107
+ "otq_Latn",
1108
+ "ots_Latn",
1109
+ "otw_Latn",
1110
+ "ozm_Latn",
1111
+ "pab_Latn",
1112
+ "pad_Latn",
1113
+ "pag_Latn",
1114
+ "pah_Latn",
1115
+ "pam_Latn",
1116
+ "pan_Guru",
1117
+ "pan_Latn",
1118
+ "pao_Latn",
1119
+ "pap_Latn",
1120
+ "pau_Latn",
1121
+ "pbb_Latn",
1122
+ "pbt_Arab",
1123
+ "pcd_Latn",
1124
+ "pck_Latn",
1125
+ "pcm_Latn",
1126
+ "pdc_Latn",
1127
+ "pdt_Latn",
1128
+ "pem_Latn",
1129
+ "pfl_Latn",
1130
+ "pib_Latn",
1131
+ "pio_Latn",
1132
+ "pir_Latn",
1133
+ "pis_Latn",
1134
+ "pjt_Latn",
1135
+ "plg_Latn",
1136
+ "pls_Latn",
1137
+ "plt_Latn",
1138
+ "plu_Latn",
1139
+ "plw_Latn",
1140
+ "pma_Latn",
1141
+ "pmf_Latn",
1142
+ "pmq_Latn",
1143
+ "pms_Latn",
1144
+ "pnb_Arab",
1145
+ "pnt_Grek",
1146
+ "poe_Latn",
1147
+ "poh_Latn",
1148
+ "poi_Latn",
1149
+ "pol_Latn",
1150
+ "pon_Latn",
1151
+ "por_Latn",
1152
+ "pot_Latn",
1153
+ "pov_Latn",
1154
+ "poy_Latn",
1155
+ "ppk_Latn",
1156
+ "ppo_Latn",
1157
+ "prf_Latn",
1158
+ "prg_Latn",
1159
+ "pri_Latn",
1160
+ "ptp_Latn",
1161
+ "ptu_Latn",
1162
+ "pwg_Latn",
1163
+ "pwn_Latn",
1164
+ "pxm_Latn",
1165
+ "qub_Latn",
1166
+ "quc_Latn",
1167
+ "quf_Latn",
1168
+ "qug_Latn",
1169
+ "quh_Latn",
1170
+ "qup_Latn",
1171
+ "quw_Latn",
1172
+ "quy_Latn",
1173
+ "quz_Latn",
1174
+ "qva_Latn",
1175
+ "qvc_Latn",
1176
+ "qve_Latn",
1177
+ "qvh_Latn",
1178
+ "qvi_Latn",
1179
+ "qvm_Latn",
1180
+ "qvn_Latn",
1181
+ "qvs_Latn",
1182
+ "qvw_Latn",
1183
+ "qvz_Latn",
1184
+ "qwh_Latn",
1185
+ "qxh_Latn",
1186
+ "qxl_Latn",
1187
+ "qxn_Latn",
1188
+ "qxo_Latn",
1189
+ "qxr_Latn",
1190
+ "rad_Latn",
1191
+ "rai_Latn",
1192
+ "rap_Latn",
1193
+ "rar_Latn",
1194
+ "rav_Deva",
1195
+ "raw_Latn",
1196
+ "rcf_Latn",
1197
+ "rej_Latn",
1198
+ "rgu_Latn",
1199
+ "rhg_Latn",
1200
+ "ria_Latn",
1201
+ "rim_Latn",
1202
+ "rkb_Latn",
1203
+ "rki_Mymr",
1204
+ "rmc_Latn",
1205
+ "rml_Latn",
1206
+ "rmn_Cyrl",
1207
+ "rmn_Grek",
1208
+ "rmn_Latn",
1209
+ "rmo_Latn",
1210
+ "rmq_Latn",
1211
+ "rmy_Cyrl",
1212
+ "rmy_Latn",
1213
+ "rnd_Latn",
1214
+ "rng_Latn",
1215
+ "roh_Latn",
1216
+ "ron_Cyrl",
1217
+ "ron_Latn",
1218
+ "roo_Latn",
1219
+ "rop_Latn",
1220
+ "row_Latn",
1221
+ "rro_Latn",
1222
+ "rtm_Latn",
1223
+ "rub_Latn",
1224
+ "rue_Cyrl",
1225
+ "ruf_Latn",
1226
+ "rug_Latn",
1227
+ "run_Latn",
1228
+ "rup_Latn",
1229
+ "rus_Cyrl",
1230
+ "rwo_Latn",
1231
+ "sab_Latn",
1232
+ "sag_Latn",
1233
+ "sah_Cyrl",
1234
+ "san_Deva",
1235
+ "san_Latn",
1236
+ "sas_Latn",
1237
+ "sat_Latn",
1238
+ "sat_Olck",
1239
+ "sba_Latn",
1240
+ "sbe_Latn",
1241
+ "sbl_Latn",
1242
+ "sby_Latn",
1243
+ "sck_Deva",
1244
+ "scn_Latn",
1245
+ "sco_Latn",
1246
+ "sda_Latn",
1247
+ "sdc_Latn",
1248
+ "sdh_Arab",
1249
+ "seh_Latn",
1250
+ "ses_Latn",
1251
+ "sey_Latn",
1252
+ "sfw_Latn",
1253
+ "sgb_Latn",
1254
+ "sgc_Latn",
1255
+ "sgh_Cyrl",
1256
+ "sgs_Latn",
1257
+ "sgw_Ethi",
1258
+ "sgz_Latn",
1259
+ "shi_Latn",
1260
+ "shn_Mymr",
1261
+ "shp_Latn",
1262
+ "sid_Latn",
1263
+ "sig_Latn",
1264
+ "sil_Latn",
1265
+ "sim_Latn",
1266
+ "sin_Sinh",
1267
+ "sja_Latn",
1268
+ "skg_Latn",
1269
+ "skr_Arab",
1270
+ "slk_Latn",
1271
+ "sll_Latn",
1272
+ "slv_Latn",
1273
+ "sma_Latn",
1274
+ "sme_Latn",
1275
+ "smj_Latn",
1276
+ "smk_Latn",
1277
+ "sml_Latn",
1278
+ "smn_Latn",
1279
+ "smo_Latn",
1280
+ "sms_Latn",
1281
+ "sna_Latn",
1282
+ "snc_Latn",
1283
+ "snd_Arab",
1284
+ "snd_Deva",
1285
+ "snd_Latn",
1286
+ "snf_Latn",
1287
+ "snn_Latn",
1288
+ "snp_Latn",
1289
+ "snw_Latn",
1290
+ "sny_Latn",
1291
+ "som_Latn",
1292
+ "sop_Latn",
1293
+ "soq_Latn",
1294
+ "sot_Latn",
1295
+ "soy_Latn",
1296
+ "spa_Latn",
1297
+ "spl_Latn",
1298
+ "spm_Latn",
1299
+ "spp_Latn",
1300
+ "sps_Latn",
1301
+ "spy_Latn",
1302
+ "srd_Latn",
1303
+ "srm_Latn",
1304
+ "srn_Latn",
1305
+ "srp_Cyrl",
1306
+ "srp_Latn",
1307
+ "srq_Latn",
1308
+ "srr_Latn",
1309
+ "ssd_Latn",
1310
+ "ssg_Latn",
1311
+ "ssw_Latn",
1312
+ "ssx_Latn",
1313
+ "stp_Latn",
1314
+ "stq_Latn",
1315
+ "sua_Latn",
1316
+ "suc_Latn",
1317
+ "sue_Latn",
1318
+ "suk_Latn",
1319
+ "sun_Latn",
1320
+ "sur_Latn",
1321
+ "sus_Arab",
1322
+ "sus_Latn",
1323
+ "suz_Deva",
1324
+ "swc_Latn",
1325
+ "swe_Latn",
1326
+ "swg_Latn",
1327
+ "swh_Latn",
1328
+ "swp_Latn",
1329
+ "sxb_Latn",
1330
+ "sxn_Latn",
1331
+ "syb_Latn",
1332
+ "syc_Syrc",
1333
+ "syl_Beng",
1334
+ "syl_Latn",
1335
+ "szb_Latn",
1336
+ "szl_Latn",
1337
+ "szy_Latn",
1338
+ "tab_Cyrl",
1339
+ "tac_Latn",
1340
+ "tah_Latn",
1341
+ "taj_Deva",
1342
+ "tam_Latn",
1343
+ "tam_Taml",
1344
+ "taq_Latn",
1345
+ "taq_Tfng",
1346
+ "tar_Latn",
1347
+ "tat_Cyrl",
1348
+ "tat_Latn",
1349
+ "tav_Latn",
1350
+ "taw_Latn",
1351
+ "tay_Latn",
1352
+ "tbc_Latn",
1353
+ "tbg_Latn",
1354
+ "tbo_Latn",
1355
+ "tby_Latn",
1356
+ "tbz_Latn",
1357
+ "tca_Latn",
1358
+ "tcf_Latn",
1359
+ "tcs_Latn",
1360
+ "tcy_Knda",
1361
+ "tcz_Latn",
1362
+ "tdt_Latn",
1363
+ "ted_Latn",
1364
+ "tee_Latn",
1365
+ "tel_Latn",
1366
+ "tel_Telu",
1367
+ "tem_Latn",
1368
+ "teo_Latn",
1369
+ "ter_Latn",
1370
+ "tet_Latn",
1371
+ "tew_Latn",
1372
+ "tfr_Latn",
1373
+ "tgk_Cyrl",
1374
+ "tgo_Latn",
1375
+ "tgp_Latn",
1376
+ "tha_Thai",
1377
+ "thk_Latn",
1378
+ "thl_Deva",
1379
+ "tif_Latn",
1380
+ "tih_Latn",
1381
+ "tim_Latn",
1382
+ "tir_Ethi",
1383
+ "tiv_Latn",
1384
+ "tiy_Latn",
1385
+ "tkl_Latn",
1386
+ "tkr_Cyrl",
1387
+ "tku_Latn",
1388
+ "tlf_Latn",
1389
+ "tlh_Latn",
1390
+ "tll_Latn",
1391
+ "tly_Latn",
1392
+ "tmd_Latn",
1393
+ "tna_Latn",
1394
+ "tnc_Latn",
1395
+ "tnk_Latn",
1396
+ "tnn_Latn",
1397
+ "tnp_Latn",
1398
+ "tob_Latn",
1399
+ "toc_Latn",
1400
+ "tod_Latn",
1401
+ "tog_Latn",
1402
+ "toh_Latn",
1403
+ "toi_Latn",
1404
+ "toj_Latn",
1405
+ "tok_Latn",
1406
+ "ton_Latn",
1407
+ "too_Latn",
1408
+ "top_Latn",
1409
+ "tos_Latn",
1410
+ "tpa_Latn",
1411
+ "tpi_Latn",
1412
+ "tpm_Latn",
1413
+ "tpp_Latn",
1414
+ "tpt_Latn",
1415
+ "tpz_Latn",
1416
+ "trc_Latn",
1417
+ "trn_Latn",
1418
+ "trp_Latn",
1419
+ "trq_Latn",
1420
+ "trv_Latn",
1421
+ "tsc_Latn",
1422
+ "tsg_Latn",
1423
+ "tsn_Latn",
1424
+ "tso_Latn",
1425
+ "tsw_Latn",
1426
+ "tsz_Latn",
1427
+ "ttc_Latn",
1428
+ "tte_Latn",
1429
+ "ttj_Latn",
1430
+ "tuc_Latn",
1431
+ "tue_Latn",
1432
+ "tuf_Latn",
1433
+ "tui_Latn",
1434
+ "tuk_Arab",
1435
+ "tuk_Cyrl",
1436
+ "tuk_Latn",
1437
+ "tum_Latn",
1438
+ "tuo_Latn",
1439
+ "tur_Latn",
1440
+ "tuv_Latn",
1441
+ "tvk_Latn",
1442
+ "tvl_Latn",
1443
+ "twi_Latn",
1444
+ "twu_Latn",
1445
+ "txq_Latn",
1446
+ "txu_Latn",
1447
+ "tyv_Cyrl",
1448
+ "tzh_Latn",
1449
+ "tzj_Latn",
1450
+ "tzm_Tfng",
1451
+ "tzo_Latn",
1452
+ "ubr_Latn",
1453
+ "ubu_Latn",
1454
+ "udm_Cyrl",
1455
+ "udu_Latn",
1456
+ "uig_Arab",
1457
+ "uig_Cyrl",
1458
+ "uig_Latn",
1459
+ "ukr_Cyrl",
1460
+ "umb_Latn",
1461
+ "und_Bali",
1462
+ "und_Bamu",
1463
+ "und_Bopo",
1464
+ "und_Cans",
1465
+ "und_Cher",
1466
+ "und_Cyrl",
1467
+ "und_Deva",
1468
+ "und_Egyp",
1469
+ "und_Ethi",
1470
+ "und_Geor",
1471
+ "und_Goth",
1472
+ "und_Grek",
1473
+ "und_Hebr",
1474
+ "und_Hluw",
1475
+ "und_Hung",
1476
+ "und_Kana",
1477
+ "und_Khmr",
1478
+ "und_Lana",
1479
+ "und_Laoo",
1480
+ "und_Lina",
1481
+ "und_Mlym",
1482
+ "und_Mong",
1483
+ "und_Mymr",
1484
+ "und_Newa",
1485
+ "und_Orya",
1486
+ "und_Shaw",
1487
+ "und_Sylo",
1488
+ "und_Syrc",
1489
+ "und_Taml",
1490
+ "und_Tang",
1491
+ "und_Telu",
1492
+ "und_Thaa",
1493
+ "und_Thai",
1494
+ "und_Tibt",
1495
+ "und_Vaii",
1496
+ "und_Xsux",
1497
+ "und_Yiii",
1498
+ "upv_Latn",
1499
+ "ura_Latn",
1500
+ "urb_Latn",
1501
+ "urd_Arab",
1502
+ "urd_Latn",
1503
+ "urh_Latn",
1504
+ "urk_Thai",
1505
+ "urt_Latn",
1506
+ "usa_Latn",
1507
+ "usp_Latn",
1508
+ "uth_Latn",
1509
+ "uvh_Latn",
1510
+ "uvl_Latn",
1511
+ "uzn_Cyrl",
1512
+ "uzn_Latn",
1513
+ "uzs_Arab",
1514
+ "vap_Latn",
1515
+ "var_Latn",
1516
+ "vec_Latn",
1517
+ "ven_Latn",
1518
+ "vep_Latn",
1519
+ "vid_Latn",
1520
+ "vie_Latn",
1521
+ "viv_Latn",
1522
+ "vls_Latn",
1523
+ "vmw_Latn",
1524
+ "vmy_Latn",
1525
+ "vol_Latn",
1526
+ "vro_Latn",
1527
+ "vun_Latn",
1528
+ "waj_Latn",
1529
+ "wal_Latn",
1530
+ "wap_Latn",
1531
+ "war_Latn",
1532
+ "way_Latn",
1533
+ "wba_Latn",
1534
+ "wbm_Latn",
1535
+ "wbp_Latn",
1536
+ "wed_Latn",
1537
+ "wer_Latn",
1538
+ "whk_Latn",
1539
+ "wib_Latn",
1540
+ "wim_Latn",
1541
+ "wiu_Latn",
1542
+ "wln_Latn",
1543
+ "wls_Latn",
1544
+ "wlv_Latn",
1545
+ "wmt_Latn",
1546
+ "wmw_Latn",
1547
+ "wnc_Latn",
1548
+ "wnu_Latn",
1549
+ "wol_Latn",
1550
+ "wos_Latn",
1551
+ "wrk_Latn",
1552
+ "wrs_Latn",
1553
+ "wsk_Latn",
1554
+ "wuu_Hani",
1555
+ "wuv_Latn",
1556
+ "xal_Cyrl",
1557
+ "xav_Latn",
1558
+ "xbi_Latn",
1559
+ "xbr_Latn",
1560
+ "xed_Latn",
1561
+ "xho_Latn",
1562
+ "xla_Latn",
1563
+ "xmf_Geor",
1564
+ "xmm_Latn",
1565
+ "xmv_Latn",
1566
+ "xnn_Latn",
1567
+ "xog_Latn",
1568
+ "xon_Latn",
1569
+ "xrb_Latn",
1570
+ "xsi_Latn",
1571
+ "xsm_Latn",
1572
+ "xsr_Deva",
1573
+ "xsu_Latn",
1574
+ "xtd_Latn",
1575
+ "xtm_Latn",
1576
+ "xtn_Latn",
1577
+ "xuo_Latn",
1578
+ "yaa_Latn",
1579
+ "yad_Latn",
1580
+ "yal_Latn",
1581
+ "yan_Latn",
1582
+ "yao_Latn",
1583
+ "yap_Latn",
1584
+ "yaq_Latn",
1585
+ "ybb_Latn",
1586
+ "yby_Latn",
1587
+ "ycn_Latn",
1588
+ "ydd_Hebr",
1589
+ "yka_Latn",
1590
+ "yle_Latn",
1591
+ "yli_Latn",
1592
+ "yml_Latn",
1593
+ "yom_Latn",
1594
+ "yon_Latn",
1595
+ "yor_Latn",
1596
+ "yrb_Latn",
1597
+ "yre_Latn",
1598
+ "yrk_Cyrl",
1599
+ "yrl_Latn",
1600
+ "yss_Latn",
1601
+ "yua_Latn",
1602
+ "yue_Hani",
1603
+ "yuj_Latn",
1604
+ "yut_Latn",
1605
+ "yuw_Latn",
1606
+ "yva_Latn",
1607
+ "zaa_Latn",
1608
+ "zab_Latn",
1609
+ "zac_Latn",
1610
+ "zad_Latn",
1611
+ "zae_Latn",
1612
+ "zai_Latn",
1613
+ "zam_Latn",
1614
+ "zao_Latn",
1615
+ "zar_Latn",
1616
+ "zas_Latn",
1617
+ "zat_Latn",
1618
+ "zav_Latn",
1619
+ "zaw_Latn",
1620
+ "zdj_Latn",
1621
+ "zea_Latn",
1622
+ "zgh_Tfng",
1623
+ "zia_Latn",
1624
+ "ziw_Latn",
1625
+ "zne_Latn",
1626
+ "zom_Latn",
1627
+ "zos_Latn",
1628
+ "zpa_Latn",
1629
+ "zpc_Latn",
1630
+ "zpg_Latn",
1631
+ "zpi_Latn",
1632
+ "zpl_Latn",
1633
+ "zpm_Latn",
1634
+ "zpo_Latn",
1635
+ "zpt_Latn",
1636
+ "zpu_Latn",
1637
+ "zpv_Latn",
1638
+ "zpz_Latn",
1639
+ "zsm_Latn",
1640
+ "zsr_Latn",
1641
+ "ztq_Latn",
1642
+ "zty_Latn",
1643
+ "zul_Latn",
1644
+ "zyb_Latn",
1645
+ "zyp_Latn"
1646
+ ],
1647
+ "aliases": {
1648
+ "ara_Arab": "arb_Arab",
1649
+ "swa_Latn": "swh_Latn",
1650
+ "sqi_Latn": "als_Latn",
1651
+ "nep_Deva": "npi_Deva",
1652
+ "orm_Latn": "gaz_Latn",
1653
+ "ori_Orya": "ory_Orya",
1654
+ "zho_Hani": "cmn_Hani",
1655
+ "zho_Hans": "cmn_Hani",
1656
+ "mlg_Latn": "plt_Latn",
1657
+ "nor_Latn": "nob_Latn",
1658
+ "pus_Arab": "pbt_Arab",
1659
+ "prs_Arab": "fas_Arab",
1660
+ "pes_Arab": "fas_Arab",
1661
+ "tgl_Latn": "fil_Latn",
1662
+ "kau_Latn": "knc_Latn",
1663
+ "bal_Arab": "bcc_Arab",
1664
+ "kok_Deva": "gom_Deva",
1665
+ "kok_Latn": "gom_Latn",
1666
+ "pan_Arab": "pnb_Arab",
1667
+ "jpn_Hira": "jpn_Jpan",
1668
+ "jpn_Kana": "jpn_Jpan",
1669
+ "jpn_Hani": "jpn_Jpan"
1670
+ },
1671
+ "dropped": [
1672
+ "din_Latn",
1673
+ "ful_Latn",
1674
+ "hbs_Latn",
1675
+ "kln_Latn"
1676
+ ],
1677
+ "trained": [
1678
+ "aai_Latn",
1679
+ "aak_Latn",
1680
+ "aau_Latn",
1681
+ "aaz_Latn",
1682
+ "aba_Latn",
1683
+ "abk_Cyrl",
1684
+ "abn_Latn",
1685
+ "abq_Cyrl",
1686
+ "abs_Latn",
1687
+ "abt_Latn",
1688
+ "abx_Latn",
1689
+ "aby_Latn",
1690
+ "abz_Latn",
1691
+ "aca_Latn",
1692
+ "acd_Latn",
1693
+ "ace_Latn",
1694
+ "acf_Latn",
1695
+ "ach_Latn",
1696
+ "acm_Arab",
1697
+ "acn_Latn",
1698
+ "acr_Latn",
1699
+ "acu_Latn",
1700
+ "ada_Latn",
1701
+ "ade_Latn",
1702
+ "adh_Latn",
1703
+ "adi_Latn",
1704
+ "adj_Latn",
1705
+ "ady_Cyrl",
1706
+ "adz_Latn",
1707
+ "aeb_Arab",
1708
+ "aeb_Latn",
1709
+ "aer_Latn",
1710
+ "aeu_Latn",
1711
+ "aey_Latn",
1712
+ "afr_Latn",
1713
+ "agd_Latn",
1714
+ "agg_Latn",
1715
+ "agm_Latn",
1716
+ "agn_Latn",
1717
+ "agr_Latn",
1718
+ "agt_Latn",
1719
+ "agu_Latn",
1720
+ "agx_Cyrl",
1721
+ "ahk_Latn",
1722
+ "aia_Latn",
1723
+ "aii_Syrc",
1724
+ "ain_Latn",
1725
+ "ajg_Latn",
1726
+ "aji_Latn",
1727
+ "ajp_Arab",
1728
+ "akb_Latn",
1729
+ "ake_Latn",
1730
+ "akh_Latn",
1731
+ "akp_Latn",
1732
+ "aln_Latn",
1733
+ "alp_Latn",
1734
+ "alq_Latn",
1735
+ "als_Latn",
1736
+ "alt_Cyrl",
1737
+ "aly_Latn",
1738
+ "alz_Latn",
1739
+ "ame_Latn",
1740
+ "amf_Latn",
1741
+ "amh_Ethi",
1742
+ "ami_Latn",
1743
+ "amk_Latn",
1744
+ "amm_Latn",
1745
+ "amn_Latn",
1746
+ "amp_Latn",
1747
+ "amr_Latn",
1748
+ "amu_Latn",
1749
+ "amx_Latn",
1750
+ "ang_Latn",
1751
+ "ann_Latn",
1752
+ "anp_Deva",
1753
+ "anv_Latn",
1754
+ "any_Latn",
1755
+ "aoi_Latn",
1756
+ "aoj_Latn",
1757
+ "aom_Latn",
1758
+ "aoz_Latn",
1759
+ "apb_Latn",
1760
+ "apc_Arab",
1761
+ "ape_Latn",
1762
+ "apn_Latn",
1763
+ "apr_Latn",
1764
+ "apt_Latn",
1765
+ "apu_Latn",
1766
+ "apw_Latn",
1767
+ "apy_Latn",
1768
+ "apz_Latn",
1769
+ "arb_Arab",
1770
+ "arb_Latn",
1771
+ "are_Latn",
1772
+ "arg_Latn",
1773
+ "arl_Latn",
1774
+ "arn_Latn",
1775
+ "arp_Latn",
1776
+ "arq_Arab",
1777
+ "ars_Arab",
1778
+ "ary_Arab",
1779
+ "arz_Arab",
1780
+ "asm_Beng",
1781
+ "asm_Latn",
1782
+ "aso_Latn",
1783
+ "ast_Latn",
1784
+ "ata_Latn",
1785
+ "atb_Latn",
1786
+ "atd_Latn",
1787
+ "atg_Latn",
1788
+ "ati_Latn",
1789
+ "atj_Latn",
1790
+ "att_Latn",
1791
+ "auc_Latn",
1792
+ "aui_Latn",
1793
+ "auy_Latn",
1794
+ "ava_Cyrl",
1795
+ "avk_Latn",
1796
+ "avt_Latn",
1797
+ "avu_Latn",
1798
+ "awa_Deva",
1799
+ "awb_Latn",
1800
+ "awx_Latn",
1801
+ "ayp_Arab",
1802
+ "ayr_Latn",
1803
+ "azb_Arab",
1804
+ "azg_Latn",
1805
+ "azj_Cyrl",
1806
+ "azj_Latn",
1807
+ "azz_Latn",
1808
+ "bak_Cyrl",
1809
+ "bam_Latn",
1810
+ "ban_Latn",
1811
+ "bao_Latn",
1812
+ "bar_Latn",
1813
+ "bas_Latn",
1814
+ "bba_Latn",
1815
+ "bbb_Latn",
1816
+ "bbc_Latn",
1817
+ "bbr_Latn",
1818
+ "bcc_Arab",
1819
+ "bch_Latn",
1820
+ "bci_Latn",
1821
+ "bcl_Latn",
1822
+ "bco_Latn",
1823
+ "bcw_Latn",
1824
+ "bdd_Latn",
1825
+ "bdh_Latn",
1826
+ "bdq_Latn",
1827
+ "bea_Latn",
1828
+ "bef_Latn",
1829
+ "bel_Cyrl",
1830
+ "bem_Latn",
1831
+ "ben_Beng",
1832
+ "ben_Latn",
1833
+ "beq_Latn",
1834
+ "bew_Latn",
1835
+ "bfd_Latn",
1836
+ "bgr_Latn",
1837
+ "bgs_Latn",
1838
+ "bgt_Latn",
1839
+ "bgz_Latn",
1840
+ "bhg_Latn",
1841
+ "bhl_Latn",
1842
+ "bho_Deva",
1843
+ "bhw_Latn",
1844
+ "bib_Latn",
1845
+ "big_Latn",
1846
+ "bim_Latn",
1847
+ "bin_Latn",
1848
+ "bis_Latn",
1849
+ "biu_Latn",
1850
+ "biv_Latn",
1851
+ "bjn_Arab",
1852
+ "bjn_Latn",
1853
+ "bjp_Latn",
1854
+ "bjr_Latn",
1855
+ "bjv_Latn",
1856
+ "bkd_Latn",
1857
+ "bkq_Latn",
1858
+ "bku_Latn",
1859
+ "bla_Latn",
1860
+ "blh_Latn",
1861
+ "blk_Mymr",
1862
+ "blt_Latn",
1863
+ "blw_Latn",
1864
+ "blz_Latn",
1865
+ "bmh_Latn",
1866
+ "bmk_Latn",
1867
+ "bmq_Latn",
1868
+ "bmr_Latn",
1869
+ "bmu_Latn",
1870
+ "bno_Latn",
1871
+ "bnp_Latn",
1872
+ "boa_Latn",
1873
+ "bod_Tibt",
1874
+ "boj_Latn",
1875
+ "bon_Latn",
1876
+ "bos_Latn",
1877
+ "box_Latn",
1878
+ "bpr_Latn",
1879
+ "bps_Latn",
1880
+ "bpy_Beng",
1881
+ "bqc_Latn",
1882
+ "bqp_Latn",
1883
+ "bre_Latn",
1884
+ "brh_Arab",
1885
+ "bru_Latn",
1886
+ "brx_Deva",
1887
+ "bsn_Latn",
1888
+ "bsp_Latn",
1889
+ "bsq_Latn",
1890
+ "bss_Latn",
1891
+ "btd_Latn",
1892
+ "bth_Latn",
1893
+ "bts_Latn",
1894
+ "btx_Latn",
1895
+ "bud_Latn",
1896
+ "bug_Latn",
1897
+ "buk_Latn",
1898
+ "bul_Cyrl",
1899
+ "bum_Latn",
1900
+ "bus_Latn",
1901
+ "bvd_Latn",
1902
+ "bvr_Latn",
1903
+ "bvz_Latn",
1904
+ "bwd_Latn",
1905
+ "bwu_Latn",
1906
+ "bxh_Latn",
1907
+ "bxr_Cyrl",
1908
+ "byr_Latn",
1909
+ "byx_Latn",
1910
+ "bzd_Latn",
1911
+ "bzh_Latn",
1912
+ "bzi_Thai",
1913
+ "bzj_Latn",
1914
+ "caa_Latn",
1915
+ "cab_Latn",
1916
+ "cac_Latn",
1917
+ "caf_Latn",
1918
+ "cag_Latn",
1919
+ "cak_Latn",
1920
+ "cao_Latn",
1921
+ "cap_Latn",
1922
+ "caq_Latn",
1923
+ "car_Latn",
1924
+ "cas_Latn",
1925
+ "cat_Latn",
1926
+ "cav_Latn",
1927
+ "cax_Latn",
1928
+ "cbc_Latn",
1929
+ "cbi_Latn",
1930
+ "cbk_Latn",
1931
+ "cbr_Latn",
1932
+ "cbs_Latn",
1933
+ "cbt_Latn",
1934
+ "cbu_Latn",
1935
+ "cbv_Latn",
1936
+ "cce_Latn",
1937
+ "cco_Latn",
1938
+ "ccp_Latn",
1939
+ "ceb_Latn",
1940
+ "ceg_Latn",
1941
+ "cek_Latn",
1942
+ "ces_Latn",
1943
+ "cfm_Latn",
1944
+ "cgc_Latn",
1945
+ "cha_Latn",
1946
+ "chd_Latn",
1947
+ "che_Cyrl",
1948
+ "chf_Latn",
1949
+ "chk_Latn",
1950
+ "cho_Latn",
1951
+ "chq_Latn",
1952
+ "chr_Cher",
1953
+ "chu_Cyrl",
1954
+ "chv_Cyrl",
1955
+ "chw_Latn",
1956
+ "chz_Latn",
1957
+ "cjk_Latn",
1958
+ "cjp_Latn",
1959
+ "cjs_Cyrl",
1960
+ "cjv_Latn",
1961
+ "ckb_Arab",
1962
+ "ckm_Latn",
1963
+ "cko_Latn",
1964
+ "ckt_Cyrl",
1965
+ "clu_Latn",
1966
+ "cme_Latn",
1967
+ "cmn_Hani",
1968
+ "cmo_Latn",
1969
+ "cnh_Latn",
1970
+ "cni_Latn",
1971
+ "cnk_Latn",
1972
+ "cnr_Latn",
1973
+ "cnw_Latn",
1974
+ "coe_Latn",
1975
+ "cof_Latn",
1976
+ "cok_Latn",
1977
+ "con_Latn",
1978
+ "cop_Copt",
1979
+ "cor_Latn",
1980
+ "cos_Latn",
1981
+ "cot_Latn",
1982
+ "cpb_Latn",
1983
+ "cpc_Latn",
1984
+ "cpu_Latn",
1985
+ "cpy_Latn",
1986
+ "crh_Cyrl",
1987
+ "crh_Latn",
1988
+ "crj_Cans",
1989
+ "crk_Cans",
1990
+ "crk_Latn",
1991
+ "crl_Cans",
1992
+ "crm_Cans",
1993
+ "crn_Latn",
1994
+ "crs_Latn",
1995
+ "crx_Latn",
1996
+ "csb_Latn",
1997
+ "csw_Latn",
1998
+ "csy_Latn",
1999
+ "cta_Latn",
2000
+ "ctd_Latn",
2001
+ "cto_Latn",
2002
+ "ctp_Latn",
2003
+ "ctu_Latn",
2004
+ "cub_Latn",
2005
+ "cui_Latn",
2006
+ "cuk_Latn",
2007
+ "cul_Latn",
2008
+ "cut_Latn",
2009
+ "cux_Latn",
2010
+ "cwe_Latn",
2011
+ "cwt_Latn",
2012
+ "cya_Latn",
2013
+ "cym_Latn",
2014
+ "czt_Latn",
2015
+ "daa_Latn",
2016
+ "dad_Latn",
2017
+ "daf_Latn",
2018
+ "dag_Latn",
2019
+ "dah_Latn",
2020
+ "dak_Latn",
2021
+ "dan_Latn",
2022
+ "dar_Cyrl",
2023
+ "ddg_Latn",
2024
+ "ded_Latn",
2025
+ "des_Latn",
2026
+ "deu_Latn",
2027
+ "dga_Latn",
2028
+ "dgc_Latn",
2029
+ "dgi_Latn",
2030
+ "dgr_Latn",
2031
+ "dgz_Latn",
2032
+ "dhm_Latn",
2033
+ "dhv_Latn",
2034
+ "dig_Latn",
2035
+ "dik_Latn",
2036
+ "diq_Latn",
2037
+ "diu_Latn",
2038
+ "div_Thaa",
2039
+ "dje_Latn",
2040
+ "djk_Latn",
2041
+ "djr_Latn",
2042
+ "dks_Latn",
2043
+ "dng_Cyrl",
2044
+ "dnj_Latn",
2045
+ "dnw_Latn",
2046
+ "dob_Latn",
2047
+ "doi_Deva",
2048
+ "dop_Latn",
2049
+ "dos_Latn",
2050
+ "drg_Latn",
2051
+ "dru_Latn",
2052
+ "dsb_Latn",
2053
+ "dtp_Latn",
2054
+ "dts_Latn",
2055
+ "dua_Latn",
2056
+ "duo_Latn",
2057
+ "dur_Latn",
2058
+ "dwr_Latn",
2059
+ "dww_Latn",
2060
+ "dyi_Latn",
2061
+ "dyo_Latn",
2062
+ "dyu_Latn",
2063
+ "dzo_Tibt",
2064
+ "ebk_Latn",
2065
+ "efi_Latn",
2066
+ "ekk_Latn",
2067
+ "eko_Latn",
2068
+ "ell_Grek",
2069
+ "emi_Latn",
2070
+ "eml_Latn",
2071
+ "emp_Latn",
2072
+ "enb_Latn",
2073
+ "eng_Latn",
2074
+ "enl_Latn",
2075
+ "enm_Latn",
2076
+ "enq_Latn",
2077
+ "epo_Latn",
2078
+ "eri_Latn",
2079
+ "ese_Latn",
2080
+ "esi_Latn",
2081
+ "esk_Latn",
2082
+ "ess_Latn",
2083
+ "esu_Latn",
2084
+ "etr_Latn",
2085
+ "eus_Latn",
2086
+ "eve_Cyrl",
2087
+ "ewe_Latn",
2088
+ "ewo_Latn",
2089
+ "ext_Latn",
2090
+ "eza_Latn",
2091
+ "faa_Latn",
2092
+ "fai_Latn",
2093
+ "fal_Latn",
2094
+ "fan_Latn",
2095
+ "fao_Latn",
2096
+ "far_Latn",
2097
+ "fas_Arab",
2098
+ "fat_Latn",
2099
+ "ffm_Latn",
2100
+ "fij_Latn",
2101
+ "fil_Latn",
2102
+ "fin_Latn",
2103
+ "fit_Latn",
2104
+ "fkv_Latn",
2105
+ "fon_Latn",
2106
+ "for_Latn",
2107
+ "fra_Latn",
2108
+ "frd_Latn",
2109
+ "fro_Latn",
2110
+ "frp_Latn",
2111
+ "frr_Latn",
2112
+ "fry_Latn",
2113
+ "fub_Latn",
2114
+ "fue_Latn",
2115
+ "fuf_Latn",
2116
+ "fuh_Latn",
2117
+ "fur_Latn",
2118
+ "fuv_Arab",
2119
+ "fuv_Latn",
2120
+ "gaa_Latn",
2121
+ "gag_Cyrl",
2122
+ "gag_Latn",
2123
+ "gah_Latn",
2124
+ "gai_Latn",
2125
+ "gam_Latn",
2126
+ "gaw_Latn",
2127
+ "gaz_Latn",
2128
+ "gbi_Latn",
2129
+ "gbo_Latn",
2130
+ "gcf_Latn",
2131
+ "gcr_Latn",
2132
+ "gde_Latn",
2133
+ "gdg_Latn",
2134
+ "gdn_Latn",
2135
+ "gdr_Latn",
2136
+ "geb_Latn",
2137
+ "gfk_Latn",
2138
+ "ghs_Latn",
2139
+ "gil_Latn",
2140
+ "gjn_Latn",
2141
+ "gkn_Latn",
2142
+ "gla_Latn",
2143
+ "gle_Latn",
2144
+ "glg_Latn",
2145
+ "glk_Arab",
2146
+ "glv_Latn",
2147
+ "gmh_Latn",
2148
+ "gmv_Ethi",
2149
+ "gmv_Latn",
2150
+ "gnb_Latn",
2151
+ "gnd_Latn",
2152
+ "gng_Latn",
2153
+ "gnn_Latn",
2154
+ "gnw_Latn",
2155
+ "gof_Ethi",
2156
+ "gof_Latn",
2157
+ "gog_Latn",
2158
+ "goh_Latn",
2159
+ "gom_Deva",
2160
+ "gom_Latn",
2161
+ "gor_Latn",
2162
+ "gos_Latn",
2163
+ "got_Goth",
2164
+ "gqr_Latn",
2165
+ "grc_Grek",
2166
+ "grt_Beng",
2167
+ "gso_Latn",
2168
+ "gsw_Latn",
2169
+ "gub_Latn",
2170
+ "guc_Latn",
2171
+ "gug_Latn",
2172
+ "guh_Latn",
2173
+ "gui_Latn",
2174
+ "guj_Gujr",
2175
+ "guj_Latn",
2176
+ "guk_Ethi",
2177
+ "gul_Latn",
2178
+ "gum_Latn",
2179
+ "gun_Latn",
2180
+ "guo_Latn",
2181
+ "guq_Latn",
2182
+ "gur_Latn",
2183
+ "guw_Latn",
2184
+ "gux_Latn",
2185
+ "guz_Latn",
2186
+ "gvc_Latn",
2187
+ "gvf_Latn",
2188
+ "gvl_Latn",
2189
+ "gvn_Latn",
2190
+ "gwi_Latn",
2191
+ "gym_Latn",
2192
+ "gyr_Latn",
2193
+ "hac_Arab",
2194
+ "hae_Latn",
2195
+ "hag_Latn",
2196
+ "hak_Hani",
2197
+ "hak_Latn",
2198
+ "hat_Latn",
2199
+ "hau_Latn",
2200
+ "hav_Latn",
2201
+ "haw_Latn",
2202
+ "hay_Latn",
2203
+ "hbo_Hebr",
2204
+ "hch_Latn",
2205
+ "heb_Hebr",
2206
+ "heg_Latn",
2207
+ "heh_Latn",
2208
+ "her_Latn",
2209
+ "hif_Latn",
2210
+ "hig_Latn",
2211
+ "hil_Latn",
2212
+ "hin_Deva",
2213
+ "hin_Latn",
2214
+ "hix_Latn",
2215
+ "hla_Latn",
2216
+ "hmo_Latn",
2217
+ "hmr_Latn",
2218
+ "hne_Deva",
2219
+ "hnj_Latn",
2220
+ "hnn_Latn",
2221
+ "hns_Latn",
2222
+ "hop_Latn",
2223
+ "hot_Latn",
2224
+ "hra_Latn",
2225
+ "hrv_Latn",
2226
+ "hrx_Latn",
2227
+ "hsb_Latn",
2228
+ "hto_Latn",
2229
+ "hub_Latn",
2230
+ "hui_Latn",
2231
+ "hun_Latn",
2232
+ "hus_Latn",
2233
+ "huu_Latn",
2234
+ "huv_Latn",
2235
+ "hvn_Latn",
2236
+ "hwc_Latn",
2237
+ "hye_Armn",
2238
+ "hyw_Armn",
2239
+ "ian_Latn",
2240
+ "iba_Latn",
2241
+ "ibg_Latn",
2242
+ "ibo_Latn",
2243
+ "icr_Latn",
2244
+ "ido_Latn",
2245
+ "idu_Latn",
2246
+ "ifb_Latn",
2247
+ "ife_Latn",
2248
+ "ifk_Latn",
2249
+ "ifu_Latn",
2250
+ "ify_Latn",
2251
+ "ige_Latn",
2252
+ "ign_Latn",
2253
+ "ike_Cans",
2254
+ "ikk_Latn",
2255
+ "ikt_Latn",
2256
+ "ikw_Latn",
2257
+ "ile_Latn",
2258
+ "ilo_Latn",
2259
+ "imo_Latn",
2260
+ "ina_Latn",
2261
+ "inb_Latn",
2262
+ "ind_Latn",
2263
+ "inh_Cyrl",
2264
+ "ino_Latn",
2265
+ "iou_Latn",
2266
+ "ipi_Latn",
2267
+ "irk_Latn",
2268
+ "isd_Latn",
2269
+ "ish_Latn",
2270
+ "isl_Latn",
2271
+ "iso_Latn",
2272
+ "ita_Latn",
2273
+ "itv_Latn",
2274
+ "ium_Latn",
2275
+ "ivv_Latn",
2276
+ "iws_Latn",
2277
+ "ixl_Latn",
2278
+ "izr_Latn",
2279
+ "izz_Latn",
2280
+ "jac_Latn",
2281
+ "jae_Latn",
2282
+ "jam_Latn",
2283
+ "jav_Latn",
2284
+ "jbo_Latn",
2285
+ "jbu_Latn",
2286
+ "jic_Latn",
2287
+ "jiv_Latn",
2288
+ "jpn_Jpan",
2289
+ "jra_Latn",
2290
+ "jvn_Latn",
2291
+ "kaa_Cyrl",
2292
+ "kaa_Latn",
2293
+ "kab_Latn",
2294
+ "kac_Latn",
2295
+ "kal_Latn",
2296
+ "kam_Latn",
2297
+ "kan_Knda",
2298
+ "kan_Latn",
2299
+ "kao_Latn",
2300
+ "kaq_Latn",
2301
+ "kas_Arab",
2302
+ "kas_Deva",
2303
+ "kat_Geor",
2304
+ "kaz_Cyrl",
2305
+ "kbc_Latn",
2306
+ "kbd_Cyrl",
2307
+ "kbh_Latn",
2308
+ "kbm_Latn",
2309
+ "kbp_Latn",
2310
+ "kbq_Latn",
2311
+ "kbr_Latn",
2312
+ "kby_Latn",
2313
+ "kca_Cyrl",
2314
+ "kcg_Latn",
2315
+ "kck_Latn",
2316
+ "kdc_Latn",
2317
+ "kde_Latn",
2318
+ "kdh_Latn",
2319
+ "kdi_Latn",
2320
+ "kdl_Latn",
2321
+ "kea_Latn",
2322
+ "kek_Latn",
2323
+ "ken_Latn",
2324
+ "keo_Latn",
2325
+ "kew_Latn",
2326
+ "kez_Latn",
2327
+ "kff_Telu",
2328
+ "kgf_Latn",
2329
+ "kgk_Latn",
2330
+ "kgp_Latn",
2331
+ "kha_Latn",
2332
+ "khk_Cyrl",
2333
+ "khm_Khmr",
2334
+ "khs_Latn",
2335
+ "khz_Latn",
2336
+ "kij_Latn",
2337
+ "kik_Latn",
2338
+ "kin_Latn",
2339
+ "kir_Cyrl",
2340
+ "kiu_Latn",
2341
+ "kix_Latn",
2342
+ "kjb_Latn",
2343
+ "kje_Latn",
2344
+ "kjh_Cyrl",
2345
+ "kjs_Latn",
2346
+ "kkc_Latn",
2347
+ "kki_Latn",
2348
+ "kkj_Latn",
2349
+ "kkl_Latn",
2350
+ "klt_Latn",
2351
+ "klv_Latn",
2352
+ "kmb_Latn",
2353
+ "kmg_Latn",
2354
+ "kmh_Latn",
2355
+ "kmk_Latn",
2356
+ "kmm_Latn",
2357
+ "kmo_Latn",
2358
+ "kmr_Cyrl",
2359
+ "kmr_Latn",
2360
+ "kms_Latn",
2361
+ "kmu_Latn",
2362
+ "kmy_Latn",
2363
+ "knc_Arab",
2364
+ "knc_Latn",
2365
+ "kne_Latn",
2366
+ "knf_Latn",
2367
+ "kng_Latn",
2368
+ "knj_Latn",
2369
+ "knk_Latn",
2370
+ "knv_Latn",
2371
+ "koi_Cyrl",
2372
+ "koo_Latn",
2373
+ "kor_Hang",
2374
+ "kos_Latn",
2375
+ "kpe_Latn",
2376
+ "kpf_Latn",
2377
+ "kpg_Latn",
2378
+ "kpj_Latn",
2379
+ "kpr_Latn",
2380
+ "kpv_Cyrl",
2381
+ "kpw_Latn",
2382
+ "kpx_Latn",
2383
+ "kpz_Latn",
2384
+ "kqc_Latn",
2385
+ "kqe_Latn",
2386
+ "kqf_Latn",
2387
+ "kqn_Latn",
2388
+ "kqp_Latn",
2389
+ "kqw_Latn",
2390
+ "krc_Cyrl",
2391
+ "kri_Latn",
2392
+ "krj_Latn",
2393
+ "krl_Latn",
2394
+ "kru_Deva",
2395
+ "ksc_Latn",
2396
+ "ksd_Latn",
2397
+ "ksh_Latn",
2398
+ "ksp_Latn",
2399
+ "ksr_Latn",
2400
+ "kss_Latn",
2401
+ "ksw_Mymr",
2402
+ "ktj_Latn",
2403
+ "kto_Latn",
2404
+ "ktu_Latn",
2405
+ "ktz_Latn",
2406
+ "kua_Latn",
2407
+ "kud_Latn",
2408
+ "kue_Latn",
2409
+ "kum_Cyrl",
2410
+ "kup_Latn",
2411
+ "kus_Latn",
2412
+ "kvg_Latn",
2413
+ "kvn_Latn",
2414
+ "kwd_Latn",
2415
+ "kwf_Latn",
2416
+ "kwi_Latn",
2417
+ "kwj_Latn",
2418
+ "kwn_Latn",
2419
+ "kwy_Latn",
2420
+ "kxc_Ethi",
2421
+ "kxw_Latn",
2422
+ "kyc_Latn",
2423
+ "kyf_Latn",
2424
+ "kyg_Latn",
2425
+ "kyq_Latn",
2426
+ "kyu_Kali",
2427
+ "kyz_Latn",
2428
+ "kze_Latn",
2429
+ "kzj_Latn",
2430
+ "lac_Latn",
2431
+ "lad_Hebr",
2432
+ "lad_Latn",
2433
+ "lai_Latn",
2434
+ "laj_Latn",
2435
+ "lam_Latn",
2436
+ "lao_Laoo",
2437
+ "lat_Latn",
2438
+ "lbb_Latn",
2439
+ "lbe_Cyrl",
2440
+ "lbj_Tibt",
2441
+ "lbk_Latn",
2442
+ "lcm_Latn",
2443
+ "lcp_Thai",
2444
+ "ldi_Latn",
2445
+ "lee_Latn",
2446
+ "lef_Latn",
2447
+ "leh_Latn",
2448
+ "leu_Latn",
2449
+ "lew_Latn",
2450
+ "lex_Latn",
2451
+ "lez_Cyrl",
2452
+ "lfn_Cyrl",
2453
+ "lfn_Latn",
2454
+ "lgg_Latn",
2455
+ "lgl_Latn",
2456
+ "lhu_Latn",
2457
+ "lia_Latn",
2458
+ "lid_Latn",
2459
+ "lif_Deva",
2460
+ "lif_Limb",
2461
+ "lij_Latn",
2462
+ "lim_Latn",
2463
+ "lin_Latn",
2464
+ "lip_Latn",
2465
+ "lis_Lisu",
2466
+ "lit_Latn",
2467
+ "liv_Latn",
2468
+ "ljp_Latn",
2469
+ "lki_Arab",
2470
+ "lld_Latn",
2471
+ "llg_Latn",
2472
+ "lmk_Latn",
2473
+ "lmo_Latn",
2474
+ "lmp_Latn",
2475
+ "lnd_Latn",
2476
+ "log_Latn",
2477
+ "loq_Latn",
2478
+ "loz_Latn",
2479
+ "lrc_Arab",
2480
+ "lsi_Latn",
2481
+ "lsm_Latn",
2482
+ "ltg_Latn",
2483
+ "ltz_Latn",
2484
+ "lua_Latn",
2485
+ "lub_Latn",
2486
+ "luc_Latn",
2487
+ "lue_Latn",
2488
+ "lug_Latn",
2489
+ "lun_Latn",
2490
+ "luo_Latn",
2491
+ "lus_Latn",
2492
+ "lvs_Latn",
2493
+ "lwg_Latn",
2494
+ "lwo_Latn",
2495
+ "lww_Latn",
2496
+ "lzh_Hani",
2497
+ "maa_Latn",
2498
+ "mad_Latn",
2499
+ "mag_Deva",
2500
+ "mah_Latn",
2501
+ "mai_Deva",
2502
+ "maj_Latn",
2503
+ "mak_Latn",
2504
+ "mal_Latn",
2505
+ "mal_Mlym",
2506
+ "mam_Latn",
2507
+ "maq_Latn",
2508
+ "mar_Deva",
2509
+ "mar_Latn",
2510
+ "mas_Latn",
2511
+ "mau_Latn",
2512
+ "mav_Latn",
2513
+ "maz_Latn",
2514
+ "mbb_Latn",
2515
+ "mbc_Latn",
2516
+ "mbd_Latn",
2517
+ "mbf_Latn",
2518
+ "mbh_Latn",
2519
+ "mbi_Latn",
2520
+ "mbj_Latn",
2521
+ "mbl_Latn",
2522
+ "mbs_Latn",
2523
+ "mbt_Latn",
2524
+ "mca_Latn",
2525
+ "mcb_Latn",
2526
+ "mcd_Latn",
2527
+ "mcf_Latn",
2528
+ "mck_Latn",
2529
+ "mco_Latn",
2530
+ "mcp_Latn",
2531
+ "mcq_Latn",
2532
+ "mcu_Latn",
2533
+ "mdf_Cyrl",
2534
+ "mdy_Ethi",
2535
+ "med_Latn",
2536
+ "mee_Latn",
2537
+ "mej_Latn",
2538
+ "mek_Latn",
2539
+ "men_Latn",
2540
+ "meq_Latn",
2541
+ "mer_Latn",
2542
+ "meu_Latn",
2543
+ "mfe_Latn",
2544
+ "mfi_Latn",
2545
+ "mfq_Latn",
2546
+ "mfy_Latn",
2547
+ "mfz_Latn",
2548
+ "mgh_Latn",
2549
+ "mgr_Latn",
2550
+ "mhi_Latn",
2551
+ "mhl_Latn",
2552
+ "mhr_Cyrl",
2553
+ "mhx_Latn",
2554
+ "mib_Latn",
2555
+ "mic_Latn",
2556
+ "mie_Latn",
2557
+ "mif_Latn",
2558
+ "mig_Latn",
2559
+ "mih_Latn",
2560
+ "mil_Latn",
2561
+ "mim_Latn",
2562
+ "min_Latn",
2563
+ "mio_Latn",
2564
+ "mip_Latn",
2565
+ "miq_Latn",
2566
+ "mir_Latn",
2567
+ "mit_Latn",
2568
+ "miy_Latn",
2569
+ "miz_Latn",
2570
+ "mjc_Latn",
2571
+ "mjw_Latn",
2572
+ "mkd_Cyrl",
2573
+ "mkl_Latn",
2574
+ "mkn_Latn",
2575
+ "mks_Latn",
2576
+ "mlh_Latn",
2577
+ "mlp_Latn",
2578
+ "mlt_Latn",
2579
+ "mlu_Latn",
2580
+ "mmn_Latn",
2581
+ "mmo_Latn",
2582
+ "mmx_Latn",
2583
+ "mna_Latn",
2584
+ "mnb_Latn",
2585
+ "mni_Beng",
2586
+ "mni_Latn",
2587
+ "mni_Mtei",
2588
+ "mnk_Latn",
2589
+ "mns_Cyrl",
2590
+ "mnw_Mymr",
2591
+ "mnx_Latn",
2592
+ "mny_Latn",
2593
+ "mog_Latn",
2594
+ "moh_Latn",
2595
+ "mop_Latn",
2596
+ "mor_Latn",
2597
+ "mos_Latn",
2598
+ "mox_Latn",
2599
+ "mph_Latn",
2600
+ "mpm_Latn",
2601
+ "mpp_Latn",
2602
+ "mps_Latn",
2603
+ "mpt_Latn",
2604
+ "mpx_Latn",
2605
+ "mqb_Latn",
2606
+ "mqj_Latn",
2607
+ "mqy_Latn",
2608
+ "mri_Latn",
2609
+ "mrj_Cyrl",
2610
+ "mrq_Latn",
2611
+ "mrw_Latn",
2612
+ "msb_Latn",
2613
+ "msk_Latn",
2614
+ "msy_Latn",
2615
+ "mta_Latn",
2616
+ "mti_Latn",
2617
+ "mto_Latn",
2618
+ "mtp_Latn",
2619
+ "muh_Latn",
2620
+ "mui_Latn",
2621
+ "mup_Deva",
2622
+ "mur_Latn",
2623
+ "mus_Latn",
2624
+ "mux_Latn",
2625
+ "muy_Latn",
2626
+ "mva_Latn",
2627
+ "mvn_Latn",
2628
+ "mvp_Latn",
2629
+ "mwc_Latn",
2630
+ "mwl_Latn",
2631
+ "mwn_Latn",
2632
+ "mwp_Latn",
2633
+ "mwq_Latn",
2634
+ "mwv_Latn",
2635
+ "mww_Latn",
2636
+ "mxb_Latn",
2637
+ "mxp_Latn",
2638
+ "mxq_Latn",
2639
+ "mxt_Latn",
2640
+ "mxv_Latn",
2641
+ "mya_Mymr",
2642
+ "myk_Latn",
2643
+ "myu_Latn",
2644
+ "myv_Cyrl",
2645
+ "myw_Latn",
2646
+ "myx_Latn",
2647
+ "myy_Latn",
2648
+ "mza_Latn",
2649
+ "mzh_Latn",
2650
+ "mzk_Latn",
2651
+ "mzn_Arab",
2652
+ "mzw_Latn",
2653
+ "mzz_Latn",
2654
+ "naf_Latn",
2655
+ "nah_Latn",
2656
+ "nak_Latn",
2657
+ "nan_Hani",
2658
+ "nan_Latn",
2659
+ "nap_Latn",
2660
+ "naq_Latn",
2661
+ "nas_Latn",
2662
+ "nav_Latn",
2663
+ "nba_Latn",
2664
+ "nbe_Latn",
2665
+ "nbl_Latn",
2666
+ "nbq_Latn",
2667
+ "nbu_Latn",
2668
+ "nca_Latn",
2669
+ "nch_Latn",
2670
+ "ncj_Latn",
2671
+ "ncl_Latn",
2672
+ "ncq_Laoo",
2673
+ "ncu_Latn",
2674
+ "ncx_Latn",
2675
+ "ndc_Latn",
2676
+ "nde_Latn",
2677
+ "ndh_Latn",
2678
+ "ndo_Latn",
2679
+ "nds_Latn",
2680
+ "neb_Latn",
2681
+ "new_Deva",
2682
+ "nfa_Latn",
2683
+ "nfr_Latn",
2684
+ "ngl_Latn",
2685
+ "ngp_Latn",
2686
+ "ngu_Latn",
2687
+ "nhe_Latn",
2688
+ "nhg_Latn",
2689
+ "nhi_Latn",
2690
+ "nho_Latn",
2691
+ "nhr_Latn",
2692
+ "nhu_Latn",
2693
+ "nhw_Latn",
2694
+ "nhx_Latn",
2695
+ "nhy_Latn",
2696
+ "nia_Latn",
2697
+ "nif_Latn",
2698
+ "nii_Latn",
2699
+ "nij_Latn",
2700
+ "nim_Latn",
2701
+ "nin_Latn",
2702
+ "niu_Latn",
2703
+ "niy_Latn",
2704
+ "njb_Latn",
2705
+ "njm_Latn",
2706
+ "njn_Latn",
2707
+ "njo_Latn",
2708
+ "njz_Latn",
2709
+ "nko_Latn",
2710
+ "nld_Latn",
2711
+ "nlg_Latn",
2712
+ "nmf_Latn",
2713
+ "nmo_Latn",
2714
+ "nmz_Latn",
2715
+ "nnb_Latn",
2716
+ "nno_Latn",
2717
+ "nnq_Latn",
2718
+ "nnw_Latn",
2719
+ "noa_Latn",
2720
+ "nob_Latn",
2721
+ "nod_Thai",
2722
+ "nog_Cyrl",
2723
+ "non_Latn",
2724
+ "nop_Latn",
2725
+ "not_Latn",
2726
+ "nou_Latn",
2727
+ "nov_Latn",
2728
+ "nph_Latn",
2729
+ "npi_Deva",
2730
+ "npi_Latn",
2731
+ "npl_Latn",
2732
+ "npy_Latn",
2733
+ "nqo_Nkoo",
2734
+ "nre_Latn",
2735
+ "nrf_Latn",
2736
+ "nrm_Latn",
2737
+ "nse_Latn",
2738
+ "nsm_Latn",
2739
+ "nsn_Latn",
2740
+ "nso_Latn",
2741
+ "nss_Latn",
2742
+ "nsu_Latn",
2743
+ "ntp_Latn",
2744
+ "ntr_Latn",
2745
+ "ntu_Latn",
2746
+ "nuj_Latn",
2747
+ "nus_Latn",
2748
+ "nuy_Latn",
2749
+ "nvm_Latn",
2750
+ "nwi_Latn",
2751
+ "nya_Latn",
2752
+ "nyf_Latn",
2753
+ "nyn_Latn",
2754
+ "nyo_Latn",
2755
+ "nyu_Latn",
2756
+ "nyy_Latn",
2757
+ "nzi_Latn",
2758
+ "nzm_Latn",
2759
+ "obo_Latn",
2760
+ "oci_Latn",
2761
+ "ogo_Latn",
2762
+ "ojb_Cans",
2763
+ "ojb_Latn",
2764
+ "oke_Latn",
2765
+ "okv_Latn",
2766
+ "old_Latn",
2767
+ "olo_Latn",
2768
+ "omw_Latn",
2769
+ "ong_Latn",
2770
+ "ons_Latn",
2771
+ "opm_Latn",
2772
+ "orv_Cyrl",
2773
+ "ory_Latn",
2774
+ "ory_Orya",
2775
+ "oss_Cyrl",
2776
+ "ota_Arab",
2777
+ "ote_Latn",
2778
+ "otm_Latn",
2779
+ "oto_Latn",
2780
+ "otq_Latn",
2781
+ "ots_Latn",
2782
+ "otw_Latn",
2783
+ "ozm_Latn",
2784
+ "pab_Latn",
2785
+ "pad_Latn",
2786
+ "pag_Latn",
2787
+ "pah_Latn",
2788
+ "pam_Latn",
2789
+ "pan_Guru",
2790
+ "pan_Latn",
2791
+ "pao_Latn",
2792
+ "pap_Latn",
2793
+ "pau_Latn",
2794
+ "pbb_Latn",
2795
+ "pbt_Arab",
2796
+ "pcd_Latn",
2797
+ "pck_Latn",
2798
+ "pcm_Latn",
2799
+ "pdc_Latn",
2800
+ "pdt_Latn",
2801
+ "pem_Latn",
2802
+ "pfl_Latn",
2803
+ "pib_Latn",
2804
+ "pio_Latn",
2805
+ "pir_Latn",
2806
+ "pis_Latn",
2807
+ "pjt_Latn",
2808
+ "plg_Latn",
2809
+ "pls_Latn",
2810
+ "plt_Latn",
2811
+ "plu_Latn",
2812
+ "plw_Latn",
2813
+ "pma_Latn",
2814
+ "pmf_Latn",
2815
+ "pmq_Latn",
2816
+ "pms_Latn",
2817
+ "pnb_Arab",
2818
+ "pnt_Grek",
2819
+ "poe_Latn",
2820
+ "poh_Latn",
2821
+ "poi_Latn",
2822
+ "pol_Latn",
2823
+ "pon_Latn",
2824
+ "por_Latn",
2825
+ "pot_Latn",
2826
+ "pov_Latn",
2827
+ "poy_Latn",
2828
+ "ppk_Latn",
2829
+ "ppo_Latn",
2830
+ "prf_Latn",
2831
+ "prg_Latn",
2832
+ "pri_Latn",
2833
+ "ptp_Latn",
2834
+ "ptu_Latn",
2835
+ "pwg_Latn",
2836
+ "pwn_Latn",
2837
+ "pxm_Latn",
2838
+ "qub_Latn",
2839
+ "quc_Latn",
2840
+ "quf_Latn",
2841
+ "qug_Latn",
2842
+ "quh_Latn",
2843
+ "qup_Latn",
2844
+ "quw_Latn",
2845
+ "quy_Latn",
2846
+ "quz_Latn",
2847
+ "qva_Latn",
2848
+ "qvc_Latn",
2849
+ "qve_Latn",
2850
+ "qvh_Latn",
2851
+ "qvi_Latn",
2852
+ "qvm_Latn",
2853
+ "qvn_Latn",
2854
+ "qvs_Latn",
2855
+ "qvw_Latn",
2856
+ "qvz_Latn",
2857
+ "qwh_Latn",
2858
+ "qxh_Latn",
2859
+ "qxl_Latn",
2860
+ "qxn_Latn",
2861
+ "qxo_Latn",
2862
+ "qxr_Latn",
2863
+ "rad_Latn",
2864
+ "rai_Latn",
2865
+ "rap_Latn",
2866
+ "rar_Latn",
2867
+ "rav_Deva",
2868
+ "raw_Latn",
2869
+ "rcf_Latn",
2870
+ "rej_Latn",
2871
+ "rgu_Latn",
2872
+ "rhg_Latn",
2873
+ "ria_Latn",
2874
+ "rim_Latn",
2875
+ "rkb_Latn",
2876
+ "rki_Mymr",
2877
+ "rmc_Latn",
2878
+ "rml_Latn",
2879
+ "rmn_Cyrl",
2880
+ "rmn_Grek",
2881
+ "rmn_Latn",
2882
+ "rmo_Latn",
2883
+ "rmq_Latn",
2884
+ "rmy_Cyrl",
2885
+ "rmy_Latn",
2886
+ "rnd_Latn",
2887
+ "rng_Latn",
2888
+ "roh_Latn",
2889
+ "ron_Cyrl",
2890
+ "ron_Latn",
2891
+ "roo_Latn",
2892
+ "rop_Latn",
2893
+ "row_Latn",
2894
+ "rro_Latn",
2895
+ "rtm_Latn",
2896
+ "rub_Latn",
2897
+ "rue_Cyrl",
2898
+ "ruf_Latn",
2899
+ "rug_Latn",
2900
+ "run_Latn",
2901
+ "rup_Latn",
2902
+ "rus_Cyrl",
2903
+ "rwo_Latn",
2904
+ "sab_Latn",
2905
+ "sag_Latn",
2906
+ "sah_Cyrl",
2907
+ "san_Deva",
2908
+ "san_Latn",
2909
+ "sas_Latn",
2910
+ "sat_Latn",
2911
+ "sat_Olck",
2912
+ "sba_Latn",
2913
+ "sbe_Latn",
2914
+ "sbl_Latn",
2915
+ "sby_Latn",
2916
+ "sck_Deva",
2917
+ "scn_Latn",
2918
+ "sco_Latn",
2919
+ "sda_Latn",
2920
+ "sdc_Latn",
2921
+ "sdh_Arab",
2922
+ "seh_Latn",
2923
+ "ses_Latn",
2924
+ "sey_Latn",
2925
+ "sfw_Latn",
2926
+ "sgb_Latn",
2927
+ "sgc_Latn",
2928
+ "sgh_Cyrl",
2929
+ "sgs_Latn",
2930
+ "sgw_Ethi",
2931
+ "sgz_Latn",
2932
+ "shi_Latn",
2933
+ "shn_Mymr",
2934
+ "shp_Latn",
2935
+ "sid_Latn",
2936
+ "sig_Latn",
2937
+ "sil_Latn",
2938
+ "sim_Latn",
2939
+ "sin_Sinh",
2940
+ "sja_Latn",
2941
+ "skg_Latn",
2942
+ "skr_Arab",
2943
+ "slk_Latn",
2944
+ "sll_Latn",
2945
+ "slv_Latn",
2946
+ "sma_Latn",
2947
+ "sme_Latn",
2948
+ "smj_Latn",
2949
+ "smk_Latn",
2950
+ "sml_Latn",
2951
+ "smn_Latn",
2952
+ "smo_Latn",
2953
+ "sms_Latn",
2954
+ "sna_Latn",
2955
+ "snc_Latn",
2956
+ "snd_Arab",
2957
+ "snd_Deva",
2958
+ "snd_Latn",
2959
+ "snf_Latn",
2960
+ "snn_Latn",
2961
+ "snp_Latn",
2962
+ "snw_Latn",
2963
+ "sny_Latn",
2964
+ "som_Latn",
2965
+ "sop_Latn",
2966
+ "soq_Latn",
2967
+ "sot_Latn",
2968
+ "soy_Latn",
2969
+ "spa_Latn",
2970
+ "spl_Latn",
2971
+ "spm_Latn",
2972
+ "spp_Latn",
2973
+ "sps_Latn",
2974
+ "spy_Latn",
2975
+ "srd_Latn",
2976
+ "srm_Latn",
2977
+ "srn_Latn",
2978
+ "srp_Cyrl",
2979
+ "srp_Latn",
2980
+ "srq_Latn",
2981
+ "srr_Latn",
2982
+ "ssd_Latn",
2983
+ "ssg_Latn",
2984
+ "ssw_Latn",
2985
+ "ssx_Latn",
2986
+ "stp_Latn",
2987
+ "stq_Latn",
2988
+ "sua_Latn",
2989
+ "suc_Latn",
2990
+ "sue_Latn",
2991
+ "suk_Latn",
2992
+ "sun_Latn",
2993
+ "sur_Latn",
2994
+ "sus_Arab",
2995
+ "sus_Latn",
2996
+ "suz_Deva",
2997
+ "swc_Latn",
2998
+ "swe_Latn",
2999
+ "swg_Latn",
3000
+ "swh_Latn",
3001
+ "swp_Latn",
3002
+ "sxb_Latn",
3003
+ "sxn_Latn",
3004
+ "syb_Latn",
3005
+ "syc_Syrc",
3006
+ "syl_Beng",
3007
+ "syl_Latn",
3008
+ "szb_Latn",
3009
+ "szl_Latn",
3010
+ "szy_Latn",
3011
+ "tab_Cyrl",
3012
+ "tac_Latn",
3013
+ "tah_Latn",
3014
+ "taj_Deva",
3015
+ "tam_Latn",
3016
+ "tam_Taml",
3017
+ "taq_Latn",
3018
+ "taq_Tfng",
3019
+ "tar_Latn",
3020
+ "tat_Cyrl",
3021
+ "tat_Latn",
3022
+ "tav_Latn",
3023
+ "taw_Latn",
3024
+ "tay_Latn",
3025
+ "tbc_Latn",
3026
+ "tbg_Latn",
3027
+ "tbo_Latn",
3028
+ "tby_Latn",
3029
+ "tbz_Latn",
3030
+ "tca_Latn",
3031
+ "tcf_Latn",
3032
+ "tcs_Latn",
3033
+ "tcy_Knda",
3034
+ "tcz_Latn",
3035
+ "tdt_Latn",
3036
+ "ted_Latn",
3037
+ "tee_Latn",
3038
+ "tel_Latn",
3039
+ "tel_Telu",
3040
+ "tem_Latn",
3041
+ "teo_Latn",
3042
+ "ter_Latn",
3043
+ "tet_Latn",
3044
+ "tew_Latn",
3045
+ "tfr_Latn",
3046
+ "tgk_Cyrl",
3047
+ "tgo_Latn",
3048
+ "tgp_Latn",
3049
+ "tha_Thai",
3050
+ "thk_Latn",
3051
+ "thl_Deva",
3052
+ "tif_Latn",
3053
+ "tih_Latn",
3054
+ "tim_Latn",
3055
+ "tir_Ethi",
3056
+ "tiv_Latn",
3057
+ "tiy_Latn",
3058
+ "tkl_Latn",
3059
+ "tkr_Cyrl",
3060
+ "tku_Latn",
3061
+ "tlf_Latn",
3062
+ "tlh_Latn",
3063
+ "tll_Latn",
3064
+ "tly_Latn",
3065
+ "tmd_Latn",
3066
+ "tna_Latn",
3067
+ "tnc_Latn",
3068
+ "tnk_Latn",
3069
+ "tnn_Latn",
3070
+ "tnp_Latn",
3071
+ "tob_Latn",
3072
+ "toc_Latn",
3073
+ "tod_Latn",
3074
+ "tog_Latn",
3075
+ "toh_Latn",
3076
+ "toi_Latn",
3077
+ "toj_Latn",
3078
+ "tok_Latn",
3079
+ "ton_Latn",
3080
+ "too_Latn",
3081
+ "top_Latn",
3082
+ "tos_Latn",
3083
+ "tpa_Latn",
3084
+ "tpi_Latn",
3085
+ "tpm_Latn",
3086
+ "tpp_Latn",
3087
+ "tpt_Latn",
3088
+ "tpz_Latn",
3089
+ "trc_Latn",
3090
+ "trn_Latn",
3091
+ "trp_Latn",
3092
+ "trq_Latn",
3093
+ "trv_Latn",
3094
+ "tsc_Latn",
3095
+ "tsg_Latn",
3096
+ "tsn_Latn",
3097
+ "tso_Latn",
3098
+ "tsw_Latn",
3099
+ "tsz_Latn",
3100
+ "ttc_Latn",
3101
+ "tte_Latn",
3102
+ "ttj_Latn",
3103
+ "tuc_Latn",
3104
+ "tue_Latn",
3105
+ "tuf_Latn",
3106
+ "tui_Latn",
3107
+ "tuk_Arab",
3108
+ "tuk_Cyrl",
3109
+ "tuk_Latn",
3110
+ "tum_Latn",
3111
+ "tuo_Latn",
3112
+ "tur_Latn",
3113
+ "tuv_Latn",
3114
+ "tvk_Latn",
3115
+ "tvl_Latn",
3116
+ "twi_Latn",
3117
+ "twu_Latn",
3118
+ "txq_Latn",
3119
+ "txu_Latn",
3120
+ "tyv_Cyrl",
3121
+ "tzh_Latn",
3122
+ "tzj_Latn",
3123
+ "tzm_Tfng",
3124
+ "tzo_Latn",
3125
+ "ubr_Latn",
3126
+ "ubu_Latn",
3127
+ "udm_Cyrl",
3128
+ "udu_Latn",
3129
+ "uig_Arab",
3130
+ "uig_Cyrl",
3131
+ "uig_Latn",
3132
+ "ukr_Cyrl",
3133
+ "umb_Latn",
3134
+ "und_Bali",
3135
+ "und_Bamu",
3136
+ "und_Bopo",
3137
+ "und_Cans",
3138
+ "und_Cher",
3139
+ "und_Cyrl",
3140
+ "und_Deva",
3141
+ "und_Egyp",
3142
+ "und_Ethi",
3143
+ "und_Geor",
3144
+ "und_Goth",
3145
+ "und_Grek",
3146
+ "und_Hebr",
3147
+ "und_Hluw",
3148
+ "und_Hung",
3149
+ "und_Kana",
3150
+ "und_Khmr",
3151
+ "und_Lana",
3152
+ "und_Laoo",
3153
+ "und_Lina",
3154
+ "und_Mlym",
3155
+ "und_Mong",
3156
+ "und_Mymr",
3157
+ "und_Newa",
3158
+ "und_Orya",
3159
+ "und_Shaw",
3160
+ "und_Sylo",
3161
+ "und_Syrc",
3162
+ "und_Taml",
3163
+ "und_Tang",
3164
+ "und_Telu",
3165
+ "und_Thaa",
3166
+ "und_Thai",
3167
+ "und_Tibt",
3168
+ "und_Vaii",
3169
+ "und_Xsux",
3170
+ "und_Yiii",
3171
+ "upv_Latn",
3172
+ "ura_Latn",
3173
+ "urb_Latn",
3174
+ "urd_Arab",
3175
+ "urd_Latn",
3176
+ "urh_Latn",
3177
+ "urk_Thai",
3178
+ "urt_Latn",
3179
+ "usa_Latn",
3180
+ "usp_Latn",
3181
+ "uth_Latn",
3182
+ "uvh_Latn",
3183
+ "uvl_Latn",
3184
+ "uzn_Cyrl",
3185
+ "uzn_Latn",
3186
+ "uzs_Arab",
3187
+ "vap_Latn",
3188
+ "var_Latn",
3189
+ "vec_Latn",
3190
+ "ven_Latn",
3191
+ "vep_Latn",
3192
+ "vid_Latn",
3193
+ "vie_Latn",
3194
+ "viv_Latn",
3195
+ "vls_Latn",
3196
+ "vmw_Latn",
3197
+ "vmy_Latn",
3198
+ "vol_Latn",
3199
+ "vro_Latn",
3200
+ "vun_Latn",
3201
+ "waj_Latn",
3202
+ "wal_Latn",
3203
+ "wap_Latn",
3204
+ "war_Latn",
3205
+ "way_Latn",
3206
+ "wba_Latn",
3207
+ "wbm_Latn",
3208
+ "wbp_Latn",
3209
+ "wed_Latn",
3210
+ "wer_Latn",
3211
+ "whk_Latn",
3212
+ "wib_Latn",
3213
+ "wim_Latn",
3214
+ "wiu_Latn",
3215
+ "wln_Latn",
3216
+ "wls_Latn",
3217
+ "wlv_Latn",
3218
+ "wmt_Latn",
3219
+ "wmw_Latn",
3220
+ "wnc_Latn",
3221
+ "wnu_Latn",
3222
+ "wol_Latn",
3223
+ "wos_Latn",
3224
+ "wrk_Latn",
3225
+ "wrs_Latn",
3226
+ "wsk_Latn",
3227
+ "wuu_Hani",
3228
+ "wuv_Latn",
3229
+ "xal_Cyrl",
3230
+ "xav_Latn",
3231
+ "xbi_Latn",
3232
+ "xbr_Latn",
3233
+ "xed_Latn",
3234
+ "xho_Latn",
3235
+ "xla_Latn",
3236
+ "xmf_Geor",
3237
+ "xmm_Latn",
3238
+ "xmv_Latn",
3239
+ "xnn_Latn",
3240
+ "xog_Latn",
3241
+ "xon_Latn",
3242
+ "xrb_Latn",
3243
+ "xsi_Latn",
3244
+ "xsm_Latn",
3245
+ "xsr_Deva",
3246
+ "xsu_Latn",
3247
+ "xtd_Latn",
3248
+ "xtm_Latn",
3249
+ "xtn_Latn",
3250
+ "xuo_Latn",
3251
+ "yaa_Latn",
3252
+ "yad_Latn",
3253
+ "yal_Latn",
3254
+ "yan_Latn",
3255
+ "yao_Latn",
3256
+ "yap_Latn",
3257
+ "yaq_Latn",
3258
+ "ybb_Latn",
3259
+ "yby_Latn",
3260
+ "ycn_Latn",
3261
+ "ydd_Hebr",
3262
+ "yka_Latn",
3263
+ "yle_Latn",
3264
+ "yli_Latn",
3265
+ "yml_Latn",
3266
+ "yom_Latn",
3267
+ "yon_Latn",
3268
+ "yor_Latn",
3269
+ "yrb_Latn",
3270
+ "yre_Latn",
3271
+ "yrk_Cyrl",
3272
+ "yrl_Latn",
3273
+ "yss_Latn",
3274
+ "yua_Latn",
3275
+ "yue_Hani",
3276
+ "yuj_Latn",
3277
+ "yut_Latn",
3278
+ "yuw_Latn",
3279
+ "yva_Latn",
3280
+ "zaa_Latn",
3281
+ "zab_Latn",
3282
+ "zac_Latn",
3283
+ "zad_Latn",
3284
+ "zae_Latn",
3285
+ "zai_Latn",
3286
+ "zam_Latn",
3287
+ "zao_Latn",
3288
+ "zar_Latn",
3289
+ "zas_Latn",
3290
+ "zat_Latn",
3291
+ "zav_Latn",
3292
+ "zaw_Latn",
3293
+ "zdj_Latn",
3294
+ "zea_Latn",
3295
+ "zgh_Tfng",
3296
+ "zia_Latn",
3297
+ "ziw_Latn",
3298
+ "zne_Latn",
3299
+ "zom_Latn",
3300
+ "zos_Latn",
3301
+ "zpa_Latn",
3302
+ "zpc_Latn",
3303
+ "zpg_Latn",
3304
+ "zpi_Latn",
3305
+ "zpl_Latn",
3306
+ "zpm_Latn",
3307
+ "zpo_Latn",
3308
+ "zpt_Latn",
3309
+ "zpu_Latn",
3310
+ "zpv_Latn",
3311
+ "zpz_Latn",
3312
+ "zsm_Latn",
3313
+ "zsr_Latn",
3314
+ "ztq_Latn",
3315
+ "zty_Latn",
3316
+ "zul_Latn",
3317
+ "zyb_Latn",
3318
+ "zyp_Latn"
3319
+ ]
3320
+ }
millid.py ADDED
@@ -0,0 +1,1529 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # /// script
2
+ # requires-python = ">=3.10"
3
+ # dependencies = [
4
+ # "torch>=2.4",
5
+ # "numpy",
6
+ # "pandas",
7
+ # "pyarrow",
8
+ # "huggingface_hub>=0.30",
9
+ # "safetensors",
10
+ # "fasttext-wheel",
11
+ # "wandb",
12
+ # "tyro>=0.8",
13
+ # ]
14
+ # ///
15
+ """MillID: MultiLingual Language IDentifier.
16
+
17
+ A byte-level, encoder-only transformer that names the language of a passage of text, over
18
+ the label set of baobabtech/millid-dataset (1,000+ language-script labels).
19
+
20
+ One file, three uses:
21
+
22
+ # train on Hugging Face Jobs, evaluate against GlotLID, push to the Hub
23
+ hf jobs uv run --flavor h200 --timeout 4h --secrets HF_TOKEN \\
24
+ millid/millid.py train --dataset baobabtech/millid-dataset --push-to baobabtech/millid
25
+
26
+ # evaluate a trained model
27
+ python millid.py evaluate --model baobabtech/millid --dataset baobabtech/millid-dataset
28
+
29
+ # tune hyperparameters with a Weights & Biases sweep (agents run as Jobs too)
30
+ wandb sweep millid/sweep.yaml # prints ENTITY/PROJECT/SWEEP_ID
31
+ hf jobs uv run --flavor h200 --secrets HF_TOKEN --secrets WANDB_API_KEY \\
32
+ millid/millid.py sweep-agent --sweep-id ENTITY/PROJECT/SWEEP_ID --count 6
33
+
34
+ # use it
35
+ from millid import MillID
36
+ model = MillID.from_pretrained("baobabtech/millid")
37
+ model.predict(["Lave men ou ak savon."], k=3) # [[("hat_Latn", 0.98), ...]]
38
+
39
+ One universal encoding
40
+ ----------------------
41
+ Text: Unicode NFKC, whitespace collapsed, then UTF-8 bytes. Every script in every language is the
42
+ same 256 symbols, so there is no tokenizer to train, no vocabulary to outgrow and no unknown
43
+ token; a script the model has never seen is still bytes it can read.
44
+
45
+ Labels: ISO 639-3 plus ISO 15924 script (`eng_Latn`, `amh_Ethi`), the dataset's labels.json
46
+ fixing label i to labels[i]. A model trained with extra sources keeps those ids and appends its
47
+ own labels after them.
48
+
49
+ Architecture (ARCHITECTURE.md has the full design)
50
+ ------------
51
+ UTF-8 bytes, each embedded as byte + script + byte-in-character + hashed char 2/3/4-grams
52
+ -> depthwise convolution stem -> strided convolution (2 bytes per token)
53
+ -> N pre-norm blocks: RMSNorm, attention with RoPE, RMSNorm, SwiGLU
54
+ -> masked mean pooling -> language head (label + language + script vectors)
55
+
56
+ Presets: tiny ~2M and small ~12M for trials, medium ~114M (default), large ~190M.
57
+
58
+ The model is two parts, and the split is deliberate. `MillIDTextEncoder` turns bytes into one
59
+ d_model vector; `LanguageHead` turns a vector into a language. MillID v2 adds images: an image
60
+ encoder producing vectors in the same d_model space, fused with the text vector (or used alone
61
+ for a scan with no text layer) before the same head. Checkpoint keys are `text.*` and `head.*`
62
+ from v1 on, so v1 weights load into v2 unchanged.
63
+
64
+ Configuration is CleanRL-style: each command is a typed dataclass (`TrainArgs`, ...) whose
65
+ fields are the flags and whose field docstrings are the help, parsed by tyro. `python millid.py
66
+ train --help` lists every setting; the resolved settings are saved with each run, in
67
+ config.json and in W&B.
68
+
69
+ Tracking: with WANDB_API_KEY set (or --wandb-project), every run logs its hyperparameters,
70
+ training loss, learning rate, gradient norm and throughput, the validation curve, and the
71
+ final per-set metrics and per-language tables to Weights & Biases.
72
+ """
73
+
74
+ from __future__ import annotations
75
+
76
+ import json
77
+ import math
78
+ import os
79
+ import random
80
+ import shutil
81
+ import sys
82
+ import time
83
+ import unicodedata
84
+ import zlib
85
+ from dataclasses import asdict, dataclass, field
86
+ from functools import lru_cache
87
+ from pathlib import Path
88
+ from typing import Literal
89
+
90
+ import numpy as np
91
+ import torch
92
+ import torch.nn as nn
93
+ import torch.nn.functional as F
94
+
95
+ # --- the universal text encoding ---------------------------------------------------------
96
+ #
97
+ # A passage becomes four aligned sequences, one entry per UTF-8 byte:
98
+ #
99
+ # ids the byte, shifted by OFFSET; CLS first
100
+ # script the Unicode script of the character the byte belongs to
101
+ # charpos 1 a one-byte character, 2 the first byte of a longer one, 3 a continuation byte
102
+ # ngrams hashed character n-grams of 2, 3 and 4 characters ending at the byte's character
103
+ #
104
+ # Bytes make every language the same 256 symbols. The other three tell the model what bytes
105
+ # alone hide: which writing system it is reading, where characters begin, and the character
106
+ # n-grams that fastText and GlotLID identify languages by.
107
+
108
+ PAD, CLS, EOS = 0, 1, 2
109
+ OFFSET = 3 # byte b is token b + OFFSET
110
+ VOCAB_SIZE = 256 + OFFSET
111
+ SCRIPT_BUCKETS = 512
112
+ SCRIPT_COMMON = 1 # digits, punctuation, symbols, spaces: shared by every script
113
+ NGRAM_ORDERS = (2, 3, 4)
114
+
115
+
116
+ def normalize(text: str) -> str:
117
+ """NFKC folds what PDF text layers and keyboards differ on (ligatures, full-width forms,
118
+ Arabic presentation forms) without changing the language of anything. Runs of whitespace
119
+ become one space."""
120
+ return " ".join(unicodedata.normalize("NFKC", str(text)).split())
121
+
122
+
123
+ @lru_cache(maxsize=1 << 16)
124
+ def char_script(ch: str) -> int:
125
+ """The script of a letter or mark, as an id: the first word of its Unicode name (LATIN,
126
+ ETHIOPIC, DEVANAGARI, CJK, HANGUL, ADLAM...), hashed. Python has no Unicode script property;
127
+ the name's first word is the same grouping for letters and marks, and hashing keeps the ids
128
+ stable when a newer Unicode adds scripts."""
129
+ if unicodedata.category(ch)[0] not in "LM":
130
+ return SCRIPT_COMMON
131
+ word = unicodedata.name(ch, "").split(" ", 1)[0]
132
+ if not word:
133
+ return SCRIPT_COMMON
134
+ return 2 + zlib.crc32(word.encode()) % (SCRIPT_BUCKETS - 2)
135
+
136
+
137
+ _SCRIPT_TABLE_SIZE = 0x40000 # planes 0 to 3, every script in use; beyond, char_script per character
138
+ _script_table: np.ndarray | None = None
139
+
140
+
141
+ def script_table() -> np.ndarray:
142
+ """char_script for every code point below 0x40000, built once per process (about a second).
143
+ Built before the DataLoader forks, the workers share it."""
144
+ global _script_table
145
+ if _script_table is None:
146
+ uncached = char_script.__wrapped__
147
+ _script_table = np.fromiter((uncached(chr(c)) for c in range(_SCRIPT_TABLE_SIZE)), dtype=np.int64, count=_SCRIPT_TABLE_SIZE)
148
+ return _script_table
149
+
150
+
151
+ # The n-gram hash: a polynomial over lowercased code points, read from the character back,
152
+ # then splitmix64, so neighbouring n-grams land in unrelated buckets. Before the passage every
153
+ # position holds _START, which no code point equals, so a word at the start of a passage has
154
+ # n-grams of its own. numpy's uint64 arithmetic wraps, which is the modulus.
155
+ _START = 0x110000
156
+ _PRIME = np.uint64(0x100000001B3)
157
+ _MIX1, _MIX2 = np.uint64(0xBF58476D1CE4E5B9), np.uint64(0x94D049BB133111EB)
158
+ _ORDER_SEED = {n: np.uint64((0x9E3779B97F4A7C15 * n) & 0xFFFFFFFFFFFFFFFF) for n in NGRAM_ORDERS}
159
+
160
+
161
+ def _splitmix(x: np.ndarray) -> np.ndarray:
162
+ x = (x ^ (x >> np.uint64(30))) * _MIX1
163
+ x = (x ^ (x >> np.uint64(27))) * _MIX2
164
+ return x ^ (x >> np.uint64(31))
165
+
166
+
167
+ def _codepoints(text: str) -> np.ndarray:
168
+ # "replace": a lone surrogate (broken PDF text) becomes "?", one code point for one
169
+ return np.frombuffer(text.encode("utf-32-le", "replace"), dtype=np.uint32)
170
+
171
+
172
+ _UTF8_LEAD = np.array([0, 0x00, 0xC0, 0xE0, 0xF0], dtype=np.int64) # by sequence length
173
+
174
+
175
+ def encode_batch(
176
+ texts: list[str], max_len: int = 256, ngram_buckets: int = 32768, rng: random.Random | None = None, pad_to: int | None = None
177
+ ) -> dict[str, torch.Tensor]:
178
+ """Passages as the model's input: the four per-byte sequences, CLS first, padded to the
179
+ longest (or to pad_to, for the fixed shapes torch.compile wants), and the mask. A passage
180
+ longer than max_len bytes is cut to a window of whole characters: its start at inference,
181
+ a random place in training.
182
+
183
+ The whole batch is one string, and every step one numpy operation over it, because the
184
+ training data workers run this for every batch: per passage it would be dozens of small
185
+ array operations, whose overhead is most of the cost."""
186
+ texts = [normalize(t) for t in texts]
187
+ b, budget = len(texts), max_len - 1
188
+ joined = "".join(texts)
189
+ cp = _codepoints(joined)
190
+ low = joined.lower() # lower() may lengthen a character; then keep the first of its lowercase
191
+ low = _codepoints(low) if len(low) == len(joined) else _codepoints("".join(ch.lower()[0] for ch in joined))
192
+ lens = np.fromiter(map(len, texts), dtype=np.int64, count=b)
193
+ first = np.cumsum(lens) - lens # each passage's first character in cp
194
+ after = first + lens
195
+ sizes = (1 + (cp >= 0x80) + (cp >= 0x800) + (cp >= 0x10000)).astype(np.int64) # UTF-8 bytes per character
196
+ ends = np.concatenate([[0], np.cumsum(sizes)]) # ends[k]: the bytes before character k
197
+
198
+ # Each passage's window, characters lo..hi-1 of cp.
199
+ lo = first.copy()
200
+ if rng is not None:
201
+ long = np.flatnonzero(ends[after] - ends[first] > budget)
202
+ if len(long):
203
+ last = np.searchsorted(ends, ends[after[long]] - budget, side="left") # the first start that fits the rest
204
+ u = np.array([rng.random() for _ in long])
205
+ lo[long] += (u * (last - first[long])).astype(np.int64) # every start before `last` fills the window
206
+ hi = np.minimum(np.searchsorted(ends, ends[lo] + budget, side="right") - 1, after)
207
+ w = hi - lo
208
+ at = np.repeat(lo - (np.cumsum(w) - w), w) + np.arange(w.sum()) # every window character, in order
209
+ c = cp[at].astype(np.int64)
210
+
211
+ inside = c < _SCRIPT_TABLE_SIZE
212
+ script = script_table()[np.where(inside, c, 0)]
213
+ for k in np.flatnonzero(~inside):
214
+ script[k] = char_script(chr(c[k]))
215
+
216
+ # n-grams: the characters from this one back, _START before the start of its passage
217
+ into = at - np.repeat(first, w)
218
+ grams = np.empty((len(at), len(NGRAM_ORDERS)), dtype=np.int64)
219
+ h = np.zeros(len(at), dtype=np.uint64)
220
+ for n in range(1, max(NGRAM_ORDERS) + 1):
221
+ h = h * _PRIME + np.where(into >= n - 1, low[np.maximum(at - (n - 1), 0)], _START).astype(np.uint64)
222
+ if n in _ORDER_SEED:
223
+ grams[:, NGRAM_ORDERS.index(n)] = (_splitmix(h ^ _ORDER_SEED[n]) % np.uint64(ngram_buckets - 1)).astype(np.int64) + 1
224
+
225
+ # UTF-8, from the code points: byte k of an s-byte character
226
+ s = sizes[at]
227
+ cb, sb = np.repeat(c, s), np.repeat(s, s)
228
+ k = np.arange(len(cb)) - np.repeat(np.cumsum(s) - s, s)
229
+ shifted = cb >> (6 * (sb - 1 - k))
230
+ raw = np.where(k == 0, shifted | _UTF8_LEAD[sb], (shifted & 0x3F) | 0x80)
231
+ charpos = np.where(sb == 1, 1, np.where(k == 0, 2, 3))
232
+
233
+ nb = ends[hi] - ends[lo] # bytes per passage
234
+ row = np.repeat(np.arange(b), nb)
235
+ col = 1 + np.arange(len(cb)) - np.repeat(np.cumsum(nb) - nb, nb)
236
+ width = max(1 + int(nb.max(initial=0)), pad_to or 0)
237
+ out = {name: np.zeros((b, width), dtype=np.int64) for name in ("ids", "script", "charpos")}
238
+ out["ngrams"] = np.zeros((b, width, len(NGRAM_ORDERS)), dtype=np.int64)
239
+ out["ids"][:, 0], out["script"][:, 0], out["charpos"][:, 0] = CLS, SCRIPT_COMMON, 1
240
+ out["ids"][row, col] = raw + OFFSET
241
+ out["script"][row, col] = np.repeat(script, s)
242
+ out["charpos"][row, col] = charpos
243
+ out["ngrams"][row, col] = np.repeat(grams, s, axis=0)
244
+ out = {name: torch.from_numpy(v) for name, v in out.items()}
245
+ out["mask"] = out["ids"] != PAD
246
+ return out
247
+
248
+
249
+ @dataclass
250
+ class Encoded:
251
+ """One passage as four aligned arrays, one entry per byte, CLS first."""
252
+
253
+ ids: np.ndarray # [m]
254
+ script: np.ndarray # [m]
255
+ charpos: np.ndarray # [m]
256
+ ngrams: np.ndarray # [m, len(NGRAM_ORDERS)]
257
+
258
+
259
+ def encode(text: str, max_len: int = 256, ngram_buckets: int = 32768, rng: random.Random | None = None) -> Encoded:
260
+ """One passage, unpadded: encode_batch of one."""
261
+ x = encode_batch([text], max_len, ngram_buckets, rng)
262
+ m = int(x["mask"][0].sum())
263
+ return Encoded(*(x[name][0, :m].numpy() for name in ("ids", "script", "charpos", "ngrams")))
264
+
265
+
266
+ def collate(items: list[Encoded]) -> dict[str, torch.Tensor]:
267
+ n, g = max(len(e.ids) for e in items), len(NGRAM_ORDERS)
268
+ ids = np.zeros((len(items), n), dtype=np.int64)
269
+ script = np.zeros_like(ids)
270
+ charpos = np.zeros_like(ids)
271
+ ngrams = np.zeros((len(items), n, g), dtype=np.int64)
272
+ for i, e in enumerate(items):
273
+ m = len(e.ids)
274
+ ids[i, :m], script[i, :m], charpos[i, :m], ngrams[i, :m] = e.ids, e.script, e.charpos, e.ngrams
275
+ out = {k: torch.from_numpy(v) for k, v in (("ids", ids), ("script", script), ("charpos", charpos), ("ngrams", ngrams))}
276
+ out["mask"] = out["ids"] != PAD
277
+ return out
278
+
279
+
280
+ # --- the universal label encoding --------------------------------------------------------
281
+
282
+
283
+ @dataclass
284
+ class Labels:
285
+ labels: list[str]
286
+ aliases: dict[str, str] = field(default_factory=dict)
287
+ dropped: list[str] = field(default_factory=list)
288
+
289
+ def __post_init__(self) -> None:
290
+ self.index = {lab: i for i, lab in enumerate(self.labels)}
291
+
292
+ def __len__(self) -> int:
293
+ return len(self.labels)
294
+
295
+ def canonical(self, label: str) -> str | None:
296
+ if label in self.dropped:
297
+ return None
298
+ return self.aliases.get(label, label)
299
+
300
+ def extend(self, more) -> Labels:
301
+ """The same ids, with new labels appended after them."""
302
+ new = sorted({lab for lab in more if lab not in self.index})
303
+ return Labels(self.labels + new, self.aliases, self.dropped)
304
+
305
+ @classmethod
306
+ def load(cls, path: Path) -> Labels:
307
+ d = json.loads(Path(path).read_text(encoding="utf-8"))
308
+ return cls(d["labels"], d.get("aliases", {}), d.get("dropped", []))
309
+
310
+ def save(self, path: Path, trained: set[str] | None = None) -> None:
311
+ d = {
312
+ "scheme": "ISO 639-3 language + '_' + ISO 15924 script, e.g. eng_Latn, amh_Ethi",
313
+ "text_encoding": "Unicode NFKC, whitespace collapsed, then UTF-8 bytes",
314
+ "labels": self.labels,
315
+ "aliases": self.aliases,
316
+ "dropped": self.dropped,
317
+ }
318
+ if trained is not None:
319
+ d["trained"] = sorted(trained)
320
+ Path(path).write_text(json.dumps(d, indent=1, ensure_ascii=False), encoding="utf-8")
321
+
322
+
323
+ # --- the model ---------------------------------------------------------------------------
324
+
325
+
326
+ @dataclass
327
+ class MillIDConfig:
328
+ num_labels: int = 0
329
+ max_len: int = 256
330
+ d_model: int = 768
331
+ n_layers: int = 12
332
+ n_heads: int = 12
333
+ dropout: float = 0.1
334
+ conv_kernel: int = 5
335
+ downsample: int = 2
336
+ ngram_buckets: int = 32768
337
+ script_buckets: int = SCRIPT_BUCKETS
338
+ rope_theta: float = 10_000.0
339
+ vocab_size: int = VOCAB_SIZE
340
+ modalities: tuple[str, ...] = ("text",)
341
+ model_type: str = "millid-byte-encoder"
342
+
343
+ @property
344
+ def d_ff(self) -> int:
345
+ """SwiGLU width: 8/3 d, rounded to 64, the same parameters as a 4d GELU layer."""
346
+ return max(64, round(8 * self.d_model / 3 / 64) * 64)
347
+
348
+
349
+ PRESETS = {
350
+ "tiny": dict(d_model=192, n_layers=3, n_heads=3, downsample=1, ngram_buckets=4096),
351
+ "small": dict(d_model=384, n_layers=6, n_heads=6, downsample=2, ngram_buckets=16384),
352
+ "medium": dict(d_model=768, n_layers=12, n_heads=12, downsample=2, ngram_buckets=32768),
353
+ "large": dict(d_model=1024, n_layers=12, n_heads=16, downsample=2, ngram_buckets=32768),
354
+ }
355
+
356
+
357
+ def rope_tables(n: int, head_dim: int, theta: float) -> tuple[torch.Tensor, torch.Tensor]:
358
+ inv = 1.0 / (theta ** (torch.arange(0, head_dim, 2).float() / head_dim))
359
+ angles = torch.outer(torch.arange(n).float(), inv)
360
+ return angles.cos(), angles.sin()
361
+
362
+
363
+ def apply_rope(x: torch.Tensor, cos: torch.Tensor, sin: torch.Tensor) -> torch.Tensor:
364
+ """Rotate each pair of features by its position's angle (x: batch, heads, length, head_dim)."""
365
+ c = cos[: x.size(2)].to(x.dtype)[None, None]
366
+ s = sin[: x.size(2)].to(x.dtype)[None, None]
367
+ x1, x2 = x[..., 0::2], x[..., 1::2]
368
+ return torch.stack((x1 * c - x2 * s, x1 * s + x2 * c), dim=-1).flatten(-2)
369
+
370
+
371
+ class Attention(nn.Module):
372
+ def __init__(self, cfg: MillIDConfig):
373
+ super().__init__()
374
+ self.h = cfg.n_heads
375
+ self.hd = cfg.d_model // cfg.n_heads
376
+ self.qkv = nn.Linear(cfg.d_model, 3 * cfg.d_model, bias=False)
377
+ self.out = nn.Linear(cfg.d_model, cfg.d_model, bias=False)
378
+ self.p = cfg.dropout
379
+
380
+ def forward(self, x, cos, sin, key_mask):
381
+ b, n, _ = x.shape
382
+ q, k, v = self.qkv(x).view(b, n, 3, self.h, self.hd).permute(2, 0, 3, 1, 4)
383
+ q, k = apply_rope(q, cos, sin), apply_rope(k, cos, sin)
384
+ y = F.scaled_dot_product_attention(
385
+ q, k, v, attn_mask=key_mask[:, None, None, :], dropout_p=self.p if self.training else 0.0
386
+ )
387
+ return self.out(y.transpose(1, 2).reshape(b, n, -1))
388
+
389
+
390
+ class SwiGLU(nn.Module):
391
+ def __init__(self, cfg: MillIDConfig):
392
+ super().__init__()
393
+ self.w1 = nn.Linear(cfg.d_model, cfg.d_ff, bias=False)
394
+ self.w3 = nn.Linear(cfg.d_model, cfg.d_ff, bias=False)
395
+ self.w2 = nn.Linear(cfg.d_ff, cfg.d_model, bias=False)
396
+ self.drop = nn.Dropout(cfg.dropout)
397
+
398
+ def forward(self, x):
399
+ return self.w2(self.drop(F.silu(self.w1(x)) * self.w3(x)))
400
+
401
+
402
+ class Block(nn.Module):
403
+ """Pre-norm: RMSNorm, attention with RoPE, residual; RMSNorm, SwiGLU, residual."""
404
+
405
+ def __init__(self, cfg: MillIDConfig):
406
+ super().__init__()
407
+ self.norm1 = nn.RMSNorm(cfg.d_model)
408
+ self.attn = Attention(cfg)
409
+ self.norm2 = nn.RMSNorm(cfg.d_model)
410
+ self.ffn = SwiGLU(cfg)
411
+ self.drop = nn.Dropout(cfg.dropout)
412
+
413
+ def forward(self, x, cos, sin, key_mask):
414
+ x = x + self.drop(self.attn(self.norm1(x), cos, sin, key_mask))
415
+ return x + self.drop(self.ffn(self.norm2(x)))
416
+
417
+
418
+ class MillIDTextEncoder(nn.Module):
419
+ """A passage's four byte sequences to one d_model vector: the representation a future image
420
+ branch is fused with."""
421
+
422
+ def __init__(self, cfg: MillIDConfig):
423
+ super().__init__()
424
+ d = cfg.d_model
425
+ self.byte_emb = nn.Embedding(cfg.vocab_size, d, padding_idx=PAD)
426
+ self.script_emb = nn.Embedding(cfg.script_buckets, d, padding_idx=PAD)
427
+ self.charpos_emb = nn.Embedding(4, d, padding_idx=PAD)
428
+ self.ngram_emb = nn.Embedding(cfg.ngram_buckets, d, padding_idx=PAD)
429
+ # Depthwise over each feature, then mixed: n-grams of conv_kernel bytes, per position.
430
+ self.stem = nn.Sequential(
431
+ nn.Conv1d(d, d, cfg.conv_kernel, padding=cfg.conv_kernel // 2, groups=d),
432
+ nn.GELU(),
433
+ nn.Conv1d(d, d, 1),
434
+ )
435
+ # Then every `downsample` bytes become one token: the transformer reads half as many.
436
+ self.r = cfg.downsample
437
+ self.down = nn.Conv1d(d, d, self.r, stride=self.r) if self.r > 1 else None
438
+ self.blocks = nn.ModuleList(Block(cfg) for _ in range(cfg.n_layers))
439
+ self.norm = nn.RMSNorm(d)
440
+ cos, sin = rope_tables(cfg.max_len // self.r + 2, d // cfg.n_heads, cfg.rope_theta)
441
+ self.register_buffer("cos", cos, persistent=False)
442
+ self.register_buffer("sin", sin, persistent=False)
443
+
444
+ def tokens(self, batch: dict[str, torch.Tensor]) -> tuple[torch.Tensor, torch.Tensor]:
445
+ """Every token's vector after the last layer, and which tokens are real."""
446
+ mask = batch["mask"]
447
+ x = (
448
+ self.byte_emb(batch["ids"])
449
+ + self.script_emb(batch["script"])
450
+ + self.charpos_emb(batch["charpos"])
451
+ + self.ngram_emb(batch["ngrams"]).sum(2)
452
+ )
453
+ m = mask.unsqueeze(-1).to(x.dtype)
454
+ x = (x + self.stem((x * m).transpose(1, 2)).transpose(1, 2)) * m
455
+ if self.down is not None:
456
+ pad = (-x.size(1)) % self.r
457
+ if pad:
458
+ x, mask = F.pad(x, (0, 0, 0, pad)), F.pad(mask, (0, pad))
459
+ x = self.down(x.transpose(1, 2)).transpose(1, 2)
460
+ mask = mask.view(mask.size(0), -1, self.r).any(-1)
461
+ for block in self.blocks:
462
+ x = block(x, self.cos, self.sin, mask)
463
+ return self.norm(x), mask
464
+
465
+ def forward(self, batch: dict[str, torch.Tensor]) -> torch.Tensor:
466
+ x, mask = self.tokens(batch)
467
+ m = mask.unsqueeze(-1).to(x.dtype)
468
+ return (x * m).sum(1) / m.sum(1).clamp(min=1.0)
469
+
470
+
471
+ class LanguageHead(nn.Module):
472
+ """A vector to a score per language, shared by every modality.
473
+
474
+ Each language's vector is built from its parts: its own, its language's (shared by
475
+ `srp_Cyrl` and `srp_Latn`) and its script's (shared by every Ethiopic-script language). A
476
+ language with little data borrows from what it shares, and `language_vectors()` are the
477
+ learned language embeddings themselves.
478
+ """
479
+
480
+ def __init__(self, cfg: MillIDConfig, labels: list[str]):
481
+ super().__init__()
482
+ codes = sorted({lab.split("_", 1)[0] for lab in labels})
483
+ scripts = sorted({lab.split("_", 1)[1] if "_" in lab else "" for lab in labels})
484
+ code_id = {c: i for i, c in enumerate(codes)}
485
+ script_id = {sc: i for i, sc in enumerate(scripts)}
486
+ self.register_buffer("code_of", torch.tensor([code_id[lab.split("_", 1)[0]] for lab in labels]))
487
+ self.register_buffer(
488
+ "script_of", torch.tensor([script_id[lab.split("_", 1)[1] if "_" in lab else ""] for lab in labels])
489
+ )
490
+ d = cfg.d_model
491
+ self.label_emb = nn.Embedding(len(labels), d)
492
+ self.code_emb = nn.Embedding(len(codes), d)
493
+ self.script_emb = nn.Embedding(len(scripts), d)
494
+ self.bias = nn.Parameter(torch.zeros(len(labels)))
495
+ self.drop = nn.Dropout(cfg.dropout)
496
+
497
+ def language_vectors(self) -> torch.Tensor:
498
+ return self.label_emb.weight + self.code_emb(self.code_of) + self.script_emb(self.script_of)
499
+
500
+ def forward(self, z: torch.Tensor) -> torch.Tensor:
501
+ return F.linear(self.drop(z), self.language_vectors(), self.bias)
502
+
503
+
504
+ class MillIDEncoder(nn.Module):
505
+ def __init__(self, cfg: MillIDConfig, labels: list[str]):
506
+ super().__init__()
507
+ self.cfg = cfg
508
+ self.text = MillIDTextEncoder(cfg)
509
+ self.head = LanguageHead(cfg, labels)
510
+ self.apply(self._init)
511
+ # Each residual branch's last projection starts small, so a deep stack starts close to
512
+ # the identity (GPT-2's scaling).
513
+ for block in self.text.blocks:
514
+ for w in (block.attn.out.weight, block.ffn.w2.weight):
515
+ nn.init.normal_(w, std=0.02 / math.sqrt(2 * cfg.n_layers))
516
+
517
+ @staticmethod
518
+ def _init(m: nn.Module) -> None:
519
+ if isinstance(m, nn.Linear):
520
+ nn.init.normal_(m.weight, std=0.02)
521
+ if m.bias is not None:
522
+ nn.init.zeros_(m.bias)
523
+ elif isinstance(m, nn.Embedding):
524
+ nn.init.normal_(m.weight, std=0.02)
525
+ if m.padding_idx is not None:
526
+ with torch.no_grad():
527
+ m.weight[m.padding_idx].zero_()
528
+
529
+ def embed(self, batch: dict[str, torch.Tensor]) -> torch.Tensor:
530
+ """The passage as one vector, before the head: for similarity, clustering, fusion."""
531
+ return self.text(batch)
532
+
533
+ def forward(self, batch: dict[str, torch.Tensor]) -> torch.Tensor:
534
+ return self.head(self.text(batch))
535
+
536
+
537
+ class MillID:
538
+ """A trained model, ready to answer: ranked (label, probability) per text."""
539
+
540
+ def __init__(self, model: MillIDEncoder, labels: Labels, trained: set[str] | None = None, device: str | None = None):
541
+ self.device = device or ("cuda" if torch.cuda.is_available() else "cpu")
542
+ self.model = model.to(self.device).eval()
543
+ self.labels = labels
544
+ # Logits of labels the model never saw a passage of are not answers.
545
+ self.trained = trained or set(labels.labels)
546
+ keep = torch.tensor([lab in self.trained for lab in labels.labels], device=self.device)
547
+ self.bias = torch.where(keep, 0.0, float("-inf"))
548
+
549
+ @classmethod
550
+ def from_pretrained(cls, path_or_repo: str, device: str | None = None) -> MillID:
551
+ from safetensors.torch import load_file
552
+
553
+ path = Path(path_or_repo)
554
+ if not path.exists():
555
+ from huggingface_hub import snapshot_download
556
+
557
+ path = Path(snapshot_download(path_or_repo, allow_patterns=["config.json", "labels.json", "model.safetensors"]))
558
+ cfg = MillIDConfig(**json.loads((path / "config.json").read_text())["model"])
559
+ meta = json.loads((path / "labels.json").read_text(encoding="utf-8"))
560
+ labels = Labels(meta["labels"], meta.get("aliases", {}), meta.get("dropped", []))
561
+ model = MillIDEncoder(cfg, labels.labels)
562
+ model.load_state_dict(load_file(str(path / "model.safetensors")))
563
+ return cls(model, labels, set(meta.get("trained", meta["labels"])), device)
564
+
565
+ def batch(self, texts: list[str]) -> dict[str, torch.Tensor]:
566
+ cfg = self.model.cfg
567
+ b = encode_batch(texts, cfg.max_len, cfg.ngram_buckets)
568
+ return {k: v.to(self.device) for k, v in b.items()}
569
+
570
+ @torch.no_grad()
571
+ def predict(self, texts: list[str], k: int = 5, batch_size: int = 512) -> list[list[tuple[str, float]]]:
572
+ out = []
573
+ for i in range(0, len(texts), batch_size):
574
+ with torch.autocast(self.device, dtype=torch.bfloat16, enabled=self.device == "cuda"):
575
+ logits = self.model(self.batch(texts[i : i + batch_size])).float()
576
+ probs = F.softmax(logits + self.bias, dim=-1)
577
+ p, idx = probs.topk(k, dim=-1)
578
+ for pr, ix in zip(p.tolist(), idx.tolist(), strict=True):
579
+ out.append([(self.labels.labels[j], v) for j, v in zip(ix, pr, strict=True)])
580
+ return out
581
+
582
+ @torch.no_grad()
583
+ def embed(self, texts: list[str]) -> torch.Tensor:
584
+ """Passage vectors, B x d_model."""
585
+ return self.model.embed(self.batch(texts)).float().cpu()
586
+
587
+
588
+ # --- metrics (the same definitions as scripts/metrics.py, tested there) -----------------
589
+
590
+
591
+ def per_language(true: list[str], pred: list[str]):
592
+ import pandas as pd
593
+
594
+ t, p = pd.Series(list(true)), pd.Series(list(pred))
595
+ n = len(t)
596
+ out = pd.DataFrame({"support": t.value_counts()})
597
+ out["tp"] = t[t.values == p.values].value_counts().reindex(out.index, fill_value=0)
598
+ out["fp"] = p.value_counts().reindex(out.index, fill_value=0) - out["tp"]
599
+ out["fn"] = out["support"] - out["tp"]
600
+ out["tn"] = n - out["tp"] - out["fp"] - out["fn"]
601
+ with np.errstate(divide="ignore", invalid="ignore"):
602
+ out["precision"] = np.where(out["tp"] + out["fp"] > 0, out["tp"] / (out["tp"] + out["fp"]), 0.0)
603
+ out["recall"] = out["tp"] / out["support"]
604
+ pr = out["precision"] + out["recall"]
605
+ out["f1"] = np.where(pr > 0, 2 * out["precision"] * out["recall"] / pr, 0.0)
606
+ out["specificity"] = out["tn"] / (out["tn"] + out["fp"])
607
+ out["fp_per_million"] = out["fp"] / (n - out["support"]) * 1e6
608
+ out["sensitivity"] = out["recall"]
609
+ out.index.name = "label"
610
+ return out.sort_index()
611
+
612
+
613
+ def summarize(table, true: list[str], ranked: list[list[str]]) -> dict:
614
+ n = max(1, len(true))
615
+ s = {f"top{k}_accuracy": sum(t in r[:k] for t, r in zip(true, ranked, strict=True)) / n for k in (1, 3, 5)}
616
+ w = table["support"] / table["support"].sum()
617
+ s.update(
618
+ passages=int(table["support"].sum()),
619
+ languages=int(len(table)),
620
+ macro_precision=float(table["precision"].mean()),
621
+ macro_recall=float(table["recall"].mean()),
622
+ macro_f1=float(table["f1"].mean()),
623
+ macro_specificity=float(table["specificity"].mean()),
624
+ weighted_f1=float((table["f1"] * w).sum()),
625
+ median_f1=float(table["f1"].median()),
626
+ languages_f1_at_least_0_9=int((table["f1"] >= 0.9).sum()),
627
+ languages_f1_below_0_5=int((table["f1"] < 0.5).sum()),
628
+ mean_fp_per_million=float(table["fp_per_million"].mean()),
629
+ )
630
+ s["micro_f1"] = s["top1_accuracy"]
631
+ return s
632
+
633
+
634
+ # --- data --------------------------------------------------------------------------------
635
+
636
+
637
+ def load_dataset_dir(dataset: str) -> Path:
638
+ """A local build directory, or the dataset repo downloaded (parquet and labels.json only)."""
639
+ if Path(dataset).exists():
640
+ return Path(dataset)
641
+ from huggingface_hub import snapshot_download
642
+
643
+ return Path(snapshot_download(dataset, repo_type="dataset", allow_patterns=["data/*", "udhr/*", "labels.json", "stats.json"]))
644
+
645
+
646
+ def read_split(root: Path, name: str):
647
+ import pandas as pd
648
+
649
+ if name == "udhr":
650
+ return pd.read_parquet(root / "udhr" / "test.parquet")
651
+ return pd.read_parquet(root / "data" / f"{name}.parquet")
652
+
653
+
654
+ class Sampler:
655
+ """Training passages, drawn so that small languages are seen often enough to learn.
656
+
657
+ A language is drawn with probability proportional to n^alpha, n being its passage count:
658
+ alpha 1 is the data as it is, alpha 0 every language equally; 0.3 in between. Then a
659
+ passage of it is drawn, and sometimes cut short, because a short snippet is where
660
+ language identification is hardest and what a document pipeline sees in table cells.
661
+ """
662
+
663
+ def __init__(self, texts: list[str], label_ids: np.ndarray, alpha: float, short_p: float, seed: int):
664
+ self.texts = texts
665
+ self.rng = random.Random(seed)
666
+ self.np_rng = np.random.default_rng(seed)
667
+ order = np.argsort(label_ids, kind="stable")
668
+ self.by_label = np.split(order, np.flatnonzero(np.diff(label_ids[order])) + 1)
669
+ self.label_of = np.array([label_ids[g[0]] for g in self.by_label])
670
+ sizes = np.array([len(g) for g in self.by_label], dtype=float)
671
+ p = sizes**alpha
672
+ self.p = p / p.sum()
673
+ self.short_p = short_p
674
+
675
+ def draw(self, n: int) -> tuple[list[str], np.ndarray]:
676
+ groups = self.np_rng.choice(len(self.by_label), size=n, p=self.p)
677
+ texts, labels = [], []
678
+ for g in groups:
679
+ idx = self.by_label[g][self.rng.randrange(len(self.by_label[g]))]
680
+ texts.append(self._maybe_short(self.texts[idx]))
681
+ labels.append(self.label_of[g])
682
+ return texts, np.array(labels)
683
+
684
+ def _maybe_short(self, text: str) -> str:
685
+ if self.rng.random() >= self.short_p or len(text) <= 40:
686
+ return text
687
+ n = self.rng.randint(20, 80)
688
+ start = self.rng.randrange(0, max(1, len(text) - n))
689
+ if " " in text: # start and end on word boundaries where the script has them
690
+ left = text.rfind(" ", 0, start) + 1
691
+ right = text.find(" ", left + n)
692
+ return text[left : right if right > 0 else len(text)]
693
+ return text[start : start + n]
694
+
695
+
696
+ # --- tracking ----------------------------------------------------------------------------
697
+
698
+
699
+ class Tracker:
700
+ """Weights & Biases when there is a key or a project, and nothing otherwise, so the same run
701
+ works locally without an account. Inside a sweep agent, the agent's run is used."""
702
+
703
+ def __init__(self, args, config: dict, enabled: bool = True):
704
+ self.run = None
705
+ self.wandb = None
706
+ if not enabled or args.no_wandb or not (args.wandb_project or os.environ.get("WANDB_API_KEY")):
707
+ return
708
+ import wandb
709
+
710
+ self.wandb = wandb
711
+ clean = asdict(args)
712
+ if wandb.run is not None:
713
+ self.run = wandb.run
714
+ self.run.config.update({**config}, allow_val_change=True)
715
+ self.owned = False
716
+ else:
717
+ self.run = wandb.init(
718
+ project=args.wandb_project or "millid",
719
+ entity=args.wandb_entity,
720
+ name=args.wandb_run_name,
721
+ tags=args.wandb_tags or None,
722
+ config={**clean, **config},
723
+ job_type="train",
724
+ )
725
+ self.owned = True
726
+ self.run.define_metric("train/*", step_metric="step")
727
+ self.run.define_metric("val/*", step_metric="step")
728
+
729
+ def log(self, data: dict, step: int) -> None:
730
+ if self.run:
731
+ self.run.log({"step": step, **data})
732
+
733
+ def summary(self, data: dict) -> None:
734
+ if self.run:
735
+ self.run.summary.update(data)
736
+
737
+ def table(self, key: str, frame) -> None:
738
+ if self.run:
739
+ self.run.log({key: self.wandb.Table(dataframe=frame.reset_index())})
740
+
741
+ def finish(self) -> None:
742
+ if self.run and self.owned:
743
+ self.run.finish()
744
+
745
+
746
+ # --- training ----------------------------------------------------------------------------
747
+
748
+
749
+ class TrainStream(torch.utils.data.IterableDataset):
750
+ """Endless training batches, encoded in DataLoader workers so the GPU never waits for
751
+ Python. Each worker draws with its own seed."""
752
+
753
+ def __init__(self, texts, label_ids, args, cfg: MillIDConfig, batch_size: int, rank: int = 0, pad_to: int | None = None):
754
+ self.texts, self.label_ids = texts, label_ids
755
+ self.args, self.cfg = args, cfg
756
+ self.batch_size, self.rank, self.pad_to = batch_size, rank, pad_to
757
+
758
+ def __iter__(self):
759
+ info = torch.utils.data.get_worker_info()
760
+ # every worker of every GPU's process draws its own passages
761
+ seed = self.args.seed * 1000 + self.rank * 100 + (info.id if info else 0)
762
+ sampler = Sampler(self.texts, self.label_ids, self.args.alpha, self.args.short_p, seed)
763
+ rng = random.Random(seed)
764
+ while True:
765
+ texts, y = sampler.draw(self.batch_size)
766
+ batch = encode_batch(texts, self.cfg.max_len, self.cfg.ngram_buckets, rng, pad_to=self.pad_to)
767
+ batch["y"] = torch.from_numpy(y)
768
+ yield batch
769
+
770
+
771
+
772
+
773
+ def stratified(frame, per_label: int, seed: int = 7):
774
+ return frame.sample(frac=1, random_state=seed).groupby("label").head(per_label)
775
+
776
+
777
+ def evaluate_frame(model: MillID, frame, batch_size: int = 1024) -> tuple[dict, object, list]:
778
+ ranked = model.predict(frame["text"].tolist(), k=5, batch_size=batch_size)
779
+ pred = [r[0][0] for r in ranked]
780
+ table = per_language(frame["label"].tolist(), pred)
781
+ return summarize(table, frame["label"].tolist(), [[lab for lab, _ in r] for r in ranked]), table, ranked
782
+
783
+
784
+ def _free_port() -> int:
785
+ import socket
786
+
787
+ with socket.socket() as s:
788
+ s.bind(("127.0.0.1", 0))
789
+ return s.getsockname()[1]
790
+
791
+
792
+ def train(args: TrainArgs) -> None:
793
+ """Train on every GPU the machine has (or args.gpus of them): one process per GPU, the batch
794
+ split between them and the gradients averaged (DistributedDataParallel). Without CUDA,
795
+ args.gpus > 1 starts that many CPU processes, which is how the distributed path is tested."""
796
+ if torch.cuda.is_available():
797
+ n = torch.cuda.device_count()
798
+ world = n if args.gpus <= 0 else min(args.gpus, n)
799
+ else:
800
+ world = max(1, args.gpus)
801
+ if world == 1:
802
+ _train(0, 1, 0, args)
803
+ return
804
+ if args.batch_size % world:
805
+ sys.exit(f"batch size {args.batch_size} does not split over {world} processes")
806
+ load_dataset_dir(args.dataset) # download once, before the processes start
807
+ import torch.multiprocessing as mp
808
+
809
+ mp.spawn(_train, args=(world, _free_port(), args), nprocs=world, join=True)
810
+
811
+
812
+ def _train(rank: int, world: int, port: int, args: TrainArgs) -> None:
813
+ import pandas as pd
814
+ from safetensors.torch import save_file
815
+
816
+ cuda = torch.cuda.is_available()
817
+ distributed = world > 1
818
+ if distributed:
819
+ import torch.distributed as dist
820
+
821
+ os.environ["MASTER_ADDR"], os.environ["MASTER_PORT"] = "127.0.0.1", str(port)
822
+ if cuda:
823
+ torch.cuda.set_device(rank)
824
+ dist.init_process_group("nccl" if cuda else "gloo", rank=rank, world_size=world)
825
+ main = rank == 0
826
+ say = print if main else (lambda *a, **k: None)
827
+ torch.manual_seed(args.seed)
828
+ if args.threads:
829
+ torch.set_num_threads(args.threads)
830
+ device = f"cuda:{rank}" if cuda else "cpu"
831
+ device_type = "cuda" if cuda else "cpu"
832
+ root = load_dataset_dir(args.dataset)
833
+ labels = Labels.load(root / "labels.json")
834
+ tr = read_split(root, "train")
835
+ va = read_split(root, "validation")
836
+ if args.commercial_only:
837
+ tr = tr[~tr["license"].str.contains("NC", na=False)]
838
+ va = va[~va["license"].str.contains("NC", na=False)]
839
+ if args.extra:
840
+ extra = pd.concat([pd.read_parquet(p, columns=["text", "label"]) for p in args.extra], ignore_index=True)
841
+ extra["label"] = extra["label"].map(labels.canonical)
842
+ extra = extra.dropna(subset=["label"])
843
+ evals = set(va["text"].map(normalize)) | set(read_split(root, "test")["text"].map(normalize)) | set(read_split(root, "udhr")["text"].map(normalize))
844
+ extra = extra[~extra["text"].map(normalize).isin(evals)]
845
+ labels = labels.extend(extra["label"].unique())
846
+ tr = pd.concat([tr[["text", "label"]], extra], ignore_index=True)
847
+ say(f"extra training passages: {len(extra):,}", flush=True)
848
+ trained = set(tr["label"])
849
+ label_ids = tr["label"].map(labels.index).to_numpy()
850
+ say(f"{device_type} x{world}; train {len(tr):,} passages, {len(trained)} labels; validation {len(va):,}; vocabulary {len(labels)}", flush=True)
851
+
852
+ cfg = MillIDConfig(num_labels=len(labels), max_len=args.max_len, dropout=args.dropout, **PRESETS[args.preset])
853
+ net = MillIDEncoder(cfg, labels.labels).to(device)
854
+ model = net
855
+ if distributed:
856
+ from torch.nn.parallel import DistributedDataParallel
857
+
858
+ model = DistributedDataParallel(net, device_ids=[rank] if cuda else None)
859
+ step_net = torch.compile(model) if args.compile and cuda else model
860
+ params = sum(p.numel() for p in net.parameters())
861
+ say(f"MillID {args.preset}: {params / 1e6:.1f}M parameters, {cfg}", flush=True)
862
+ tracker = Tracker(
863
+ args,
864
+ {"model": asdict(cfg), "parameters": params, "train_passages": int(len(tr)), "gpus": world,
865
+ "trained_labels": len(trained), "vocabulary": len(labels), "validation_passages": int(len(va))},
866
+ enabled=main,
867
+ ) # fmt: skip
868
+
869
+ decay = [p for n, p in net.named_parameters() if p.dim() >= 2 and "emb" not in n]
870
+ no_decay = [p for n, p in net.named_parameters() if p.dim() < 2 or "emb" in n]
871
+ opt = torch.optim.AdamW(
872
+ [{"params": decay, "weight_decay": args.weight_decay}, {"params": no_decay, "weight_decay": 0.0}],
873
+ lr=args.lr, betas=(0.9, 0.98), eps=1e-8, fused=cuda,
874
+ ) # fmt: skip
875
+
876
+ def lr_at(step: int) -> float:
877
+ if step < args.warmup:
878
+ return args.lr * step / args.warmup
879
+ progress = (step - args.warmup) / max(1, args.steps - args.warmup)
880
+ return args.lr * (0.05 + 0.95 * 0.5 * (1 + math.cos(math.pi * progress)))
881
+
882
+ workers = args.workers
883
+ if workers < 0:
884
+ workers = 0 if os.name == "nt" else max(0, min(12, ((os.cpu_count() or 2) - 2) // world))
885
+ script_table() # once, before the workers fork, so they share it
886
+ say(f"{workers} data workers per process, {args.batch_size // world} passages per process per step", flush=True)
887
+ pad_to = cfg.max_len if args.compile and cuda else None # fixed shapes: compiled once
888
+ loader = torch.utils.data.DataLoader(
889
+ TrainStream(tr["text"].tolist(), label_ids, args, cfg, args.batch_size // world, rank, pad_to),
890
+ batch_size=None,
891
+ num_workers=workers,
892
+ pin_memory=cuda,
893
+ prefetch_factor=4 if workers else None,
894
+ persistent_workers=workers > 0,
895
+ )
896
+ stream = iter(loader)
897
+ va_small = stratified(va, args.eval_per_label)
898
+ out = Path(args.output_dir)
899
+ out.mkdir(parents=True, exist_ok=True)
900
+ log = open(out / "training_log.jsonl", "w", encoding="utf-8") if main else None
901
+ best, best_step, started, seen = -1.0, 0, time.monotonic(), 0
902
+ use_bf16 = cuda and torch.cuda.is_bf16_supported()
903
+
904
+ for step in range(1, args.steps + 1):
905
+ net.train()
906
+ batch = next(stream)
907
+ y = batch.pop("y").to(device, non_blocking=True)
908
+ batch = {k: v.to(device, non_blocking=True) for k, v in batch.items()}
909
+ for g in opt.param_groups:
910
+ g["lr"] = lr_at(step)
911
+ with torch.autocast(device_type, dtype=torch.bfloat16, enabled=use_bf16):
912
+ logits = step_net(batch)
913
+ loss = F.cross_entropy(logits.float(), y, label_smoothing=args.label_smoothing)
914
+ opt.zero_grad(set_to_none=True)
915
+ loss.backward()
916
+ grad_norm = torch.nn.utils.clip_grad_norm_(net.parameters(), 1.0)
917
+ opt.step()
918
+ seen += args.batch_size
919
+
920
+ if step % args.log_every == 0 and main:
921
+ rate = seen / (time.monotonic() - started)
922
+ print(f"step {step}/{args.steps} loss {loss.item():.4f} lr {lr_at(step):.2e} {rate:,.0f} passages/s", flush=True)
923
+ tracker.log(
924
+ {"train/loss": loss.item(), "train/lr": lr_at(step), "train/grad_norm": float(grad_norm),
925
+ "train/passages_per_s": rate, "train/epochs": seen / len(tr)},
926
+ step,
927
+ ) # fmt: skip
928
+ if step % args.eval_every == 0 or step == args.steps:
929
+ # The first process evaluates and saves; the others wait for its verdict.
930
+ stop = False
931
+ if main:
932
+ s, _, _ = evaluate_frame(MillID(net, labels, trained, device), va_small)
933
+ entry = {"step": step, "loss": round(loss.item(), 5), **{k: round(s[k], 5) for k in ("macro_f1", "top1_accuracy", "top3_accuracy")}}
934
+ log.write(json.dumps(entry) + "\n")
935
+ log.flush()
936
+ print(f" validation @ {step}: macro F1 {s['macro_f1']:.4f} top-1 {s['top1_accuracy']:.4f}", flush=True)
937
+ if s["macro_f1"] > best:
938
+ best, best_step = s["macro_f1"], step
939
+ save_file({k: v.detach().cpu().contiguous() for k, v in net.state_dict().items()}, str(out / "model.safetensors"))
940
+ elif step - best_step >= args.patience:
941
+ print(f"no gain on validation for {args.patience} steps: stopping at {step}", flush=True)
942
+ stop = True
943
+ tracker.log(
944
+ {f"val/{k}": s[k] for k in ("macro_f1", "top1_accuracy", "top3_accuracy", "macro_precision", "macro_recall")}
945
+ | {"val/best_macro_f1": best},
946
+ step,
947
+ )
948
+ if distributed:
949
+ flag = torch.tensor([int(stop)], device=device)
950
+ dist.broadcast(flag, 0)
951
+ stop = bool(flag.item())
952
+ if stop:
953
+ break
954
+ if distributed:
955
+ dist.destroy_process_group()
956
+ if not main:
957
+ return
958
+ log.close()
959
+ tracker.summary({"best_step": best_step, "val/best_macro_f1": best})
960
+
961
+ labels.save(out / "labels.json", trained)
962
+ config = {
963
+ "model": asdict(cfg),
964
+ "training": asdict(args),
965
+ "best_step": best_step,
966
+ "parameters": params,
967
+ "gpus": world,
968
+ "train_passages": int(len(tr)),
969
+ "trained_labels": len(trained),
970
+ "seconds": round(time.monotonic() - started),
971
+ }
972
+ (out / "config.json").write_text(json.dumps(config, indent=2, default=str), encoding="utf-8")
973
+ shutil.copy(__file__, out / "millid.py")
974
+ doc = Path(__file__).with_name("ARCHITECTURE.md")
975
+ if doc.exists(): # beside the script locally; a Job ships only the script
976
+ shutil.copy(doc, out / "ARCHITECTURE.md")
977
+ print(f"best validation macro F1 {best:.4f} at step {best_step}", flush=True)
978
+
979
+ if args.final_eval == "none":
980
+ tracker.finish()
981
+ return
982
+ model = MillID.from_pretrained(str(out))
983
+ sets = ("validation",) if args.final_eval == "validation" else ("validation", "test", "udhr")
984
+ names = json.loads((root / "labels.json").read_text(encoding="utf-8")).get("names", {})
985
+ compare = [ext for ext, on in (("glotlid", args.compare_glotlid), ("fasttext", args.compare_fasttext)) if on]
986
+ results, boards = evaluate_all(model, root, out / "reports", compare, sets, names)
987
+ tracker.summary(
988
+ {f"eval/{set_name}/{m}/{k}": v for set_name, by in results.items() for m, sm in by.items()
989
+ for k, v in sm.items() if isinstance(v, (int, float))}
990
+ ) # fmt: skip
991
+ for set_name, by in results.items():
992
+ rows = [{"model": m, **{k: v for k, v in sm.items() if isinstance(v, (int, float))}} for m, sm in by.items()]
993
+ tracker.table(f"leaderboard/{set_name}/models", pd.DataFrame(rows).set_index("model"))
994
+ for set_name, board in boards.items():
995
+ tracker.table(f"leaderboard/{set_name}/languages", board.round(4))
996
+ if "winner" in board:
997
+ tracker.summary({f"eval/{set_name}/languages_{w.lower()}": int((board["winner"] == w).sum()) for w in ("MillID", "GlotLID", "tie")})
998
+ write_card(out, config, results, args, boards)
999
+ tracker.finish()
1000
+ if args.push_to:
1001
+ from huggingface_hub import HfApi
1002
+
1003
+ api = HfApi()
1004
+ api.create_repo(args.push_to, private=not args.public, exist_ok=True)
1005
+ api.upload_folder(repo_id=args.push_to, folder_path=str(out), commit_message=f"MillID {args.preset}, step {best_step}")
1006
+ print(f"pushed https://huggingface.co/{args.push_to}", flush=True)
1007
+
1008
+
1009
+ # --- evaluation against GlotLID and fastText ---------------------------------------------
1010
+ #
1011
+ # Both are fastText models: GlotLID (cis-lmu, 2,000+ labels) and Meta's NLLB language identifier
1012
+ # (218 labels), published as facebook/fasttext-language-identification. Both write labels as
1013
+ # ISO 639-3 + script; their answers are mapped onto MillID's spelling of the same language
1014
+ # before scoring, so that a right answer spelled differently is not counted wrong.
1015
+
1016
+ #: name: (Hub repo, file, environment variable for a copy on disk, display name, GB in memory)
1017
+ EXTERNAL = {
1018
+ "glotlid": ("cis-lmu/glotlid", "model.bin", "GLOTLID_PATH", "GlotLID", 1.8),
1019
+ "fasttext": ("facebook/fasttext-language-identification", "model.bin", "FASTTEXT_LID_PATH", "fastText (Meta, NLLB)", 1.3),
1020
+ }
1021
+ #: Spellings MillID's aliases do not cover: a macrolanguage for its one member in MillID
1022
+ #: (Estonian, Akan as Twi, Guarani as Paraguayan Guarani, Kikongo as Koongo).
1023
+ EXTERNAL_ALIASES = {"est_Latn": "ekk_Latn", "aka_Latn": "twi_Latn", "grn_Latn": "gug_Latn", "kon_Latn": "kng_Latn"}
1024
+
1025
+ _lid = None
1026
+ _lid_aliases: dict[str, str] = {}
1027
+
1028
+
1029
+ def to_millid_label(label: str, aliases: dict[str, str]) -> str:
1030
+ """An external model's label in MillID's spelling: Simplified and Traditional Han are both
1031
+ Hani, then MillID's aliases, then EXTERNAL_ALIASES."""
1032
+ code, _, script = label.partition("_")
1033
+ if script in ("Hans", "Hant"):
1034
+ label = f"{code}_Hani"
1035
+ label = aliases.get(label, label)
1036
+ return EXTERNAL_ALIASES.get(label, label)
1037
+
1038
+
1039
+ def _lid_init(path: str, aliases: dict[str, str]) -> None:
1040
+ global _lid, _lid_aliases
1041
+ import fasttext
1042
+
1043
+ _lid, _lid_aliases = fasttext.load_model(path), aliases
1044
+
1045
+
1046
+ def _lid_chunk(texts: list[str]) -> list[list[tuple[str, float]]]:
1047
+ labels, probs = _lid.f.multilinePredict([normalize(t) for t in texts], 50, 0.0, "strict")
1048
+ out = []
1049
+ for ls, ps in zip(labels, probs, strict=True):
1050
+ seen, pairs = set(), []
1051
+ for lab, p in zip(ls, ps, strict=True):
1052
+ lab = to_millid_label(lab.removeprefix("__label__"), _lid_aliases)
1053
+ if lab not in seen: # two of its labels can be one of MillID's: keep the better
1054
+ seen.add(lab)
1055
+ pairs.append((lab, float(p)))
1056
+ out.append(pairs)
1057
+ return out
1058
+
1059
+
1060
+ def _lid_labels() -> list[str]:
1061
+ return sorted({to_millid_label(lab.removeprefix("__label__"), _lid_aliases) for lab in _lid.get_labels()})
1062
+
1063
+
1064
+ def _cpu_workers(gb_each: float) -> int:
1065
+ """Processes the machine has cores and memory for, at most 8."""
1066
+ cpus = os.cpu_count() or 2
1067
+ try:
1068
+ ram = os.sysconf("SC_PAGE_SIZE") * os.sysconf("SC_PHYS_PAGES") / 2**30
1069
+ except (ValueError, OSError, AttributeError):
1070
+ ram = 16.0
1071
+ return max(1, min(8, cpus - 2, int(ram // (gb_each * 2))))
1072
+
1073
+
1074
+ class FastTextLID:
1075
+ """A fastText language identifier's 50 best answers per passage, in MillID's label
1076
+ spelling, computed in parallel processes (fastText holds the GIL, and each process loads the
1077
+ model once). Both views come from the same answers: as it is, and restricted to MillID's
1078
+ labels."""
1079
+
1080
+ def __init__(self, name: str = "glotlid", aliases: dict[str, str] | None = None, workers: int | None = None):
1081
+ from huggingface_hub import hf_hub_download
1082
+
1083
+ repo, filename, env, self.display, gb = EXTERNAL[name]
1084
+ self.name, self.aliases = name, aliases or {}
1085
+ # A copy already on disk, rather than a gigabyte or two from the Hub again.
1086
+ self.path = os.environ.get(env) or hf_hub_download(repo, filename)
1087
+ self.workers = workers or _cpu_workers(gb_each=gb)
1088
+ self._labels: set[str] | None = None
1089
+
1090
+ def labels(self) -> set[str]:
1091
+ """Every label it can answer, in MillID's spelling."""
1092
+ if self._labels is None:
1093
+ _lid_init(self.path, self.aliases)
1094
+ self._labels = set(_lid_labels())
1095
+ return self._labels
1096
+
1097
+ def rank(self, texts: list[str], chunk: int = 10_000) -> list[list[tuple[str, float]]]:
1098
+ parts = [texts[i : i + chunk] for i in range(0, len(texts), chunk)]
1099
+ if self.workers <= 1 or len(parts) == 1:
1100
+ _lid_init(self.path, self.aliases)
1101
+ return [r for part in parts for r in _lid_chunk(part)]
1102
+ from concurrent.futures import ProcessPoolExecutor
1103
+
1104
+ with ProcessPoolExecutor(self.workers, initializer=_lid_init, initargs=(self.path, self.aliases)) as pool:
1105
+ return [r for result in pool.map(_lid_chunk, parts) for r in result]
1106
+
1107
+ @staticmethod
1108
+ def view(ranked, allowed: set[str] | None = None, k: int = 5) -> list[list[tuple[str, float]]]:
1109
+ out = []
1110
+ for pairs in ranked:
1111
+ if allowed is not None:
1112
+ pairs = [(lab, p) for lab, p in pairs if lab in allowed]
1113
+ out.append(pairs[:k] or [("unk", 0.0)])
1114
+ return out
1115
+
1116
+
1117
+ GlotLID = FastTextLID # the name earlier code and reports use
1118
+
1119
+
1120
+ def leaderboard(tables: dict, names: dict[str, str]):
1121
+ """One row per language: MillID against each external model, as it is and restricted to
1122
+ MillID's labels. `delta` is MillID's F1 minus restricted GlotLID's, `delta_fasttext` minus
1123
+ restricted fastText's: the like-for-like comparisons."""
1124
+ import pandas as pd
1125
+
1126
+ m = tables["millid"]
1127
+ out = pd.DataFrame({"language": [names.get(lab, lab) for lab in m.index], "support": m["support"]}, index=m.index)
1128
+ for model, t in tables.items():
1129
+ for col in ("f1", "precision", "recall"):
1130
+ out[f"{model}_{col}"] = t[col].reindex(m.index)
1131
+ for ext, suffix, winner in (("glotlid", "", "GlotLID"), ("fasttext", "_fasttext", "fastText")):
1132
+ if f"{ext}@millid" in tables:
1133
+ d = out["millid_f1"] - out[f"{ext}@millid_f1"]
1134
+ out[f"delta{suffix}"] = d
1135
+ out[f"winner{suffix}"] = np.where(d > 0.01, "MillID", np.where(d < -0.01, winner, "tie"))
1136
+ out.index.name = "label"
1137
+ return out.sort_values("support", ascending=False)
1138
+
1139
+
1140
+ def _score(name: str, frame, rankings: dict, out: Path, names: dict) -> tuple[dict, object]:
1141
+ d = out / name
1142
+ d.mkdir(parents=True, exist_ok=True)
1143
+ results, tables = {}, {}
1144
+ for mname, ranked in rankings.items():
1145
+ pred = [r[0][0] for r in ranked]
1146
+ table = per_language(frame["label"].tolist(), pred)
1147
+ sm = summarize(table, frame["label"].tolist(), [[lab for lab, _ in r] for r in ranked])
1148
+ if "size" in frame:
1149
+ f = frame.assign(pred=pred)
1150
+ sm["top1_by_size"] = {k: float((g["label"] == g["pred"]).mean()) for k, g in f.groupby("size")}
1151
+ table.round(6).to_csv(d / f"{mname}_per_language.csv")
1152
+ (d / f"{mname}_summary.json").write_text(json.dumps(sm, indent=2), encoding="utf-8")
1153
+ results[mname], tables[mname] = sm, table
1154
+ print(f"{name:24} {mname:16} top-1 {sm['top1_accuracy']:.4f} top-3 {sm['top3_accuracy']:.4f} macro F1 {sm['macro_f1']:.4f}", flush=True)
1155
+ board = None
1156
+ if len(tables) > 1:
1157
+ board = leaderboard(tables, names)
1158
+ board.round(4).to_csv(d / "leaderboard.csv")
1159
+ return results, board
1160
+
1161
+
1162
+ def evaluate_all(
1163
+ model: MillID, root: Path, out: Path, compare=False, which=("validation", "test", "udhr"), names=None,
1164
+ lids: dict[str, FastTextLID] | None = None, cache: dict | None = None,
1165
+ ) -> tuple[dict, dict]: # fmt: skip
1166
+ """MillID on validation, test and UDHR, and the external models in `compare` (True means
1167
+ GlotLID alone) on test and UDHR, each as it is and restricted to MillID's labels. Writes
1168
+ per-language tables, summaries and a leaderboard per set under out/<set>/. Returns the
1169
+ summaries and the leaderboards.
1170
+
1171
+ fastText knows 218 labels, so on sets of 1,600 it is mostly scored on languages it cannot
1172
+ answer. `<set>-common` scores every model on the passages whose language all of them know:
1173
+ the head-to-head on equal terms.
1174
+
1175
+ An external model's ranking of a set does not depend on the MillID it is compared with:
1176
+ pass the same `lids` and `cache` to evaluate several models and each set is read once."""
1177
+ names = names or {}
1178
+ compare = ("glotlid",) if compare is True else tuple(compare or ())
1179
+ lids = {} if lids is None else lids
1180
+ cache = {} if cache is None else cache
1181
+ for ext in compare:
1182
+ if ext not in lids:
1183
+ lids[ext] = FastTextLID(ext, model.labels.aliases)
1184
+ frames = {}
1185
+ if "validation" in which:
1186
+ frames["validation"] = read_split(root, "validation")
1187
+ if "test" in which:
1188
+ frames["test"] = read_split(root, "test")
1189
+ if "udhr" in which:
1190
+ u = read_split(root, "udhr").reset_index(drop=True)
1191
+ frames["udhr"] = u[u["label"].isin(model.trained)]
1192
+ frames["udhr-all"] = u
1193
+ common = set(model.trained)
1194
+ if len(compare) > 1:
1195
+ for ext in compare:
1196
+ common &= lids[ext].labels()
1197
+
1198
+ results, boards = {}, {}
1199
+ for name, frame in frames.items():
1200
+ texts = frame["text"].tolist()
1201
+ rankings = {"millid": model.predict(texts, k=5, batch_size=1024)}
1202
+ if name != "validation":
1203
+ for ext in compare:
1204
+ if name in ("udhr", "udhr-all"):
1205
+ if (ext, "udhr") not in cache:
1206
+ cache[ext, "udhr"] = lids[ext].rank(frames["udhr-all"]["text"].tolist())
1207
+ full = cache[ext, "udhr"]
1208
+ ranked = [full[i] for i in frame.index]
1209
+ else:
1210
+ if (ext, name) not in cache:
1211
+ cache[ext, name] = lids[ext].rank(texts)
1212
+ ranked = cache[ext, name]
1213
+ rankings[ext] = FastTextLID.view(ranked)
1214
+ rankings[f"{ext}@millid"] = FastTextLID.view(ranked, model.trained)
1215
+ results[name], board = _score(name, frame, rankings, out, names)
1216
+ if board is not None:
1217
+ boards[name] = board
1218
+ if len(compare) > 1 and name in ("test", "udhr"):
1219
+ keep = frame["label"].isin(common).to_numpy()
1220
+ sub = {m: [r for r, k in zip(ranked, keep, strict=True) if k] for m, ranked in rankings.items()}
1221
+ results[f"{name}-common"], board = _score(f"{name}-common", frame[keep], sub, out, names)
1222
+ boards[f"{name}-common"] = board
1223
+ (out / "summary.json").write_text(json.dumps(results, indent=2), encoding="utf-8")
1224
+ return results, boards
1225
+
1226
+
1227
+ def _board_md(board, set_name: str) -> str:
1228
+ ext = [(name, col, w) for name, col, w in (("GlotLID", "glotlid", "winner"), ("fastText", "fasttext", "winner_fasttext")) if w in board]
1229
+ if not ext:
1230
+ return ""
1231
+ counts = "; ".join(
1232
+ f"against {name} restricted to MillID's labels, MillID is better on **{(board[w] == 'MillID').sum()}** languages, "
1233
+ f"worse on **{(board[w] == name).sum()}** and within 0.01 on {(board[w] == 'tie').sum()}"
1234
+ for name, _, w in ext
1235
+ )
1236
+ key = "delta" if "delta" in board else "delta_fasttext"
1237
+
1238
+ def table(frame) -> str:
1239
+ head = "| Label | Language | Passages | MillID F1 | " + " | ".join(f"{n} F1 | {n} F1, restricted" for n, _, _ in ext) + " |"
1240
+ lines = [head, "|---|---|---|---|" + "---|---|" * len(ext)]
1241
+ for lab, r in frame.iterrows():
1242
+ cells = " | ".join(f"{r[f'{c}_f1']:.3f} | {r[f'{c}@millid_f1']:.3f}" for _, c, _ in ext)
1243
+ lines.append(f"| `{lab}` | {r['language']} | {int(r['support'])} | {r['millid_f1']:.3f} | {cells} |")
1244
+ return "\n".join(lines)
1245
+
1246
+ return f"""### Leaderboard: {set_name}
1247
+
1248
+ MillID's F1 against the others', language by language: {counts}. The full table, with precision and recall, is
1249
+ `reports/{set_name}/leaderboard.csv`.
1250
+
1251
+ The 20 languages with the most passages:
1252
+
1253
+ {table(board.head(20))}
1254
+
1255
+ Where MillID gains most over {ext[0][0]}:
1256
+
1257
+ {table(board.sort_values(key, ascending=False).head(15))}
1258
+
1259
+ Where MillID loses most to {ext[0][0]}:
1260
+
1261
+ {table(board.sort_values(key).head(15))}
1262
+ """
1263
+
1264
+
1265
+ def write_card(out: Path, config: dict, results: dict, args, boards: dict | None = None) -> None:
1266
+ boards = boards or {}
1267
+ rows = ["| Set | Model | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages |", "|---|---|---|---|---|---|---|---|---|---|"]
1268
+ for set_name, by_model in results.items():
1269
+ for mname, sm in by_model.items():
1270
+ rows.append(
1271
+ f"| {set_name} | {mname} | {sm['top1_accuracy']:.4f} | {sm['top3_accuracy']:.4f} | {sm['top5_accuracy']:.4f} | "
1272
+ f"{sm['macro_precision']:.4f} | {sm['macro_recall']:.4f} | {sm['macro_f1']:.4f} | {sm['median_f1']:.4f} | {sm['languages']} |"
1273
+ )
1274
+ size_rows = ["| Set | Model | short | sentence | paragraph |", "|---|---|---|---|---|"]
1275
+ for set_name, by_model in results.items():
1276
+ for mname, sm in by_model.items():
1277
+ b = sm.get("top1_by_size") or {}
1278
+ if b:
1279
+ size_rows.append(f"| {set_name} | {mname} | " + " | ".join(f"{b.get(k, float('nan')):.4f}" for k in ("short", "sentence", "paragraph")) + " |")
1280
+ m = config["model"]
1281
+ repo = args.push_to or "baobabtech/millid"
1282
+ card = f"""---
1283
+ library_name: pytorch
1284
+ pipeline_tag: text-classification
1285
+ tags:
1286
+ - language-identification
1287
+ datasets:
1288
+ - {args.dataset}
1289
+ ---
1290
+
1291
+ # MillID {args.preset}: MultiLingual Language IDentifier
1292
+
1293
+ A byte-level, encoder-only transformer that names the language of a passage: **{config['trained_labels']} language-script
1294
+ labels** (ISO 639-3 + script, e.g. `eng_Latn`, `amh_Ethi`). {config['parameters'] / 1e6:.1f}M parameters, trained from
1295
+ scratch on [{args.dataset}](https://huggingface.co/datasets/{args.dataset}).
1296
+
1297
+ ```python
1298
+ from millid import MillID # millid.py, in this repository
1299
+
1300
+ model = MillID.from_pretrained("{repo}")
1301
+ model.predict(["Lave men ou ak savon anvan ou manje."], k=3)
1302
+ ```
1303
+
1304
+ ## Architecture
1305
+
1306
+ UTF-8 bytes (after Unicode NFKC), each embedded as byte + Unicode script + byte-in-character + hashed character
1307
+ 2-, 3- and 4-grams ({m['ngram_buckets']:,} buckets) -> depthwise convolution stem (kernel {m['conv_kernel']}) -> strided
1308
+ convolution, {m['downsample']} bytes per token -> {m['n_layers']} pre-norm blocks (RMSNorm, attention with RoPE,
1309
+ {m['n_heads']} heads, SwiGLU; d={m['d_model']}) -> masked mean pooling -> language head, each language's vector the sum of
1310
+ its own, its language's and its script's. Up to {m['max_len']} bytes per passage. See `ARCHITECTURE.md`.
1311
+
1312
+ ## Evaluation against GlotLID and fastText
1313
+
1314
+ `validation` chose the checkpoint; `test` is split by document from training; `udhr` is the Universal Declaration
1315
+ of Human Rights, labelled by its translators, over the languages MillID knows, and `udhr-all` over all of them.
1316
+ `glotlid` is [GlotLID](https://huggingface.co/cis-lmu/glotlid) as it is; `glotlid@millid` is GlotLID restricted to
1317
+ MillID's labels, the like-for-like comparison. GlotLID's own labels came from training on data that includes UDHR
1318
+ and labelled FinePDFs and FineWeb-2, so its scores on `udhr` and on those sources are optimistic. `fasttext` is
1319
+ Meta's [fastText language identifier](https://huggingface.co/facebook/fasttext-language-identification) (NLLB,
1320
+ 218 labels), its answers mapped onto MillID's spelling (Simplified and Traditional Han as `Hani`, `pes`/`prs` as
1321
+ `fas`, `est` as `ekk`). It cannot answer most of the 1,600 languages here, so `test-common` and `udhr-common`
1322
+ score every model on the passages whose language all of them know: the head-to-head on equal terms.
1323
+
1324
+ {chr(10).join(rows)}
1325
+
1326
+ Top-1 accuracy by passage length:
1327
+
1328
+ {chr(10).join(size_rows)}
1329
+
1330
+ {chr(10).join(_board_md(boards[s], s) for s in ('test', 'udhr', 'test-common') if s in boards)}
1331
+ Per-language precision, recall (sensitivity), F1 and specificity for every model are in `reports/<set>/`.
1332
+
1333
+ ## Training
1334
+
1335
+ {config['train_passages']:,} passages, best validation macro F1 at step {config['best_step']}, {config['seconds'] / 3600:.1f} hours.
1336
+ Languages sampled in proportion to n^{args.alpha}; {int(args.short_p * 100)}% of passages cut to a 20 to 80 character
1337
+ snippet; batch {args.batch_size}, AdamW at {args.lr}, cosine schedule, label smoothing {args.label_smoothing}.
1338
+ """
1339
+ (out / "README.md").write_text(card, encoding="utf-8")
1340
+
1341
+
1342
+ # --- command line ------------------------------------------------------------------------
1343
+
1344
+
1345
+ @dataclass
1346
+ class TrainArgs:
1347
+ """Train MillID, evaluate it against GlotLID, and optionally push it to the Hub."""
1348
+
1349
+ dataset: str = "baobabtech/millid-dataset"
1350
+ """Hub dataset id, or a local build directory with data/, udhr/ and labels.json"""
1351
+ preset: Literal["tiny", "small", "medium", "large"] = "medium"
1352
+ """model size: tiny ~2M and small ~12M for trials, medium ~114M, large ~190M parameters"""
1353
+ max_len: int = 256
1354
+ """bytes per passage, [CLS] included; a longer passage is cut to a window"""
1355
+ steps: int = 60_000
1356
+ """optimiser steps"""
1357
+ batch_size: int = 512
1358
+ """passages per step"""
1359
+ lr: float = 3e-4
1360
+ """peak learning rate, after warm-up"""
1361
+ warmup: int = 2_000
1362
+ """steps of linear warm-up, then cosine decay to 5% of the peak"""
1363
+ weight_decay: float = 0.01
1364
+ """AdamW weight decay, on weight matrices only"""
1365
+ dropout: float = 0.1
1366
+ """dropout in the encoder and before the head"""
1367
+ label_smoothing: float = 0.1
1368
+ """cross-entropy label smoothing"""
1369
+ alpha: float = 0.3
1370
+ """language sampling: a language is drawn in proportion to n^alpha (1: as the data is, 0: uniform)"""
1371
+ short_p: float = 0.25
1372
+ """share of training passages cut to a 20 to 80 character snippet"""
1373
+ eval_every: int = 2_000
1374
+ """steps between validation passes, which choose the checkpoint"""
1375
+ eval_per_label: int = 20
1376
+ """validation passages per language at each pass"""
1377
+ patience: int = 12_000
1378
+ """stop after this many steps without a better validation macro F1"""
1379
+ commercial_only: bool = False
1380
+ """leave out rows licensed for non-commercial use only"""
1381
+ extra: list[str] = field(default_factory=list)
1382
+ """more training parquet files (text, label): trained on, never evaluated on"""
1383
+ compare_glotlid: bool = False
1384
+ """score GlotLID too, as it is and restricted to MillID's labels"""
1385
+ compare_fasttext: bool = False
1386
+ """score Meta's fastText language identifier (NLLB, 218 labels) too"""
1387
+ final_eval: Literal["all", "validation", "none"] = "all"
1388
+ """which sets to score after training"""
1389
+ output_dir: str = "millid-out"
1390
+ """where the model, its card and reports are written"""
1391
+ push_to: str | None = None
1392
+ """Hub model repo to push to, e.g. baobabtech/millid"""
1393
+ public: bool = False
1394
+ """make the pushed repo public; private otherwise"""
1395
+ seed: int = 7
1396
+ """random seed"""
1397
+ log_every: int = 100
1398
+ """steps between training-loss lines and W&B points"""
1399
+ threads: int = 0
1400
+ """CPU threads for PyTorch; 0 leaves PyTorch's default"""
1401
+ workers: int = -1
1402
+ """DataLoader workers per training process; -1 picks from the cores available, 0 encodes in the training process"""
1403
+ compile: bool = False
1404
+ """torch.compile the model for training (GPU only); batches are then padded to max_len, so it compiles once"""
1405
+ gpus: int = 0
1406
+ """GPUs to train on, one process each, the batch split between them; 0 uses every GPU the machine has"""
1407
+ wandb_project: str | None = os.environ.get("WANDB_PROJECT")
1408
+ """Weights & Biases project; with WANDB_API_KEY set, 'millid' when not given"""
1409
+ wandb_entity: str | None = os.environ.get("WANDB_ENTITY")
1410
+ """Weights & Biases team or user"""
1411
+ wandb_run_name: str | None = None
1412
+ """run name in Weights & Biases"""
1413
+ wandb_tags: list[str] = field(default_factory=list)
1414
+ """run tags in Weights & Biases"""
1415
+ no_wandb: bool = False
1416
+ """never log to Weights & Biases, even with a key"""
1417
+
1418
+
1419
+ @dataclass
1420
+ class EvaluateArgs:
1421
+ """Evaluate trained models on validation, test and UDHR, for instance again after the
1422
+ dataset's evaluation splits were corrected."""
1423
+
1424
+ model: list[str]
1425
+ """model directories or Hub repos; GlotLID and fastText read each set once for all of them"""
1426
+ dataset: str = "baobabtech/millid-dataset"
1427
+ """Hub dataset id or local build directory"""
1428
+ compare_glotlid: bool = False
1429
+ """score GlotLID too"""
1430
+ compare_fasttext: bool = False
1431
+ """score Meta's fastText language identifier (NLLB, 218 labels) too"""
1432
+ output_dir: str = "millid-eval"
1433
+ """where the reports are written, one directory per model"""
1434
+ push: bool = False
1435
+ """push each Hub model's new reports and model card back to its repo"""
1436
+
1437
+
1438
+ @dataclass
1439
+ class SweepArgs:
1440
+ """Run Weights & Biases sweep trials in this process."""
1441
+
1442
+ sweep_id: str
1443
+ """ENTITY/PROJECT/SWEEP_ID, from `wandb sweep millid/sweep.yaml`"""
1444
+ count: int = 4
1445
+ """trials this agent runs"""
1446
+ dataset: str = "baobabtech/millid-dataset"
1447
+ """used unless the sweep sets it"""
1448
+
1449
+
1450
+ @dataclass
1451
+ class PredictArgs:
1452
+ """The language of each text."""
1453
+
1454
+ model: str
1455
+ """model directory or Hub repo"""
1456
+ texts: list[str] = field(default_factory=list)
1457
+ """texts to identify"""
1458
+ k: int = 3
1459
+ """answers per text"""
1460
+
1461
+
1462
+ def evaluate_models(args: EvaluateArgs) -> None:
1463
+ from types import SimpleNamespace
1464
+
1465
+ from huggingface_hub import HfApi, snapshot_download
1466
+
1467
+ root = load_dataset_dir(args.dataset)
1468
+ names = json.loads((root / "labels.json").read_text(encoding="utf-8")).get("names", {})
1469
+ compare = [ext for ext, on in (("glotlid", args.compare_glotlid), ("fasttext", args.compare_fasttext)) if on]
1470
+ lids: dict = {}
1471
+ cache: dict = {}
1472
+ for ref in args.model:
1473
+ local = Path(ref).exists()
1474
+ src = Path(ref) if local else Path(snapshot_download(ref, allow_patterns=["*.json", "*.safetensors"]))
1475
+ out = Path(args.output_dir) / ref.replace("/", "__")
1476
+ print(f"== {ref}", flush=True)
1477
+ model = MillID.from_pretrained(str(src))
1478
+ results, boards = evaluate_all(model, root, out / "reports", compare, names=names, lids=lids, cache=cache)
1479
+ config = json.loads((src / "config.json").read_text(encoding="utf-8"))
1480
+ training = SimpleNamespace(**config["training"])
1481
+ write_card(out, config, results, training, boards)
1482
+ if args.push and not local:
1483
+ HfApi().upload_folder(repo_id=ref, folder_path=str(out), commit_message=f"Evaluated again on {args.dataset}")
1484
+ print(f"pushed https://huggingface.co/{ref}", flush=True)
1485
+
1486
+
1487
+ def sweep_agent(args: SweepArgs) -> None:
1488
+ """Each trial takes its settings from the sweep and the TrainArgs defaults for the rest,
1489
+ and reports val/best_macro_f1. No pushing, no GlotLID, validation only: a sweep chooses
1490
+ settings, and the chosen ones are then trained in full."""
1491
+ import wandb
1492
+
1493
+ def trial() -> None:
1494
+ run = wandb.init()
1495
+ a = TrainArgs(dataset=args.dataset)
1496
+ for key, value in dict(run.config).items():
1497
+ name = key.replace("-", "_")
1498
+ if hasattr(a, name):
1499
+ setattr(a, name, value)
1500
+ a.push_to, a.compare_glotlid, a.final_eval = None, False, "validation"
1501
+ a.output_dir = f"sweep/{run.id}"
1502
+ train(a)
1503
+ run.finish()
1504
+
1505
+ wandb.agent(args.sweep_id, function=trial, count=args.count)
1506
+
1507
+
1508
+ def main(argv: list[str] | None = None) -> None:
1509
+ import tyro
1510
+
1511
+ args = tyro.extras.subcommand_cli_from_dict(
1512
+ {"train": TrainArgs, "evaluate": EvaluateArgs, "sweep-agent": SweepArgs, "predict": PredictArgs},
1513
+ args=argv,
1514
+ prog="millid",
1515
+ )
1516
+ if isinstance(args, TrainArgs):
1517
+ train(args)
1518
+ elif isinstance(args, EvaluateArgs):
1519
+ evaluate_models(args)
1520
+ elif isinstance(args, SweepArgs):
1521
+ sweep_agent(args)
1522
+ else:
1523
+ for text, answers in zip(args.texts, MillID.from_pretrained(args.model).predict(args.texts, args.k), strict=True):
1524
+ print(text, "->", answers)
1525
+
1526
+
1527
+ if __name__ == "__main__":
1528
+ os.environ.setdefault("TOKENIZERS_PARALLELISM", "false")
1529
+ main(sys.argv[1:])
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bb663d8c513daf3e4f95d5af02169c7f500ad7868ae3a9820baadc2abbedc8a
3
+ size 11738164
reports/summary.json ADDED
@@ -0,0 +1,511 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "validation": {
3
+ "millid": {
4
+ "top1_accuracy": 0.9577820504464577,
5
+ "top3_accuracy": 0.9888874405266245,
6
+ "top5_accuracy": 0.9932746203480415,
7
+ "passages": 245488,
8
+ "languages": 1626,
9
+ "macro_precision": 0.9538820330004751,
10
+ "macro_recall": 0.9590954075456577,
11
+ "macro_f1": 0.9550536411106632,
12
+ "macro_specificity": 0.9999740290832557,
13
+ "weighted_f1": 0.9579611590588513,
14
+ "median_f1": 0.9822485207100591,
15
+ "languages_f1_at_least_0_9": 1435,
16
+ "languages_f1_below_0_5": 8,
17
+ "mean_fp_per_million": 25.97091674438312,
18
+ "micro_f1": 0.9577820504464577,
19
+ "top1_by_size": {
20
+ "paragraph": 0.984960458955001,
21
+ "sentence": 0.9788390119887341,
22
+ "short": 0.9312356034595158
23
+ }
24
+ }
25
+ },
26
+ "test": {
27
+ "millid": {
28
+ "top1_accuracy": 0.9587247805328816,
29
+ "top3_accuracy": 0.9890484971341278,
30
+ "top5_accuracy": 0.9932401213781161,
31
+ "passages": 240241,
32
+ "languages": 1621,
33
+ "macro_precision": 0.9549770065582561,
34
+ "macro_recall": 0.9588167712047285,
35
+ "macro_f1": 0.9553762683202616,
36
+ "macro_specificity": 0.9999745397211366,
37
+ "weighted_f1": 0.9589133936122667,
38
+ "median_f1": 0.9824561403508771,
39
+ "languages_f1_at_least_0_9": 1446,
40
+ "languages_f1_below_0_5": 8,
41
+ "mean_fp_per_million": 25.46027886332467,
42
+ "micro_f1": 0.9587247805328816,
43
+ "top1_by_size": {
44
+ "paragraph": 0.9832807891792942,
45
+ "sentence": 0.9797006643418943,
46
+ "short": 0.933343407228316
47
+ }
48
+ },
49
+ "glotlid": {
50
+ "top1_accuracy": 0.977614145795264,
51
+ "top3_accuracy": 0.9977189572137978,
52
+ "top5_accuracy": 0.9983766301339072,
53
+ "passages": 240241,
54
+ "languages": 1621,
55
+ "macro_precision": 0.9782517709855841,
56
+ "macro_recall": 0.9751782136320077,
57
+ "macro_f1": 0.9748179587217549,
58
+ "macro_specificity": 0.9999867952157099,
59
+ "weighted_f1": 0.9776092036050326,
60
+ "median_f1": 1.0,
61
+ "languages_f1_at_least_0_9": 1488,
62
+ "languages_f1_below_0_5": 6,
63
+ "mean_fp_per_million": 13.204784290051938,
64
+ "micro_f1": 0.977614145795264,
65
+ "top1_by_size": {
66
+ "paragraph": 0.9910708837587715,
67
+ "sentence": 0.9852877542189529,
68
+ "short": 0.9663739311301133
69
+ }
70
+ },
71
+ "glotlid@millid": {
72
+ "top1_accuracy": 0.978292631149554,
73
+ "top3_accuracy": 0.9977897194900122,
74
+ "top5_accuracy": 0.9984557173837938,
75
+ "passages": 240241,
76
+ "languages": 1621,
77
+ "macro_precision": 0.9778492893480586,
78
+ "macro_recall": 0.9764998669631992,
79
+ "macro_f1": 0.9754780061637239,
80
+ "macro_specificity": 0.9999866076235475,
81
+ "weighted_f1": 0.9778914257911913,
82
+ "median_f1": 1.0,
83
+ "languages_f1_at_least_0_9": 1490,
84
+ "languages_f1_below_0_5": 5,
85
+ "mean_fp_per_million": 13.392376452534537,
86
+ "micro_f1": 0.978292631149554,
87
+ "top1_by_size": {
88
+ "paragraph": 0.9911725821214279,
89
+ "sentence": 0.98578410161122,
90
+ "short": 0.967431690103287
91
+ }
92
+ },
93
+ "fasttext": {
94
+ "top1_accuracy": 0.25110201838986684,
95
+ "top3_accuracy": 0.2610045745730329,
96
+ "top5_accuracy": 0.262482257399861,
97
+ "passages": 240241,
98
+ "languages": 1621,
99
+ "macro_precision": 0.05202750834127428,
100
+ "macro_recall": 0.12048375928156996,
101
+ "macro_f1": 0.06567764337804372,
102
+ "macro_specificity": 0.9995388522643763,
103
+ "weighted_f1": 0.14972995387859817,
104
+ "median_f1": 0.0,
105
+ "languages_f1_at_least_0_9": 25,
106
+ "languages_f1_below_0_5": 1518,
107
+ "mean_fp_per_million": 461.14773562356646,
108
+ "micro_f1": 0.25110201838986684,
109
+ "top1_by_size": {
110
+ "paragraph": 0.19578968778602665,
111
+ "sentence": 0.2500699977091659,
112
+ "short": 0.2759950934205614
113
+ }
114
+ },
115
+ "fasttext@millid": {
116
+ "top1_accuracy": 0.2514599922577745,
117
+ "top3_accuracy": 0.2610753368492472,
118
+ "top5_accuracy": 0.2625197197813862,
119
+ "passages": 240241,
120
+ "languages": 1621,
121
+ "macro_precision": 0.05205991842533006,
122
+ "macro_recall": 0.12089826722608317,
123
+ "macro_f1": 0.06593662879256669,
124
+ "macro_specificity": 0.9995376539627219,
125
+ "weighted_f1": 0.1498625447047829,
126
+ "median_f1": 0.0,
127
+ "languages_f1_at_least_0_9": 26,
128
+ "languages_f1_below_0_5": 1517,
129
+ "mean_fp_per_million": 462.34603727812436,
130
+ "micro_f1": 0.2514599922577745,
131
+ "top1_by_size": {
132
+ "paragraph": 0.19587104647615172,
133
+ "sentence": 0.25056634510143305,
134
+ "short": 0.27637730884784273
135
+ }
136
+ }
137
+ },
138
+ "test-common": {
139
+ "millid": {
140
+ "top1_accuracy": 0.9395947180209607,
141
+ "top3_accuracy": 0.9856649689614069,
142
+ "top5_accuracy": 0.9908664489062959,
143
+ "passages": 64597,
144
+ "languages": 213,
145
+ "macro_precision": 0.970922775379856,
146
+ "macro_recall": 0.9353270477650256,
147
+ "macro_f1": 0.951259698841108,
148
+ "macro_specificity": 0.9998952436560236,
149
+ "weighted_f1": 0.9570662852696624,
150
+ "median_f1": 0.9726495726495726,
151
+ "languages_f1_at_least_0_9": 188,
152
+ "languages_f1_below_0_5": 0,
153
+ "mean_fp_per_million": 104.75634397647721,
154
+ "micro_f1": 0.9395947180209607,
155
+ "top1_by_size": {
156
+ "paragraph": 0.9725285742931622,
157
+ "sentence": 0.9684640840957758,
158
+ "short": 0.9125458547322084
159
+ }
160
+ },
161
+ "glotlid": {
162
+ "top1_accuracy": 0.9738223137297398,
163
+ "top3_accuracy": 0.9924609501989257,
164
+ "top5_accuracy": 0.9946437141043701,
165
+ "passages": 64597,
166
+ "languages": 213,
167
+ "macro_precision": 0.9924377815827973,
168
+ "macro_recall": 0.9770740040297234,
169
+ "macro_f1": 0.9835053354686013,
170
+ "macro_specificity": 0.9999660547959016,
171
+ "weighted_f1": 0.9823407826125089,
172
+ "median_f1": 0.9982788296041308,
173
+ "languages_f1_at_least_0_9": 201,
174
+ "languages_f1_below_0_5": 0,
175
+ "mean_fp_per_million": 33.94520409829502,
176
+ "micro_f1": 0.9738223137297398,
177
+ "top1_by_size": {
178
+ "paragraph": 0.9946861840786043,
179
+ "sentence": 0.9876386996301343,
180
+ "short": 0.9593837123991196
181
+ }
182
+ },
183
+ "glotlid@millid": {
184
+ "top1_accuracy": 0.9749369165750732,
185
+ "top3_accuracy": 0.9926931591250368,
186
+ "top5_accuracy": 0.994829481245259,
187
+ "passages": 64597,
188
+ "languages": 213,
189
+ "macro_precision": 0.9922871273519716,
190
+ "macro_recall": 0.9790381188248578,
191
+ "macro_f1": 0.9845885184031669,
192
+ "macro_specificity": 0.9999656167342897,
193
+ "weighted_f1": 0.9829375630604269,
194
+ "median_f1": 0.9983471074380166,
195
+ "languages_f1_at_least_0_9": 203,
196
+ "languages_f1_below_0_5": 0,
197
+ "mean_fp_per_million": 34.38326571019212,
198
+ "micro_f1": 0.9749369165750732,
199
+ "top1_by_size": {
200
+ "paragraph": 0.9948867054341287,
201
+ "sentence": 0.9885146972941405,
202
+ "short": 0.9609097578870139
203
+ }
204
+ },
205
+ "fasttext": {
206
+ "top1_accuracy": 0.9338668978435531,
207
+ "top3_accuracy": 0.9706952335247767,
208
+ "top5_accuracy": 0.9761908447760732,
209
+ "passages": 64597,
210
+ "languages": 213,
211
+ "macro_precision": 0.9356570616737796,
212
+ "macro_recall": 0.9169210037343893,
213
+ "macro_f1": 0.9148824189777787,
214
+ "macro_specificity": 0.9996959024393602,
215
+ "weighted_f1": 0.9352000319739436,
216
+ "median_f1": 0.9680365296803652,
217
+ "languages_f1_at_least_0_9": 165,
218
+ "languages_f1_below_0_5": 8,
219
+ "mean_fp_per_million": 304.0975606397608,
220
+ "micro_f1": 0.9338668978435531,
221
+ "top1_by_size": {
222
+ "paragraph": 0.9651092841387607,
223
+ "sentence": 0.9562487833365778,
224
+ "short": 0.9112252384446075
225
+ }
226
+ },
227
+ "fasttext@millid": {
228
+ "top1_accuracy": 0.9351982290199236,
229
+ "top3_accuracy": 0.9709584036410359,
230
+ "top5_accuracy": 0.9763301701317398,
231
+ "passages": 64597,
232
+ "languages": 213,
233
+ "macro_precision": 0.9353710554982398,
234
+ "macro_recall": 0.9200755454154029,
235
+ "macro_f1": 0.9173068426975766,
236
+ "macro_specificity": 0.9996942142238651,
237
+ "weighted_f1": 0.9361359929041825,
238
+ "median_f1": 0.9680365296803652,
239
+ "languages_f1_at_least_0_9": 166,
240
+ "languages_f1_below_0_5": 7,
241
+ "mean_fp_per_million": 305.78577613496856,
242
+ "micro_f1": 0.9351982290199236,
243
+ "top1_by_size": {
244
+ "paragraph": 0.9655103268498095,
245
+ "sentence": 0.958146778275258,
246
+ "short": 0.9124871606749817
247
+ }
248
+ }
249
+ },
250
+ "udhr": {
251
+ "millid": {
252
+ "top1_accuracy": 0.8492328500781944,
253
+ "top3_accuracy": 0.911703791369035,
254
+ "top5_accuracy": 0.9256519717655015,
255
+ "passages": 23659,
256
+ "languages": 358,
257
+ "macro_precision": 0.914803800630921,
258
+ "macro_recall": 0.8736275490421017,
259
+ "macro_f1": 0.8764285216392155,
260
+ "macro_specificity": 0.9998609432354121,
261
+ "weighted_f1": 0.8584797362391883,
262
+ "median_f1": 0.9906542056074767,
263
+ "languages_f1_at_least_0_9": 274,
264
+ "languages_f1_below_0_5": 32,
265
+ "mean_fp_per_million": 139.05676458798044,
266
+ "micro_f1": 0.8492328500781944
267
+ },
268
+ "glotlid": {
269
+ "top1_accuracy": 0.8598419206221734,
270
+ "top3_accuracy": 0.9279766684982459,
271
+ "top5_accuracy": 0.9420516505346802,
272
+ "passages": 23659,
273
+ "languages": 358,
274
+ "macro_precision": 0.9261030959501081,
275
+ "macro_recall": 0.8825915640670888,
276
+ "macro_f1": 0.8864649884094992,
277
+ "macro_specificity": 0.999887104475242,
278
+ "weighted_f1": 0.8701800337416647,
279
+ "median_f1": 0.9915248150542268,
280
+ "languages_f1_at_least_0_9": 287,
281
+ "languages_f1_below_0_5": 32,
282
+ "mean_fp_per_million": 112.89552475798357,
283
+ "micro_f1": 0.8598419206221734
284
+ },
285
+ "glotlid@millid": {
286
+ "top1_accuracy": 0.8614480747284331,
287
+ "top3_accuracy": 0.9294137537512152,
288
+ "top5_accuracy": 0.943319666934359,
289
+ "passages": 23659,
290
+ "languages": 358,
291
+ "macro_precision": 0.9257695969546421,
292
+ "macro_recall": 0.8844312457708232,
293
+ "macro_f1": 0.8873151713293488,
294
+ "macro_specificity": 0.9998860393705818,
295
+ "weighted_f1": 0.8709300475765809,
296
+ "median_f1": 0.9915248150542268,
297
+ "languages_f1_at_least_0_9": 291,
298
+ "languages_f1_below_0_5": 32,
299
+ "mean_fp_per_million": 113.96062941822754,
300
+ "micro_f1": 0.8614480747284331
301
+ },
302
+ "fasttext": {
303
+ "top1_accuracy": 0.4624878481761697,
304
+ "top3_accuracy": 0.4856502810769686,
305
+ "top5_accuracy": 0.49034194175578005,
306
+ "passages": 23659,
307
+ "languages": 358,
308
+ "macro_precision": 0.31521227915727285,
309
+ "macro_recall": 0.4478627321056064,
310
+ "macro_f1": 0.3496561644788506,
311
+ "macro_specificity": 0.9986965572826259,
312
+ "weighted_f1": 0.3709499799103122,
313
+ "median_f1": 0.0,
314
+ "languages_f1_at_least_0_9": 60,
315
+ "languages_f1_below_0_5": 220,
316
+ "mean_fp_per_million": 1303.4427173741606,
317
+ "micro_f1": 0.4624878481761697
318
+ },
319
+ "fasttext@millid": {
320
+ "top1_accuracy": 0.4628682530960734,
321
+ "top3_accuracy": 0.4856502810769686,
322
+ "top5_accuracy": 0.4904264761824253,
323
+ "passages": 23659,
324
+ "languages": 358,
325
+ "macro_precision": 0.3151627394343268,
326
+ "macro_recall": 0.4483116546914005,
327
+ "macro_f1": 0.34986047374808604,
328
+ "macro_specificity": 0.9986947805299987,
329
+ "weighted_f1": 0.37111316345366563,
330
+ "median_f1": 0.0,
331
+ "languages_f1_at_least_0_9": 61,
332
+ "languages_f1_below_0_5": 220,
333
+ "mean_fp_per_million": 1305.2194700013772,
334
+ "micro_f1": 0.4628682530960734
335
+ }
336
+ },
337
+ "udhr-common": {
338
+ "millid": {
339
+ "top1_accuracy": 0.9123425692695214,
340
+ "top3_accuracy": 0.9606213266162889,
341
+ "top5_accuracy": 0.9654911838790932,
342
+ "passages": 11910,
343
+ "languages": 170,
344
+ "macro_precision": 0.9794271783100589,
345
+ "macro_recall": 0.9393117513722192,
346
+ "macro_f1": 0.9512636942896991,
347
+ "macro_specificity": 0.9999174355030307,
348
+ "weighted_f1": 0.92868171659548,
349
+ "median_f1": 1.0,
350
+ "languages_f1_at_least_0_9": 149,
351
+ "languages_f1_below_0_5": 4,
352
+ "mean_fp_per_million": 82.56449696922371,
353
+ "micro_f1": 0.9123425692695214
354
+ },
355
+ "glotlid": {
356
+ "top1_accuracy": 0.9335852225020991,
357
+ "top3_accuracy": 0.9677581863979848,
358
+ "top5_accuracy": 0.973215785054576,
359
+ "passages": 11910,
360
+ "languages": 170,
361
+ "macro_precision": 0.9887806114106193,
362
+ "macro_recall": 0.9575995164374027,
363
+ "macro_f1": 0.9657221446088623,
364
+ "macro_specificity": 0.9999338492838657,
365
+ "weighted_f1": 0.9467136106728533,
366
+ "median_f1": 1.0,
367
+ "languages_f1_at_least_0_9": 155,
368
+ "languages_f1_below_0_5": 3,
369
+ "mean_fp_per_million": 66.15071613431165,
370
+ "micro_f1": 0.9335852225020991
371
+ },
372
+ "glotlid@millid": {
373
+ "top1_accuracy": 0.9338371116708648,
374
+ "top3_accuracy": 0.9682619647355164,
375
+ "top5_accuracy": 0.9735516372795969,
376
+ "passages": 11910,
377
+ "languages": 170,
378
+ "macro_precision": 0.9887806114106193,
379
+ "macro_recall": 0.9578604445634422,
380
+ "macro_f1": 0.9658801542070193,
381
+ "macro_specificity": 0.9999338492838657,
382
+ "weighted_f1": 0.9468741038422634,
383
+ "median_f1": 1.0,
384
+ "languages_f1_at_least_0_9": 156,
385
+ "languages_f1_below_0_5": 3,
386
+ "mean_fp_per_million": 66.15071613431165,
387
+ "micro_f1": 0.9338371116708648
388
+ },
389
+ "fasttext": {
390
+ "top1_accuracy": 0.9187237615449202,
391
+ "top3_accuracy": 0.964735516372796,
392
+ "top5_accuracy": 0.9740554156171285,
393
+ "passages": 11910,
394
+ "languages": 170,
395
+ "macro_precision": 0.9473808585265043,
396
+ "macro_recall": 0.9431462240812183,
397
+ "macro_f1": 0.9323102708833079,
398
+ "macro_specificity": 0.9996006150778249,
399
+ "weighted_f1": 0.917761071560676,
400
+ "median_f1": 1.0,
401
+ "languages_f1_at_least_0_9": 141,
402
+ "languages_f1_below_0_5": 6,
403
+ "mean_fp_per_million": 399.3849221751375,
404
+ "micro_f1": 0.9187237615449202
405
+ },
406
+ "fasttext@millid": {
407
+ "top1_accuracy": 0.9194794290512175,
408
+ "top3_accuracy": 0.964735516372796,
409
+ "top5_accuracy": 0.974223341729639,
410
+ "passages": 11910,
411
+ "languages": 170,
412
+ "macro_precision": 0.9473808585265043,
413
+ "macro_recall": 0.9440916022324787,
414
+ "macro_f1": 0.9328542536140149,
415
+ "macro_specificity": 0.9996006150778249,
416
+ "weighted_f1": 0.9181958923496206,
417
+ "median_f1": 1.0,
418
+ "languages_f1_at_least_0_9": 142,
419
+ "languages_f1_below_0_5": 6,
420
+ "mean_fp_per_million": 399.3849221751375,
421
+ "micro_f1": 0.9194794290512175
422
+ }
423
+ },
424
+ "udhr-all": {
425
+ "millid": {
426
+ "top1_accuracy": 0.7273648770951743,
427
+ "top3_accuracy": 0.7808710132860297,
428
+ "top5_accuracy": 0.7928175795532708,
429
+ "passages": 27623,
430
+ "languages": 429,
431
+ "macro_precision": 0.7340309394117082,
432
+ "macro_recall": 0.7290411714617072,
433
+ "macro_f1": 0.7148579318843858,
434
+ "macro_specificity": 0.9997903094250377,
435
+ "weighted_f1": 0.7196404590366388,
436
+ "median_f1": 0.9649122807017544,
437
+ "languages_f1_at_least_0_9": 254,
438
+ "languages_f1_below_0_5": 105,
439
+ "mean_fp_per_million": 209.69057496245543,
440
+ "micro_f1": 0.7273648770951743
441
+ },
442
+ "glotlid": {
443
+ "top1_accuracy": 0.750244361582739,
444
+ "top3_accuracy": 0.8144662056981501,
445
+ "top5_accuracy": 0.8281866560474966,
446
+ "passages": 27623,
447
+ "languages": 429,
448
+ "macro_precision": 0.7694575973118034,
449
+ "macro_recall": 0.7529055089081532,
450
+ "macro_f1": 0.7454327849166208,
451
+ "macro_specificity": 0.9998410395298513,
452
+ "weighted_f1": 0.7485822543592835,
453
+ "median_f1": 0.9795918367346939,
454
+ "languages_f1_at_least_0_9": 277,
455
+ "languages_f1_below_0_5": 97,
456
+ "mean_fp_per_million": 158.96047014874904,
457
+ "micro_f1": 0.750244361582739
458
+ },
459
+ "glotlid@millid": {
460
+ "top1_accuracy": 0.7378271730080006,
461
+ "top3_accuracy": 0.7960395322738297,
462
+ "top5_accuracy": 0.8079498968251095,
463
+ "passages": 27623,
464
+ "languages": 429,
465
+ "macro_precision": 0.7425329775774382,
466
+ "macro_recall": 0.7380568437901042,
467
+ "macro_f1": 0.724506747472521,
468
+ "macro_specificity": 0.999809579502659,
469
+ "weighted_f1": 0.7305913692421664,
470
+ "median_f1": 0.9747899159663865,
471
+ "languages_f1_at_least_0_9": 272,
472
+ "languages_f1_below_0_5": 105,
473
+ "mean_fp_per_million": 190.42049734090864,
474
+ "micro_f1": 0.7378271730080006
475
+ },
476
+ "fasttext": {
477
+ "top1_accuracy": 0.3961191760489447,
478
+ "top3_accuracy": 0.4159577163957572,
479
+ "top5_accuracy": 0.4199761068674655,
480
+ "passages": 27623,
481
+ "languages": 429,
482
+ "macro_precision": 0.24791077144530446,
483
+ "macro_recall": 0.3737409279575923,
484
+ "macro_f1": 0.279501714390051,
485
+ "macro_specificity": 0.9988210740543896,
486
+ "weighted_f1": 0.30525958931365826,
487
+ "median_f1": 0.0,
488
+ "languages_f1_at_least_0_9": 54,
489
+ "languages_f1_below_0_5": 299,
490
+ "mean_fp_per_million": 1178.9259456102943,
491
+ "micro_f1": 0.3961191760489447
492
+ },
493
+ "fasttext@millid": {
494
+ "top1_accuracy": 0.39644499149259677,
495
+ "top3_accuracy": 0.4159577163957572,
496
+ "top5_accuracy": 0.42004851029938817,
497
+ "passages": 27623,
498
+ "languages": 429,
499
+ "macro_precision": 0.2478791005299098,
500
+ "macro_recall": 0.3741155533322177,
501
+ "macro_f1": 0.27967804305179117,
502
+ "macro_specificity": 0.998819804723614,
503
+ "weighted_f1": 0.3054055953686982,
504
+ "median_f1": 0.0,
505
+ "languages_f1_at_least_0_9": 55,
506
+ "languages_f1_below_0_5": 299,
507
+ "mean_fp_per_million": 1180.1952763859204,
508
+ "micro_f1": 0.39644499149259677
509
+ }
510
+ }
511
+ }
reports/test-common/fasttext@millid_per_language.csv ADDED
@@ -0,0 +1,214 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,285,285,0,0,64312,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,113,110,27,3,64457,0.80292,0.973451,0.88,0.999581,418.708517,0.973451
4
+ ady_Cyrl,135,132,2,3,64460,0.985075,0.977778,0.981413,0.999969,31.026031,0.977778
5
+ afr_Latn,569,557,4,12,64024,0.99287,0.97891,0.985841,0.999938,62.472668,0.97891
6
+ als_Latn,213,209,4,4,64380,0.981221,0.981221,0.981221,0.999938,62.127237,0.981221
7
+ alt_Cyrl,208,169,0,39,64389,1.0,0.8125,0.896552,1.0,0.0,0.8125
8
+ amh_Ethi,458,458,2,0,64137,0.995652,1.0,0.997821,0.999969,31.182276,1.0
9
+ arb_Arab,745,739,65,6,63787,0.919154,0.991946,0.954164,0.998982,1017.979077,0.991946
10
+ arb_Latn,163,124,4,39,64430,0.96875,0.760736,0.852234,0.999938,62.079027,0.760736
11
+ arn_Latn,250,231,1,19,64346,0.99569,0.924,0.958506,0.999984,15.54074,0.924
12
+ asm_Beng,467,465,1,2,64129,0.997854,0.995717,0.996785,0.999984,15.593326,0.995717
13
+ ast_Latn,244,231,20,13,64333,0.920319,0.946721,0.933333,0.999689,310.785822,0.946721
14
+ awa_Deva,91,67,19,24,64487,0.77907,0.736264,0.757062,0.999705,294.546244,0.736264
15
+ ayr_Latn,309,295,1,14,64287,0.996622,0.954693,0.975207,0.999984,15.555002,0.954693
16
+ azb_Arab,369,353,5,16,64223,0.986034,0.95664,0.971114,0.999922,77.847668,0.95664
17
+ azj_Latn,187,184,5,3,64405,0.973545,0.983957,0.978723,0.999922,77.627698,0.983957
18
+ bak_Cyrl,289,287,7,2,64301,0.97619,0.99308,0.984563,0.999891,108.851154,0.99308
19
+ bam_Latn,287,267,120,20,64190,0.689922,0.930314,0.792285,0.998134,1865.961748,0.930314
20
+ ban_Latn,202,178,6,24,64389,0.967391,0.881188,0.92228,0.999907,93.174936,0.881188
21
+ bel_Cyrl,157,157,2,0,64438,0.987421,1.0,0.993671,0.999969,31.036623,1.0
22
+ bem_Latn,222,216,10,6,64365,0.955752,0.972973,0.964286,0.999845,155.339806,0.972973
23
+ ben_Beng,466,465,9,1,64122,0.981013,0.997854,0.989362,0.99986,140.337746,0.997854
24
+ bho_Deva,290,241,21,49,64286,0.919847,0.831034,0.873188,0.999673,326.55854,0.831034
25
+ bis_Latn,257,243,2,14,64338,0.991837,0.945525,0.968127,0.999969,31.084862,0.945525
26
+ bjn_Arab,116,107,0,9,64481,1.0,0.922414,0.959641,1.0,0.0,0.922414
27
+ bjn_Latn,153,139,28,14,64416,0.832335,0.908497,0.86875,0.999566,434.485755,0.908497
28
+ bod_Tibt,406,385,149,21,64042,0.720974,0.948276,0.819149,0.997679,2321.197676,0.948276
29
+ bos_Latn,198,178,21,20,64378,0.894472,0.89899,0.896725,0.999674,326.09202,0.89899
30
+ bug_Latn,78,75,7,3,64512,0.914634,0.961538,0.9375,0.999892,108.495172,0.961538
31
+ bul_Cyrl,289,284,5,5,64303,0.982699,0.982699,0.982699,0.999922,77.750824,0.982699
32
+ bxr_Cyrl,277,245,0,32,64320,1.0,0.884477,0.938697,1.0,0.0,0.884477
33
+ cat_Latn,318,303,15,15,64264,0.95283,0.95283,0.95283,0.999767,233.357706,0.95283
34
+ ceb_Latn,338,337,4,1,64255,0.98827,0.997041,0.992636,0.999938,62.24809,0.997041
35
+ ces_Latn,183,183,12,0,64402,0.938462,1.0,0.968254,0.999814,186.294905,1.0
36
+ che_Cyrl,345,338,4,7,64248,0.988304,0.97971,0.983988,0.999938,62.254871,0.97971
37
+ chv_Cyrl,335,335,5,0,64257,0.985294,1.0,0.992593,0.999922,77.80648,1.0
38
+ cjk_Latn,24,23,10,1,64563,0.69697,0.958333,0.807018,0.999845,154.863488,0.958333
39
+ ckb_Arab,421,417,0,4,64176,1.0,0.990499,0.995227,1.0,0.0,0.990499
40
+ cmn_Hani,288,95,6,193,64303,0.940594,0.329861,0.488432,0.999907,93.299538,0.329861
41
+ crh_Latn,189,183,2,6,64406,0.989189,0.968254,0.97861,0.999969,31.052043,0.968254
42
+ cym_Latn,189,185,1,4,64407,0.994624,0.978836,0.986667,0.999984,15.526022,0.978836
43
+ dan_Latn,242,230,6,12,64349,0.974576,0.950413,0.962343,0.999907,93.232849,0.950413
44
+ deu_Latn,356,356,8,0,64233,0.978022,1.0,0.988889,0.999875,124.531063,1.0
45
+ dik_Latn,350,348,5,2,64242,0.985836,0.994286,0.990043,0.999922,77.824646,0.994286
46
+ diq_Latn,134,119,2,15,64461,0.983471,0.88806,0.933333,0.999969,31.02555,0.88806
47
+ dyu_Latn,390,280,11,110,64196,0.962199,0.717949,0.82232,0.999829,171.320884,0.717949
48
+ dzo_Tibt,346,191,12,155,64239,0.940887,0.552023,0.695811,0.999813,186.767521,0.552023
49
+ ekk_Latn,419,415,8,4,64170,0.981087,0.990453,0.985748,0.999875,124.653308,0.990453
50
+ ell_Grek,394,372,1,22,64202,0.997319,0.944162,0.970013,0.999984,15.575596,0.944162
51
+ eng_Latn,1444,1206,164,238,62989,0.880292,0.83518,0.857143,0.997403,2596.867924,0.83518
52
+ epo_Latn,294,293,6,1,64297,0.979933,0.996599,0.988196,0.999907,93.308244,0.996599
53
+ eus_Latn,254,251,4,3,64339,0.984314,0.988189,0.986248,0.999938,62.166825,0.988189
54
+ ewe_Latn,308,300,1,8,64288,0.996678,0.974026,0.985222,0.999984,15.554761,0.974026
55
+ ewo_Latn,134,101,0,33,64463,1.0,0.753731,0.859574,1.0,0.0,0.753731
56
+ fao_Latn,237,75,0,162,64360,1.0,0.316456,0.480769,1.0,0.0,0.316456
57
+ fas_Arab,396,387,37,9,64164,0.912736,0.977273,0.943902,0.999424,576.315011,0.977273
58
+ fij_Latn,344,340,4,4,64249,0.988372,0.988372,0.988372,0.999938,62.253903,0.988372
59
+ fil_Latn,137,135,0,2,64460,1.0,0.985401,0.992647,1.0,0.0,0.985401
60
+ fin_Latn,368,365,1,3,64228,0.997268,0.991848,0.99455,0.999984,15.569291,0.991848
61
+ fon_Latn,180,164,0,16,64417,1.0,0.911111,0.953488,1.0,0.0,0.911111
62
+ fra_Latn,1652,1545,11,107,62934,0.992931,0.93523,0.963217,0.999825,174.755739,0.93523
63
+ fur_Latn,221,196,15,25,64361,0.92891,0.886878,0.907407,0.999767,233.006089,0.886878
64
+ fuv_Latn,164,161,50,3,64383,0.763033,0.981707,0.858667,0.999224,775.999876,0.981707
65
+ gaz_Latn,441,420,2,21,64154,0.995261,0.952381,0.973349,0.999969,31.174013,0.952381
66
+ gla_Latn,223,216,1,7,64373,0.995392,0.96861,0.981818,0.999984,15.534222,0.96861
67
+ gle_Latn,203,198,2,5,64392,0.99,0.975369,0.98263,0.999969,31.058794,0.975369
68
+ glg_Latn,215,211,27,4,64355,0.886555,0.981395,0.931567,0.999581,419.371874,0.981395
69
+ gom_Deva,170,170,17,0,64410,0.909091,1.0,0.952381,0.999736,263.864529,1.0
70
+ gug_Latn,228,202,3,26,64366,0.985366,0.885965,0.933025,0.999953,46.606286,0.885965
71
+ guj_Gujr,354,343,0,11,64243,1.0,0.968927,0.984218,1.0,0.0,0.968927
72
+ hat_Latn,338,325,2,13,64257,0.993884,0.961538,0.977444,0.999969,31.124045,0.961538
73
+ hau_Latn,367,363,8,4,64222,0.978437,0.989101,0.98374,0.999875,124.55239,0.989101
74
+ heb_Hebr,203,203,1,0,64393,0.995098,1.0,0.997543,0.999984,15.529397,1.0
75
+ hin_Deva,392,359,81,33,64124,0.815909,0.915816,0.862981,0.998738,1261.583989,0.915816
76
+ hne_Deva,198,174,14,24,64385,0.925532,0.878788,0.901554,0.999783,217.39468,0.878788
77
+ hrv_Latn,168,146,27,22,64402,0.843931,0.869048,0.856305,0.999581,419.065949,0.869048
78
+ hun_Latn,576,576,23,0,63998,0.961603,1.0,0.980426,0.999641,359.257119,1.0
79
+ hye_Armn,178,170,0,8,64419,1.0,0.955056,0.977011,1.0,0.0,0.955056
80
+ ibo_Latn,257,254,1,3,64339,0.996078,0.988327,0.992188,0.999984,15.542431,0.988327
81
+ ilo_Latn,252,239,0,13,64345,1.0,0.948413,0.973523,1.0,0.0,0.948413
82
+ ind_Latn,335,311,55,24,64207,0.849727,0.928358,0.887304,0.999144,855.871277,0.928358
83
+ isl_Latn,276,276,148,0,64173,0.650943,1.0,0.788571,0.997699,2300.959251,1.0
84
+ ita_Latn,342,335,29,7,64226,0.92033,0.979532,0.949008,0.999549,451.326745,0.979532
85
+ jav_Latn,158,156,21,2,64418,0.881356,0.987342,0.931343,0.999674,325.889601,0.987342
86
+ jpn_Jpan,323,254,8,69,64266,0.969466,0.786378,0.868376,0.999876,124.467125,0.786378
87
+ kab_Latn,165,162,12,3,64420,0.931034,0.981818,0.955752,0.999814,186.242861,0.981818
88
+ kac_Latn,216,211,1,5,64380,0.995283,0.976852,0.985981,0.999984,15.532533,0.976852
89
+ kal_Latn,369,364,0,5,64228,1.0,0.98645,0.993179,1.0,0.0,0.98645
90
+ kam_Latn,272,207,1,65,64324,0.995192,0.761029,0.8625,0.999984,15.546055,0.761029
91
+ kan_Knda,601,600,0,1,63996,1.0,0.998336,0.999167,1.0,0.0,0.998336
92
+ kas_Arab,118,113,0,5,64479,1.0,0.957627,0.978355,1.0,0.0,0.957627
93
+ kas_Deva,47,22,6,25,64544,0.785714,0.468085,0.586667,0.999907,92.951201,0.468085
94
+ kat_Geor,324,315,0,9,64273,1.0,0.972222,0.985915,1.0,0.0,0.972222
95
+ kaz_Cyrl,340,337,2,3,64255,0.9941,0.991176,0.992636,0.999969,31.125014,0.991176
96
+ kbp_Latn,130,125,1,5,64466,0.992063,0.961538,0.976562,0.999984,15.511812,0.961538
97
+ kea_Latn,205,159,0,46,64392,1.0,0.77561,0.873626,1.0,0.0,0.77561
98
+ khk_Cyrl,262,249,30,13,64305,0.892473,0.950382,0.920518,0.999534,466.309163,0.950382
99
+ khm_Khmr,187,187,0,0,64410,1.0,1.0,1.0,1.0,0.0,1.0
100
+ kik_Latn,193,142,0,51,64404,1.0,0.735751,0.847761,1.0,0.0,0.735751
101
+ kin_Latn,210,201,60,9,64327,0.770115,0.957143,0.853503,0.999068,931.865128,0.957143
102
+ kir_Cyrl,242,238,33,4,64322,0.878229,0.983471,0.927875,0.999487,512.78067,0.983471
103
+ kmb_Latn,119,118,8,1,64470,0.936508,0.991597,0.963265,0.999876,124.073327,0.991597
104
+ kmr_Latn,289,289,15,0,64293,0.950658,1.0,0.974705,0.999767,233.252472,1.0
105
+ knc_Arab,68,1,0,67,64529,1.0,0.014706,0.028986,1.0,0.0,0.014706
106
+ knc_Latn,293,286,4,7,64300,0.986207,0.976109,0.981132,0.999938,62.204528,0.976109
107
+ kng_Latn,362,344,2,18,64233,0.99422,0.950276,0.971751,0.999969,31.135674,0.950276
108
+ kor_Hang,265,264,112,1,64220,0.702128,0.996226,0.823713,0.998259,1740.968725,0.996226
109
+ krc_Cyrl,159,158,43,1,64395,0.78607,0.993711,0.877778,0.999333,667.30811,0.993711
110
+ lao_Laoo,335,329,0,6,64262,1.0,0.98209,0.990964,1.0,0.0,0.98209
111
+ lij_Latn,245,189,7,56,64345,0.964286,0.771429,0.857143,0.999891,108.776728,0.771429
112
+ lim_Latn,196,183,4,13,64397,0.97861,0.933673,0.955614,0.999938,62.110837,0.933673
113
+ lin_Latn,215,212,4,3,64378,0.981481,0.986047,0.983759,0.999938,62.129167,0.986047
114
+ lit_Latn,330,319,6,11,64261,0.981538,0.966667,0.974046,0.999907,93.360512,0.966667
115
+ lmo_Latn,276,252,27,24,64294,0.903226,0.913043,0.908108,0.99958,419.769593,0.913043
116
+ ltg_Latn,259,246,5,13,64333,0.98008,0.949807,0.964706,0.999922,77.71457,0.949807
117
+ ltz_Latn,251,251,24,0,64322,0.912727,1.0,0.954373,0.999627,372.983558,1.0
118
+ lua_Latn,346,328,7,18,64244,0.979104,0.947977,0.963289,0.999891,108.947721,0.947977
119
+ lug_Latn,405,396,8,9,64184,0.980198,0.977778,0.978986,0.999875,124.626122,0.977778
120
+ luo_Latn,415,384,4,31,64178,0.989691,0.925301,0.956413,0.999938,62.32277,0.925301
121
+ lus_Latn,391,383,0,8,64206,1.0,0.97954,0.989664,1.0,0.0,0.97954
122
+ lvs_Latn,298,278,11,20,64288,0.961938,0.932886,0.947189,0.999829,171.075755,0.932886
123
+ mag_Deva,97,78,27,19,64473,0.742857,0.804124,0.772277,0.999581,418.604651,0.804124
124
+ mai_Deva,234,223,28,11,64335,0.888446,0.952991,0.919588,0.999565,435.03255,0.952991
125
+ mal_Mlym,338,334,0,4,64259,1.0,0.988166,0.994048,1.0,0.0,0.988166
126
+ mar_Deva,589,575,1,14,64007,0.998264,0.976231,0.987124,0.999984,15.623047,0.976231
127
+ min_Latn,55,11,0,44,64542,1.0,0.2,0.333333,1.0,0.0,0.2
128
+ mkd_Cyrl,331,328,2,3,64264,0.993939,0.990937,0.992436,0.999969,31.120655,0.990937
129
+ mlt_Latn,291,274,5,17,64301,0.982079,0.941581,0.961404,0.999922,77.753242,0.941581
130
+ mni_Beng,304,275,0,29,64293,1.0,0.904605,0.949914,1.0,0.0,0.904605
131
+ mos_Latn,133,130,2,3,64462,0.984848,0.977444,0.981132,0.999969,31.025068,0.977444
132
+ mri_Latn,162,159,158,3,64277,0.501577,0.981481,0.663883,0.997548,2452.083495,0.981481
133
+ mya_Mymr,342,335,0,7,64255,1.0,0.979532,0.98966,1.0,0.0,0.979532
134
+ nav_Latn,113,106,0,7,64484,1.0,0.938053,0.968037,1.0,0.0,0.938053
135
+ nia_Latn,242,239,3,3,64352,0.987603,0.987603,0.987603,0.999953,46.616425,0.987603
136
+ nld_Latn,259,250,12,9,64326,0.954198,0.965251,0.959693,0.999813,186.514968,0.965251
137
+ nno_Latn,427,406,18,21,64152,0.957547,0.95082,0.954172,0.999719,280.504909,0.95082
138
+ nob_Latn,265,241,33,24,64299,0.879562,0.909434,0.894249,0.999487,512.963999,0.909434
139
+ npi_Deva,273,268,9,5,64315,0.967509,0.981685,0.974545,0.99986,139.916672,0.981685
140
+ nso_Latn,479,458,10,21,64108,0.978632,0.956159,0.967265,0.999844,155.962444,0.956159
141
+ nus_Latn,199,195,0,4,64398,1.0,0.979899,0.989848,1.0,0.0,0.979899
142
+ nya_Latn,262,231,6,31,64329,0.974684,0.881679,0.925852,0.999907,93.261833,0.881679
143
+ oci_Latn,333,328,21,5,64243,0.939828,0.984985,0.961877,0.999673,326.777045,0.984985
144
+ ory_Orya,511,507,0,4,64086,1.0,0.992172,0.996071,1.0,0.0,0.992172
145
+ oss_Cyrl,152,152,0,0,64445,1.0,1.0,1.0,1.0,0.0,1.0
146
+ pag_Latn,122,117,5,5,64470,0.959016,0.959016,0.959016,0.999922,77.549438,0.959016
147
+ pan_Guru,460,451,0,9,64137,1.0,0.980435,0.990121,1.0,0.0,0.980435
148
+ pap_Latn,423,416,16,7,64158,0.962963,0.983452,0.973099,0.999751,249.322155,0.983452
149
+ pbt_Arab,419,403,3,16,64175,0.992611,0.961814,0.97697,0.999953,46.74499,0.961814
150
+ pcm_Latn,251,93,0,158,64346,1.0,0.370518,0.540698,1.0,0.0,0.370518
151
+ plt_Latn,248,243,4,5,64345,0.983806,0.979839,0.981818,0.999938,62.161028,0.979839
152
+ pol_Latn,254,253,43,1,64300,0.85473,0.996063,0.92,0.999332,668.293365,0.996063
153
+ por_Latn,657,637,48,20,63892,0.929927,0.969559,0.949329,0.999249,750.703785,0.969559
154
+ quy_Latn,271,262,2,9,64324,0.992424,0.96679,0.979439,0.999969,31.091627,0.96679
155
+ roh_Latn,307,302,11,5,64279,0.964856,0.983713,0.974194,0.999829,171.099704,0.983713
156
+ ron_Latn,369,365,14,4,64214,0.963061,0.98916,0.975936,0.999782,217.97347,0.98916
157
+ run_Latn,291,229,16,62,64290,0.934694,0.786942,0.854478,0.999751,248.810375,0.786942
158
+ rus_Cyrl,528,483,31,45,64038,0.939689,0.914773,0.927063,0.999516,483.853346,0.914773
159
+ sag_Latn,237,230,0,7,64360,1.0,0.970464,0.985011,1.0,0.0,0.970464
160
+ san_Deva,239,230,5,9,64353,0.978723,0.962343,0.970464,0.999922,77.690419,0.962343
161
+ sat_Olck,122,122,0,0,64475,1.0,1.0,1.0,1.0,0.0,1.0
162
+ scn_Latn,172,171,27,1,64398,0.863636,0.994186,0.924324,0.999581,419.091967,0.994186
163
+ shn_Mymr,174,169,0,5,64423,1.0,0.971264,0.985423,1.0,0.0,0.971264
164
+ sin_Sinh,232,231,0,1,64365,1.0,0.99569,0.99784,1.0,0.0,0.99569
165
+ slk_Latn,374,357,4,17,64219,0.98892,0.954545,0.971429,0.999938,62.282983,0.954545
166
+ slv_Latn,338,320,5,18,64254,0.984615,0.946746,0.965309,0.999922,77.810112,0.946746
167
+ smo_Latn,426,418,48,8,64123,0.896996,0.981221,0.93722,0.999252,748.001434,0.981221
168
+ sna_Latn,415,408,7,7,64175,0.983133,0.983133,0.983133,0.999891,109.064847,0.983133
169
+ snd_Arab,325,324,10,1,64262,0.97006,0.996923,0.983308,0.999844,155.588748,0.996923
170
+ som_Latn,439,436,5,3,64153,0.988662,0.993166,0.990909,0.999922,77.932604,0.993166
171
+ sot_Latn,491,375,10,116,64096,0.974026,0.763747,0.856164,0.999844,155.991639,0.763747
172
+ spa_Latn,1136,1031,25,105,63436,0.976326,0.90757,0.940693,0.999606,393.942736,0.90757
173
+ srd_Latn,139,125,3,14,64455,0.976562,0.899281,0.93633,0.999953,46.541934,0.899281
174
+ srp_Cyrl,269,266,6,3,64322,0.977941,0.988848,0.983364,0.999907,93.271981,0.988848
175
+ ssw_Latn,322,314,10,8,64265,0.969136,0.975155,0.972136,0.999844,155.581486,0.975155
176
+ sun_Latn,143,142,15,1,64439,0.904459,0.993007,0.946667,0.999767,232.724113,0.993007
177
+ swe_Latn,328,314,1,14,64268,0.996825,0.957317,0.976672,0.999984,15.559601,0.957317
178
+ swh_Latn,592,571,45,21,63960,0.926948,0.964527,0.945364,0.999297,703.070073,0.964527
179
+ szl_Latn,320,279,4,41,64273,0.985866,0.871875,0.925373,0.999938,62.230658,0.871875
180
+ tah_Latn,242,238,0,4,64355,1.0,0.983471,0.991667,1.0,0.0,0.983471
181
+ tam_Taml,754,750,0,4,63843,1.0,0.994695,0.99734,1.0,0.0,0.994695
182
+ taq_Latn,106,80,5,26,64486,0.941176,0.754717,0.837696,0.999922,77.530198,0.754717
183
+ taq_Tfng,104,0,0,104,64493,0.0,0.0,0.0,1.0,0.0,0.0
184
+ tat_Cyrl,201,200,12,1,64384,0.943396,0.995025,0.968523,0.999814,186.346978,0.995025
185
+ tel_Telu,555,554,0,1,64042,1.0,0.998198,0.999098,1.0,0.0,0.998198
186
+ tgk_Cyrl,413,404,5,9,64179,0.987775,0.978208,0.982968,0.999922,77.901035,0.978208
187
+ tha_Thai,431,415,0,16,64166,1.0,0.962877,0.981087,1.0,0.0,0.962877
188
+ tir_Ethi,339,336,0,3,64258,1.0,0.99115,0.995556,1.0,0.0,0.99115
189
+ ton_Latn,298,0,14,298,64285,0.0,0.0,0.0,0.999782,217.73278,0.0
190
+ tpi_Latn,302,296,2,6,64293,0.993289,0.980132,0.986667,0.999969,31.106618,0.980132
191
+ tsn_Latn,456,441,117,15,64024,0.790323,0.967105,0.869822,0.998176,1824.106266,0.967105
192
+ tso_Latn,581,567,2,14,64014,0.996485,0.975904,0.986087,0.999969,31.242189,0.975904
193
+ tuk_Latn,227,219,0,8,64370,1.0,0.964758,0.982063,1.0,0.0,0.964758
194
+ tum_Latn,265,257,10,8,64322,0.962547,0.969811,0.966165,0.999845,155.443636,0.969811
195
+ tur_Latn,430,423,10,7,64157,0.976905,0.983721,0.980301,0.999844,155.843346,0.983721
196
+ twi_Latn,359,353,17,6,64221,0.954054,0.983287,0.96845,0.999735,264.640867,0.983287
197
+ tzm_Tfng,157,157,104,0,64336,0.601533,1.0,0.751196,0.998386,1613.904407,1.0
198
+ udm_Cyrl,159,115,5,44,64433,0.958333,0.72327,0.824373,0.999922,77.593966,0.72327
199
+ uig_Arab,334,333,5,1,64258,0.985207,0.997006,0.991071,0.999922,77.805269,0.997006
200
+ ukr_Cyrl,322,316,8,6,64267,0.975309,0.981366,0.978328,0.999876,124.465189,0.981366
201
+ umb_Latn,100,96,18,4,64479,0.842105,0.96,0.897196,0.999721,279.082748,0.96
202
+ urd_Arab,257,257,36,0,64304,0.877133,1.0,0.934545,0.99944,559.52751,1.0
203
+ uzn_Latn,436,425,2,11,64159,0.995316,0.974771,0.984936,0.999969,31.171584,0.974771
204
+ vec_Latn,49,40,40,9,64508,0.5,0.816327,0.620155,0.99938,619.693871,0.816327
205
+ vie_Latn,338,329,2,9,64257,0.993958,0.973373,0.983558,0.999969,31.124045,0.973373
206
+ war_Latn,193,175,0,18,64404,1.0,0.906736,0.951087,1.0,0.0,0.906736
207
+ wol_Latn,214,205,9,9,64374,0.957944,0.957944,0.957944,0.99986,139.788453,0.957944
208
+ xho_Latn,367,350,19,17,64211,0.948509,0.953678,0.951087,0.999704,295.811926,0.953678
209
+ xmf_Geor,132,130,8,2,64457,0.942029,0.984848,0.962963,0.999876,124.098348,0.984848
210
+ ydd_Hebr,430,429,0,1,64167,1.0,0.997674,0.998836,1.0,0.0,0.997674
211
+ yor_Latn,308,305,17,3,64272,0.947205,0.99026,0.968254,0.999736,264.430929,0.99026
212
+ yue_Hani,194,188,1071,6,63332,0.149325,0.969072,0.258775,0.98337,16629.660109,0.969072
213
+ zsm_Latn,244,217,17,27,64336,0.92735,0.889344,0.90795,0.999736,264.167949,0.889344
214
+ zul_Latn,594,573,14,21,63989,0.97615,0.964646,0.970364,0.999781,218.739747,0.964646
reports/test-common/fasttext@millid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9351982290199236,
3
+ "top3_accuracy": 0.9709584036410359,
4
+ "top5_accuracy": 0.9763301701317398,
5
+ "passages": 64597,
6
+ "languages": 213,
7
+ "macro_precision": 0.9353710554982398,
8
+ "macro_recall": 0.9200755454154029,
9
+ "macro_f1": 0.9173068426975766,
10
+ "macro_specificity": 0.9996942142238651,
11
+ "weighted_f1": 0.9361359929041825,
12
+ "median_f1": 0.9680365296803652,
13
+ "languages_f1_at_least_0_9": 166,
14
+ "languages_f1_below_0_5": 7,
15
+ "mean_fp_per_million": 305.78577613496856,
16
+ "micro_f1": 0.9351982290199236,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9655103268498095,
19
+ "sentence": 0.958146778275258,
20
+ "short": 0.9124871606749817
21
+ }
22
+ }
reports/test-common/fasttext_per_language.csv ADDED
@@ -0,0 +1,214 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,285,285,0,0,64312,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,113,110,23,3,64461,0.827068,0.973451,0.894309,0.999643,356.677625,0.973451
4
+ ady_Cyrl,135,132,2,3,64460,0.985075,0.977778,0.981413,0.999969,31.026031,0.977778
5
+ afr_Latn,569,557,4,12,64024,0.99287,0.97891,0.985841,0.999938,62.472668,0.97891
6
+ als_Latn,213,209,4,4,64380,0.981221,0.981221,0.981221,0.999938,62.127237,0.981221
7
+ alt_Cyrl,208,169,0,39,64389,1.0,0.8125,0.896552,1.0,0.0,0.8125
8
+ amh_Ethi,458,458,2,0,64137,0.995652,1.0,0.997821,0.999969,31.182276,1.0
9
+ arb_Arab,745,739,60,6,63792,0.924906,0.991946,0.957254,0.99906,939.672994,0.991946
10
+ arb_Latn,163,124,4,39,64430,0.96875,0.760736,0.852234,0.999938,62.079027,0.760736
11
+ arn_Latn,250,231,1,19,64346,0.99569,0.924,0.958506,0.999984,15.54074,0.924
12
+ asm_Beng,467,465,1,2,64129,0.997854,0.995717,0.996785,0.999984,15.593326,0.995717
13
+ ast_Latn,244,231,20,13,64333,0.920319,0.946721,0.933333,0.999689,310.785822,0.946721
14
+ awa_Deva,91,67,19,24,64487,0.77907,0.736264,0.757062,0.999705,294.546244,0.736264
15
+ ayr_Latn,309,295,1,14,64287,0.996622,0.954693,0.975207,0.999984,15.555002,0.954693
16
+ azb_Arab,369,353,5,16,64223,0.986034,0.95664,0.971114,0.999922,77.847668,0.95664
17
+ azj_Latn,187,184,5,3,64405,0.973545,0.983957,0.978723,0.999922,77.627698,0.983957
18
+ bak_Cyrl,289,287,7,2,64301,0.97619,0.99308,0.984563,0.999891,108.851154,0.99308
19
+ bam_Latn,287,267,120,20,64190,0.689922,0.930314,0.792285,0.998134,1865.961748,0.930314
20
+ ban_Latn,202,178,6,24,64389,0.967391,0.881188,0.92228,0.999907,93.174936,0.881188
21
+ bel_Cyrl,157,157,2,0,64438,0.987421,1.0,0.993671,0.999969,31.036623,1.0
22
+ bem_Latn,222,216,10,6,64365,0.955752,0.972973,0.964286,0.999845,155.339806,0.972973
23
+ ben_Beng,466,465,9,1,64122,0.981013,0.997854,0.989362,0.99986,140.337746,0.997854
24
+ bho_Deva,290,241,21,49,64286,0.919847,0.831034,0.873188,0.999673,326.55854,0.831034
25
+ bis_Latn,257,243,2,14,64338,0.991837,0.945525,0.968127,0.999969,31.084862,0.945525
26
+ bjn_Arab,116,34,0,82,64481,1.0,0.293103,0.453333,1.0,0.0,0.293103
27
+ bjn_Latn,153,139,28,14,64416,0.832335,0.908497,0.86875,0.999566,434.485755,0.908497
28
+ bod_Tibt,406,385,149,21,64042,0.720974,0.948276,0.819149,0.997679,2321.197676,0.948276
29
+ bos_Latn,198,178,21,20,64378,0.894472,0.89899,0.896725,0.999674,326.09202,0.89899
30
+ bug_Latn,78,75,7,3,64512,0.914634,0.961538,0.9375,0.999892,108.495172,0.961538
31
+ bul_Cyrl,289,284,5,5,64303,0.982699,0.982699,0.982699,0.999922,77.750824,0.982699
32
+ bxr_Cyrl,277,245,0,32,64320,1.0,0.884477,0.938697,1.0,0.0,0.884477
33
+ cat_Latn,318,303,15,15,64264,0.95283,0.95283,0.95283,0.999767,233.357706,0.95283
34
+ ceb_Latn,338,337,4,1,64255,0.98827,0.997041,0.992636,0.999938,62.24809,0.997041
35
+ ces_Latn,183,183,12,0,64402,0.938462,1.0,0.968254,0.999814,186.294905,1.0
36
+ che_Cyrl,345,338,4,7,64248,0.988304,0.97971,0.983988,0.999938,62.254871,0.97971
37
+ chv_Cyrl,335,335,5,0,64257,0.985294,1.0,0.992593,0.999922,77.80648,1.0
38
+ cjk_Latn,24,23,10,1,64563,0.69697,0.958333,0.807018,0.999845,154.863488,0.958333
39
+ ckb_Arab,421,417,0,4,64176,1.0,0.990499,0.995227,1.0,0.0,0.990499
40
+ cmn_Hani,288,95,6,193,64303,0.940594,0.329861,0.488432,0.999907,93.299538,0.329861
41
+ crh_Latn,189,183,2,6,64406,0.989189,0.968254,0.97861,0.999969,31.052043,0.968254
42
+ cym_Latn,189,185,1,4,64407,0.994624,0.978836,0.986667,0.999984,15.526022,0.978836
43
+ dan_Latn,242,230,6,12,64349,0.974576,0.950413,0.962343,0.999907,93.232849,0.950413
44
+ deu_Latn,356,356,8,0,64233,0.978022,1.0,0.988889,0.999875,124.531063,1.0
45
+ dik_Latn,350,348,5,2,64242,0.985836,0.994286,0.990043,0.999922,77.824646,0.994286
46
+ diq_Latn,134,119,2,15,64461,0.983471,0.88806,0.933333,0.999969,31.02555,0.88806
47
+ dyu_Latn,390,280,11,110,64196,0.962199,0.717949,0.82232,0.999829,171.320884,0.717949
48
+ dzo_Tibt,346,191,12,155,64239,0.940887,0.552023,0.695811,0.999813,186.767521,0.552023
49
+ ekk_Latn,419,415,8,4,64170,0.981087,0.990453,0.985748,0.999875,124.653308,0.990453
50
+ ell_Grek,394,372,1,22,64202,0.997319,0.944162,0.970013,0.999984,15.575596,0.944162
51
+ eng_Latn,1444,1203,159,241,62994,0.88326,0.833102,0.857448,0.997482,2517.695121,0.833102
52
+ epo_Latn,294,293,6,1,64297,0.979933,0.996599,0.988196,0.999907,93.308244,0.996599
53
+ eus_Latn,254,251,4,3,64339,0.984314,0.988189,0.986248,0.999938,62.166825,0.988189
54
+ ewe_Latn,308,300,1,8,64288,0.996678,0.974026,0.985222,0.999984,15.554761,0.974026
55
+ ewo_Latn,134,101,0,33,64463,1.0,0.753731,0.859574,1.0,0.0,0.753731
56
+ fao_Latn,237,75,0,162,64360,1.0,0.316456,0.480769,1.0,0.0,0.316456
57
+ fas_Arab,396,387,37,9,64164,0.912736,0.977273,0.943902,0.999424,576.315011,0.977273
58
+ fij_Latn,344,340,4,4,64249,0.988372,0.988372,0.988372,0.999938,62.253903,0.988372
59
+ fil_Latn,137,135,0,2,64460,1.0,0.985401,0.992647,1.0,0.0,0.985401
60
+ fin_Latn,368,365,1,3,64228,0.997268,0.991848,0.99455,0.999984,15.569291,0.991848
61
+ fon_Latn,180,164,0,16,64417,1.0,0.911111,0.953488,1.0,0.0,0.911111
62
+ fra_Latn,1652,1545,11,107,62934,0.992931,0.93523,0.963217,0.999825,174.755739,0.93523
63
+ fur_Latn,221,196,12,25,64364,0.942308,0.886878,0.913753,0.999814,186.404871,0.886878
64
+ fuv_Latn,164,161,50,3,64383,0.763033,0.981707,0.858667,0.999224,775.999876,0.981707
65
+ gaz_Latn,441,420,2,21,64154,0.995261,0.952381,0.973349,0.999969,31.174013,0.952381
66
+ gla_Latn,223,216,1,7,64373,0.995392,0.96861,0.981818,0.999984,15.534222,0.96861
67
+ gle_Latn,203,198,2,5,64392,0.99,0.975369,0.98263,0.999969,31.058794,0.975369
68
+ glg_Latn,215,211,27,4,64355,0.886555,0.981395,0.931567,0.999581,419.371874,0.981395
69
+ gom_Deva,170,170,17,0,64410,0.909091,1.0,0.952381,0.999736,263.864529,1.0
70
+ gug_Latn,228,202,3,26,64366,0.985366,0.885965,0.933025,0.999953,46.606286,0.885965
71
+ guj_Gujr,354,343,0,11,64243,1.0,0.968927,0.984218,1.0,0.0,0.968927
72
+ hat_Latn,338,325,2,13,64257,0.993884,0.961538,0.977444,0.999969,31.124045,0.961538
73
+ hau_Latn,367,363,7,4,64223,0.981081,0.989101,0.985075,0.999891,108.983341,0.989101
74
+ heb_Hebr,203,203,1,0,64393,0.995098,1.0,0.997543,0.999984,15.529397,1.0
75
+ hin_Deva,392,359,81,33,64124,0.815909,0.915816,0.862981,0.998738,1261.583989,0.915816
76
+ hne_Deva,198,174,14,24,64385,0.925532,0.878788,0.901554,0.999783,217.39468,0.878788
77
+ hrv_Latn,168,146,27,22,64402,0.843931,0.869048,0.856305,0.999581,419.065949,0.869048
78
+ hun_Latn,576,576,23,0,63998,0.961603,1.0,0.980426,0.999641,359.257119,1.0
79
+ hye_Armn,178,170,0,8,64419,1.0,0.955056,0.977011,1.0,0.0,0.955056
80
+ ibo_Latn,257,254,1,3,64339,0.996078,0.988327,0.992188,0.999984,15.542431,0.988327
81
+ ilo_Latn,252,239,0,13,64345,1.0,0.948413,0.973523,1.0,0.0,0.948413
82
+ ind_Latn,335,311,55,24,64207,0.849727,0.928358,0.887304,0.999144,855.871277,0.928358
83
+ isl_Latn,276,276,148,0,64173,0.650943,1.0,0.788571,0.997699,2300.959251,1.0
84
+ ita_Latn,342,335,29,7,64226,0.92033,0.979532,0.949008,0.999549,451.326745,0.979532
85
+ jav_Latn,158,156,21,2,64418,0.881356,0.987342,0.931343,0.999674,325.889601,0.987342
86
+ jpn_Jpan,323,254,8,69,64266,0.969466,0.786378,0.868376,0.999876,124.467125,0.786378
87
+ kab_Latn,165,162,12,3,64420,0.931034,0.981818,0.955752,0.999814,186.242861,0.981818
88
+ kac_Latn,216,211,1,5,64380,0.995283,0.976852,0.985981,0.999984,15.532533,0.976852
89
+ kal_Latn,369,364,0,5,64228,1.0,0.98645,0.993179,1.0,0.0,0.98645
90
+ kam_Latn,272,207,1,65,64324,0.995192,0.761029,0.8625,0.999984,15.546055,0.761029
91
+ kan_Knda,601,600,0,1,63996,1.0,0.998336,0.999167,1.0,0.0,0.998336
92
+ kas_Arab,118,113,0,5,64479,1.0,0.957627,0.978355,1.0,0.0,0.957627
93
+ kas_Deva,47,22,6,25,64544,0.785714,0.468085,0.586667,0.999907,92.951201,0.468085
94
+ kat_Geor,324,315,0,9,64273,1.0,0.972222,0.985915,1.0,0.0,0.972222
95
+ kaz_Cyrl,340,337,2,3,64255,0.9941,0.991176,0.992636,0.999969,31.125014,0.991176
96
+ kbp_Latn,130,125,1,5,64466,0.992063,0.961538,0.976562,0.999984,15.511812,0.961538
97
+ kea_Latn,205,159,0,46,64392,1.0,0.77561,0.873626,1.0,0.0,0.77561
98
+ khk_Cyrl,262,249,30,13,64305,0.892473,0.950382,0.920518,0.999534,466.309163,0.950382
99
+ khm_Khmr,187,187,0,0,64410,1.0,1.0,1.0,1.0,0.0,1.0
100
+ kik_Latn,193,142,0,51,64404,1.0,0.735751,0.847761,1.0,0.0,0.735751
101
+ kin_Latn,210,201,60,9,64327,0.770115,0.957143,0.853503,0.999068,931.865128,0.957143
102
+ kir_Cyrl,242,238,33,4,64322,0.878229,0.983471,0.927875,0.999487,512.78067,0.983471
103
+ kmb_Latn,119,118,8,1,64470,0.936508,0.991597,0.963265,0.999876,124.073327,0.991597
104
+ kmr_Latn,289,289,15,0,64293,0.950658,1.0,0.974705,0.999767,233.252472,1.0
105
+ knc_Arab,68,1,0,67,64529,1.0,0.014706,0.028986,1.0,0.0,0.014706
106
+ knc_Latn,293,286,4,7,64300,0.986207,0.976109,0.981132,0.999938,62.204528,0.976109
107
+ kng_Latn,362,344,2,18,64233,0.99422,0.950276,0.971751,0.999969,31.135674,0.950276
108
+ kor_Hang,265,264,112,1,64220,0.702128,0.996226,0.823713,0.998259,1740.968725,0.996226
109
+ krc_Cyrl,159,158,43,1,64395,0.78607,0.993711,0.877778,0.999333,667.30811,0.993711
110
+ lao_Laoo,335,329,0,6,64262,1.0,0.98209,0.990964,1.0,0.0,0.98209
111
+ lij_Latn,245,189,7,56,64345,0.964286,0.771429,0.857143,0.999891,108.776728,0.771429
112
+ lim_Latn,196,183,4,13,64397,0.97861,0.933673,0.955614,0.999938,62.110837,0.933673
113
+ lin_Latn,215,212,4,3,64378,0.981481,0.986047,0.983759,0.999938,62.129167,0.986047
114
+ lit_Latn,330,319,6,11,64261,0.981538,0.966667,0.974046,0.999907,93.360512,0.966667
115
+ lmo_Latn,276,252,26,24,64295,0.906475,0.913043,0.909747,0.999596,404.222571,0.913043
116
+ ltg_Latn,259,246,5,13,64333,0.98008,0.949807,0.964706,0.999922,77.71457,0.949807
117
+ ltz_Latn,251,251,24,0,64322,0.912727,1.0,0.954373,0.999627,372.983558,1.0
118
+ lua_Latn,346,328,7,18,64244,0.979104,0.947977,0.963289,0.999891,108.947721,0.947977
119
+ lug_Latn,405,396,8,9,64184,0.980198,0.977778,0.978986,0.999875,124.626122,0.977778
120
+ luo_Latn,415,384,4,31,64178,0.989691,0.925301,0.956413,0.999938,62.32277,0.925301
121
+ lus_Latn,391,383,0,8,64206,1.0,0.97954,0.989664,1.0,0.0,0.97954
122
+ lvs_Latn,298,278,11,20,64288,0.961938,0.932886,0.947189,0.999829,171.075755,0.932886
123
+ mag_Deva,97,78,27,19,64473,0.742857,0.804124,0.772277,0.999581,418.604651,0.804124
124
+ mai_Deva,234,223,28,11,64335,0.888446,0.952991,0.919588,0.999565,435.03255,0.952991
125
+ mal_Mlym,338,334,0,4,64259,1.0,0.988166,0.994048,1.0,0.0,0.988166
126
+ mar_Deva,589,575,1,14,64007,0.998264,0.976231,0.987124,0.999984,15.623047,0.976231
127
+ min_Latn,55,11,0,44,64542,1.0,0.2,0.333333,1.0,0.0,0.2
128
+ mkd_Cyrl,331,328,2,3,64264,0.993939,0.990937,0.992436,0.999969,31.120655,0.990937
129
+ mlt_Latn,291,274,5,17,64301,0.982079,0.941581,0.961404,0.999922,77.753242,0.941581
130
+ mni_Beng,304,275,0,29,64293,1.0,0.904605,0.949914,1.0,0.0,0.904605
131
+ mos_Latn,133,130,2,3,64462,0.984848,0.977444,0.981132,0.999969,31.025068,0.977444
132
+ mri_Latn,162,159,158,3,64277,0.501577,0.981481,0.663883,0.997548,2452.083495,0.981481
133
+ mya_Mymr,342,335,0,7,64255,1.0,0.979532,0.98966,1.0,0.0,0.979532
134
+ nav_Latn,113,106,0,7,64484,1.0,0.938053,0.968037,1.0,0.0,0.938053
135
+ nia_Latn,242,239,3,3,64352,0.987603,0.987603,0.987603,0.999953,46.616425,0.987603
136
+ nld_Latn,259,250,12,9,64326,0.954198,0.965251,0.959693,0.999813,186.514968,0.965251
137
+ nno_Latn,427,406,18,21,64152,0.957547,0.95082,0.954172,0.999719,280.504909,0.95082
138
+ nob_Latn,265,241,33,24,64299,0.879562,0.909434,0.894249,0.999487,512.963999,0.909434
139
+ npi_Deva,273,268,9,5,64315,0.967509,0.981685,0.974545,0.99986,139.916672,0.981685
140
+ nso_Latn,479,458,10,21,64108,0.978632,0.956159,0.967265,0.999844,155.962444,0.956159
141
+ nus_Latn,199,195,0,4,64398,1.0,0.979899,0.989848,1.0,0.0,0.979899
142
+ nya_Latn,262,231,6,31,64329,0.974684,0.881679,0.925852,0.999907,93.261833,0.881679
143
+ oci_Latn,333,328,21,5,64243,0.939828,0.984985,0.961877,0.999673,326.777045,0.984985
144
+ ory_Orya,511,507,0,4,64086,1.0,0.992172,0.996071,1.0,0.0,0.992172
145
+ oss_Cyrl,152,152,0,0,64445,1.0,1.0,1.0,1.0,0.0,1.0
146
+ pag_Latn,122,117,5,5,64470,0.959016,0.959016,0.959016,0.999922,77.549438,0.959016
147
+ pan_Guru,460,451,0,9,64137,1.0,0.980435,0.990121,1.0,0.0,0.980435
148
+ pap_Latn,423,416,15,7,64159,0.965197,0.983452,0.974239,0.999766,233.739521,0.983452
149
+ pbt_Arab,419,403,2,16,64176,0.995062,0.961814,0.978155,0.999969,31.163327,0.961814
150
+ pcm_Latn,251,84,0,167,64346,1.0,0.334661,0.501493,1.0,0.0,0.334661
151
+ plt_Latn,248,243,4,5,64345,0.983806,0.979839,0.981818,0.999938,62.161028,0.979839
152
+ pol_Latn,254,253,43,1,64300,0.85473,0.996063,0.92,0.999332,668.293365,0.996063
153
+ por_Latn,657,637,47,20,63893,0.931287,0.969559,0.950037,0.999265,735.064123,0.969559
154
+ quy_Latn,271,262,2,9,64324,0.992424,0.96679,0.979439,0.999969,31.091627,0.96679
155
+ roh_Latn,307,302,11,5,64279,0.964856,0.983713,0.974194,0.999829,171.099704,0.983713
156
+ ron_Latn,369,365,14,4,64214,0.963061,0.98916,0.975936,0.999782,217.97347,0.98916
157
+ run_Latn,291,229,16,62,64290,0.934694,0.786942,0.854478,0.999751,248.810375,0.786942
158
+ rus_Cyrl,528,483,31,45,64038,0.939689,0.914773,0.927063,0.999516,483.853346,0.914773
159
+ sag_Latn,237,230,0,7,64360,1.0,0.970464,0.985011,1.0,0.0,0.970464
160
+ san_Deva,239,230,5,9,64353,0.978723,0.962343,0.970464,0.999922,77.690419,0.962343
161
+ sat_Olck,122,122,0,0,64475,1.0,1.0,1.0,1.0,0.0,1.0
162
+ scn_Latn,172,171,27,1,64398,0.863636,0.994186,0.924324,0.999581,419.091967,0.994186
163
+ shn_Mymr,174,169,0,5,64423,1.0,0.971264,0.985423,1.0,0.0,0.971264
164
+ sin_Sinh,232,231,0,1,64365,1.0,0.99569,0.99784,1.0,0.0,0.99569
165
+ slk_Latn,374,357,4,17,64219,0.98892,0.954545,0.971429,0.999938,62.282983,0.954545
166
+ slv_Latn,338,320,5,18,64254,0.984615,0.946746,0.965309,0.999922,77.810112,0.946746
167
+ smo_Latn,426,418,48,8,64123,0.896996,0.981221,0.93722,0.999252,748.001434,0.981221
168
+ sna_Latn,415,408,7,7,64175,0.983133,0.983133,0.983133,0.999891,109.064847,0.983133
169
+ snd_Arab,325,324,9,1,64263,0.972973,0.996923,0.984802,0.99986,140.029873,0.996923
170
+ som_Latn,439,436,5,3,64153,0.988662,0.993166,0.990909,0.999922,77.932604,0.993166
171
+ sot_Latn,491,375,10,116,64096,0.974026,0.763747,0.856164,0.999844,155.991639,0.763747
172
+ spa_Latn,1136,1031,25,105,63436,0.976326,0.90757,0.940693,0.999606,393.942736,0.90757
173
+ srd_Latn,139,125,3,14,64455,0.976562,0.899281,0.93633,0.999953,46.541934,0.899281
174
+ srp_Cyrl,269,266,6,3,64322,0.977941,0.988848,0.983364,0.999907,93.271981,0.988848
175
+ ssw_Latn,322,314,10,8,64265,0.969136,0.975155,0.972136,0.999844,155.581486,0.975155
176
+ sun_Latn,143,142,15,1,64439,0.904459,0.993007,0.946667,0.999767,232.724113,0.993007
177
+ swe_Latn,328,314,1,14,64268,0.996825,0.957317,0.976672,0.999984,15.559601,0.957317
178
+ swh_Latn,592,571,45,21,63960,0.926948,0.964527,0.945364,0.999297,703.070073,0.964527
179
+ szl_Latn,320,279,4,41,64273,0.985866,0.871875,0.925373,0.999938,62.230658,0.871875
180
+ tah_Latn,242,238,0,4,64355,1.0,0.983471,0.991667,1.0,0.0,0.983471
181
+ tam_Taml,754,750,0,4,63843,1.0,0.994695,0.99734,1.0,0.0,0.994695
182
+ taq_Latn,106,80,5,26,64486,0.941176,0.754717,0.837696,0.999922,77.530198,0.754717
183
+ taq_Tfng,104,0,0,104,64493,0.0,0.0,0.0,1.0,0.0,0.0
184
+ tat_Cyrl,201,200,12,1,64384,0.943396,0.995025,0.968523,0.999814,186.346978,0.995025
185
+ tel_Telu,555,554,0,1,64042,1.0,0.998198,0.999098,1.0,0.0,0.998198
186
+ tgk_Cyrl,413,404,5,9,64179,0.987775,0.978208,0.982968,0.999922,77.901035,0.978208
187
+ tha_Thai,431,415,0,16,64166,1.0,0.962877,0.981087,1.0,0.0,0.962877
188
+ tir_Ethi,339,336,0,3,64258,1.0,0.99115,0.995556,1.0,0.0,0.99115
189
+ ton_Latn,298,0,14,298,64285,0.0,0.0,0.0,0.999782,217.73278,0.0
190
+ tpi_Latn,302,296,2,6,64293,0.993289,0.980132,0.986667,0.999969,31.106618,0.980132
191
+ tsn_Latn,456,441,117,15,64024,0.790323,0.967105,0.869822,0.998176,1824.106266,0.967105
192
+ tso_Latn,581,567,2,14,64014,0.996485,0.975904,0.986087,0.999969,31.242189,0.975904
193
+ tuk_Latn,227,219,0,8,64370,1.0,0.964758,0.982063,1.0,0.0,0.964758
194
+ tum_Latn,265,257,10,8,64322,0.962547,0.969811,0.966165,0.999845,155.443636,0.969811
195
+ tur_Latn,430,423,10,7,64157,0.976905,0.983721,0.980301,0.999844,155.843346,0.983721
196
+ twi_Latn,359,353,17,6,64221,0.954054,0.983287,0.96845,0.999735,264.640867,0.983287
197
+ tzm_Tfng,157,157,104,0,64336,0.601533,1.0,0.751196,0.998386,1613.904407,1.0
198
+ udm_Cyrl,159,115,5,44,64433,0.958333,0.72327,0.824373,0.999922,77.593966,0.72327
199
+ uig_Arab,334,333,5,1,64258,0.985207,0.997006,0.991071,0.999922,77.805269,0.997006
200
+ ukr_Cyrl,322,316,8,6,64267,0.975309,0.981366,0.978328,0.999876,124.465189,0.981366
201
+ umb_Latn,100,96,18,4,64479,0.842105,0.96,0.897196,0.999721,279.082748,0.96
202
+ urd_Arab,257,257,36,0,64304,0.877133,1.0,0.934545,0.99944,559.52751,1.0
203
+ uzn_Latn,436,425,2,11,64159,0.995316,0.974771,0.984936,0.999969,31.171584,0.974771
204
+ vec_Latn,49,40,40,9,64508,0.5,0.816327,0.620155,0.99938,619.693871,0.816327
205
+ vie_Latn,338,329,2,9,64257,0.993958,0.973373,0.983558,0.999969,31.124045,0.973373
206
+ war_Latn,193,175,0,18,64404,1.0,0.906736,0.951087,1.0,0.0,0.906736
207
+ wol_Latn,214,204,9,10,64374,0.957746,0.953271,0.955504,0.99986,139.788453,0.953271
208
+ xho_Latn,367,350,19,17,64211,0.948509,0.953678,0.951087,0.999704,295.811926,0.953678
209
+ xmf_Geor,132,130,8,2,64457,0.942029,0.984848,0.962963,0.999876,124.098348,0.984848
210
+ ydd_Hebr,430,429,0,1,64167,1.0,0.997674,0.998836,1.0,0.0,0.997674
211
+ yor_Latn,308,305,17,3,64272,0.947205,0.99026,0.968254,0.999736,264.430929,0.99026
212
+ yue_Hani,194,188,1071,6,63332,0.149325,0.969072,0.258775,0.98337,16629.660109,0.969072
213
+ zsm_Latn,244,217,17,27,64336,0.92735,0.889344,0.90795,0.999736,264.167949,0.889344
214
+ zul_Latn,594,573,14,21,63989,0.97615,0.964646,0.970364,0.999781,218.739747,0.964646
reports/test-common/fasttext_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9338668978435531,
3
+ "top3_accuracy": 0.9706952335247767,
4
+ "top5_accuracy": 0.9761908447760732,
5
+ "passages": 64597,
6
+ "languages": 213,
7
+ "macro_precision": 0.9356570616737796,
8
+ "macro_recall": 0.9169210037343893,
9
+ "macro_f1": 0.9148824189777787,
10
+ "macro_specificity": 0.9996959024393602,
11
+ "weighted_f1": 0.9352000319739436,
12
+ "median_f1": 0.9680365296803652,
13
+ "languages_f1_at_least_0_9": 165,
14
+ "languages_f1_below_0_5": 8,
15
+ "mean_fp_per_million": 304.0975606397608,
16
+ "micro_f1": 0.9338668978435531,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9651092841387607,
19
+ "sentence": 0.9562487833365778,
20
+ "short": 0.9112252384446075
21
+ }
22
+ }
reports/test-common/glotlid@millid_per_language.csv ADDED
@@ -0,0 +1,214 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,285,285,0,0,64312,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,113,113,0,0,64484,1.0,1.0,1.0,1.0,0.0,1.0
4
+ ady_Cyrl,135,135,0,0,64462,1.0,1.0,1.0,1.0,0.0,1.0
5
+ afr_Latn,569,555,3,14,64025,0.994624,0.975395,0.984916,0.999953,46.854501,0.975395
6
+ als_Latn,213,213,0,0,64384,1.0,1.0,1.0,1.0,0.0,1.0
7
+ alt_Cyrl,208,208,0,0,64389,1.0,1.0,1.0,1.0,0.0,1.0
8
+ amh_Ethi,458,458,0,0,64139,1.0,1.0,1.0,1.0,0.0,1.0
9
+ arb_Arab,745,593,0,152,63852,1.0,0.795973,0.886398,1.0,0.0,0.795973
10
+ arb_Latn,163,137,0,26,64434,1.0,0.840491,0.913333,1.0,0.0,0.840491
11
+ arn_Latn,250,250,0,0,64347,1.0,1.0,1.0,1.0,0.0,1.0
12
+ asm_Beng,467,466,0,1,64130,1.0,0.997859,0.998928,1.0,0.0,0.997859
13
+ ast_Latn,244,244,15,0,64338,0.942085,1.0,0.970179,0.999767,233.089366,1.0
14
+ awa_Deva,91,91,7,0,64499,0.928571,1.0,0.962963,0.999891,108.517037,1.0
15
+ ayr_Latn,309,309,0,0,64288,1.0,1.0,1.0,1.0,0.0,1.0
16
+ azb_Arab,369,367,1,2,64227,0.997283,0.99458,0.995929,0.999984,15.569534,0.99458
17
+ azj_Latn,187,187,1,0,64409,0.994681,1.0,0.997333,0.999984,15.52554,1.0
18
+ bak_Cyrl,289,289,0,0,64308,1.0,1.0,1.0,1.0,0.0,1.0
19
+ bam_Latn,287,287,1,0,64309,0.996528,1.0,0.998261,0.999984,15.549681,1.0
20
+ ban_Latn,202,202,0,0,64395,1.0,1.0,1.0,1.0,0.0,1.0
21
+ bel_Cyrl,157,157,0,0,64440,1.0,1.0,1.0,1.0,0.0,1.0
22
+ bem_Latn,222,216,2,6,64373,0.990826,0.972973,0.981818,0.999969,31.067961,0.972973
23
+ ben_Beng,466,464,1,2,64130,0.997849,0.995708,0.996778,0.999984,15.593083,0.995708
24
+ bho_Deva,290,290,1,0,64306,0.996564,1.0,0.998279,0.999984,15.550407,1.0
25
+ bis_Latn,257,257,0,0,64340,1.0,1.0,1.0,1.0,0.0,1.0
26
+ bjn_Arab,116,113,0,3,64481,1.0,0.974138,0.9869,1.0,0.0,0.974138
27
+ bjn_Latn,153,153,1,0,64443,0.993506,1.0,0.996743,0.999984,15.517348,1.0
28
+ bod_Tibt,406,405,0,1,64191,1.0,0.997537,0.998767,1.0,0.0,0.997537
29
+ bos_Latn,198,198,0,0,64399,1.0,1.0,1.0,1.0,0.0,1.0
30
+ bug_Latn,78,78,3,0,64516,0.962963,1.0,0.981132,0.999954,46.497931,1.0
31
+ bul_Cyrl,289,289,0,0,64308,1.0,1.0,1.0,1.0,0.0,1.0
32
+ bxr_Cyrl,277,277,0,0,64320,1.0,1.0,1.0,1.0,0.0,1.0
33
+ cat_Latn,318,318,10,0,64269,0.969512,1.0,0.98452,0.999844,155.571804,1.0
34
+ ceb_Latn,338,338,0,0,64259,1.0,1.0,1.0,1.0,0.0,1.0
35
+ ces_Latn,183,183,0,0,64414,1.0,1.0,1.0,1.0,0.0,1.0
36
+ che_Cyrl,345,345,0,0,64252,1.0,1.0,1.0,1.0,0.0,1.0
37
+ chv_Cyrl,335,335,0,0,64262,1.0,1.0,1.0,1.0,0.0,1.0
38
+ cjk_Latn,24,24,0,0,64573,1.0,1.0,1.0,1.0,0.0,1.0
39
+ ckb_Arab,421,402,0,19,64176,1.0,0.954869,0.976914,1.0,0.0,0.954869
40
+ cmn_Hani,288,287,19,1,64290,0.937908,0.996528,0.96633,0.999705,295.448538,0.996528
41
+ crh_Latn,189,189,0,0,64408,1.0,1.0,1.0,1.0,0.0,1.0
42
+ cym_Latn,189,189,0,0,64408,1.0,1.0,1.0,1.0,0.0,1.0
43
+ dan_Latn,242,237,20,5,64335,0.922179,0.979339,0.9499,0.999689,310.776163,0.979339
44
+ deu_Latn,356,356,2,0,64239,0.994413,1.0,0.997199,0.999969,31.132766,1.0
45
+ dik_Latn,350,350,0,0,64247,1.0,1.0,1.0,1.0,0.0,1.0
46
+ diq_Latn,134,134,0,0,64463,1.0,1.0,1.0,1.0,0.0,1.0
47
+ dyu_Latn,390,390,0,0,64207,1.0,1.0,1.0,1.0,0.0,1.0
48
+ dzo_Tibt,346,346,1,0,64250,0.997118,1.0,0.998557,0.999984,15.56396,1.0
49
+ ekk_Latn,419,419,6,0,64172,0.985882,1.0,0.992891,0.999907,93.489981,1.0
50
+ ell_Grek,394,393,0,1,64203,1.0,0.997462,0.998729,1.0,0.0,0.997462
51
+ eng_Latn,1444,1157,38,287,63115,0.968201,0.801247,0.876847,0.999398,601.713299,0.801247
52
+ epo_Latn,294,293,0,1,64303,1.0,0.996599,0.998296,1.0,0.0,0.996599
53
+ eus_Latn,254,254,4,0,64339,0.984496,1.0,0.992188,0.999938,62.166825,1.0
54
+ ewe_Latn,308,308,0,0,64289,1.0,1.0,1.0,1.0,0.0,1.0
55
+ ewo_Latn,134,106,0,28,64463,1.0,0.791045,0.883333,1.0,0.0,0.791045
56
+ fao_Latn,237,237,0,0,64360,1.0,1.0,1.0,1.0,0.0,1.0
57
+ fas_Arab,396,385,0,11,64201,1.0,0.972222,0.985915,1.0,0.0,0.972222
58
+ fij_Latn,344,344,0,0,64253,1.0,1.0,1.0,1.0,0.0,1.0
59
+ fil_Latn,137,133,1,4,64459,0.992537,0.970803,0.98155,0.999984,15.513497,0.970803
60
+ fin_Latn,368,368,0,0,64229,1.0,1.0,1.0,1.0,0.0,1.0
61
+ fon_Latn,180,180,0,0,64417,1.0,1.0,1.0,1.0,0.0,1.0
62
+ fra_Latn,1652,1509,0,143,62945,1.0,0.913438,0.954761,1.0,0.0,0.913438
63
+ fur_Latn,221,221,2,0,64374,0.991031,1.0,0.995495,0.999969,31.067479,1.0
64
+ fuv_Latn,164,132,0,32,64433,1.0,0.804878,0.891892,1.0,0.0,0.804878
65
+ gaz_Latn,441,419,0,22,64156,1.0,0.950113,0.974419,1.0,0.0,0.950113
66
+ gla_Latn,223,223,2,0,64372,0.991111,1.0,0.995536,0.999969,31.068444,1.0
67
+ gle_Latn,203,203,0,0,64394,1.0,1.0,1.0,1.0,0.0,1.0
68
+ glg_Latn,215,215,15,0,64367,0.934783,1.0,0.966292,0.999767,232.984375,1.0
69
+ gom_Deva,170,170,7,0,64420,0.960452,1.0,0.979827,0.999891,108.6501,1.0
70
+ gug_Latn,228,228,2,0,64367,0.991304,1.0,0.995633,0.999969,31.070857,1.0
71
+ guj_Gujr,354,354,0,0,64243,1.0,1.0,1.0,1.0,0.0,1.0
72
+ hat_Latn,338,337,1,1,64258,0.997041,0.997041,0.997041,0.999984,15.562022,0.997041
73
+ hau_Latn,367,366,4,1,64226,0.989189,0.997275,0.993216,0.999938,62.276195,0.997275
74
+ heb_Hebr,203,203,0,0,64394,1.0,1.0,1.0,1.0,0.0,1.0
75
+ hin_Deva,392,306,0,86,64205,1.0,0.780612,0.876791,1.0,0.0,0.780612
76
+ hne_Deva,198,198,6,0,64393,0.970588,1.0,0.985075,0.999907,93.169149,1.0
77
+ hrv_Latn,168,168,2,0,64427,0.988235,1.0,0.994083,0.999969,31.041922,1.0
78
+ hun_Latn,576,576,0,0,64021,1.0,1.0,1.0,1.0,0.0,1.0
79
+ hye_Armn,178,178,0,0,64419,1.0,1.0,1.0,1.0,0.0,1.0
80
+ ibo_Latn,257,257,1,0,64339,0.996124,1.0,0.998058,0.999984,15.542431,1.0
81
+ ilo_Latn,252,252,0,0,64345,1.0,1.0,1.0,1.0,0.0,1.0
82
+ ind_Latn,335,335,6,0,64256,0.982405,1.0,0.991124,0.999907,93.367776,1.0
83
+ isl_Latn,276,276,0,0,64321,1.0,1.0,1.0,1.0,0.0,1.0
84
+ ita_Latn,342,333,2,9,64253,0.99403,0.973684,0.983752,0.999969,31.125982,0.973684
85
+ jav_Latn,158,158,2,0,64437,0.9875,1.0,0.993711,0.999969,31.037105,1.0
86
+ jpn_Jpan,323,323,2,0,64272,0.993846,1.0,0.996914,0.999969,31.116781,1.0
87
+ kab_Latn,165,165,0,0,64432,1.0,1.0,1.0,1.0,0.0,1.0
88
+ kac_Latn,216,216,0,0,64381,1.0,1.0,1.0,1.0,0.0,1.0
89
+ kal_Latn,369,369,1,0,64227,0.997297,1.0,0.998647,0.999984,15.569534,1.0
90
+ kam_Latn,272,258,0,14,64325,1.0,0.948529,0.973585,1.0,0.0,0.948529
91
+ kan_Knda,601,594,0,7,63996,1.0,0.988353,0.994142,1.0,0.0,0.988353
92
+ kas_Arab,118,118,0,0,64479,1.0,1.0,1.0,1.0,0.0,1.0
93
+ kas_Deva,47,26,1,21,64549,0.962963,0.553191,0.702703,0.999985,15.491867,0.553191
94
+ kat_Geor,324,324,0,0,64273,1.0,1.0,1.0,1.0,0.0,1.0
95
+ kaz_Cyrl,340,340,0,0,64257,1.0,1.0,1.0,1.0,0.0,1.0
96
+ kbp_Latn,130,130,0,0,64467,1.0,1.0,1.0,1.0,0.0,1.0
97
+ kea_Latn,205,205,1,0,64391,0.995146,1.0,0.997567,0.999984,15.529879,1.0
98
+ khk_Cyrl,262,262,0,0,64335,1.0,1.0,1.0,1.0,0.0,1.0
99
+ khm_Khmr,187,187,0,0,64410,1.0,1.0,1.0,1.0,0.0,1.0
100
+ kik_Latn,193,193,0,0,64404,1.0,1.0,1.0,1.0,0.0,1.0
101
+ kin_Latn,210,203,1,7,64386,0.995098,0.966667,0.980676,0.999984,15.531085,0.966667
102
+ kir_Cyrl,242,242,0,0,64355,1.0,1.0,1.0,1.0,0.0,1.0
103
+ kmb_Latn,119,119,2,0,64476,0.983471,1.0,0.991667,0.999969,31.018332,1.0
104
+ kmr_Latn,289,289,0,0,64308,1.0,1.0,1.0,1.0,0.0,1.0
105
+ knc_Arab,68,52,1,16,64528,0.981132,0.764706,0.859504,0.999985,15.496908,0.764706
106
+ knc_Latn,293,266,0,27,64304,1.0,0.90785,0.951699,1.0,0.0,0.90785
107
+ kng_Latn,362,362,0,0,64235,1.0,1.0,1.0,1.0,0.0,1.0
108
+ kor_Hang,265,265,0,0,64332,1.0,1.0,1.0,1.0,0.0,1.0
109
+ krc_Cyrl,159,159,0,0,64438,1.0,1.0,1.0,1.0,0.0,1.0
110
+ lao_Laoo,335,335,0,0,64262,1.0,1.0,1.0,1.0,0.0,1.0
111
+ lij_Latn,245,245,1,0,64351,0.995935,1.0,0.997963,0.999984,15.539533,1.0
112
+ lim_Latn,196,196,0,0,64401,1.0,1.0,1.0,1.0,0.0,1.0
113
+ lin_Latn,215,214,1,1,64381,0.995349,0.995349,0.995349,0.999984,15.532292,0.995349
114
+ lit_Latn,330,330,3,0,64264,0.990991,1.0,0.995475,0.999953,46.680256,1.0
115
+ lmo_Latn,276,276,7,0,64314,0.975265,1.0,0.987478,0.999891,108.829154,1.0
116
+ ltg_Latn,259,259,1,0,64337,0.996154,1.0,0.998073,0.999984,15.542914,1.0
117
+ ltz_Latn,251,251,0,0,64346,1.0,1.0,1.0,1.0,0.0,1.0
118
+ lua_Latn,346,346,2,0,64249,0.994253,1.0,0.997118,0.999969,31.12792,1.0
119
+ lug_Latn,405,397,2,8,64190,0.994987,0.980247,0.987562,0.999969,31.15653,0.980247
120
+ luo_Latn,415,415,0,0,64182,1.0,1.0,1.0,1.0,0.0,1.0
121
+ lus_Latn,391,391,2,0,64204,0.994911,1.0,0.997449,0.999969,31.149737,1.0
122
+ lvs_Latn,298,298,3,0,64296,0.990033,1.0,0.994992,0.999953,46.657024,1.0
123
+ mag_Deva,97,97,0,0,64500,1.0,1.0,1.0,1.0,0.0,1.0
124
+ mai_Deva,234,234,2,0,64361,0.991525,1.0,0.995745,0.999969,31.073754,1.0
125
+ mal_Mlym,338,338,0,0,64259,1.0,1.0,1.0,1.0,0.0,1.0
126
+ mar_Deva,589,577,0,12,64008,1.0,0.979626,0.989708,1.0,0.0,0.979626
127
+ min_Latn,55,55,1,0,64541,0.982143,1.0,0.990991,0.999985,15.493787,1.0
128
+ mkd_Cyrl,331,331,0,0,64266,1.0,1.0,1.0,1.0,0.0,1.0
129
+ mlt_Latn,291,291,4,0,64302,0.986441,1.0,0.993174,0.999938,62.202594,1.0
130
+ mni_Beng,304,304,0,0,64293,1.0,1.0,1.0,1.0,0.0,1.0
131
+ mos_Latn,133,133,0,0,64464,1.0,1.0,1.0,1.0,0.0,1.0
132
+ mri_Latn,162,162,0,0,64435,1.0,1.0,1.0,1.0,0.0,1.0
133
+ mya_Mymr,342,342,0,0,64255,1.0,1.0,1.0,1.0,0.0,1.0
134
+ nav_Latn,113,113,0,0,64484,1.0,1.0,1.0,1.0,0.0,1.0
135
+ nia_Latn,242,242,0,0,64355,1.0,1.0,1.0,1.0,0.0,1.0
136
+ nld_Latn,259,259,15,0,64323,0.945255,1.0,0.971857,0.999767,233.14371,1.0
137
+ nno_Latn,427,414,0,13,64170,1.0,0.969555,0.984542,1.0,0.0,0.969555
138
+ nob_Latn,265,260,17,5,64315,0.938628,0.981132,0.95941,0.999736,264.254181,0.981132
139
+ npi_Deva,273,271,2,2,64322,0.992674,0.992674,0.992674,0.999969,31.092594,0.992674
140
+ nso_Latn,479,461,11,18,64107,0.976695,0.962422,0.969506,0.999828,171.558689,0.962422
141
+ nus_Latn,199,199,0,0,64398,1.0,1.0,1.0,1.0,0.0,1.0
142
+ nya_Latn,262,252,1,10,64334,0.996047,0.961832,0.978641,0.999984,15.543639,0.961832
143
+ oci_Latn,333,333,6,0,64258,0.982301,1.0,0.991071,0.999907,93.36487,1.0
144
+ ory_Orya,511,511,0,0,64086,1.0,1.0,1.0,1.0,0.0,1.0
145
+ oss_Cyrl,152,152,0,0,64445,1.0,1.0,1.0,1.0,0.0,1.0
146
+ pag_Latn,122,122,1,0,64474,0.99187,1.0,0.995918,0.999984,15.509888,1.0
147
+ pan_Guru,460,460,0,0,64137,1.0,1.0,1.0,1.0,0.0,1.0
148
+ pap_Latn,423,423,1,0,64173,0.997642,1.0,0.998819,0.999984,15.582635,1.0
149
+ pbt_Arab,419,419,1,0,64177,0.997619,1.0,0.998808,0.999984,15.581663,1.0
150
+ pcm_Latn,251,202,19,49,64327,0.914027,0.804781,0.855932,0.999705,295.27865,0.804781
151
+ plt_Latn,248,248,1,0,64348,0.995984,1.0,0.997988,0.999984,15.540257,1.0
152
+ pol_Latn,254,253,7,1,64336,0.973077,0.996063,0.984436,0.999891,108.791943,0.996063
153
+ por_Latn,657,633,34,24,63906,0.949025,0.96347,0.956193,0.999468,531.748514,0.96347
154
+ quy_Latn,271,237,0,34,64326,1.0,0.874539,0.933071,1.0,0.0,0.874539
155
+ roh_Latn,307,307,0,0,64290,1.0,1.0,1.0,1.0,0.0,1.0
156
+ ron_Latn,369,368,2,1,64226,0.994595,0.99729,0.99594,0.999969,31.139067,0.99729
157
+ run_Latn,291,291,9,0,64297,0.97,1.0,0.984772,0.99986,139.955836,1.0
158
+ rus_Cyrl,528,512,0,16,64069,1.0,0.969697,0.984615,1.0,0.0,0.969697
159
+ sag_Latn,237,237,0,0,64360,1.0,1.0,1.0,1.0,0.0,1.0
160
+ san_Deva,239,235,1,4,64357,0.995763,0.983264,0.989474,0.999984,15.538084,0.983264
161
+ sat_Olck,122,122,0,0,64475,1.0,1.0,1.0,1.0,0.0,1.0
162
+ scn_Latn,172,172,0,0,64425,1.0,1.0,1.0,1.0,0.0,1.0
163
+ shn_Mymr,174,174,0,0,64423,1.0,1.0,1.0,1.0,0.0,1.0
164
+ sin_Sinh,232,232,0,0,64365,1.0,1.0,1.0,1.0,0.0,1.0
165
+ slk_Latn,374,374,1,0,64222,0.997333,1.0,0.998665,0.999984,15.570746,1.0
166
+ slv_Latn,338,338,5,0,64254,0.985423,1.0,0.992658,0.999922,77.810112,1.0
167
+ smo_Latn,426,426,1,0,64170,0.997658,1.0,0.998828,0.999984,15.583363,1.0
168
+ sna_Latn,415,415,0,0,64182,1.0,1.0,1.0,1.0,0.0,1.0
169
+ snd_Arab,325,325,0,0,64272,1.0,1.0,1.0,1.0,0.0,1.0
170
+ som_Latn,439,435,0,4,64158,1.0,0.990888,0.995423,1.0,0.0,0.990888
171
+ sot_Latn,491,476,6,15,64100,0.987552,0.96945,0.978417,0.999906,93.594983,0.96945
172
+ spa_Latn,1136,1046,1,90,63460,0.999045,0.920775,0.958314,0.999984,15.757709,0.920775
173
+ srd_Latn,139,139,0,0,64458,1.0,1.0,1.0,1.0,0.0,1.0
174
+ srp_Cyrl,269,269,0,0,64328,1.0,1.0,1.0,1.0,0.0,1.0
175
+ ssw_Latn,322,307,4,15,64271,0.987138,0.953416,0.969984,0.999938,62.232594,0.953416
176
+ sun_Latn,143,143,0,0,64454,1.0,1.0,1.0,1.0,0.0,1.0
177
+ swe_Latn,328,326,17,2,64252,0.950437,0.993902,0.971684,0.999735,264.513218,0.993902
178
+ swh_Latn,592,545,7,47,63998,0.987319,0.920608,0.952797,0.999891,109.366456,0.920608
179
+ szl_Latn,320,320,2,0,64275,0.993789,1.0,0.996885,0.999969,31.115329,1.0
180
+ tah_Latn,242,242,0,0,64355,1.0,1.0,1.0,1.0,0.0,1.0
181
+ tam_Taml,754,754,0,0,63843,1.0,1.0,1.0,1.0,0.0,1.0
182
+ taq_Latn,106,106,0,0,64491,1.0,1.0,1.0,1.0,0.0,1.0
183
+ taq_Tfng,104,70,0,34,64493,1.0,0.673077,0.804598,1.0,0.0,0.673077
184
+ tat_Cyrl,201,201,0,0,64396,1.0,1.0,1.0,1.0,0.0,1.0
185
+ tel_Telu,555,553,0,2,64042,1.0,0.996396,0.998195,1.0,0.0,0.996396
186
+ tgk_Cyrl,413,413,0,0,64184,1.0,1.0,1.0,1.0,0.0,1.0
187
+ tha_Thai,431,414,0,17,64166,1.0,0.960557,0.979882,1.0,0.0,0.960557
188
+ tir_Ethi,339,338,0,1,64258,1.0,0.99705,0.998523,1.0,0.0,0.99705
189
+ ton_Latn,298,298,0,0,64299,1.0,1.0,1.0,1.0,0.0,1.0
190
+ tpi_Latn,302,302,1,0,64294,0.9967,1.0,0.998347,0.999984,15.553309,1.0
191
+ tsn_Latn,456,438,18,18,64123,0.960526,0.960526,0.960526,0.999719,280.631733,0.960526
192
+ tso_Latn,581,532,0,49,64016,1.0,0.915663,0.955975,1.0,0.0,0.915663
193
+ tuk_Latn,227,227,1,0,64369,0.995614,1.0,0.997802,0.999984,15.535187,1.0
194
+ tum_Latn,265,264,1,1,64331,0.996226,0.996226,0.996226,0.999984,15.544364,0.996226
195
+ tur_Latn,430,429,0,1,64167,1.0,0.997674,0.998836,1.0,0.0,0.997674
196
+ twi_Latn,359,353,1,6,64237,0.997175,0.983287,0.990182,0.999984,15.56711,0.983287
197
+ tzm_Tfng,157,157,22,0,64418,0.877095,1.0,0.934524,0.999659,341.402855,1.0
198
+ udm_Cyrl,159,159,0,0,64438,1.0,1.0,1.0,1.0,0.0,1.0
199
+ uig_Arab,334,334,0,0,64263,1.0,1.0,1.0,1.0,0.0,1.0
200
+ ukr_Cyrl,322,322,0,0,64275,1.0,1.0,1.0,1.0,0.0,1.0
201
+ umb_Latn,100,100,1,0,64496,0.990099,1.0,0.995025,0.999984,15.504597,1.0
202
+ urd_Arab,257,257,0,0,64340,1.0,1.0,1.0,1.0,0.0,1.0
203
+ uzn_Latn,436,436,1,0,64160,0.997712,1.0,0.998855,0.999984,15.585792,1.0
204
+ vec_Latn,49,37,0,12,64548,1.0,0.755102,0.860465,1.0,0.0,0.755102
205
+ vie_Latn,338,338,0,0,64259,1.0,1.0,1.0,1.0,0.0,1.0
206
+ war_Latn,193,193,0,0,64404,1.0,1.0,1.0,1.0,0.0,1.0
207
+ wol_Latn,214,214,2,0,64381,0.990741,1.0,0.995349,0.999969,31.064101,1.0
208
+ xho_Latn,367,338,8,29,64222,0.976879,0.920981,0.948107,0.999875,124.55239,0.920981
209
+ xmf_Geor,132,132,0,0,64465,1.0,1.0,1.0,1.0,0.0,1.0
210
+ ydd_Hebr,430,430,0,0,64167,1.0,1.0,1.0,1.0,0.0,1.0
211
+ yor_Latn,308,308,1,0,64288,0.996764,1.0,0.998379,0.999984,15.554761,1.0
212
+ yue_Hani,194,160,1,34,64402,0.993789,0.824742,0.901408,0.999984,15.527227,0.824742
213
+ zsm_Latn,244,244,1,0,64352,0.995918,1.0,0.997955,0.999984,15.539291,1.0
214
+ zul_Latn,594,500,12,94,63991,0.976562,0.841751,0.904159,0.999813,187.491211,0.841751
reports/test-common/glotlid@millid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9749369165750732,
3
+ "top3_accuracy": 0.9926931591250368,
4
+ "top5_accuracy": 0.994829481245259,
5
+ "passages": 64597,
6
+ "languages": 213,
7
+ "macro_precision": 0.9922871273519716,
8
+ "macro_recall": 0.9790381188248578,
9
+ "macro_f1": 0.9845885184031669,
10
+ "macro_specificity": 0.9999656167342897,
11
+ "weighted_f1": 0.9829375630604269,
12
+ "median_f1": 0.9983471074380166,
13
+ "languages_f1_at_least_0_9": 203,
14
+ "languages_f1_below_0_5": 0,
15
+ "mean_fp_per_million": 34.38326571019212,
16
+ "micro_f1": 0.9749369165750732,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9948867054341287,
19
+ "sentence": 0.9885146972941405,
20
+ "short": 0.9609097578870139
21
+ }
22
+ }
reports/test-common/glotlid_per_language.csv ADDED
@@ -0,0 +1,214 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,285,285,0,0,64312,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,113,113,0,0,64484,1.0,1.0,1.0,1.0,0.0,1.0
4
+ ady_Cyrl,135,135,0,0,64462,1.0,1.0,1.0,1.0,0.0,1.0
5
+ afr_Latn,569,555,3,14,64025,0.994624,0.975395,0.984916,0.999953,46.854501,0.975395
6
+ als_Latn,213,213,0,0,64384,1.0,1.0,1.0,1.0,0.0,1.0
7
+ alt_Cyrl,208,208,0,0,64389,1.0,1.0,1.0,1.0,0.0,1.0
8
+ amh_Ethi,458,458,0,0,64139,1.0,1.0,1.0,1.0,0.0,1.0
9
+ arb_Arab,745,593,0,152,63852,1.0,0.795973,0.886398,1.0,0.0,0.795973
10
+ arb_Latn,163,135,0,28,64434,1.0,0.828221,0.90604,1.0,0.0,0.828221
11
+ arn_Latn,250,250,0,0,64347,1.0,1.0,1.0,1.0,0.0,1.0
12
+ asm_Beng,467,466,0,1,64130,1.0,0.997859,0.998928,1.0,0.0,0.997859
13
+ ast_Latn,244,244,15,0,64338,0.942085,1.0,0.970179,0.999767,233.089366,1.0
14
+ awa_Deva,91,91,7,0,64499,0.928571,1.0,0.962963,0.999891,108.517037,1.0
15
+ ayr_Latn,309,309,0,0,64288,1.0,1.0,1.0,1.0,0.0,1.0
16
+ azb_Arab,369,367,1,2,64227,0.997283,0.99458,0.995929,0.999984,15.569534,0.99458
17
+ azj_Latn,187,187,1,0,64409,0.994681,1.0,0.997333,0.999984,15.52554,1.0
18
+ bak_Cyrl,289,289,0,0,64308,1.0,1.0,1.0,1.0,0.0,1.0
19
+ bam_Latn,287,287,1,0,64309,0.996528,1.0,0.998261,0.999984,15.549681,1.0
20
+ ban_Latn,202,202,0,0,64395,1.0,1.0,1.0,1.0,0.0,1.0
21
+ bel_Cyrl,157,157,0,0,64440,1.0,1.0,1.0,1.0,0.0,1.0
22
+ bem_Latn,222,216,1,6,64374,0.995392,0.972973,0.984055,0.999984,15.533981,0.972973
23
+ ben_Beng,466,464,1,2,64130,0.997849,0.995708,0.996778,0.999984,15.593083,0.995708
24
+ bho_Deva,290,290,1,0,64306,0.996564,1.0,0.998279,0.999984,15.550407,1.0
25
+ bis_Latn,257,257,0,0,64340,1.0,1.0,1.0,1.0,0.0,1.0
26
+ bjn_Arab,116,83,0,33,64481,1.0,0.715517,0.834171,1.0,0.0,0.715517
27
+ bjn_Latn,153,153,1,0,64443,0.993506,1.0,0.996743,0.999984,15.517348,1.0
28
+ bod_Tibt,406,405,0,1,64191,1.0,0.997537,0.998767,1.0,0.0,0.997537
29
+ bos_Latn,198,198,0,0,64399,1.0,1.0,1.0,1.0,0.0,1.0
30
+ bug_Latn,78,78,3,0,64516,0.962963,1.0,0.981132,0.999954,46.497931,1.0
31
+ bul_Cyrl,289,289,0,0,64308,1.0,1.0,1.0,1.0,0.0,1.0
32
+ bxr_Cyrl,277,277,0,0,64320,1.0,1.0,1.0,1.0,0.0,1.0
33
+ cat_Latn,318,318,10,0,64269,0.969512,1.0,0.98452,0.999844,155.571804,1.0
34
+ ceb_Latn,338,338,0,0,64259,1.0,1.0,1.0,1.0,0.0,1.0
35
+ ces_Latn,183,183,0,0,64414,1.0,1.0,1.0,1.0,0.0,1.0
36
+ che_Cyrl,345,345,0,0,64252,1.0,1.0,1.0,1.0,0.0,1.0
37
+ chv_Cyrl,335,335,0,0,64262,1.0,1.0,1.0,1.0,0.0,1.0
38
+ cjk_Latn,24,24,0,0,64573,1.0,1.0,1.0,1.0,0.0,1.0
39
+ ckb_Arab,421,402,0,19,64176,1.0,0.954869,0.976914,1.0,0.0,0.954869
40
+ cmn_Hani,288,287,19,1,64290,0.937908,0.996528,0.96633,0.999705,295.448538,0.996528
41
+ crh_Latn,189,189,0,0,64408,1.0,1.0,1.0,1.0,0.0,1.0
42
+ cym_Latn,189,189,0,0,64408,1.0,1.0,1.0,1.0,0.0,1.0
43
+ dan_Latn,242,237,20,5,64335,0.922179,0.979339,0.9499,0.999689,310.776163,0.979339
44
+ deu_Latn,356,356,2,0,64239,0.994413,1.0,0.997199,0.999969,31.132766,1.0
45
+ dik_Latn,350,350,0,0,64247,1.0,1.0,1.0,1.0,0.0,1.0
46
+ diq_Latn,134,134,0,0,64463,1.0,1.0,1.0,1.0,0.0,1.0
47
+ dyu_Latn,390,390,0,0,64207,1.0,1.0,1.0,1.0,0.0,1.0
48
+ dzo_Tibt,346,346,1,0,64250,0.997118,1.0,0.998557,0.999984,15.56396,1.0
49
+ ekk_Latn,419,419,6,0,64172,0.985882,1.0,0.992891,0.999907,93.489981,1.0
50
+ ell_Grek,394,393,0,1,64203,1.0,0.997462,0.998729,1.0,0.0,0.997462
51
+ eng_Latn,1444,1155,38,289,63115,0.968148,0.799861,0.875995,0.999398,601.713299,0.799861
52
+ epo_Latn,294,293,0,1,64303,1.0,0.996599,0.998296,1.0,0.0,0.996599
53
+ eus_Latn,254,254,4,0,64339,0.984496,1.0,0.992188,0.999938,62.166825,1.0
54
+ ewe_Latn,308,308,0,0,64289,1.0,1.0,1.0,1.0,0.0,1.0
55
+ ewo_Latn,134,105,0,29,64463,1.0,0.783582,0.878661,1.0,0.0,0.783582
56
+ fao_Latn,237,237,0,0,64360,1.0,1.0,1.0,1.0,0.0,1.0
57
+ fas_Arab,396,385,0,11,64201,1.0,0.972222,0.985915,1.0,0.0,0.972222
58
+ fij_Latn,344,344,0,0,64253,1.0,1.0,1.0,1.0,0.0,1.0
59
+ fil_Latn,137,133,1,4,64459,0.992537,0.970803,0.98155,0.999984,15.513497,0.970803
60
+ fin_Latn,368,368,0,0,64229,1.0,1.0,1.0,1.0,0.0,1.0
61
+ fon_Latn,180,180,0,0,64417,1.0,1.0,1.0,1.0,0.0,1.0
62
+ fra_Latn,1652,1509,0,143,62945,1.0,0.913438,0.954761,1.0,0.0,0.913438
63
+ fur_Latn,221,221,2,0,64374,0.991031,1.0,0.995495,0.999969,31.067479,1.0
64
+ fuv_Latn,164,128,0,36,64433,1.0,0.780488,0.876712,1.0,0.0,0.780488
65
+ gaz_Latn,441,419,0,22,64156,1.0,0.950113,0.974419,1.0,0.0,0.950113
66
+ gla_Latn,223,223,2,0,64372,0.991111,1.0,0.995536,0.999969,31.068444,1.0
67
+ gle_Latn,203,203,0,0,64394,1.0,1.0,1.0,1.0,0.0,1.0
68
+ glg_Latn,215,215,15,0,64367,0.934783,1.0,0.966292,0.999767,232.984375,1.0
69
+ gom_Deva,170,170,7,0,64420,0.960452,1.0,0.979827,0.999891,108.6501,1.0
70
+ gug_Latn,228,228,2,0,64367,0.991304,1.0,0.995633,0.999969,31.070857,1.0
71
+ guj_Gujr,354,354,0,0,64243,1.0,1.0,1.0,1.0,0.0,1.0
72
+ hat_Latn,338,337,1,1,64258,0.997041,0.997041,0.997041,0.999984,15.562022,0.997041
73
+ hau_Latn,367,366,4,1,64226,0.989189,0.997275,0.993216,0.999938,62.276195,0.997275
74
+ heb_Hebr,203,203,0,0,64394,1.0,1.0,1.0,1.0,0.0,1.0
75
+ hin_Deva,392,306,0,86,64205,1.0,0.780612,0.876791,1.0,0.0,0.780612
76
+ hne_Deva,198,198,6,0,64393,0.970588,1.0,0.985075,0.999907,93.169149,1.0
77
+ hrv_Latn,168,168,2,0,64427,0.988235,1.0,0.994083,0.999969,31.041922,1.0
78
+ hun_Latn,576,576,0,0,64021,1.0,1.0,1.0,1.0,0.0,1.0
79
+ hye_Armn,178,178,0,0,64419,1.0,1.0,1.0,1.0,0.0,1.0
80
+ ibo_Latn,257,257,1,0,64339,0.996124,1.0,0.998058,0.999984,15.542431,1.0
81
+ ilo_Latn,252,252,0,0,64345,1.0,1.0,1.0,1.0,0.0,1.0
82
+ ind_Latn,335,335,6,0,64256,0.982405,1.0,0.991124,0.999907,93.367776,1.0
83
+ isl_Latn,276,276,0,0,64321,1.0,1.0,1.0,1.0,0.0,1.0
84
+ ita_Latn,342,333,2,9,64253,0.99403,0.973684,0.983752,0.999969,31.125982,0.973684
85
+ jav_Latn,158,158,2,0,64437,0.9875,1.0,0.993711,0.999969,31.037105,1.0
86
+ jpn_Jpan,323,323,2,0,64272,0.993846,1.0,0.996914,0.999969,31.116781,1.0
87
+ kab_Latn,165,165,0,0,64432,1.0,1.0,1.0,1.0,0.0,1.0
88
+ kac_Latn,216,216,0,0,64381,1.0,1.0,1.0,1.0,0.0,1.0
89
+ kal_Latn,369,369,1,0,64227,0.997297,1.0,0.998647,0.999984,15.569534,1.0
90
+ kam_Latn,272,257,0,15,64325,1.0,0.944853,0.971645,1.0,0.0,0.944853
91
+ kan_Knda,601,594,0,7,63996,1.0,0.988353,0.994142,1.0,0.0,0.988353
92
+ kas_Arab,118,118,0,0,64479,1.0,1.0,1.0,1.0,0.0,1.0
93
+ kas_Deva,47,26,1,21,64549,0.962963,0.553191,0.702703,0.999985,15.491867,0.553191
94
+ kat_Geor,324,324,0,0,64273,1.0,1.0,1.0,1.0,0.0,1.0
95
+ kaz_Cyrl,340,340,0,0,64257,1.0,1.0,1.0,1.0,0.0,1.0
96
+ kbp_Latn,130,130,0,0,64467,1.0,1.0,1.0,1.0,0.0,1.0
97
+ kea_Latn,205,205,1,0,64391,0.995146,1.0,0.997567,0.999984,15.529879,1.0
98
+ khk_Cyrl,262,262,0,0,64335,1.0,1.0,1.0,1.0,0.0,1.0
99
+ khm_Khmr,187,187,0,0,64410,1.0,1.0,1.0,1.0,0.0,1.0
100
+ kik_Latn,193,193,0,0,64404,1.0,1.0,1.0,1.0,0.0,1.0
101
+ kin_Latn,210,203,1,7,64386,0.995098,0.966667,0.980676,0.999984,15.531085,0.966667
102
+ kir_Cyrl,242,242,0,0,64355,1.0,1.0,1.0,1.0,0.0,1.0
103
+ kmb_Latn,119,119,2,0,64476,0.983471,1.0,0.991667,0.999969,31.018332,1.0
104
+ kmr_Latn,289,289,0,0,64308,1.0,1.0,1.0,1.0,0.0,1.0
105
+ knc_Arab,68,51,0,17,64529,1.0,0.75,0.857143,1.0,0.0,0.75
106
+ knc_Latn,293,266,0,27,64304,1.0,0.90785,0.951699,1.0,0.0,0.90785
107
+ kng_Latn,362,362,0,0,64235,1.0,1.0,1.0,1.0,0.0,1.0
108
+ kor_Hang,265,265,0,0,64332,1.0,1.0,1.0,1.0,0.0,1.0
109
+ krc_Cyrl,159,159,0,0,64438,1.0,1.0,1.0,1.0,0.0,1.0
110
+ lao_Laoo,335,335,0,0,64262,1.0,1.0,1.0,1.0,0.0,1.0
111
+ lij_Latn,245,245,1,0,64351,0.995935,1.0,0.997963,0.999984,15.539533,1.0
112
+ lim_Latn,196,196,0,0,64401,1.0,1.0,1.0,1.0,0.0,1.0
113
+ lin_Latn,215,214,1,1,64381,0.995349,0.995349,0.995349,0.999984,15.532292,0.995349
114
+ lit_Latn,330,330,3,0,64264,0.990991,1.0,0.995475,0.999953,46.680256,1.0
115
+ lmo_Latn,276,276,7,0,64314,0.975265,1.0,0.987478,0.999891,108.829154,1.0
116
+ ltg_Latn,259,259,1,0,64337,0.996154,1.0,0.998073,0.999984,15.542914,1.0
117
+ ltz_Latn,251,251,0,0,64346,1.0,1.0,1.0,1.0,0.0,1.0
118
+ lua_Latn,346,346,2,0,64249,0.994253,1.0,0.997118,0.999969,31.12792,1.0
119
+ lug_Latn,405,396,2,9,64190,0.994975,0.977778,0.986301,0.999969,31.15653,0.977778
120
+ luo_Latn,415,415,0,0,64182,1.0,1.0,1.0,1.0,0.0,1.0
121
+ lus_Latn,391,391,2,0,64204,0.994911,1.0,0.997449,0.999969,31.149737,1.0
122
+ lvs_Latn,298,298,3,0,64296,0.990033,1.0,0.994992,0.999953,46.657024,1.0
123
+ mag_Deva,97,97,0,0,64500,1.0,1.0,1.0,1.0,0.0,1.0
124
+ mai_Deva,234,234,2,0,64361,0.991525,1.0,0.995745,0.999969,31.073754,1.0
125
+ mal_Mlym,338,338,0,0,64259,1.0,1.0,1.0,1.0,0.0,1.0
126
+ mar_Deva,589,576,0,13,64008,1.0,0.977929,0.988841,1.0,0.0,0.977929
127
+ min_Latn,55,55,1,0,64541,0.982143,1.0,0.990991,0.999985,15.493787,1.0
128
+ mkd_Cyrl,331,331,0,0,64266,1.0,1.0,1.0,1.0,0.0,1.0
129
+ mlt_Latn,291,291,4,0,64302,0.986441,1.0,0.993174,0.999938,62.202594,1.0
130
+ mni_Beng,304,304,0,0,64293,1.0,1.0,1.0,1.0,0.0,1.0
131
+ mos_Latn,133,133,0,0,64464,1.0,1.0,1.0,1.0,0.0,1.0
132
+ mri_Latn,162,162,0,0,64435,1.0,1.0,1.0,1.0,0.0,1.0
133
+ mya_Mymr,342,342,0,0,64255,1.0,1.0,1.0,1.0,0.0,1.0
134
+ nav_Latn,113,113,0,0,64484,1.0,1.0,1.0,1.0,0.0,1.0
135
+ nia_Latn,242,242,0,0,64355,1.0,1.0,1.0,1.0,0.0,1.0
136
+ nld_Latn,259,259,15,0,64323,0.945255,1.0,0.971857,0.999767,233.14371,1.0
137
+ nno_Latn,427,414,0,13,64170,1.0,0.969555,0.984542,1.0,0.0,0.969555
138
+ nob_Latn,265,260,16,5,64316,0.942029,0.981132,0.961183,0.999751,248.709818,0.981132
139
+ npi_Deva,273,270,2,3,64322,0.992647,0.989011,0.990826,0.999969,31.092594,0.989011
140
+ nso_Latn,479,461,11,18,64107,0.976695,0.962422,0.969506,0.999828,171.558689,0.962422
141
+ nus_Latn,199,199,0,0,64398,1.0,1.0,1.0,1.0,0.0,1.0
142
+ nya_Latn,262,252,1,10,64334,0.996047,0.961832,0.978641,0.999984,15.543639,0.961832
143
+ oci_Latn,333,333,6,0,64258,0.982301,1.0,0.991071,0.999907,93.36487,1.0
144
+ ory_Orya,511,508,0,3,64086,1.0,0.994129,0.997056,1.0,0.0,0.994129
145
+ oss_Cyrl,152,152,0,0,64445,1.0,1.0,1.0,1.0,0.0,1.0
146
+ pag_Latn,122,122,1,0,64474,0.99187,1.0,0.995918,0.999984,15.509888,1.0
147
+ pan_Guru,460,460,0,0,64137,1.0,1.0,1.0,1.0,0.0,1.0
148
+ pap_Latn,423,423,1,0,64173,0.997642,1.0,0.998819,0.999984,15.582635,1.0
149
+ pbt_Arab,419,419,1,0,64177,0.997619,1.0,0.998808,0.999984,15.581663,1.0
150
+ pcm_Latn,251,194,18,57,64328,0.915094,0.772908,0.838013,0.99972,279.737668,0.772908
151
+ plt_Latn,248,248,1,0,64348,0.995984,1.0,0.997988,0.999984,15.540257,1.0
152
+ pol_Latn,254,253,7,1,64336,0.973077,0.996063,0.984436,0.999891,108.791943,0.996063
153
+ por_Latn,657,630,34,27,63906,0.948795,0.958904,0.953823,0.999468,531.748514,0.958904
154
+ quy_Latn,271,233,0,38,64326,1.0,0.859779,0.924603,1.0,0.0,0.859779
155
+ roh_Latn,307,307,0,0,64290,1.0,1.0,1.0,1.0,0.0,1.0
156
+ ron_Latn,369,368,2,1,64226,0.994595,0.99729,0.99594,0.999969,31.139067,0.99729
157
+ run_Latn,291,291,9,0,64297,0.97,1.0,0.984772,0.99986,139.955836,1.0
158
+ rus_Cyrl,528,512,0,16,64069,1.0,0.969697,0.984615,1.0,0.0,0.969697
159
+ sag_Latn,237,237,0,0,64360,1.0,1.0,1.0,1.0,0.0,1.0
160
+ san_Deva,239,235,1,4,64357,0.995763,0.983264,0.989474,0.999984,15.538084,0.983264
161
+ sat_Olck,122,122,0,0,64475,1.0,1.0,1.0,1.0,0.0,1.0
162
+ scn_Latn,172,172,0,0,64425,1.0,1.0,1.0,1.0,0.0,1.0
163
+ shn_Mymr,174,174,0,0,64423,1.0,1.0,1.0,1.0,0.0,1.0
164
+ sin_Sinh,232,232,0,0,64365,1.0,1.0,1.0,1.0,0.0,1.0
165
+ slk_Latn,374,374,1,0,64222,0.997333,1.0,0.998665,0.999984,15.570746,1.0
166
+ slv_Latn,338,338,5,0,64254,0.985423,1.0,0.992658,0.999922,77.810112,1.0
167
+ smo_Latn,426,426,1,0,64170,0.997658,1.0,0.998828,0.999984,15.583363,1.0
168
+ sna_Latn,415,415,0,0,64182,1.0,1.0,1.0,1.0,0.0,1.0
169
+ snd_Arab,325,325,0,0,64272,1.0,1.0,1.0,1.0,0.0,1.0
170
+ som_Latn,439,435,0,4,64158,1.0,0.990888,0.995423,1.0,0.0,0.990888
171
+ sot_Latn,491,475,6,16,64100,0.987526,0.967413,0.977366,0.999906,93.594983,0.967413
172
+ spa_Latn,1136,1046,1,90,63460,0.999045,0.920775,0.958314,0.999984,15.757709,0.920775
173
+ srd_Latn,139,139,0,0,64458,1.0,1.0,1.0,1.0,0.0,1.0
174
+ srp_Cyrl,269,269,0,0,64328,1.0,1.0,1.0,1.0,0.0,1.0
175
+ ssw_Latn,322,306,4,16,64271,0.987097,0.950311,0.968354,0.999938,62.232594,0.950311
176
+ sun_Latn,143,143,0,0,64454,1.0,1.0,1.0,1.0,0.0,1.0
177
+ swe_Latn,328,326,17,2,64252,0.950437,0.993902,0.971684,0.999735,264.513218,0.993902
178
+ swh_Latn,592,545,6,47,63999,0.989111,0.920608,0.953631,0.999906,93.742676,0.920608
179
+ szl_Latn,320,320,2,0,64275,0.993789,1.0,0.996885,0.999969,31.115329,1.0
180
+ tah_Latn,242,242,0,0,64355,1.0,1.0,1.0,1.0,0.0,1.0
181
+ tam_Taml,754,754,0,0,63843,1.0,1.0,1.0,1.0,0.0,1.0
182
+ taq_Latn,106,106,0,0,64491,1.0,1.0,1.0,1.0,0.0,1.0
183
+ taq_Tfng,104,70,0,34,64493,1.0,0.673077,0.804598,1.0,0.0,0.673077
184
+ tat_Cyrl,201,201,0,0,64396,1.0,1.0,1.0,1.0,0.0,1.0
185
+ tel_Telu,555,553,0,2,64042,1.0,0.996396,0.998195,1.0,0.0,0.996396
186
+ tgk_Cyrl,413,413,0,0,64184,1.0,1.0,1.0,1.0,0.0,1.0
187
+ tha_Thai,431,414,0,17,64166,1.0,0.960557,0.979882,1.0,0.0,0.960557
188
+ tir_Ethi,339,331,0,8,64258,1.0,0.976401,0.98806,1.0,0.0,0.976401
189
+ ton_Latn,298,298,0,0,64299,1.0,1.0,1.0,1.0,0.0,1.0
190
+ tpi_Latn,302,302,1,0,64294,0.9967,1.0,0.998347,0.999984,15.553309,1.0
191
+ tsn_Latn,456,438,18,18,64123,0.960526,0.960526,0.960526,0.999719,280.631733,0.960526
192
+ tso_Latn,581,532,0,49,64016,1.0,0.915663,0.955975,1.0,0.0,0.915663
193
+ tuk_Latn,227,227,1,0,64369,0.995614,1.0,0.997802,0.999984,15.535187,1.0
194
+ tum_Latn,265,264,1,1,64331,0.996226,0.996226,0.996226,0.999984,15.544364,0.996226
195
+ tur_Latn,430,429,0,1,64167,1.0,0.997674,0.998836,1.0,0.0,0.997674
196
+ twi_Latn,359,353,0,6,64238,1.0,0.983287,0.991573,1.0,0.0,0.983287
197
+ tzm_Tfng,157,157,22,0,64418,0.877095,1.0,0.934524,0.999659,341.402855,1.0
198
+ udm_Cyrl,159,159,0,0,64438,1.0,1.0,1.0,1.0,0.0,1.0
199
+ uig_Arab,334,334,0,0,64263,1.0,1.0,1.0,1.0,0.0,1.0
200
+ ukr_Cyrl,322,322,0,0,64275,1.0,1.0,1.0,1.0,0.0,1.0
201
+ umb_Latn,100,100,1,0,64496,0.990099,1.0,0.995025,0.999984,15.504597,1.0
202
+ urd_Arab,257,257,0,0,64340,1.0,1.0,1.0,1.0,0.0,1.0
203
+ uzn_Latn,436,436,1,0,64160,0.997712,1.0,0.998855,0.999984,15.585792,1.0
204
+ vec_Latn,49,37,0,12,64548,1.0,0.755102,0.860465,1.0,0.0,0.755102
205
+ vie_Latn,338,338,0,0,64259,1.0,1.0,1.0,1.0,0.0,1.0
206
+ war_Latn,193,193,0,0,64404,1.0,1.0,1.0,1.0,0.0,1.0
207
+ wol_Latn,214,214,2,0,64381,0.990741,1.0,0.995349,0.999969,31.064101,1.0
208
+ xho_Latn,367,338,8,29,64222,0.976879,0.920981,0.948107,0.999875,124.55239,0.920981
209
+ xmf_Geor,132,132,0,0,64465,1.0,1.0,1.0,1.0,0.0,1.0
210
+ ydd_Hebr,430,430,0,0,64167,1.0,1.0,1.0,1.0,0.0,1.0
211
+ yor_Latn,308,308,1,0,64288,0.996764,1.0,0.998379,0.999984,15.554761,1.0
212
+ yue_Hani,194,159,1,35,64402,0.99375,0.819588,0.898305,0.999984,15.527227,0.819588
213
+ zsm_Latn,244,244,1,0,64352,0.995918,1.0,0.997955,0.999984,15.539291,1.0
214
+ zul_Latn,594,500,12,94,63991,0.976562,0.841751,0.904159,0.999813,187.491211,0.841751
reports/test-common/glotlid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9738223137297398,
3
+ "top3_accuracy": 0.9924609501989257,
4
+ "top5_accuracy": 0.9946437141043701,
5
+ "passages": 64597,
6
+ "languages": 213,
7
+ "macro_precision": 0.9924377815827973,
8
+ "macro_recall": 0.9770740040297234,
9
+ "macro_f1": 0.9835053354686013,
10
+ "macro_specificity": 0.9999660547959016,
11
+ "weighted_f1": 0.9823407826125089,
12
+ "median_f1": 0.9982788296041308,
13
+ "languages_f1_at_least_0_9": 201,
14
+ "languages_f1_below_0_5": 0,
15
+ "mean_fp_per_million": 33.94520409829502,
16
+ "micro_f1": 0.9738223137297398,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9946861840786043,
19
+ "sentence": 0.9876386996301343,
20
+ "short": 0.9593837123991196
21
+ }
22
+ }
reports/test-common/leaderboard.csv ADDED
@@ -0,0 +1,214 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,language,support,millid_f1,millid_precision,millid_recall,glotlid_f1,glotlid_precision,glotlid_recall,glotlid@millid_f1,glotlid@millid_precision,glotlid@millid_recall,fasttext_f1,fasttext_precision,fasttext_recall,fasttext@millid_f1,fasttext@millid_precision,fasttext@millid_recall,delta,winner,delta_fasttext,winner_fasttext
2
+ fra_Latn,French,1652,0.943,0.9946,0.8965,0.9548,1.0,0.9134,0.9548,1.0,0.9134,0.9632,0.9929,0.9352,0.9632,0.9929,0.9352,-0.0117,GlotLID,-0.0202,fastText
3
+ eng_Latn,English,1444,0.9324,0.9439,0.9211,0.876,0.9681,0.7999,0.8768,0.9682,0.8012,0.8574,0.8833,0.8331,0.8571,0.8803,0.8352,0.0555,MillID,0.0752,MillID
4
+ spa_Latn,Spanish,1136,0.937,0.9817,0.8961,0.9583,0.999,0.9208,0.9583,0.999,0.9208,0.9407,0.9763,0.9076,0.9407,0.9763,0.9076,-0.0214,GlotLID,-0.0037,tie
5
+ tam_Taml,Tamil,754,0.9973,1.0,0.9947,1.0,1.0,1.0,1.0,1.0,1.0,0.9973,1.0,0.9947,0.9973,1.0,0.9947,-0.0027,tie,0.0,tie
6
+ arb_Arab,Arabic (Modern Standard),745,0.8712,1.0,0.7718,0.8864,1.0,0.796,0.8864,1.0,0.796,0.9573,0.9249,0.9919,0.9542,0.9192,0.9919,-0.0152,GlotLID,-0.083,fastText
7
+ por_Latn,Portuguese,657,0.9589,0.9763,0.9422,0.9538,0.9488,0.9589,0.9562,0.949,0.9635,0.95,0.9313,0.9696,0.9493,0.9299,0.9696,0.0028,tie,0.0096,tie
8
+ kan_Knda,Kannada,601,0.9726,1.0,0.9468,0.9941,1.0,0.9884,0.9941,1.0,0.9884,0.9992,1.0,0.9983,0.9992,1.0,0.9983,-0.0215,GlotLID,-0.0265,fastText
9
+ zul_Latn,Zulu,594,0.883,0.9326,0.8384,0.9042,0.9766,0.8418,0.9042,0.9766,0.8418,0.9704,0.9761,0.9646,0.9704,0.9761,0.9646,-0.0212,GlotLID,-0.0874,fastText
10
+ swh_Latn,Swahili,592,0.893,0.9938,0.8108,0.9536,0.9891,0.9206,0.9528,0.9873,0.9206,0.9454,0.9269,0.9645,0.9454,0.9269,0.9645,-0.0598,GlotLID,-0.0523,fastText
11
+ mar_Deva,Marathi,589,0.9683,0.9775,0.9593,0.9888,1.0,0.9779,0.9897,1.0,0.9796,0.9871,0.9983,0.9762,0.9871,0.9983,0.9762,-0.0214,GlotLID,-0.0188,fastText
12
+ tso_Latn,Tsonga,581,0.9789,0.9982,0.9604,0.956,1.0,0.9157,0.956,1.0,0.9157,0.9861,0.9965,0.9759,0.9861,0.9965,0.9759,0.023,MillID,-0.0071,tie
13
+ hun_Latn,Hungarian,576,0.9886,0.9947,0.9826,1.0,1.0,1.0,1.0,1.0,1.0,0.9804,0.9616,1.0,0.9804,0.9616,1.0,-0.0114,GlotLID,0.0082,tie
14
+ afr_Latn,Afrikaans,569,0.9716,0.9803,0.9631,0.9849,0.9946,0.9754,0.9849,0.9946,0.9754,0.9858,0.9929,0.9789,0.9858,0.9929,0.9789,-0.0133,GlotLID,-0.0142,fastText
15
+ tel_Telu,Telugu,555,0.9973,1.0,0.9946,0.9982,1.0,0.9964,0.9982,1.0,0.9964,0.9991,1.0,0.9982,0.9991,1.0,0.9982,-0.0009,tie,-0.0018,tie
16
+ rus_Cyrl,Russian,528,0.9453,0.9958,0.8996,0.9846,1.0,0.9697,0.9846,1.0,0.9697,0.9271,0.9397,0.9148,0.9271,0.9397,0.9148,-0.0393,GlotLID,0.0182,MillID
17
+ ory_Orya,Odia (individual language),511,0.9941,1.0,0.9883,0.9971,1.0,0.9941,1.0,1.0,1.0,0.9961,1.0,0.9922,0.9961,1.0,0.9922,-0.0059,tie,-0.002,tie
18
+ sot_Latn,Southern Sotho,491,0.9694,0.9714,0.9674,0.9774,0.9875,0.9674,0.9784,0.9876,0.9695,0.8562,0.974,0.7637,0.8562,0.974,0.7637,-0.009,tie,0.1132,MillID
19
+ nso_Latn,Northern Sotho,479,0.9579,0.966,0.9499,0.9695,0.9767,0.9624,0.9695,0.9767,0.9624,0.9673,0.9786,0.9562,0.9673,0.9786,0.9562,-0.0116,GlotLID,-0.0094,tie
20
+ asm_Beng,Assamese,467,0.9968,1.0,0.9936,0.9989,1.0,0.9979,0.9989,1.0,0.9979,0.9968,0.9979,0.9957,0.9968,0.9979,0.9957,-0.0022,tie,-0.0,tie
21
+ ben_Beng,Bangla,466,0.9882,0.9872,0.9893,0.9968,0.9978,0.9957,0.9968,0.9978,0.9957,0.9894,0.981,0.9979,0.9894,0.981,0.9979,-0.0086,tie,-0.0012,tie
22
+ pan_Guru,Punjabi,460,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9901,1.0,0.9804,0.9901,1.0,0.9804,0.0,tie,0.0099,tie
23
+ amh_Ethi,Amharic,458,0.9835,0.989,0.9782,1.0,1.0,1.0,1.0,1.0,1.0,0.9978,0.9957,1.0,0.9978,0.9957,1.0,-0.0165,GlotLID,-0.0143,fastText
24
+ tsn_Latn,Tswana,456,0.9475,0.9454,0.9496,0.9605,0.9605,0.9605,0.9605,0.9605,0.9605,0.8698,0.7903,0.9671,0.8698,0.7903,0.9671,-0.013,GlotLID,0.0777,MillID
25
+ gaz_Latn,Oromo (West Central),441,0.9354,0.9899,0.8866,0.9744,1.0,0.9501,0.9744,1.0,0.9501,0.9733,0.9953,0.9524,0.9733,0.9953,0.9524,-0.039,GlotLID,-0.0379,fastText
26
+ som_Latn,Somali,439,0.9839,0.9953,0.9727,0.9954,1.0,0.9909,0.9954,1.0,0.9909,0.9909,0.9887,0.9932,0.9909,0.9887,0.9932,-0.0116,GlotLID,-0.007,tie
27
+ uzn_Latn,Northern Uzbek,436,0.9839,0.9884,0.9794,0.9989,0.9977,1.0,0.9989,0.9977,1.0,0.9849,0.9953,0.9748,0.9849,0.9953,0.9748,-0.015,GlotLID,-0.0011,tie
28
+ tha_Thai,Thai,431,0.9799,1.0,0.9606,0.9799,1.0,0.9606,0.9799,1.0,0.9606,0.9811,1.0,0.9629,0.9811,1.0,0.9629,0.0,tie,-0.0012,tie
29
+ ydd_Hebr,Eastern Yiddish,430,0.993,1.0,0.986,1.0,1.0,1.0,1.0,1.0,1.0,0.9988,1.0,0.9977,0.9988,1.0,0.9977,-0.007,tie,-0.0059,tie
30
+ tur_Latn,Turkish,430,0.968,0.9855,0.9512,0.9988,1.0,0.9977,0.9988,1.0,0.9977,0.9803,0.9769,0.9837,0.9803,0.9769,0.9837,-0.0308,GlotLID,-0.0123,fastText
31
+ nno_Latn,Norwegian Nynorsk,427,0.9132,0.9275,0.8993,0.9845,1.0,0.9696,0.9845,1.0,0.9696,0.9542,0.9575,0.9508,0.9542,0.9575,0.9508,-0.0713,GlotLID,-0.041,fastText
32
+ smo_Latn,Samoan,426,0.9905,0.9976,0.9836,0.9988,0.9977,1.0,0.9988,0.9977,1.0,0.9372,0.897,0.9812,0.9372,0.897,0.9812,-0.0083,tie,0.0533,MillID
33
+ pap_Latn,Papiamento,423,0.9784,0.9951,0.9622,0.9988,0.9976,1.0,0.9988,0.9976,1.0,0.9742,0.9652,0.9835,0.9731,0.963,0.9835,-0.0205,GlotLID,0.0053,tie
34
+ ckb_Arab,Central Kurdish,421,0.9554,0.9974,0.9169,0.9769,1.0,0.9549,0.9769,1.0,0.9549,0.9952,1.0,0.9905,0.9952,1.0,0.9905,-0.0215,GlotLID,-0.0398,fastText
35
+ pbt_Arab,Southern Pashto,419,0.9855,0.9976,0.9737,0.9988,0.9976,1.0,0.9988,0.9976,1.0,0.9782,0.9951,0.9618,0.977,0.9926,0.9618,-0.0133,GlotLID,0.0085,tie
36
+ ekk_Latn,Estonian,419,0.9709,0.9853,0.957,0.9929,0.9859,1.0,0.9929,0.9859,1.0,0.9857,0.9811,0.9905,0.9857,0.9811,0.9905,-0.0219,GlotLID,-0.0148,fastText
37
+ sna_Latn,Shona,415,0.9817,0.995,0.9687,1.0,1.0,1.0,1.0,1.0,1.0,0.9831,0.9831,0.9831,0.9831,0.9831,0.9831,-0.0183,GlotLID,-0.0014,tie
38
+ luo_Latn,Luo (Kenya and Tanzania),415,0.9879,0.9951,0.9807,1.0,1.0,1.0,1.0,1.0,1.0,0.9564,0.9897,0.9253,0.9564,0.9897,0.9253,-0.0121,GlotLID,0.0315,MillID
39
+ tgk_Cyrl,Tajik,413,0.9951,1.0,0.9903,1.0,1.0,1.0,1.0,1.0,1.0,0.983,0.9878,0.9782,0.983,0.9878,0.9782,-0.0049,tie,0.0122,MillID
40
+ bod_Tibt,Tibetan,406,0.9354,0.9093,0.9631,0.9988,1.0,0.9975,0.9988,1.0,0.9975,0.8191,0.721,0.9483,0.8191,0.721,0.9483,-0.0634,GlotLID,0.1163,MillID
41
+ lug_Latn,Ganda,405,0.9682,1.0,0.9383,0.9863,0.995,0.9778,0.9876,0.995,0.9802,0.979,0.9802,0.9778,0.979,0.9802,0.9778,-0.0194,GlotLID,-0.0108,fastText
42
+ fas_Arab,Persian,396,0.945,0.981,0.9116,0.9859,1.0,0.9722,0.9859,1.0,0.9722,0.9439,0.9127,0.9773,0.9439,0.9127,0.9773,-0.0409,GlotLID,0.0011,tie
43
+ ell_Grek,Greek,394,0.901,1.0,0.8198,0.9987,1.0,0.9975,0.9987,1.0,0.9975,0.97,0.9973,0.9442,0.97,0.9973,0.9442,-0.0978,GlotLID,-0.069,fastText
44
+ hin_Deva,Hindi,392,0.8552,0.9417,0.7832,0.8768,1.0,0.7806,0.8768,1.0,0.7806,0.863,0.8159,0.9158,0.863,0.8159,0.9158,-0.0216,GlotLID,-0.0078,tie
45
+ lus_Latn,Mizo,391,0.9831,1.0,0.9668,0.9974,0.9949,1.0,0.9974,0.9949,1.0,0.9897,1.0,0.9795,0.9897,1.0,0.9795,-0.0144,GlotLID,-0.0066,tie
46
+ dyu_Latn,Dyula,390,0.9658,0.9919,0.941,1.0,1.0,1.0,1.0,1.0,1.0,0.8223,0.9622,0.7179,0.8223,0.9622,0.7179,-0.0342,GlotLID,0.1435,MillID
47
+ slk_Latn,Slovak,374,0.9515,0.9592,0.9439,0.9987,0.9973,1.0,0.9987,0.9973,1.0,0.9714,0.9889,0.9545,0.9714,0.9889,0.9545,-0.0472,GlotLID,-0.0199,fastText
48
+ ron_Latn,Romanian,369,0.9672,0.9752,0.9593,0.9959,0.9946,0.9973,0.9959,0.9946,0.9973,0.9759,0.9631,0.9892,0.9759,0.9631,0.9892,-0.0287,GlotLID,-0.0087,tie
49
+ kal_Latn,Kalaallisut,369,0.9986,0.9973,1.0,0.9986,0.9973,1.0,0.9986,0.9973,1.0,0.9932,1.0,0.9864,0.9932,1.0,0.9864,0.0,tie,0.0055,tie
50
+ azb_Arab,South Azerbaijani,369,0.9586,0.9775,0.9404,0.9959,0.9973,0.9946,0.9959,0.9973,0.9946,0.9711,0.986,0.9566,0.9711,0.986,0.9566,-0.0374,GlotLID,-0.0126,fastText
51
+ fin_Latn,Finnish,368,0.9291,0.9938,0.8723,1.0,1.0,1.0,1.0,1.0,1.0,0.9946,0.9973,0.9918,0.9946,0.9973,0.9918,-0.0709,GlotLID,-0.0655,fastText
52
+ hau_Latn,Hausa,367,0.971,0.986,0.9564,0.9932,0.9892,0.9973,0.9932,0.9892,0.9973,0.9851,0.9811,0.9891,0.9837,0.9784,0.9891,-0.0223,GlotLID,-0.0128,fastText
53
+ xho_Latn,Xhosa,367,0.8953,0.9455,0.8501,0.9481,0.9769,0.921,0.9481,0.9769,0.921,0.9511,0.9485,0.9537,0.9511,0.9485,0.9537,-0.0528,GlotLID,-0.0558,fastText
54
+ kng_Latn,Koongo,362,0.9446,1.0,0.895,1.0,1.0,1.0,1.0,1.0,1.0,0.9718,0.9942,0.9503,0.9718,0.9942,0.9503,-0.0554,GlotLID,-0.0271,fastText
55
+ twi_Latn,Twi,359,0.9773,0.9971,0.9582,0.9916,1.0,0.9833,0.9902,0.9972,0.9833,0.9684,0.9541,0.9833,0.9684,0.9541,0.9833,-0.0129,GlotLID,0.0088,tie
56
+ deu_Latn,German,356,0.9802,0.9858,0.9747,0.9972,0.9944,1.0,0.9972,0.9944,1.0,0.9889,0.978,1.0,0.9889,0.978,1.0,-0.017,GlotLID,-0.0087,tie
57
+ guj_Gujr,Gujarati,354,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9842,1.0,0.9689,0.9842,1.0,0.9689,0.0,tie,0.0158,MillID
58
+ dik_Latn,Southwestern Dinka,350,0.9928,1.0,0.9857,1.0,1.0,1.0,1.0,1.0,1.0,0.99,0.9858,0.9943,0.99,0.9858,0.9943,-0.0072,tie,0.0028,tie
59
+ lua_Latn,Luba-Lulua,346,0.9794,1.0,0.9595,0.9971,0.9943,1.0,0.9971,0.9943,1.0,0.9633,0.9791,0.948,0.9633,0.9791,0.948,-0.0178,GlotLID,0.0161,MillID
60
+ dzo_Tibt,Dzongkha,346,0.9061,0.9522,0.8642,0.9986,0.9971,1.0,0.9986,0.9971,1.0,0.6958,0.9409,0.552,0.6958,0.9409,0.552,-0.0925,GlotLID,0.2103,MillID
61
+ che_Cyrl,Chechen,345,0.9778,0.997,0.9594,1.0,1.0,1.0,1.0,1.0,1.0,0.984,0.9883,0.9797,0.984,0.9883,0.9797,-0.0222,GlotLID,-0.0061,tie
62
+ fij_Latn,Fijian,344,0.9883,0.9912,0.9855,1.0,1.0,1.0,1.0,1.0,1.0,0.9884,0.9884,0.9884,0.9884,0.9884,0.9884,-0.0117,GlotLID,-0.0,tie
63
+ ita_Latn,Italian,342,0.9216,0.9932,0.8596,0.9838,0.994,0.9737,0.9838,0.994,0.9737,0.949,0.9203,0.9795,0.949,0.9203,0.9795,-0.0621,GlotLID,-0.0274,fastText
64
+ mya_Mymr,Burmese,342,0.9745,1.0,0.9503,1.0,1.0,1.0,1.0,1.0,1.0,0.9897,1.0,0.9795,0.9897,1.0,0.9795,-0.0255,GlotLID,-0.0151,fastText
65
+ kaz_Cyrl,Kazakh,340,0.9836,1.0,0.9676,1.0,1.0,1.0,1.0,1.0,1.0,0.9926,0.9941,0.9912,0.9926,0.9941,0.9912,-0.0164,GlotLID,-0.0091,tie
66
+ tir_Ethi,Tigrinya,339,0.9824,0.9795,0.9853,0.9881,1.0,0.9764,0.9985,1.0,0.9971,0.9956,1.0,0.9912,0.9956,1.0,0.9912,-0.0162,GlotLID,-0.0132,fastText
67
+ mal_Mlym,Malayalam,338,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.994,1.0,0.9882,0.994,1.0,0.9882,0.0,tie,0.006,tie
68
+ hat_Latn,Haitian Creole,338,0.9865,1.0,0.9734,0.997,0.997,0.997,0.997,0.997,0.997,0.9774,0.9939,0.9615,0.9774,0.9939,0.9615,-0.0105,GlotLID,0.0091,tie
69
+ ceb_Latn,Cebuano,338,0.9807,0.9851,0.9763,1.0,1.0,1.0,1.0,1.0,1.0,0.9926,0.9883,0.997,0.9926,0.9883,0.997,-0.0193,GlotLID,-0.012,fastText
70
+ vie_Latn,Vietnamese,338,0.9519,1.0,0.9083,1.0,1.0,1.0,1.0,1.0,1.0,0.9836,0.994,0.9734,0.9836,0.994,0.9734,-0.0481,GlotLID,-0.0316,fastText
71
+ slv_Latn,Slovenian,338,0.96,0.9614,0.9586,0.9927,0.9854,1.0,0.9927,0.9854,1.0,0.9653,0.9846,0.9467,0.9653,0.9846,0.9467,-0.0327,GlotLID,-0.0053,tie
72
+ lao_Laoo,Lao,335,0.997,1.0,0.994,1.0,1.0,1.0,1.0,1.0,1.0,0.991,1.0,0.9821,0.991,1.0,0.9821,-0.003,tie,0.006,tie
73
+ chv_Cyrl,Chuvash,335,0.9985,1.0,0.997,1.0,1.0,1.0,1.0,1.0,1.0,0.9926,0.9853,1.0,0.9926,0.9853,1.0,-0.0015,tie,0.0059,tie
74
+ ind_Latn,Indonesian,335,0.8419,0.8849,0.803,0.9911,0.9824,1.0,0.9911,0.9824,1.0,0.8873,0.8497,0.9284,0.8873,0.8497,0.9284,-0.1492,GlotLID,-0.0454,fastText
75
+ uig_Arab,Uyghur,334,0.9955,0.997,0.994,1.0,1.0,1.0,1.0,1.0,1.0,0.9911,0.9852,0.997,0.9911,0.9852,0.997,-0.0045,tie,0.0044,tie
76
+ oci_Latn,Occitan,333,0.9574,0.9692,0.9459,0.9911,0.9823,1.0,0.9911,0.9823,1.0,0.9619,0.9398,0.985,0.9619,0.9398,0.985,-0.0336,GlotLID,-0.0044,tie
77
+ mkd_Cyrl,Macedonian,331,0.9727,0.9757,0.9698,1.0,1.0,1.0,1.0,1.0,1.0,0.9924,0.9939,0.9909,0.9924,0.9939,0.9909,-0.0273,GlotLID,-0.0197,fastText
78
+ lit_Latn,Lithuanian,330,0.9676,0.9843,0.9515,0.9955,0.991,1.0,0.9955,0.991,1.0,0.974,0.9815,0.9667,0.974,0.9815,0.9667,-0.0278,GlotLID,-0.0064,tie
79
+ swe_Latn,Swedish,328,0.9588,0.9602,0.9573,0.9717,0.9504,0.9939,0.9717,0.9504,0.9939,0.9767,0.9968,0.9573,0.9767,0.9968,0.9573,-0.0129,GlotLID,-0.0179,fastText
80
+ snd_Arab,Sindhi,325,0.9891,0.9969,0.9815,1.0,1.0,1.0,1.0,1.0,1.0,0.9848,0.973,0.9969,0.9833,0.9701,0.9969,-0.0109,GlotLID,0.0058,tie
81
+ kat_Geor,Georgian,324,0.9954,0.9969,0.9938,1.0,1.0,1.0,1.0,1.0,1.0,0.9859,1.0,0.9722,0.9859,1.0,0.9722,-0.0046,tie,0.0094,tie
82
+ jpn_Jpan,Japanese,323,0.9746,1.0,0.9505,0.9969,0.9938,1.0,0.9969,0.9938,1.0,0.8684,0.9695,0.7864,0.8684,0.9695,0.7864,-0.0223,GlotLID,0.1062,MillID
83
+ ssw_Latn,Swati,322,0.9537,0.9803,0.9286,0.9684,0.9871,0.9503,0.97,0.9871,0.9534,0.9721,0.9691,0.9752,0.9721,0.9691,0.9752,-0.0162,GlotLID,-0.0184,fastText
84
+ ukr_Cyrl,Ukrainian,322,0.9617,0.9901,0.9348,1.0,1.0,1.0,1.0,1.0,1.0,0.9783,0.9753,0.9814,0.9783,0.9753,0.9814,-0.0383,GlotLID,-0.0167,fastText
85
+ szl_Latn,Silesian,320,0.9556,0.971,0.9406,0.9969,0.9938,1.0,0.9969,0.9938,1.0,0.9254,0.9859,0.8719,0.9254,0.9859,0.8719,-0.0413,GlotLID,0.0302,MillID
86
+ cat_Latn,Catalan,318,0.9497,0.9497,0.9497,0.9845,0.9695,1.0,0.9845,0.9695,1.0,0.9528,0.9528,0.9528,0.9528,0.9528,0.9528,-0.0348,GlotLID,-0.0031,tie
87
+ ayr_Latn,Central Aymara,309,0.9886,0.9967,0.9806,1.0,1.0,1.0,1.0,1.0,1.0,0.9752,0.9966,0.9547,0.9752,0.9966,0.9547,-0.0114,GlotLID,0.0134,MillID
88
+ yor_Latn,Yoruba,308,0.987,0.9902,0.9838,0.9984,0.9968,1.0,0.9984,0.9968,1.0,0.9683,0.9472,0.9903,0.9683,0.9472,0.9903,-0.0114,GlotLID,0.0187,MillID
89
+ ewe_Latn,Ewe,308,0.9902,0.9967,0.9838,1.0,1.0,1.0,1.0,1.0,1.0,0.9852,0.9967,0.974,0.9852,0.9967,0.974,-0.0098,tie,0.005,tie
90
+ roh_Latn,Romansh,307,0.9789,0.9773,0.9805,1.0,1.0,1.0,1.0,1.0,1.0,0.9742,0.9649,0.9837,0.9742,0.9649,0.9837,-0.0211,GlotLID,0.0047,tie
91
+ mni_Beng,Manipuri,304,0.9501,0.9964,0.9079,1.0,1.0,1.0,1.0,1.0,1.0,0.9499,1.0,0.9046,0.9499,1.0,0.9046,-0.0499,GlotLID,0.0002,tie
92
+ tpi_Latn,Tok Pisin,302,0.9934,0.9967,0.9901,0.9983,0.9967,1.0,0.9983,0.9967,1.0,0.9867,0.9933,0.9801,0.9867,0.9933,0.9801,-0.005,tie,0.0067,tie
93
+ lvs_Latn,Standard Latvian,298,0.9603,0.9893,0.9329,0.995,0.99,1.0,0.995,0.99,1.0,0.9472,0.9619,0.9329,0.9472,0.9619,0.9329,-0.0347,GlotLID,0.0131,MillID
94
+ ton_Latn,Tongan,298,0.9966,1.0,0.9933,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0034,tie,0.9966,MillID
95
+ epo_Latn,Esperanto,294,0.976,0.9828,0.9694,0.9983,1.0,0.9966,0.9983,1.0,0.9966,0.9882,0.9799,0.9966,0.9882,0.9799,0.9966,-0.0223,GlotLID,-0.0122,fastText
96
+ knc_Latn,Central Kanuri,293,0.9666,0.9964,0.9386,0.9517,1.0,0.9078,0.9517,1.0,0.9078,0.9811,0.9862,0.9761,0.9811,0.9862,0.9761,0.0149,MillID,-0.0145,fastText
97
+ run_Latn,Rundi,291,0.8832,0.8832,0.8832,0.9848,0.97,1.0,0.9848,0.97,1.0,0.8545,0.9347,0.7869,0.8545,0.9347,0.7869,-0.1016,GlotLID,0.0287,MillID
98
+ mlt_Latn,Maltese,291,0.9948,0.9966,0.9931,0.9932,0.9864,1.0,0.9932,0.9864,1.0,0.9614,0.9821,0.9416,0.9614,0.9821,0.9416,0.0017,tie,0.0334,MillID
99
+ bho_Deva,Bhojpuri,290,0.9556,0.9459,0.9655,0.9983,0.9966,1.0,0.9983,0.9966,1.0,0.8732,0.9198,0.831,0.8732,0.9198,0.831,-0.0426,GlotLID,0.0824,MillID
100
+ bak_Cyrl,Bashkir,289,0.9825,0.9929,0.9723,1.0,1.0,1.0,1.0,1.0,1.0,0.9846,0.9762,0.9931,0.9846,0.9762,0.9931,-0.0175,GlotLID,-0.002,tie
101
+ kmr_Latn,Northern Kurdish,289,0.9791,0.986,0.9723,1.0,1.0,1.0,1.0,1.0,1.0,0.9747,0.9507,1.0,0.9747,0.9507,1.0,-0.0209,GlotLID,0.0044,tie
102
+ bul_Cyrl,Bulgarian,289,0.9636,0.9653,0.9619,1.0,1.0,1.0,1.0,1.0,1.0,0.9827,0.9827,0.9827,0.9827,0.9827,0.9827,-0.0364,GlotLID,-0.0191,fastText
103
+ cmn_Hani,Chinese (Mandarin),288,0.9149,0.9348,0.8958,0.9663,0.9379,0.9965,0.9663,0.9379,0.9965,0.4884,0.9406,0.3299,0.4884,0.9406,0.3299,-0.0514,GlotLID,0.4265,MillID
104
+ bam_Latn,Bambara,287,0.9521,0.936,0.9686,0.9983,0.9965,1.0,0.9983,0.9965,1.0,0.7923,0.6899,0.9303,0.7923,0.6899,0.9303,-0.0462,GlotLID,0.1598,MillID
105
+ abk_Cyrl,Abkhazian,285,0.9965,1.0,0.993,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0035,tie,-0.0035,tie
106
+ bxr_Cyrl,Russia Buriat,277,0.9726,0.9852,0.9603,1.0,1.0,1.0,1.0,1.0,1.0,0.9387,1.0,0.8845,0.9387,1.0,0.8845,-0.0274,GlotLID,0.0339,MillID
107
+ isl_Latn,Icelandic,276,0.949,0.9921,0.9094,1.0,1.0,1.0,1.0,1.0,1.0,0.7886,0.6509,1.0,0.7886,0.6509,1.0,-0.051,GlotLID,0.1604,MillID
108
+ lmo_Latn,Lombard,276,0.9149,0.9565,0.8768,0.9875,0.9753,1.0,0.9875,0.9753,1.0,0.9097,0.9065,0.913,0.9081,0.9032,0.913,-0.0725,GlotLID,0.0068,tie
109
+ npi_Deva,Nepali,273,0.9649,0.9739,0.956,0.9908,0.9926,0.989,0.9927,0.9927,0.9927,0.9745,0.9675,0.9817,0.9745,0.9675,0.9817,-0.0278,GlotLID,-0.0097,tie
110
+ kam_Latn,Kamba,272,0.9795,0.9925,0.9669,0.9716,1.0,0.9449,0.9736,1.0,0.9485,0.8625,0.9952,0.761,0.8625,0.9952,0.761,0.0059,tie,0.117,MillID
111
+ quy_Latn,Ayacucho Quechua,271,0.9398,0.9918,0.893,0.9246,1.0,0.8598,0.9331,1.0,0.8745,0.9794,0.9924,0.9668,0.9794,0.9924,0.9668,0.0067,tie,-0.0396,fastText
112
+ srp_Cyrl,Serbian,269,0.974,0.974,0.974,1.0,1.0,1.0,1.0,1.0,1.0,0.9834,0.9779,0.9888,0.9834,0.9779,0.9888,-0.026,GlotLID,-0.0094,tie
113
+ nob_Latn,Norwegian Bokmål,265,0.8207,0.8043,0.8377,0.9612,0.942,0.9811,0.9594,0.9386,0.9811,0.8942,0.8796,0.9094,0.8942,0.8796,0.9094,-0.1387,GlotLID,-0.0735,fastText
114
+ kor_Hang,Korean,265,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8237,0.7021,0.9962,0.8237,0.7021,0.9962,0.0,tie,0.1763,MillID
115
+ tum_Latn,Tumbuka,265,0.9773,0.981,0.9736,0.9962,0.9962,0.9962,0.9962,0.9962,0.9962,0.9662,0.9625,0.9698,0.9662,0.9625,0.9698,-0.019,GlotLID,0.0111,MillID
116
+ khk_Cyrl,Halh Mongolian,262,0.9774,0.9664,0.9885,1.0,1.0,1.0,1.0,1.0,1.0,0.9205,0.8925,0.9504,0.9205,0.8925,0.9504,-0.0226,GlotLID,0.0568,MillID
117
+ nya_Latn,Nyanja,262,0.9518,0.9611,0.9427,0.9786,0.996,0.9618,0.9786,0.996,0.9618,0.9259,0.9747,0.8817,0.9259,0.9747,0.8817,-0.0268,GlotLID,0.026,MillID
118
+ nld_Latn,Dutch,259,0.9363,0.9671,0.9073,0.9719,0.9453,1.0,0.9719,0.9453,1.0,0.9597,0.9542,0.9653,0.9597,0.9542,0.9653,-0.0356,GlotLID,-0.0234,fastText
119
+ ltg_Latn,Latgalian,259,0.9656,0.9547,0.9768,0.9981,0.9962,1.0,0.9981,0.9962,1.0,0.9647,0.9801,0.9498,0.9647,0.9801,0.9498,-0.0324,GlotLID,0.0009,tie
120
+ ibo_Latn,Igbo,257,0.9922,0.9961,0.9883,0.9981,0.9961,1.0,0.9981,0.9961,1.0,0.9922,0.9961,0.9883,0.9922,0.9961,0.9883,-0.0059,tie,0.0,tie
121
+ bis_Latn,Bislama,257,0.9862,1.0,0.9728,1.0,1.0,1.0,1.0,1.0,1.0,0.9681,0.9918,0.9455,0.9681,0.9918,0.9455,-0.0138,GlotLID,0.0181,MillID
122
+ urd_Arab,Urdu,257,0.9622,0.9837,0.9416,1.0,1.0,1.0,1.0,1.0,1.0,0.9345,0.8771,1.0,0.9345,0.8771,1.0,-0.0378,GlotLID,0.0277,MillID
123
+ pol_Latn,Polish,254,0.9565,0.9603,0.9528,0.9844,0.9731,0.9961,0.9844,0.9731,0.9961,0.92,0.8547,0.9961,0.92,0.8547,0.9961,-0.0279,GlotLID,0.0365,MillID
124
+ eus_Latn,Basque,254,0.9782,0.9841,0.9724,0.9922,0.9845,1.0,0.9922,0.9845,1.0,0.9862,0.9843,0.9882,0.9862,0.9843,0.9882,-0.014,GlotLID,-0.008,tie
125
+ ilo_Latn,Iloko,252,0.9901,0.992,0.9881,1.0,1.0,1.0,1.0,1.0,1.0,0.9735,1.0,0.9484,0.9735,1.0,0.9484,-0.0099,tie,0.0165,MillID
126
+ ltz_Latn,Luxembourgish,251,0.9742,0.9722,0.9761,1.0,1.0,1.0,1.0,1.0,1.0,0.9544,0.9127,1.0,0.9544,0.9127,1.0,-0.0258,GlotLID,0.0198,MillID
127
+ pcm_Latn,Nigerian Pidgin,251,0.8228,0.9126,0.749,0.838,0.9151,0.7729,0.8559,0.914,0.8048,0.5015,1.0,0.3347,0.5407,1.0,0.3705,-0.0332,GlotLID,0.2821,MillID
128
+ arn_Latn,Mapuche,250,0.992,0.996,0.988,1.0,1.0,1.0,1.0,1.0,1.0,0.9585,0.9957,0.924,0.9585,0.9957,0.924,-0.008,tie,0.0335,MillID
129
+ plt_Latn,Malagasy (Plateau),248,0.9691,0.9916,0.9476,0.998,0.996,1.0,0.998,0.996,1.0,0.9818,0.9838,0.9798,0.9818,0.9838,0.9798,-0.0289,GlotLID,-0.0127,fastText
130
+ lij_Latn,Ligurian,245,0.9379,0.9865,0.8939,0.998,0.9959,1.0,0.998,0.9959,1.0,0.8571,0.9643,0.7714,0.8571,0.9643,0.7714,-0.0601,GlotLID,0.0808,MillID
131
+ ast_Latn,Asturian,244,0.9188,0.9598,0.8811,0.9702,0.9421,1.0,0.9702,0.9421,1.0,0.9333,0.9203,0.9467,0.9333,0.9203,0.9467,-0.0514,GlotLID,-0.0145,fastText
132
+ zsm_Latn,Standard Malay,244,0.7891,0.8043,0.7746,0.998,0.9959,1.0,0.998,0.9959,1.0,0.9079,0.9274,0.8893,0.9079,0.9274,0.8893,-0.2088,GlotLID,-0.1188,fastText
133
+ nia_Latn,Nias,242,0.9979,1.0,0.9959,1.0,1.0,1.0,1.0,1.0,1.0,0.9876,0.9876,0.9876,0.9876,0.9876,0.9876,-0.0021,tie,0.0103,MillID
134
+ dan_Latn,Danish,242,0.8874,0.9318,0.8471,0.9499,0.9222,0.9793,0.9499,0.9222,0.9793,0.9623,0.9746,0.9504,0.9623,0.9746,0.9504,-0.0625,GlotLID,-0.0749,fastText
135
+ kir_Cyrl,Kyrgyz,242,0.9733,0.9673,0.9793,1.0,1.0,1.0,1.0,1.0,1.0,0.9279,0.8782,0.9835,0.9279,0.8782,0.9835,-0.0267,GlotLID,0.0454,MillID
136
+ tah_Latn,Tahitian,242,0.9833,0.9916,0.9752,1.0,1.0,1.0,1.0,1.0,1.0,0.9917,1.0,0.9835,0.9917,1.0,0.9835,-0.0167,GlotLID,-0.0083,tie
137
+ san_Deva,Sanskrit,239,0.9895,0.9916,0.9874,0.9895,0.9958,0.9833,0.9895,0.9958,0.9833,0.9705,0.9787,0.9623,0.9705,0.9787,0.9623,0.0,tie,0.0191,MillID
138
+ fao_Latn,Faroese,237,0.975,0.963,0.9873,1.0,1.0,1.0,1.0,1.0,1.0,0.4808,1.0,0.3165,0.4808,1.0,0.3165,-0.025,GlotLID,0.4942,MillID
139
+ sag_Latn,Sango,237,0.9936,1.0,0.9873,1.0,1.0,1.0,1.0,1.0,1.0,0.985,1.0,0.9705,0.985,1.0,0.9705,-0.0064,tie,0.0086,tie
140
+ mai_Deva,Maithili,234,0.9258,0.9763,0.8803,0.9957,0.9915,1.0,0.9957,0.9915,1.0,0.9196,0.8884,0.953,0.9196,0.8884,0.953,-0.0699,GlotLID,0.0063,tie
141
+ sin_Sinh,Sinhala,232,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9978,1.0,0.9957,0.9978,1.0,0.9957,0.0,tie,0.0022,tie
142
+ gug_Latn,Paraguayan Guaraní,228,0.9686,0.9908,0.9474,0.9956,0.9913,1.0,0.9956,0.9913,1.0,0.933,0.9854,0.886,0.933,0.9854,0.886,-0.027,GlotLID,0.0356,MillID
143
+ tuk_Latn,Turkmen,227,0.9799,0.9955,0.9648,0.9978,0.9956,1.0,0.9978,0.9956,1.0,0.9821,1.0,0.9648,0.9821,1.0,0.9648,-0.0179,GlotLID,-0.0022,tie
144
+ gla_Latn,Scottish Gaelic,223,0.9888,0.991,0.9865,0.9955,0.9911,1.0,0.9955,0.9911,1.0,0.9818,0.9954,0.9686,0.9818,0.9954,0.9686,-0.0068,tie,0.0069,tie
145
+ bem_Latn,Bemba,222,0.9729,0.9773,0.9685,0.9841,0.9954,0.973,0.9818,0.9908,0.973,0.9643,0.9558,0.973,0.9643,0.9558,0.973,-0.009,tie,0.0086,tie
146
+ fur_Latn,Friulian,221,0.9484,0.9854,0.914,0.9955,0.991,1.0,0.9955,0.991,1.0,0.9138,0.9423,0.8869,0.9074,0.9289,0.8869,-0.0471,GlotLID,0.0409,MillID
147
+ kac_Latn,Kachin,216,0.9977,1.0,0.9954,1.0,1.0,1.0,1.0,1.0,1.0,0.986,0.9953,0.9769,0.986,0.9953,0.9769,-0.0023,tie,0.0117,MillID
148
+ glg_Latn,Galician,215,0.9517,0.9409,0.9628,0.9663,0.9348,1.0,0.9663,0.9348,1.0,0.9316,0.8866,0.9814,0.9316,0.8866,0.9814,-0.0146,GlotLID,0.0202,MillID
149
+ lin_Latn,Lingala,215,0.9789,0.9858,0.9721,0.9953,0.9953,0.9953,0.9953,0.9953,0.9953,0.9838,0.9815,0.986,0.9838,0.9815,0.986,-0.0164,GlotLID,-0.0048,tie
150
+ wol_Latn,Wolof,214,0.969,0.9902,0.9486,0.9953,0.9907,1.0,0.9953,0.9907,1.0,0.9555,0.9577,0.9533,0.9579,0.9579,0.9579,-0.0264,GlotLID,0.011,MillID
151
+ als_Latn,Albanian (Tosk),213,0.976,1.0,0.9531,1.0,1.0,1.0,1.0,1.0,1.0,0.9812,0.9812,0.9812,0.9812,0.9812,0.9812,-0.024,GlotLID,-0.0053,tie
152
+ kin_Latn,Kinyarwanda,210,0.8491,0.8411,0.8571,0.9807,0.9951,0.9667,0.9807,0.9951,0.9667,0.8535,0.7701,0.9571,0.8535,0.7701,0.9571,-0.1316,GlotLID,-0.0044,tie
153
+ alt_Cyrl,Southern Altai,208,0.9653,0.9949,0.9375,1.0,1.0,1.0,1.0,1.0,1.0,0.8966,1.0,0.8125,0.8966,1.0,0.8125,-0.0347,GlotLID,0.0688,MillID
154
+ kea_Latn,Kabuverdianu,205,0.958,0.97,0.9463,0.9976,0.9951,1.0,0.9976,0.9951,1.0,0.8736,1.0,0.7756,0.8736,1.0,0.7756,-0.0395,GlotLID,0.0844,MillID
155
+ heb_Hebr,Hebrew,203,0.9752,0.9801,0.9704,1.0,1.0,1.0,1.0,1.0,1.0,0.9975,0.9951,1.0,0.9975,0.9951,1.0,-0.0248,GlotLID,-0.0223,fastText
156
+ gle_Latn,Irish,203,0.9776,0.9899,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,0.9826,0.99,0.9754,0.9826,0.99,0.9754,-0.0224,GlotLID,-0.0051,tie
157
+ ban_Latn,Balinese,202,0.9695,0.9948,0.9455,1.0,1.0,1.0,1.0,1.0,1.0,0.9223,0.9674,0.8812,0.9223,0.9674,0.8812,-0.0305,GlotLID,0.0473,MillID
158
+ tat_Cyrl,Tatar,201,0.9776,0.98,0.9751,1.0,1.0,1.0,1.0,1.0,1.0,0.9685,0.9434,0.995,0.9685,0.9434,0.995,-0.0224,GlotLID,0.009,tie
159
+ nus_Latn,Nuer,199,0.9925,0.99,0.995,1.0,1.0,1.0,1.0,1.0,1.0,0.9898,1.0,0.9799,0.9898,1.0,0.9799,-0.0075,tie,0.0026,tie
160
+ bos_Latn,Bosnian,198,0.6852,0.764,0.6212,1.0,1.0,1.0,1.0,1.0,1.0,0.8967,0.8945,0.899,0.8967,0.8945,0.899,-0.3148,GlotLID,-0.2115,fastText
161
+ hne_Deva,Chhattisgarhi,198,0.9381,0.9579,0.9192,0.9851,0.9706,1.0,0.9851,0.9706,1.0,0.9016,0.9255,0.8788,0.9016,0.9255,0.8788,-0.0469,GlotLID,0.0366,MillID
162
+ lim_Latn,Limburgish,196,0.896,0.9385,0.8571,1.0,1.0,1.0,1.0,1.0,1.0,0.9556,0.9786,0.9337,0.9556,0.9786,0.9337,-0.104,GlotLID,-0.0596,fastText
163
+ yue_Hani,Cantonese,194,0.8937,0.948,0.8454,0.8983,0.9938,0.8196,0.9014,0.9938,0.8247,0.2588,0.1493,0.9691,0.2588,0.1493,0.9691,-0.0077,tie,0.635,MillID
164
+ war_Latn,Waray,193,0.9462,0.9832,0.9119,1.0,1.0,1.0,1.0,1.0,1.0,0.9511,1.0,0.9067,0.9511,1.0,0.9067,-0.0538,GlotLID,-0.0049,tie
165
+ kik_Latn,Kikuyu,193,0.9922,1.0,0.9845,1.0,1.0,1.0,1.0,1.0,1.0,0.8478,1.0,0.7358,0.8478,1.0,0.7358,-0.0078,tie,0.1444,MillID
166
+ crh_Latn,Crimean Tatar,189,0.9711,0.9635,0.9788,1.0,1.0,1.0,1.0,1.0,1.0,0.9786,0.9892,0.9683,0.9786,0.9892,0.9683,-0.0289,GlotLID,-0.0075,tie
167
+ cym_Latn,Welsh,189,0.9893,1.0,0.9788,1.0,1.0,1.0,1.0,1.0,1.0,0.9867,0.9946,0.9788,0.9867,0.9946,0.9788,-0.0107,GlotLID,0.0026,tie
168
+ khm_Khmr,Khmer,187,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
169
+ azj_Latn,North Azerbaijani,187,0.9731,0.9784,0.9679,0.9973,0.9947,1.0,0.9973,0.9947,1.0,0.9787,0.9735,0.984,0.9787,0.9735,0.984,-0.0242,GlotLID,-0.0056,tie
170
+ ces_Latn,Czech,183,0.9389,0.9548,0.9235,1.0,1.0,1.0,1.0,1.0,1.0,0.9683,0.9385,1.0,0.9683,0.9385,1.0,-0.0611,GlotLID,-0.0294,fastText
171
+ fon_Latn,Fon,180,0.9833,0.9833,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,0.9535,1.0,0.9111,0.9535,1.0,0.9111,-0.0167,GlotLID,0.0298,MillID
172
+ hye_Armn,Armenian,178,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.977,1.0,0.9551,0.977,1.0,0.9551,0.0,tie,0.023,MillID
173
+ shn_Mymr,Shan,174,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9854,1.0,0.9713,0.9854,1.0,0.9713,0.0,tie,0.0146,MillID
174
+ scn_Latn,Sicilian,172,0.9767,0.9767,0.9767,1.0,1.0,1.0,1.0,1.0,1.0,0.9243,0.8636,0.9942,0.9243,0.8636,0.9942,-0.0233,GlotLID,0.0524,MillID
175
+ gom_Deva,Goan Konkani,170,0.948,0.9318,0.9647,0.9798,0.9605,1.0,0.9798,0.9605,1.0,0.9524,0.9091,1.0,0.9524,0.9091,1.0,-0.0319,GlotLID,-0.0044,tie
176
+ hrv_Latn,Croatian,168,0.6588,0.6512,0.6667,0.9941,0.9882,1.0,0.9941,0.9882,1.0,0.8563,0.8439,0.869,0.8563,0.8439,0.869,-0.3353,GlotLID,-0.1975,fastText
177
+ kab_Latn,Kabyle,165,0.9354,0.95,0.9212,1.0,1.0,1.0,1.0,1.0,1.0,0.9558,0.931,0.9818,0.9558,0.931,0.9818,-0.0646,GlotLID,-0.0204,fastText
178
+ fuv_Latn,Nigerian Fulfulde,164,0.9073,0.9928,0.8354,0.8767,1.0,0.7805,0.8919,1.0,0.8049,0.8587,0.763,0.9817,0.8587,0.763,0.9817,0.0154,MillID,0.0486,MillID
179
+ arb_Latn,Standard Arabic,163,0.9419,0.9932,0.8957,0.906,1.0,0.8282,0.9133,1.0,0.8405,0.8522,0.9688,0.7607,0.8522,0.9688,0.7607,0.0286,MillID,0.0897,MillID
180
+ mri_Latn,Māori,162,0.9969,1.0,0.9938,1.0,1.0,1.0,1.0,1.0,1.0,0.6639,0.5016,0.9815,0.6639,0.5016,0.9815,-0.0031,tie,0.333,MillID
181
+ udm_Cyrl,Udmurt,159,0.9779,0.981,0.9748,1.0,1.0,1.0,1.0,1.0,1.0,0.8244,0.9583,0.7233,0.8244,0.9583,0.7233,-0.0221,GlotLID,0.1535,MillID
182
+ krc_Cyrl,Karachay-Balkar,159,0.9748,0.9748,0.9748,1.0,1.0,1.0,1.0,1.0,1.0,0.8778,0.7861,0.9937,0.8778,0.7861,0.9937,-0.0252,GlotLID,0.0971,MillID
183
+ jav_Latn,Javanese,158,0.9551,0.9675,0.943,0.9937,0.9875,1.0,0.9937,0.9875,1.0,0.9313,0.8814,0.9873,0.9313,0.8814,0.9873,-0.0386,GlotLID,0.0238,MillID
184
+ tzm_Tfng,Central Atlas Tamazight,157,0.6973,0.875,0.5796,0.9345,0.8771,1.0,0.9345,0.8771,1.0,0.7512,0.6015,1.0,0.7512,0.6015,1.0,-0.2372,GlotLID,-0.0539,fastText
185
+ bel_Cyrl,Belarusian,157,0.9841,0.981,0.9873,1.0,1.0,1.0,1.0,1.0,1.0,0.9937,0.9874,1.0,0.9937,0.9874,1.0,-0.0159,GlotLID,-0.0095,tie
186
+ bjn_Latn,Banjar,153,0.9369,0.9527,0.9216,0.9967,0.9935,1.0,0.9967,0.9935,1.0,0.8688,0.8323,0.9085,0.8688,0.8323,0.9085,-0.0599,GlotLID,0.0681,MillID
187
+ oss_Cyrl,Ossetic,152,0.9868,0.9933,0.9803,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0132,GlotLID,-0.0132,fastText
188
+ sun_Latn,Sundanese,143,0.9677,0.9926,0.9441,1.0,1.0,1.0,1.0,1.0,1.0,0.9467,0.9045,0.993,0.9467,0.9045,0.993,-0.0323,GlotLID,0.0211,MillID
189
+ srd_Latn,Sardinian,139,0.9751,0.9648,0.9856,1.0,1.0,1.0,1.0,1.0,1.0,0.9363,0.9766,0.8993,0.9363,0.9766,0.8993,-0.0249,GlotLID,0.0388,MillID
190
+ fil_Latn,Filipino,137,0.9466,0.992,0.9051,0.9815,0.9925,0.9708,0.9815,0.9925,0.9708,0.9926,1.0,0.9854,0.9926,1.0,0.9854,-0.035,GlotLID,-0.0461,fastText
191
+ ady_Cyrl,Adyghe,135,0.9963,1.0,0.9926,1.0,1.0,1.0,1.0,1.0,1.0,0.9814,0.9851,0.9778,0.9814,0.9851,0.9778,-0.0037,tie,0.0149,MillID
192
+ diq_Latn,Dimli (individual language),134,0.9339,0.9756,0.8955,1.0,1.0,1.0,1.0,1.0,1.0,0.9333,0.9835,0.8881,0.9333,0.9835,0.8881,-0.0661,GlotLID,0.0005,tie
193
+ ewo_Latn,Ewondo,134,0.9591,0.9556,0.9627,0.8787,1.0,0.7836,0.8833,1.0,0.791,0.8596,1.0,0.7537,0.8596,1.0,0.7537,0.0758,MillID,0.0995,MillID
194
+ mos_Latn,Mossi,133,0.9774,0.9774,0.9774,1.0,1.0,1.0,1.0,1.0,1.0,0.9811,0.9848,0.9774,0.9811,0.9848,0.9774,-0.0226,GlotLID,-0.0037,tie
195
+ xmf_Geor,Mingrelian,132,0.9848,0.9848,0.9848,1.0,1.0,1.0,1.0,1.0,1.0,0.963,0.942,0.9848,0.963,0.942,0.9848,-0.0152,GlotLID,0.0219,MillID
196
+ kbp_Latn,Kabiyè,130,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9766,0.9921,0.9615,0.9766,0.9921,0.9615,0.0,tie,0.0234,MillID
197
+ pag_Latn,Pangasinan,122,0.9573,1.0,0.918,0.9959,0.9919,1.0,0.9959,0.9919,1.0,0.959,0.959,0.959,0.959,0.959,0.959,-0.0387,GlotLID,-0.0018,tie
198
+ sat_Olck,Santali,122,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
199
+ kmb_Latn,Kimbundu,119,0.9833,0.9752,0.9916,0.9917,0.9835,1.0,0.9917,0.9835,1.0,0.9633,0.9365,0.9916,0.9633,0.9365,0.9916,-0.0083,tie,0.0201,MillID
200
+ kas_Arab,Kashmiri,118,0.9957,1.0,0.9915,1.0,1.0,1.0,1.0,1.0,1.0,0.9784,1.0,0.9576,0.9784,1.0,0.9576,-0.0043,tie,0.0174,MillID
201
+ bjn_Arab,Banjar,116,0.9915,0.9831,1.0,0.8342,1.0,0.7155,0.9869,1.0,0.9741,0.4533,1.0,0.2931,0.9596,1.0,0.9224,0.0046,tie,0.0318,MillID
202
+ ace_Latn,Acehnese,113,0.9776,0.9909,0.9646,1.0,1.0,1.0,1.0,1.0,1.0,0.8943,0.8271,0.9735,0.88,0.8029,0.9735,-0.0224,GlotLID,0.0976,MillID
203
+ nav_Latn,Navajo,113,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.968,1.0,0.9381,0.968,1.0,0.9381,0.0,tie,0.032,MillID
204
+ taq_Latn,Tamasheq,106,0.9016,1.0,0.8208,1.0,1.0,1.0,1.0,1.0,1.0,0.8377,0.9412,0.7547,0.8377,0.9412,0.7547,-0.0984,GlotLID,0.0639,MillID
205
+ taq_Tfng,Tamasheq,104,0.654,0.6449,0.6635,0.8046,1.0,0.6731,0.8046,1.0,0.6731,0.0,0.0,0.0,0.0,0.0,0.0,-0.1506,GlotLID,0.654,MillID
206
+ umb_Latn,Umbundu,100,0.98,0.98,0.98,0.995,0.9901,1.0,0.995,0.9901,1.0,0.8972,0.8421,0.96,0.8972,0.8421,0.96,-0.015,GlotLID,0.0828,MillID
207
+ mag_Deva,Magahi,97,0.89,0.8641,0.9175,1.0,1.0,1.0,1.0,1.0,1.0,0.7723,0.7429,0.8041,0.7723,0.7429,0.8041,-0.11,GlotLID,0.1177,MillID
208
+ awa_Deva,Awadhi,91,0.8977,0.9294,0.8681,0.963,0.9286,1.0,0.963,0.9286,1.0,0.7571,0.7791,0.7363,0.7571,0.7791,0.7363,-0.0652,GlotLID,0.1407,MillID
209
+ bug_Latn,Buginese,78,0.9806,0.987,0.9744,0.9811,0.963,1.0,0.9811,0.963,1.0,0.9375,0.9146,0.9615,0.9375,0.9146,0.9615,-0.0005,tie,0.0431,MillID
210
+ knc_Arab,Central Kanuri,68,0.5217,1.0,0.3529,0.8571,1.0,0.75,0.8595,0.9811,0.7647,0.029,1.0,0.0147,0.029,1.0,0.0147,-0.3378,GlotLID,0.4928,MillID
211
+ min_Latn,Minangkabau,55,0.8947,0.8644,0.9273,0.991,0.9821,1.0,0.991,0.9821,1.0,0.3333,1.0,0.2,0.3333,1.0,0.2,-0.0963,GlotLID,0.5614,MillID
212
+ vec_Latn,Venetian,49,0.7664,0.7069,0.8367,0.8605,1.0,0.7551,0.8605,1.0,0.7551,0.6202,0.5,0.8163,0.6202,0.5,0.8163,-0.0941,GlotLID,0.1462,MillID
213
+ kas_Deva,Kashmiri,47,0.557,0.6875,0.4681,0.7027,0.963,0.5532,0.7027,0.963,0.5532,0.5867,0.7857,0.4681,0.5867,0.7857,0.4681,-0.1457,GlotLID,-0.0297,fastText
214
+ cjk_Latn,Chokwe,24,0.8571,1.0,0.75,1.0,1.0,1.0,1.0,1.0,1.0,0.807,0.697,0.9583,0.807,0.697,0.9583,-0.1429,GlotLID,0.0501,MillID
reports/test-common/millid_per_language.csv ADDED
@@ -0,0 +1,214 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,285,283,0,2,64312,1.0,0.992982,0.996479,1.0,0.0,0.992982
3
+ ace_Latn,113,109,1,4,64483,0.990909,0.964602,0.977578,0.999984,15.507723,0.964602
4
+ ady_Cyrl,135,134,0,1,64462,1.0,0.992593,0.996283,1.0,0.0,0.992593
5
+ afr_Latn,569,548,11,21,64017,0.980322,0.963093,0.971631,0.999828,171.799838,0.963093
6
+ als_Latn,213,203,0,10,64384,1.0,0.953052,0.975962,1.0,0.0,0.953052
7
+ alt_Cyrl,208,195,1,13,64388,0.994898,0.9375,0.965347,0.999984,15.530603,0.9375
8
+ amh_Ethi,458,448,5,10,64134,0.988962,0.978166,0.983535,0.999922,77.95569,0.978166
9
+ arb_Arab,745,575,0,170,63852,1.0,0.771812,0.871212,1.0,0.0,0.771812
10
+ arb_Latn,163,146,1,17,64433,0.993197,0.895706,0.941935,0.999984,15.519757,0.895706
11
+ arn_Latn,250,247,1,3,64346,0.995968,0.988,0.991968,0.999984,15.54074,0.988
12
+ asm_Beng,467,464,0,3,64130,1.0,0.993576,0.996778,1.0,0.0,0.993576
13
+ ast_Latn,244,215,9,29,64344,0.959821,0.881148,0.918803,0.99986,139.85362,0.881148
14
+ awa_Deva,91,79,6,12,64500,0.929412,0.868132,0.897727,0.999907,93.014603,0.868132
15
+ ayr_Latn,309,303,1,6,64287,0.996711,0.980583,0.988581,0.999984,15.555002,0.980583
16
+ azb_Arab,369,347,8,22,64220,0.977465,0.940379,0.958564,0.999875,124.556268,0.940379
17
+ azj_Latn,187,181,4,6,64406,0.978378,0.967914,0.973118,0.999938,62.102158,0.967914
18
+ bak_Cyrl,289,281,2,8,64306,0.992933,0.972318,0.982517,0.999969,31.10033,0.972318
19
+ bam_Latn,287,278,19,9,64291,0.936027,0.968641,0.952055,0.999705,295.443943,0.968641
20
+ ban_Latn,202,191,1,11,64394,0.994792,0.945545,0.969543,0.999984,15.529156,0.945545
21
+ bel_Cyrl,157,155,3,2,64437,0.981013,0.987261,0.984127,0.999953,46.554935,0.987261
22
+ bem_Latn,222,215,5,7,64370,0.977273,0.968468,0.972851,0.999922,77.669903,0.968468
23
+ ben_Beng,466,461,6,5,64125,0.987152,0.98927,0.98821,0.999906,93.558497,0.98927
24
+ bho_Deva,290,280,16,10,64291,0.945946,0.965517,0.955631,0.999751,248.806506,0.965517
25
+ bis_Latn,257,250,0,7,64340,1.0,0.972763,0.986193,1.0,0.0,0.972763
26
+ bjn_Arab,116,116,2,0,64479,0.983051,1.0,0.991453,0.999969,31.016889,1.0
27
+ bjn_Latn,153,141,7,12,64437,0.952703,0.921569,0.936877,0.999891,108.621439,0.921569
28
+ bod_Tibt,406,391,39,15,64152,0.909302,0.963054,0.935407,0.999392,607.561808,0.963054
29
+ bos_Latn,198,123,38,75,64361,0.763975,0.621212,0.685237,0.99941,590.071274,0.621212
30
+ bug_Latn,78,76,1,2,64518,0.987013,0.974359,0.980645,0.999985,15.49931,0.974359
31
+ bul_Cyrl,289,278,10,11,64298,0.965278,0.961938,0.963605,0.999844,155.501648,0.961938
32
+ bxr_Cyrl,277,266,4,11,64316,0.985185,0.960289,0.972578,0.999938,62.189055,0.960289
33
+ cat_Latn,318,302,16,16,64263,0.949686,0.949686,0.949686,0.999751,248.914887,0.949686
34
+ ceb_Latn,338,330,5,8,64254,0.985075,0.976331,0.980684,0.999922,77.810112,0.976331
35
+ ces_Latn,183,169,8,14,64406,0.954802,0.923497,0.938889,0.999876,124.196603,0.923497
36
+ che_Cyrl,345,331,1,14,64251,0.996988,0.95942,0.977843,0.999984,15.563718,0.95942
37
+ chv_Cyrl,335,334,0,1,64262,1.0,0.997015,0.998505,1.0,0.0,0.997015
38
+ cjk_Latn,24,18,0,6,64573,1.0,0.75,0.857143,1.0,0.0,0.75
39
+ ckb_Arab,421,386,1,35,64175,0.997416,0.916865,0.955446,0.999984,15.582149,0.916865
40
+ cmn_Hani,288,258,18,30,64291,0.934783,0.895833,0.914894,0.99972,279.898615,0.895833
41
+ crh_Latn,189,185,7,4,64401,0.963542,0.978836,0.971129,0.999891,108.682151,0.978836
42
+ cym_Latn,189,185,0,4,64408,1.0,0.978836,0.989305,1.0,0.0,0.978836
43
+ dan_Latn,242,205,15,37,64340,0.931818,0.847107,0.887446,0.999767,233.082123,0.847107
44
+ deu_Latn,356,347,5,9,64236,0.985795,0.974719,0.980226,0.999922,77.831914,0.974719
45
+ dik_Latn,350,345,0,5,64247,1.0,0.985714,0.992806,1.0,0.0,0.985714
46
+ diq_Latn,134,120,3,14,64460,0.97561,0.895522,0.933852,0.999953,46.538324,0.895522
47
+ dyu_Latn,390,367,3,23,64204,0.991892,0.941026,0.965789,0.999953,46.723877,0.941026
48
+ dzo_Tibt,346,299,15,47,64236,0.952229,0.864162,0.906061,0.999767,233.459401,0.864162
49
+ ekk_Latn,419,401,6,18,64172,0.985258,0.957041,0.970944,0.999907,93.489981,0.957041
50
+ ell_Grek,394,323,0,71,64203,1.0,0.819797,0.900976,1.0,0.0,0.819797
51
+ eng_Latn,1444,1330,79,114,63074,0.943932,0.921053,0.932352,0.998749,1250.93028,0.921053
52
+ epo_Latn,294,285,5,9,64298,0.982759,0.969388,0.976027,0.999922,77.75687,0.969388
53
+ eus_Latn,254,247,4,7,64339,0.984064,0.972441,0.978218,0.999938,62.166825,0.972441
54
+ ewe_Latn,308,303,1,5,64288,0.996711,0.983766,0.990196,0.999984,15.554761,0.983766
55
+ ewo_Latn,134,129,6,5,64457,0.955556,0.962687,0.959108,0.999907,93.076649,0.962687
56
+ fao_Latn,237,234,9,3,64351,0.962963,0.987342,0.975,0.99986,139.838409,0.987342
57
+ fas_Arab,396,361,7,35,64194,0.980978,0.911616,0.945026,0.999891,109.03257,0.911616
58
+ fij_Latn,344,339,3,5,64250,0.991228,0.985465,0.988338,0.999953,46.690427,0.985465
59
+ fil_Latn,137,124,1,13,64459,0.992,0.905109,0.946565,0.999984,15.513497,0.905109
60
+ fin_Latn,368,321,2,47,64227,0.993808,0.872283,0.929088,0.999969,31.138582,0.872283
61
+ fon_Latn,180,177,3,3,64414,0.983333,0.983333,0.983333,0.999953,46.571557,0.983333
62
+ fra_Latn,1652,1481,8,171,62937,0.994627,0.896489,0.943012,0.999873,127.095083,0.896489
63
+ fur_Latn,221,202,3,19,64373,0.985366,0.914027,0.948357,0.999953,46.601218,0.914027
64
+ fuv_Latn,164,137,1,27,64432,0.992754,0.835366,0.907285,0.999984,15.519998,0.835366
65
+ gaz_Latn,441,391,4,50,64152,0.989873,0.886621,0.935407,0.999938,62.348027,0.886621
66
+ gla_Latn,223,220,2,3,64372,0.990991,0.986547,0.988764,0.999969,31.068444,0.986547
67
+ gle_Latn,203,196,2,7,64392,0.989899,0.965517,0.977556,0.999969,31.058794,0.965517
68
+ glg_Latn,215,207,13,8,64369,0.940909,0.962791,0.951724,0.999798,201.919791,0.962791
69
+ gom_Deva,170,164,12,6,64415,0.931818,0.964706,0.947977,0.999814,186.257314,0.964706
70
+ gug_Latn,228,216,2,12,64367,0.990826,0.947368,0.96861,0.999969,31.070857,0.947368
71
+ guj_Gujr,354,354,0,0,64243,1.0,1.0,1.0,1.0,0.0,1.0
72
+ hat_Latn,338,329,0,9,64259,1.0,0.973373,0.986507,1.0,0.0,0.973373
73
+ hau_Latn,367,351,5,16,64225,0.985955,0.956403,0.970954,0.999922,77.845244,0.956403
74
+ heb_Hebr,203,197,4,6,64390,0.9801,0.970443,0.975248,0.999938,62.117589,0.970443
75
+ hin_Deva,392,307,19,85,64186,0.941718,0.783163,0.855153,0.999704,295.927108,0.783163
76
+ hne_Deva,198,182,8,16,64391,0.957895,0.919192,0.938144,0.999876,124.225531,0.919192
77
+ hrv_Latn,168,112,60,56,64369,0.651163,0.666667,0.658824,0.999069,931.257663,0.666667
78
+ hun_Latn,576,566,3,10,64018,0.994728,0.982639,0.988646,0.999953,46.859624,0.982639
79
+ hye_Armn,178,178,0,0,64419,1.0,1.0,1.0,1.0,0.0,1.0
80
+ ibo_Latn,257,254,1,3,64339,0.996078,0.988327,0.992188,0.999984,15.542431,0.988327
81
+ ilo_Latn,252,249,2,3,64343,0.992032,0.988095,0.99006,0.999969,31.082446,0.988095
82
+ ind_Latn,335,269,35,66,64227,0.884868,0.802985,0.841941,0.999455,544.645358,0.802985
83
+ isl_Latn,276,251,2,25,64319,0.992095,0.90942,0.94896,0.999969,31.094044,0.90942
84
+ ita_Latn,342,294,2,48,64253,0.993243,0.859649,0.92163,0.999969,31.125982,0.859649
85
+ jav_Latn,158,149,5,9,64434,0.967532,0.943038,0.955128,0.999922,77.592762,0.943038
86
+ jpn_Jpan,323,307,0,16,64274,1.0,0.950464,0.974603,1.0,0.0,0.950464
87
+ kab_Latn,165,152,8,13,64424,0.95,0.921212,0.935385,0.999876,124.161907,0.921212
88
+ kac_Latn,216,215,0,1,64381,1.0,0.99537,0.99768,1.0,0.0,0.99537
89
+ kal_Latn,369,369,1,0,64227,0.997297,1.0,0.998647,0.999984,15.569534,1.0
90
+ kam_Latn,272,263,2,9,64323,0.992453,0.966912,0.979516,0.999969,31.09211,0.966912
91
+ kan_Knda,601,569,0,32,63996,1.0,0.946755,0.97265,1.0,0.0,0.946755
92
+ kas_Arab,118,117,0,1,64479,1.0,0.991525,0.995745,1.0,0.0,0.991525
93
+ kas_Deva,47,22,10,25,64540,0.6875,0.468085,0.556962,0.999845,154.918668,0.468085
94
+ kat_Geor,324,322,1,2,64272,0.996904,0.993827,0.995363,0.999984,15.558633,0.993827
95
+ kaz_Cyrl,340,329,0,11,64257,1.0,0.967647,0.983558,1.0,0.0,0.967647
96
+ kbp_Latn,130,130,0,0,64467,1.0,1.0,1.0,1.0,0.0,1.0
97
+ kea_Latn,205,194,6,11,64386,0.97,0.946341,0.958025,0.999907,93.179277,0.946341
98
+ khk_Cyrl,262,259,9,3,64326,0.966418,0.98855,0.977358,0.99986,139.892749,0.98855
99
+ khm_Khmr,187,187,0,0,64410,1.0,1.0,1.0,1.0,0.0,1.0
100
+ kik_Latn,193,190,0,3,64404,1.0,0.984456,0.992167,1.0,0.0,0.984456
101
+ kin_Latn,210,180,34,30,64353,0.841121,0.857143,0.849057,0.999472,528.056906,0.857143
102
+ kir_Cyrl,242,237,8,5,64347,0.967347,0.979339,0.973306,0.999876,124.310465,0.979339
103
+ kmb_Latn,119,118,3,1,64475,0.975207,0.991597,0.983333,0.999953,46.527498,0.991597
104
+ kmr_Latn,289,281,4,8,64304,0.985965,0.972318,0.979094,0.999938,62.200659,0.972318
105
+ knc_Arab,68,24,0,44,64529,1.0,0.352941,0.521739,1.0,0.0,0.352941
106
+ knc_Latn,293,275,1,18,64303,0.996377,0.938567,0.966608,0.999984,15.551132,0.938567
107
+ kng_Latn,362,324,0,38,64235,1.0,0.895028,0.944606,1.0,0.0,0.895028
108
+ kor_Hang,265,265,0,0,64332,1.0,1.0,1.0,1.0,0.0,1.0
109
+ krc_Cyrl,159,155,4,4,64434,0.974843,0.974843,0.974843,0.999938,62.075173,0.974843
110
+ lao_Laoo,335,333,0,2,64262,1.0,0.99403,0.997006,1.0,0.0,0.99403
111
+ lij_Latn,245,219,3,26,64349,0.986486,0.893878,0.937901,0.999953,46.618598,0.893878
112
+ lim_Latn,196,168,11,28,64390,0.938547,0.857143,0.896,0.999829,170.804801,0.857143
113
+ lin_Latn,215,209,3,6,64379,0.985849,0.972093,0.978923,0.999953,46.596875,0.972093
114
+ lit_Latn,330,314,5,16,64262,0.984326,0.951515,0.967643,0.999922,77.800426,0.951515
115
+ lmo_Latn,276,242,11,34,64310,0.956522,0.876812,0.914934,0.999829,171.017242,0.876812
116
+ ltg_Latn,259,253,12,6,64326,0.954717,0.976834,0.965649,0.999813,186.514968,0.976834
117
+ ltz_Latn,251,245,7,6,64339,0.972222,0.976096,0.974155,0.999891,108.786871,0.976096
118
+ lua_Latn,346,332,0,14,64251,1.0,0.959538,0.979351,1.0,0.0,0.959538
119
+ lug_Latn,405,380,0,25,64192,1.0,0.938272,0.968153,1.0,0.0,0.938272
120
+ luo_Latn,415,407,2,8,64180,0.99511,0.980723,0.987864,0.999969,31.161385,0.980723
121
+ lus_Latn,391,378,0,13,64206,1.0,0.966752,0.983095,1.0,0.0,0.966752
122
+ lvs_Latn,298,278,3,20,64296,0.989324,0.932886,0.960276,0.999953,46.657024,0.932886
123
+ mag_Deva,97,89,14,8,64486,0.864078,0.917526,0.89,0.999783,217.054264,0.917526
124
+ mai_Deva,234,206,5,28,64358,0.976303,0.880342,0.925843,0.999922,77.684384,0.880342
125
+ mal_Mlym,338,338,0,0,64259,1.0,1.0,1.0,1.0,0.0,1.0
126
+ mar_Deva,589,565,13,24,63995,0.977509,0.959253,0.968295,0.999797,203.099613,0.959253
127
+ min_Latn,55,51,8,4,64534,0.864407,0.927273,0.894737,0.999876,123.950296,0.927273
128
+ mkd_Cyrl,331,321,8,10,64258,0.975684,0.969789,0.972727,0.999876,124.482619,0.969789
129
+ mlt_Latn,291,289,1,2,64305,0.996552,0.993127,0.994836,0.999984,15.550648,0.993127
130
+ mni_Beng,304,276,1,28,64292,0.99639,0.907895,0.950086,0.999984,15.553793,0.907895
131
+ mos_Latn,133,130,3,3,64461,0.977444,0.977444,0.977444,0.999953,46.537602,0.977444
132
+ mri_Latn,162,161,0,1,64435,1.0,0.993827,0.996904,1.0,0.0,0.993827
133
+ mya_Mymr,342,325,0,17,64255,1.0,0.950292,0.974513,1.0,0.0,0.950292
134
+ nav_Latn,113,113,0,0,64484,1.0,1.0,1.0,1.0,0.0,1.0
135
+ nia_Latn,242,241,0,1,64355,1.0,0.995868,0.99793,1.0,0.0,0.995868
136
+ nld_Latn,259,235,8,24,64330,0.967078,0.907336,0.936255,0.999876,124.343312,0.907336
137
+ nno_Latn,427,384,30,43,64140,0.927536,0.899297,0.913199,0.999532,467.508181,0.899297
138
+ nob_Latn,265,222,54,43,64278,0.804348,0.837736,0.820702,0.999161,839.395635,0.837736
139
+ npi_Deva,273,261,7,12,64317,0.973881,0.956044,0.96488,0.999891,108.824078,0.956044
140
+ nso_Latn,479,455,16,24,64102,0.96603,0.949896,0.957895,0.99975,249.539911,0.949896
141
+ nus_Latn,199,198,2,1,64396,0.99,0.994975,0.992481,0.999969,31.056865,0.994975
142
+ nya_Latn,262,247,10,15,64325,0.961089,0.942748,0.95183,0.999845,155.436388,0.942748
143
+ oci_Latn,333,315,10,18,64254,0.969231,0.945946,0.957447,0.999844,155.608117,0.945946
144
+ ory_Orya,511,505,0,6,64086,1.0,0.988258,0.994094,1.0,0.0,0.988258
145
+ oss_Cyrl,152,149,1,3,64444,0.993333,0.980263,0.986755,0.999984,15.517108,0.980263
146
+ pag_Latn,122,112,0,10,64475,1.0,0.918033,0.957265,1.0,0.0,0.918033
147
+ pan_Guru,460,460,0,0,64137,1.0,1.0,1.0,1.0,0.0,1.0
148
+ pap_Latn,423,407,2,16,64172,0.99511,0.962175,0.978365,0.999969,31.165269,0.962175
149
+ pbt_Arab,419,408,1,11,64177,0.997555,0.973747,0.985507,0.999984,15.581663,0.973747
150
+ pcm_Latn,251,188,18,63,64328,0.912621,0.749004,0.822757,0.99972,279.737668,0.749004
151
+ plt_Latn,248,235,2,13,64347,0.991561,0.947581,0.969072,0.999969,31.080514,0.947581
152
+ pol_Latn,254,242,10,12,64333,0.960317,0.952756,0.956522,0.999845,155.417062,0.952756
153
+ por_Latn,657,619,15,38,63925,0.976341,0.942161,0.958947,0.999765,234.594933,0.942161
154
+ quy_Latn,271,242,2,29,64324,0.991803,0.892989,0.939806,0.999969,31.091627,0.892989
155
+ roh_Latn,307,301,7,6,64283,0.977273,0.980456,0.978862,0.999891,108.88163,0.980456
156
+ ron_Latn,369,354,9,15,64219,0.975207,0.95935,0.967213,0.99986,140.125802,0.95935
157
+ run_Latn,291,257,34,34,64272,0.883162,0.883162,0.883162,0.999471,528.722048,0.883162
158
+ rus_Cyrl,528,475,2,53,64067,0.995807,0.899621,0.945274,0.999969,31.216345,0.899621
159
+ sag_Latn,237,234,0,3,64360,1.0,0.987342,0.993631,1.0,0.0,0.987342
160
+ san_Deva,239,236,2,3,64356,0.991597,0.987448,0.989518,0.999969,31.076168,0.987448
161
+ sat_Olck,122,122,0,0,64475,1.0,1.0,1.0,1.0,0.0,1.0
162
+ scn_Latn,172,168,4,4,64421,0.976744,0.976744,0.976744,0.999938,62.087699,0.976744
163
+ shn_Mymr,174,174,0,0,64423,1.0,1.0,1.0,1.0,0.0,1.0
164
+ sin_Sinh,232,232,0,0,64365,1.0,1.0,1.0,1.0,0.0,1.0
165
+ slk_Latn,374,353,15,21,64208,0.959239,0.94385,0.951482,0.999766,233.561185,0.94385
166
+ slv_Latn,338,324,13,14,64246,0.961424,0.95858,0.96,0.999798,202.306292,0.95858
167
+ smo_Latn,426,419,1,7,64170,0.997619,0.983568,0.990544,0.999984,15.583363,0.983568
168
+ sna_Latn,415,402,2,13,64180,0.99505,0.968675,0.981685,0.999969,31.161385,0.968675
169
+ snd_Arab,325,319,1,6,64271,0.996875,0.981538,0.989147,0.999984,15.558875,0.981538
170
+ som_Latn,439,427,2,12,64156,0.995338,0.972665,0.983871,0.999969,31.173042,0.972665
171
+ sot_Latn,491,475,14,16,64092,0.97137,0.967413,0.969388,0.999782,218.388294,0.967413
172
+ spa_Latn,1136,1018,19,118,63442,0.981678,0.896127,0.936954,0.999701,299.39648,0.896127
173
+ srd_Latn,139,137,5,2,64453,0.964789,0.985612,0.975089,0.999922,77.56989,0.985612
174
+ srp_Cyrl,269,262,7,7,64321,0.973978,0.973978,0.973978,0.999891,108.817311,0.973978
175
+ ssw_Latn,322,299,6,23,64269,0.980328,0.928571,0.953748,0.999907,93.348891,0.928571
176
+ sun_Latn,143,135,1,8,64453,0.992647,0.944056,0.967742,0.999984,15.514941,0.944056
177
+ swe_Latn,328,314,13,14,64256,0.960245,0.957317,0.958779,0.999798,202.274814,0.957317
178
+ swh_Latn,592,480,3,112,64002,0.993789,0.810811,0.893023,0.999953,46.871338,0.810811
179
+ szl_Latn,320,301,9,19,64268,0.970968,0.940625,0.955556,0.99986,140.01898,0.940625
180
+ tah_Latn,242,236,2,6,64353,0.991597,0.975207,0.983333,0.999969,31.077616,0.975207
181
+ tam_Taml,754,750,0,4,63843,1.0,0.994695,0.99734,1.0,0.0,0.994695
182
+ taq_Latn,106,87,0,19,64491,1.0,0.820755,0.901554,1.0,0.0,0.820755
183
+ taq_Tfng,104,69,38,35,64455,0.64486,0.663462,0.654028,0.999411,589.211232,0.663462
184
+ tat_Cyrl,201,196,4,5,64392,0.98,0.975124,0.977556,0.999938,62.115659,0.975124
185
+ tel_Telu,555,552,0,3,64042,1.0,0.994595,0.99729,1.0,0.0,0.994595
186
+ tgk_Cyrl,413,409,0,4,64184,1.0,0.990315,0.995134,1.0,0.0,0.990315
187
+ tha_Thai,431,414,0,17,64166,1.0,0.960557,0.979882,1.0,0.0,0.960557
188
+ tir_Ethi,339,334,7,5,64251,0.979472,0.985251,0.982353,0.999891,108.935852,0.985251
189
+ ton_Latn,298,296,0,2,64299,1.0,0.993289,0.996633,1.0,0.0,0.993289
190
+ tpi_Latn,302,299,1,3,64294,0.996667,0.990066,0.993355,0.999984,15.553309,0.990066
191
+ tsn_Latn,456,433,25,23,64116,0.945415,0.949561,0.947484,0.99961,389.766296,0.949561
192
+ tso_Latn,581,558,1,23,64015,0.998211,0.960413,0.978947,0.999984,15.621095,0.960413
193
+ tuk_Latn,227,219,1,8,64369,0.995455,0.964758,0.979866,0.999984,15.535187,0.964758
194
+ tum_Latn,265,258,5,7,64327,0.980989,0.973585,0.977273,0.999922,77.721818,0.973585
195
+ tur_Latn,430,409,6,21,64161,0.985542,0.951163,0.968047,0.999906,93.506008,0.951163
196
+ twi_Latn,359,344,1,15,64237,0.997101,0.958217,0.977273,0.999984,15.56711,0.958217
197
+ tzm_Tfng,157,91,13,66,64427,0.875,0.579618,0.697318,0.999798,201.738051,0.579618
198
+ udm_Cyrl,159,155,3,4,64435,0.981013,0.974843,0.977918,0.999953,46.55638,0.974843
199
+ uig_Arab,334,332,1,2,64262,0.996997,0.994012,0.995502,0.999984,15.561054,0.994012
200
+ ukr_Cyrl,322,301,3,21,64272,0.990132,0.934783,0.961661,0.999953,46.674446,0.934783
201
+ umb_Latn,100,98,2,2,64495,0.98,0.98,0.98,0.999969,31.009194,0.98
202
+ urd_Arab,257,242,4,15,64336,0.98374,0.941634,0.962227,0.999938,62.169723,0.941634
203
+ uzn_Latn,436,427,5,9,64156,0.988426,0.979358,0.983871,0.999922,77.92896,0.979358
204
+ vec_Latn,49,41,17,8,64531,0.706897,0.836735,0.766355,0.999737,263.369895,0.836735
205
+ vie_Latn,338,307,0,31,64259,1.0,0.908284,0.951938,1.0,0.0,0.908284
206
+ war_Latn,193,176,3,17,64401,0.98324,0.911917,0.946237,0.999953,46.580958,0.911917
207
+ wol_Latn,214,203,2,11,64381,0.990244,0.948598,0.968974,0.999969,31.064101,0.948598
208
+ xho_Latn,367,312,18,55,64212,0.945455,0.850136,0.895265,0.99972,280.242877,0.850136
209
+ xmf_Geor,132,130,2,2,64463,0.984848,0.984848,0.984848,0.999969,31.024587,0.984848
210
+ ydd_Hebr,430,424,0,6,64167,1.0,0.986047,0.992974,1.0,0.0,0.986047
211
+ yor_Latn,308,303,3,5,64286,0.990196,0.983766,0.986971,0.999953,46.664282,0.983766
212
+ yue_Hani,194,164,9,30,64394,0.947977,0.845361,0.893733,0.99986,139.745043,0.845361
213
+ zsm_Latn,244,189,46,55,64307,0.804255,0.77459,0.789144,0.999285,714.80739,0.77459
214
+ zul_Latn,594,498,36,96,63967,0.932584,0.838384,0.882979,0.999438,562.473634,0.838384
reports/test-common/millid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9395947180209607,
3
+ "top3_accuracy": 0.9856649689614069,
4
+ "top5_accuracy": 0.9908664489062959,
5
+ "passages": 64597,
6
+ "languages": 213,
7
+ "macro_precision": 0.970922775379856,
8
+ "macro_recall": 0.9353270477650256,
9
+ "macro_f1": 0.951259698841108,
10
+ "macro_specificity": 0.9998952436560236,
11
+ "weighted_f1": 0.9570662852696624,
12
+ "median_f1": 0.9726495726495726,
13
+ "languages_f1_at_least_0_9": 188,
14
+ "languages_f1_below_0_5": 0,
15
+ "mean_fp_per_million": 104.75634397647721,
16
+ "micro_f1": 0.9395947180209607,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9725285742931622,
19
+ "sentence": 0.9684640840957758,
20
+ "short": 0.9125458547322084
21
+ }
22
+ }
reports/test/fasttext@millid_per_language.csv ADDED
@@ -0,0 +1,1622 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aai_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
3
+ aak_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
4
+ aau_Latn,214,0,0,214,240027,0.0,0.0,0.0,1.0,0.0,0.0
5
+ aaz_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
6
+ aba_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
7
+ abk_Cyrl,285,285,139,0,239817,0.67217,1.0,0.803949,0.999421,579.272867,1.0
8
+ abn_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
9
+ abq_Cyrl,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
10
+ abs_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
11
+ abt_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
12
+ abx_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
13
+ aby_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
14
+ abz_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
15
+ aca_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
16
+ acd_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
17
+ ace_Latn,113,110,1854,3,238274,0.056008,0.973451,0.105922,0.992279,7720.882196,0.973451
18
+ acf_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
19
+ ach_Latn,242,0,0,242,239999,0.0,0.0,0.0,1.0,0.0,0.0
20
+ acm_Arab,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
21
+ acn_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
22
+ acr_Latn,255,0,0,255,239986,0.0,0.0,0.0,1.0,0.0,0.0
23
+ acu_Latn,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
24
+ ada_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
25
+ ade_Latn,31,0,0,31,240210,0.0,0.0,0.0,1.0,0.0,0.0
26
+ adh_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
27
+ adj_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
28
+ ady_Cyrl,135,132,222,3,239884,0.372881,0.977778,0.539877,0.999075,924.591639,0.977778
29
+ adz_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
30
+ aeb_Arab,244,0,0,244,239997,0.0,0.0,0.0,1.0,0.0,0.0
31
+ aeb_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
32
+ aer_Latn,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
33
+ aeu_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
34
+ aey_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
35
+ afr_Latn,569,557,169,12,239503,0.767218,0.97891,0.860232,0.999295,705.130345,0.97891
36
+ agd_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
37
+ agg_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
38
+ agm_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
39
+ agn_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
40
+ agr_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
41
+ agt_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
42
+ agu_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
43
+ agx_Cyrl,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
44
+ ahk_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
45
+ aia_Latn,163,0,0,163,240078,0.0,0.0,0.0,1.0,0.0,0.0
46
+ aii_Syrc,234,0,0,234,240007,0.0,0.0,0.0,1.0,0.0,0.0
47
+ ain_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
48
+ ajg_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
49
+ aji_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
50
+ ajp_Arab,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
51
+ akb_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
52
+ ake_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
53
+ akh_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
54
+ akp_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
55
+ aln_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
56
+ alp_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
57
+ alq_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
58
+ als_Latn,213,209,788,4,239240,0.209629,0.981221,0.345455,0.996717,3282.950322,0.981221
59
+ alt_Cyrl,208,169,142,39,239891,0.543408,0.8125,0.651252,0.999408,591.585324,0.8125
60
+ aly_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
61
+ alz_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
62
+ ame_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
63
+ amf_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
64
+ amh_Ethi,458,458,219,0,239564,0.676514,1.0,0.807048,0.999087,913.325799,1.0
65
+ ami_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
66
+ amk_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
67
+ amm_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
68
+ amn_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
69
+ amp_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
70
+ amr_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
71
+ amu_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
72
+ amx_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
73
+ ang_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
74
+ ann_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
75
+ anp_Deva,252,0,0,252,239989,0.0,0.0,0.0,1.0,0.0,0.0
76
+ anv_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
77
+ any_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
78
+ aoi_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
79
+ aoj_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
80
+ aom_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
81
+ aoz_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
82
+ apb_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
83
+ apc_Arab,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
84
+ ape_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
85
+ apn_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
86
+ apr_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
87
+ apt_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
88
+ apu_Latn,213,0,0,213,240028,0.0,0.0,0.0,1.0,0.0,0.0
89
+ apw_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
90
+ apy_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
91
+ apz_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
92
+ arb_Arab,745,739,1404,6,238092,0.344844,0.991946,0.511773,0.994138,5862.310853,0.991946
93
+ arb_Latn,163,124,895,39,239183,0.121688,0.760736,0.209814,0.996272,3727.955081,0.760736
94
+ are_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
95
+ arg_Latn,194,0,0,194,240047,0.0,0.0,0.0,1.0,0.0,0.0
96
+ arl_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
97
+ arn_Latn,250,231,360,19,239631,0.390863,0.924,0.549346,0.9985,1500.056252,0.924
98
+ arp_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
99
+ arq_Arab,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
100
+ ars_Arab,309,0,0,309,239932,0.0,0.0,0.0,1.0,0.0,0.0
101
+ ary_Arab,192,0,0,192,240049,0.0,0.0,0.0,1.0,0.0,0.0
102
+ arz_Arab,229,0,0,229,240012,0.0,0.0,0.0,1.0,0.0,0.0
103
+ asm_Beng,467,465,7,2,239767,0.985169,0.995717,0.990415,0.999971,29.194158,0.995717
104
+ asm_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
105
+ aso_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
106
+ ast_Latn,244,231,1094,13,238903,0.17434,0.946721,0.294455,0.995442,4558.390313,0.946721
107
+ ata_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
108
+ atb_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
109
+ atd_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
110
+ atg_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
111
+ ati_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
112
+ atj_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
113
+ att_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
114
+ auc_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
115
+ aui_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
116
+ auy_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
117
+ ava_Cyrl,240,0,0,240,240001,0.0,0.0,0.0,1.0,0.0,0.0
118
+ avk_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
119
+ avt_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
120
+ avu_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
121
+ awa_Deva,91,67,184,24,239966,0.266932,0.736264,0.391813,0.999234,766.187799,0.736264
122
+ awb_Latn,167,0,0,167,240074,0.0,0.0,0.0,1.0,0.0,0.0
123
+ awx_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
124
+ ayp_Arab,72,0,0,72,240169,0.0,0.0,0.0,1.0,0.0,0.0
125
+ ayr_Latn,309,295,463,14,239469,0.389182,0.954693,0.552952,0.99807,1929.713419,0.954693
126
+ azb_Arab,369,353,389,16,239483,0.475741,0.95664,0.635464,0.998378,1621.698239,0.95664
127
+ azg_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
128
+ azj_Cyrl,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
129
+ azj_Latn,187,184,1097,3,238957,0.143638,0.983957,0.250681,0.99543,4569.805127,0.983957
130
+ azz_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
131
+ bak_Cyrl,289,287,237,2,239715,0.54771,0.99308,0.706027,0.999012,987.69754,0.99308
132
+ bam_Latn,287,267,3791,20,236163,0.065796,0.930314,0.1229,0.984201,15798.861448,0.930314
133
+ ban_Latn,202,178,1328,24,238711,0.118194,0.881188,0.208431,0.994468,5532.434313,0.881188
134
+ bao_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
135
+ bar_Latn,331,0,0,331,239910,0.0,0.0,0.0,1.0,0.0,0.0
136
+ bas_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
137
+ bba_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
138
+ bbb_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
139
+ bbc_Latn,247,0,0,247,239994,0.0,0.0,0.0,1.0,0.0,0.0
140
+ bbr_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
141
+ bcc_Arab,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
142
+ bch_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
143
+ bci_Latn,193,0,0,193,240048,0.0,0.0,0.0,1.0,0.0,0.0
144
+ bcl_Latn,231,0,0,231,240010,0.0,0.0,0.0,1.0,0.0,0.0
145
+ bco_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
146
+ bcw_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
147
+ bdd_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
148
+ bdh_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
149
+ bdq_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
150
+ bea_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
151
+ bef_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
152
+ bel_Cyrl,157,157,307,0,239777,0.338362,1.0,0.505636,0.998721,1278.719115,1.0
153
+ bem_Latn,222,216,1736,6,238283,0.110656,0.972973,0.198712,0.992767,7232.76074,0.972973
154
+ ben_Beng,466,465,364,1,239411,0.560917,0.997854,0.718147,0.998482,1518.089876,0.997854
155
+ ben_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
156
+ beq_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
157
+ bew_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
158
+ bfd_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
159
+ bgr_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
160
+ bgs_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
161
+ bgt_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
162
+ bgz_Latn,13,0,0,13,240228,0.0,0.0,0.0,1.0,0.0,0.0
163
+ bhg_Latn,19,0,0,19,240222,0.0,0.0,0.0,1.0,0.0,0.0
164
+ bhl_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
165
+ bho_Deva,290,241,166,49,239785,0.592138,0.831034,0.691535,0.999308,691.807911,0.831034
166
+ bhw_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
167
+ bib_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
168
+ big_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
169
+ bim_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
170
+ bin_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
171
+ bis_Latn,257,243,287,14,239697,0.458491,0.945525,0.617535,0.998804,1195.913061,0.945525
172
+ biu_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
173
+ biv_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
174
+ bjn_Arab,116,107,12,9,240113,0.89916,0.922414,0.910638,0.99995,49.973972,0.922414
175
+ bjn_Latn,153,139,1533,14,238555,0.083134,0.908497,0.152329,0.993615,6385.158775,0.908497
176
+ bjp_Latn,171,0,0,171,240070,0.0,0.0,0.0,1.0,0.0,0.0
177
+ bjr_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
178
+ bjv_Latn,84,0,0,84,240157,0.0,0.0,0.0,1.0,0.0,0.0
179
+ bkd_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
180
+ bkq_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
181
+ bku_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
182
+ bla_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
183
+ blh_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
184
+ blk_Mymr,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
185
+ blt_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
186
+ blw_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
187
+ blz_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
188
+ bmh_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
189
+ bmk_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
190
+ bmq_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
191
+ bmr_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
192
+ bmu_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
193
+ bno_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
194
+ bnp_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
195
+ boa_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
196
+ bod_Tibt,406,385,200,21,239635,0.65812,0.948276,0.776993,0.999166,833.906644,0.948276
197
+ boj_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
198
+ bon_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
199
+ bos_Latn,198,178,1589,20,238454,0.100736,0.89899,0.18117,0.99338,6619.647313,0.89899
200
+ box_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
201
+ bpr_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
202
+ bps_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
203
+ bpy_Beng,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
204
+ bqc_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
205
+ bqp_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
206
+ bre_Latn,277,0,0,277,239964,0.0,0.0,0.0,1.0,0.0,0.0
207
+ brh_Arab,311,0,0,311,239930,0.0,0.0,0.0,1.0,0.0,0.0
208
+ bru_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
209
+ brx_Deva,351,0,0,351,239890,0.0,0.0,0.0,1.0,0.0,0.0
210
+ bsn_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
211
+ bsp_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
212
+ bsq_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
213
+ bss_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
214
+ btd_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
215
+ bth_Latn,33,0,0,33,240208,0.0,0.0,0.0,1.0,0.0,0.0
216
+ bts_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
217
+ btx_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
218
+ bud_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
219
+ bug_Latn,78,75,5471,3,234692,0.013523,0.961538,0.026671,0.97722,22780.361671,0.961538
220
+ buk_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
221
+ bul_Cyrl,289,284,150,5,239802,0.654378,0.982699,0.785615,0.999375,625.125025,0.982699
222
+ bum_Latn,245,0,0,245,239996,0.0,0.0,0.0,1.0,0.0,0.0
223
+ bus_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
224
+ bvd_Latn,206,0,0,206,240035,0.0,0.0,0.0,1.0,0.0,0.0
225
+ bvr_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
226
+ bvz_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
227
+ bwd_Latn,51,0,0,51,240190,0.0,0.0,0.0,1.0,0.0,0.0
228
+ bwu_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
229
+ bxh_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
230
+ bxr_Cyrl,277,245,201,32,239763,0.549327,0.884477,0.677732,0.999162,837.625644,0.884477
231
+ byr_Latn,194,0,0,194,240047,0.0,0.0,0.0,1.0,0.0,0.0
232
+ byx_Latn,206,0,0,206,240035,0.0,0.0,0.0,1.0,0.0,0.0
233
+ bzd_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
234
+ bzh_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
235
+ bzi_Thai,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
236
+ bzj_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
237
+ caa_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
238
+ cab_Latn,201,0,0,201,240040,0.0,0.0,0.0,1.0,0.0,0.0
239
+ cac_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
240
+ caf_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
241
+ cag_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
242
+ cak_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
243
+ cao_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
244
+ cap_Latn,226,0,0,226,240015,0.0,0.0,0.0,1.0,0.0,0.0
245
+ caq_Latn,189,0,0,189,240052,0.0,0.0,0.0,1.0,0.0,0.0
246
+ car_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
247
+ cas_Latn,74,0,0,74,240167,0.0,0.0,0.0,1.0,0.0,0.0
248
+ cat_Latn,318,303,646,15,239277,0.319283,0.95283,0.478295,0.997307,2692.53052,0.95283
249
+ cav_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
250
+ cax_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
251
+ cbc_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
252
+ cbi_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
253
+ cbk_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
254
+ cbr_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
255
+ cbs_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
256
+ cbt_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
257
+ cbu_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
258
+ cbv_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
259
+ cce_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
260
+ cco_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
261
+ ccp_Latn,3,0,0,3,240238,0.0,0.0,0.0,1.0,0.0,0.0
262
+ ceb_Latn,338,337,1068,1,238835,0.239858,0.997041,0.38669,0.995548,4451.799269,0.997041
263
+ ceg_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
264
+ cek_Latn,67,0,0,67,240174,0.0,0.0,0.0,1.0,0.0,0.0
265
+ ces_Latn,183,183,481,0,239577,0.275602,1.0,0.432113,0.997996,2003.682443,1.0
266
+ cfm_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
267
+ cgc_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
268
+ cha_Latn,348,0,0,348,239893,0.0,0.0,0.0,1.0,0.0,0.0
269
+ chd_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
270
+ che_Cyrl,345,338,476,7,239420,0.415233,0.97971,0.583261,0.998016,1984.19315,0.97971
271
+ chf_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
272
+ chk_Latn,294,0,0,294,239947,0.0,0.0,0.0,1.0,0.0,0.0
273
+ cho_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
274
+ chq_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
275
+ chr_Cher,44,0,0,44,240197,0.0,0.0,0.0,1.0,0.0,0.0
276
+ chu_Cyrl,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
277
+ chv_Cyrl,335,335,96,0,239810,0.777262,1.0,0.874674,0.9996,400.156728,1.0
278
+ chw_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
279
+ chz_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
280
+ cjk_Latn,24,23,1102,1,239115,0.020444,0.958333,0.040035,0.995412,4587.518785,0.958333
281
+ cjp_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
282
+ cjs_Cyrl,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
283
+ cjv_Latn,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
284
+ ckb_Arab,421,417,734,4,239086,0.362294,0.990499,0.530534,0.996939,3060.628805,0.990499
285
+ ckm_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
286
+ cko_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
287
+ ckt_Cyrl,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
288
+ clu_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
289
+ cme_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
290
+ cmn_Hani,288,95,180,193,239773,0.345455,0.329861,0.337478,0.99925,750.146904,0.329861
291
+ cmo_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
292
+ cnh_Latn,286,0,0,286,239955,0.0,0.0,0.0,1.0,0.0,0.0
293
+ cni_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
294
+ cnk_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
295
+ cnr_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
296
+ cnw_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
297
+ coe_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
298
+ cof_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
299
+ cok_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
300
+ con_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
301
+ cop_Copt,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
302
+ cor_Latn,290,0,0,290,239951,0.0,0.0,0.0,1.0,0.0,0.0
303
+ cos_Latn,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
304
+ cot_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
305
+ cpb_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
306
+ cpc_Latn,389,0,0,389,239852,0.0,0.0,0.0,1.0,0.0,0.0
307
+ cpu_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
308
+ cpy_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
309
+ crh_Cyrl,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
310
+ crh_Latn,189,183,664,6,239388,0.216057,0.968254,0.353282,0.997234,2766.067352,0.968254
311
+ crj_Cans,21,0,0,21,240220,0.0,0.0,0.0,1.0,0.0,0.0
312
+ crk_Cans,27,0,0,27,240214,0.0,0.0,0.0,1.0,0.0,0.0
313
+ crk_Latn,225,0,0,225,240016,0.0,0.0,0.0,1.0,0.0,0.0
314
+ crl_Cans,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
315
+ crm_Cans,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
316
+ crn_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
317
+ crs_Latn,218,0,0,218,240023,0.0,0.0,0.0,1.0,0.0,0.0
318
+ crx_Latn,322,0,0,322,239919,0.0,0.0,0.0,1.0,0.0,0.0
319
+ csb_Latn,307,0,0,307,239934,0.0,0.0,0.0,1.0,0.0,0.0
320
+ csw_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
321
+ csy_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
322
+ cta_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
323
+ ctd_Latn,196,0,0,196,240045,0.0,0.0,0.0,1.0,0.0,0.0
324
+ cto_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
325
+ ctp_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
326
+ ctu_Latn,243,0,0,243,239998,0.0,0.0,0.0,1.0,0.0,0.0
327
+ cub_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
328
+ cui_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
329
+ cuk_Latn,245,0,0,245,239996,0.0,0.0,0.0,1.0,0.0,0.0
330
+ cul_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
331
+ cut_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
332
+ cux_Latn,54,0,0,54,240187,0.0,0.0,0.0,1.0,0.0,0.0
333
+ cwe_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
334
+ cwt_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
335
+ cya_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
336
+ cym_Latn,189,185,357,4,239695,0.341328,0.978836,0.506156,0.998513,1487.177778,0.978836
337
+ czt_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
338
+ daa_Latn,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
339
+ dad_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
340
+ daf_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
341
+ dag_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
342
+ dah_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
343
+ dak_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
344
+ dan_Latn,242,230,92,12,239907,0.714286,0.950413,0.815603,0.999617,383.334931,0.950413
345
+ dar_Cyrl,227,0,0,227,240014,0.0,0.0,0.0,1.0,0.0,0.0
346
+ ded_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
347
+ des_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
348
+ deu_Latn,356,356,1031,0,238854,0.256669,1.0,0.408491,0.995702,4297.89274,1.0
349
+ dga_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
350
+ dgc_Latn,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
351
+ dgi_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
352
+ dgr_Latn,305,0,0,305,239936,0.0,0.0,0.0,1.0,0.0,0.0
353
+ dgz_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
354
+ dhm_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
355
+ dhv_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
356
+ dig_Latn,224,0,0,224,240017,0.0,0.0,0.0,1.0,0.0,0.0
357
+ dik_Latn,350,348,2899,2,236992,0.107176,0.994286,0.193495,0.987915,12084.655114,0.994286
358
+ diq_Latn,134,119,1070,15,239037,0.100084,0.88806,0.179894,0.995544,4456.346545,0.88806
359
+ div_Thaa,238,0,0,238,240003,0.0,0.0,0.0,1.0,0.0,0.0
360
+ dje_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
361
+ djk_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
362
+ djr_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
363
+ dks_Latn,3,0,0,3,240238,0.0,0.0,0.0,1.0,0.0,0.0
364
+ dng_Cyrl,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
365
+ dnj_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
366
+ dnw_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
367
+ dob_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
368
+ doi_Deva,254,0,0,254,239987,0.0,0.0,0.0,1.0,0.0,0.0
369
+ dop_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
370
+ dos_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
371
+ drg_Latn,13,0,0,13,240228,0.0,0.0,0.0,1.0,0.0,0.0
372
+ dru_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
373
+ dsb_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
374
+ dtp_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
375
+ dts_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
376
+ dua_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
377
+ duo_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
378
+ dur_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
379
+ dwr_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
380
+ dww_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
381
+ dyi_Latn,249,0,0,249,239992,0.0,0.0,0.0,1.0,0.0,0.0
382
+ dyo_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
383
+ dyu_Latn,390,280,386,110,239465,0.42042,0.717949,0.530303,0.998391,1609.332461,0.717949
384
+ dzo_Tibt,346,191,139,155,239756,0.578788,0.552023,0.565089,0.999421,579.420163,0.552023
385
+ ebk_Latn,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
386
+ efi_Latn,268,0,0,268,239973,0.0,0.0,0.0,1.0,0.0,0.0
387
+ ekk_Latn,419,415,2395,4,237427,0.147687,0.990453,0.257046,0.990013,9986.573375,0.990453
388
+ eko_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
389
+ ell_Grek,394,372,760,22,239087,0.328622,0.944162,0.487549,0.996831,3168.686704,0.944162
390
+ emi_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
391
+ eml_Latn,198,0,0,198,240043,0.0,0.0,0.0,1.0,0.0,0.0
392
+ emp_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
393
+ enb_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
394
+ eng_Latn,1444,1206,1070,238,237727,0.529877,0.83518,0.648387,0.995519,4480.79331,0.83518
395
+ enl_Latn,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
396
+ enm_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
397
+ enq_Latn,222,0,0,222,240019,0.0,0.0,0.0,1.0,0.0,0.0
398
+ epo_Latn,294,293,1931,1,238016,0.131745,0.996599,0.232724,0.991952,8047.610514,0.996599
399
+ eri_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
400
+ ese_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
401
+ esi_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
402
+ esk_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
403
+ ess_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
404
+ esu_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
405
+ etr_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
406
+ eus_Latn,254,251,234,3,239753,0.517526,0.988189,0.679296,0.999025,975.052815,0.988189
407
+ eve_Cyrl,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
408
+ ewe_Latn,308,300,495,8,239438,0.377358,0.974026,0.543971,0.997937,2063.075942,0.974026
409
+ ewo_Latn,134,101,720,33,239387,0.123021,0.753731,0.211518,0.997001,2998.663096,0.753731
410
+ ext_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
411
+ eza_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
412
+ faa_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
413
+ fai_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
414
+ fal_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
415
+ fan_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
416
+ fao_Latn,237,75,161,162,239843,0.317797,0.316456,0.317125,0.999329,670.822153,0.316456
417
+ far_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
418
+ fas_Arab,396,387,1406,9,238439,0.215839,0.977273,0.353586,0.994138,5862.119285,0.977273
419
+ fat_Latn,396,0,0,396,239845,0.0,0.0,0.0,1.0,0.0,0.0
420
+ ffm_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
421
+ fij_Latn,344,340,804,4,239093,0.297203,0.988372,0.456989,0.996649,3351.438326,0.988372
422
+ fil_Latn,137,135,722,2,239382,0.157526,0.985401,0.27163,0.996993,3007.030287,0.985401
423
+ fin_Latn,368,365,2008,3,237865,0.153814,0.991848,0.266326,0.991629,8371.096372,0.991848
424
+ fit_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
425
+ fkv_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
426
+ fon_Latn,180,164,1288,16,238773,0.112948,0.911111,0.20098,0.994635,5365.302985,0.911111
427
+ for_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
428
+ fra_Latn,1652,1545,626,107,237963,0.711654,0.93523,0.808266,0.997376,2623.758849,0.93523
429
+ frd_Latn,51,0,0,51,240190,0.0,0.0,0.0,1.0,0.0,0.0
430
+ fro_Latn,287,0,0,287,239954,0.0,0.0,0.0,1.0,0.0,0.0
431
+ frp_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
432
+ frr_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
433
+ fry_Latn,241,0,0,241,240000,0.0,0.0,0.0,1.0,0.0,0.0
434
+ fub_Latn,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
435
+ fue_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
436
+ fuf_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
437
+ fuh_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
438
+ fur_Latn,221,196,462,25,239558,0.297872,0.886878,0.445961,0.998075,1924.839597,0.886878
439
+ fuv_Arab,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
440
+ fuv_Latn,164,161,6779,3,233298,0.023199,0.981707,0.045327,0.971763,28236.774035,0.981707
441
+ gaa_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
442
+ gag_Cyrl,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
443
+ gag_Latn,41,0,0,41,240200,0.0,0.0,0.0,1.0,0.0,0.0
444
+ gah_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
445
+ gai_Latn,175,0,0,175,240066,0.0,0.0,0.0,1.0,0.0,0.0
446
+ gam_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
447
+ gaw_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
448
+ gaz_Latn,441,420,1203,21,238597,0.25878,0.952381,0.406977,0.994983,5016.680567,0.952381
449
+ gbi_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
450
+ gbo_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
451
+ gcf_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
452
+ gcr_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
453
+ gde_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
454
+ gdg_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
455
+ gdn_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
456
+ gdr_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
457
+ geb_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
458
+ gfk_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
459
+ ghs_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
460
+ gil_Latn,298,0,0,298,239943,0.0,0.0,0.0,1.0,0.0,0.0
461
+ gjn_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
462
+ gkn_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
463
+ gla_Latn,223,216,117,7,239901,0.648649,0.96861,0.776978,0.999513,487.46344,0.96861
464
+ gle_Latn,203,198,24,5,240014,0.891892,0.975369,0.931765,0.9999,99.984169,0.975369
465
+ glg_Latn,215,211,516,4,239510,0.290234,0.981395,0.447983,0.99785,2149.767109,0.981395
466
+ glk_Arab,319,0,0,319,239922,0.0,0.0,0.0,1.0,0.0,0.0
467
+ glv_Latn,357,0,0,357,239884,0.0,0.0,0.0,1.0,0.0,0.0
468
+ gmh_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
469
+ gmv_Ethi,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
470
+ gmv_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
471
+ gnb_Latn,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
472
+ gnd_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
473
+ gng_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
474
+ gnn_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
475
+ gnw_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
476
+ gof_Ethi,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
477
+ gof_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
478
+ gog_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
479
+ goh_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
480
+ gom_Deva,170,170,1561,0,238510,0.098209,1.0,0.178853,0.993498,6502.243086,1.0
481
+ gom_Latn,221,0,0,221,240020,0.0,0.0,0.0,1.0,0.0,0.0
482
+ gor_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
483
+ gos_Latn,74,0,0,74,240167,0.0,0.0,0.0,1.0,0.0,0.0
484
+ got_Goth,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
485
+ grc_Grek,317,0,0,317,239924,0.0,0.0,0.0,1.0,0.0,0.0
486
+ grt_Beng,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
487
+ gso_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
488
+ gsw_Latn,208,0,0,208,240033,0.0,0.0,0.0,1.0,0.0,0.0
489
+ gub_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
490
+ guc_Latn,252,0,0,252,239989,0.0,0.0,0.0,1.0,0.0,0.0
491
+ gug_Latn,228,202,2835,26,237178,0.066513,0.885965,0.123737,0.988188,11811.860191,0.885965
492
+ guh_Latn,207,0,0,207,240034,0.0,0.0,0.0,1.0,0.0,0.0
493
+ gui_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
494
+ guj_Gujr,354,343,0,11,239887,1.0,0.968927,0.984218,1.0,0.0,0.968927
495
+ guj_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
496
+ guk_Ethi,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
497
+ gul_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
498
+ gum_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
499
+ gun_Latn,54,0,0,54,240187,0.0,0.0,0.0,1.0,0.0,0.0
500
+ guo_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
501
+ guq_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
502
+ gur_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
503
+ guw_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
504
+ gux_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
505
+ guz_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
506
+ gvc_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
507
+ gvf_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
508
+ gvl_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
509
+ gvn_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
510
+ gwi_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
511
+ gym_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
512
+ gyr_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
513
+ hac_Arab,382,0,0,382,239859,0.0,0.0,0.0,1.0,0.0,0.0
514
+ hae_Latn,75,0,0,75,240166,0.0,0.0,0.0,1.0,0.0,0.0
515
+ hag_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
516
+ hak_Hani,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
517
+ hak_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
518
+ hat_Latn,338,325,847,13,239056,0.277304,0.961538,0.430464,0.996469,3530.593615,0.961538
519
+ hau_Latn,367,363,991,4,238883,0.268095,0.989101,0.421848,0.995869,4131.335618,0.989101
520
+ hav_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
521
+ haw_Latn,214,0,0,214,240027,0.0,0.0,0.0,1.0,0.0,0.0
522
+ hay_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
523
+ hbo_Hebr,189,0,0,189,240052,0.0,0.0,0.0,1.0,0.0,0.0
524
+ hch_Latn,259,0,0,259,239982,0.0,0.0,0.0,1.0,0.0,0.0
525
+ heb_Hebr,203,203,229,0,239809,0.469907,1.0,0.63937,0.999046,954.015614,1.0
526
+ heg_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
527
+ heh_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
528
+ her_Latn,235,0,0,235,240006,0.0,0.0,0.0,1.0,0.0,0.0
529
+ hif_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
530
+ hig_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
531
+ hil_Latn,266,0,0,266,239975,0.0,0.0,0.0,1.0,0.0,0.0
532
+ hin_Deva,392,359,872,33,238977,0.291633,0.915816,0.442391,0.996364,3635.620745,0.915816
533
+ hin_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
534
+ hix_Latn,222,0,0,222,240019,0.0,0.0,0.0,1.0,0.0,0.0
535
+ hla_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
536
+ hmo_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
537
+ hmr_Latn,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
538
+ hne_Deva,198,174,213,24,239830,0.449612,0.878788,0.594872,0.999113,887.341018,0.878788
539
+ hnj_Latn,300,0,0,300,239941,0.0,0.0,0.0,1.0,0.0,0.0
540
+ hnn_Latn,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
541
+ hns_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
542
+ hop_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
543
+ hot_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
544
+ hra_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
545
+ hrv_Latn,168,146,1324,22,238749,0.09932,0.869048,0.178266,0.994485,5514.989191,0.869048
546
+ hrx_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
547
+ hsb_Latn,269,0,0,269,239972,0.0,0.0,0.0,1.0,0.0,0.0
548
+ hto_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
549
+ hub_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
550
+ hui_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
551
+ hun_Latn,576,576,3811,0,235854,0.131297,1.0,0.232118,0.984099,15901.362318,1.0
552
+ hus_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
553
+ huu_Latn,72,0,0,72,240169,0.0,0.0,0.0,1.0,0.0,0.0
554
+ huv_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
555
+ hvn_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
556
+ hwc_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
557
+ hye_Armn,178,170,225,8,239838,0.43038,0.955056,0.593368,0.999063,937.253971,0.955056
558
+ hyw_Armn,233,0,0,233,240008,0.0,0.0,0.0,1.0,0.0,0.0
559
+ ian_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
560
+ iba_Latn,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
561
+ ibg_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
562
+ ibo_Latn,257,254,1121,3,238863,0.184727,0.988327,0.311275,0.995329,4671.144743,0.988327
563
+ icr_Latn,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
564
+ ido_Latn,270,0,0,270,239971,0.0,0.0,0.0,1.0,0.0,0.0
565
+ idu_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
566
+ ifb_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
567
+ ife_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
568
+ ifk_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
569
+ ifu_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
570
+ ify_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
571
+ ige_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
572
+ ign_Latn,44,0,0,44,240197,0.0,0.0,0.0,1.0,0.0,0.0
573
+ ike_Cans,310,0,0,310,239931,0.0,0.0,0.0,1.0,0.0,0.0
574
+ ikk_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
575
+ ikt_Latn,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
576
+ ikw_Latn,21,0,0,21,240220,0.0,0.0,0.0,1.0,0.0,0.0
577
+ ile_Latn,252,0,0,252,239989,0.0,0.0,0.0,1.0,0.0,0.0
578
+ ilo_Latn,252,239,413,13,239576,0.366564,0.948413,0.528761,0.998279,1720.912208,0.948413
579
+ imo_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
580
+ ina_Latn,234,0,0,234,240007,0.0,0.0,0.0,1.0,0.0,0.0
581
+ inb_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
582
+ ind_Latn,335,311,1877,24,238029,0.142139,0.928358,0.246532,0.992176,7823.897693,0.928358
583
+ inh_Cyrl,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
584
+ ino_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
585
+ iou_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
586
+ ipi_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
587
+ irk_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
588
+ isd_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
589
+ ish_Latn,21,0,0,21,240220,0.0,0.0,0.0,1.0,0.0,0.0
590
+ isl_Latn,276,276,324,0,239641,0.46,1.0,0.630137,0.99865,1350.196904,1.0
591
+ iso_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
592
+ ita_Latn,342,335,508,7,239391,0.39739,0.979532,0.565401,0.997882,2117.557806,0.979532
593
+ itv_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
594
+ ium_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
595
+ ivv_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
596
+ iws_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
597
+ ixl_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
598
+ izr_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
599
+ izz_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
600
+ jac_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
601
+ jae_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
602
+ jam_Latn,196,0,0,196,240045,0.0,0.0,0.0,1.0,0.0,0.0
603
+ jav_Latn,158,156,2825,2,237258,0.052331,0.987342,0.099395,0.988233,11766.763994,0.987342
604
+ jbo_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
605
+ jbu_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
606
+ jic_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
607
+ jiv_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
608
+ jpn_Jpan,323,254,169,69,239749,0.600473,0.786378,0.680965,0.999296,704.407339,0.786378
609
+ jra_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
610
+ jvn_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
611
+ kaa_Cyrl,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
612
+ kaa_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
613
+ kab_Latn,165,162,382,3,239694,0.297794,0.981818,0.456982,0.998409,1591.162798,0.981818
614
+ kac_Latn,216,211,133,5,239892,0.613372,0.976852,0.753571,0.999446,554.108947,0.976852
615
+ kal_Latn,369,364,857,5,239015,0.298116,0.98645,0.457862,0.996427,3572.738794,0.98645
616
+ kam_Latn,272,207,228,65,239741,0.475862,0.761029,0.585573,0.99905,950.122724,0.761029
617
+ kan_Knda,601,600,100,1,239540,0.857143,0.998336,0.922367,0.999583,417.292606,0.998336
618
+ kan_Latn,264,0,0,264,239977,0.0,0.0,0.0,1.0,0.0,0.0
619
+ kao_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
620
+ kaq_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
621
+ kas_Arab,118,113,15,5,240108,0.882812,0.957627,0.918699,0.999938,62.467985,0.957627
622
+ kas_Deva,47,22,446,25,239748,0.047009,0.468085,0.085437,0.998143,1856.832394,0.468085
623
+ kat_Geor,324,315,16,9,239901,0.951662,0.972222,0.961832,0.999933,66.68973,0.972222
624
+ kaz_Cyrl,340,337,399,3,239502,0.45788,0.991176,0.626394,0.998337,1663.186064,0.991176
625
+ kbc_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
626
+ kbd_Cyrl,238,0,0,238,240003,0.0,0.0,0.0,1.0,0.0,0.0
627
+ kbh_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
628
+ kbm_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
629
+ kbp_Latn,130,125,1967,5,238144,0.059751,0.961538,0.112511,0.991808,8192.044513,0.961538
630
+ kbq_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
631
+ kbr_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
632
+ kby_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
633
+ kca_Cyrl,345,0,0,345,239896,0.0,0.0,0.0,1.0,0.0,0.0
634
+ kcg_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
635
+ kck_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
636
+ kdc_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
637
+ kde_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
638
+ kdh_Latn,34,0,0,34,240207,0.0,0.0,0.0,1.0,0.0,0.0
639
+ kdi_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
640
+ kdl_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
641
+ kea_Latn,205,159,438,46,239598,0.266332,0.77561,0.396509,0.998175,1824.726291,0.77561
642
+ kek_Latn,183,0,0,183,240058,0.0,0.0,0.0,1.0,0.0,0.0
643
+ ken_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
644
+ keo_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
645
+ kew_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
646
+ kez_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
647
+ kff_Telu,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
648
+ kgf_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
649
+ kgk_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
650
+ kgp_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
651
+ kha_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
652
+ khk_Cyrl,262,249,244,13,239735,0.505071,0.950382,0.659603,0.998983,1016.755633,0.950382
653
+ khm_Khmr,187,187,23,0,240031,0.890476,1.0,0.942065,0.999904,95.811776,1.0
654
+ khs_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
655
+ khz_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
656
+ kij_Latn,226,0,0,226,240015,0.0,0.0,0.0,1.0,0.0,0.0
657
+ kik_Latn,193,142,244,51,239804,0.367876,0.735751,0.490501,0.998984,1016.463374,0.735751
658
+ kin_Latn,210,201,377,9,239654,0.347751,0.957143,0.510152,0.998429,1570.63046,0.957143
659
+ kir_Cyrl,242,238,555,4,239444,0.300126,0.983471,0.459903,0.997687,2312.509635,0.983471
660
+ kiu_Latn,293,0,0,293,239948,0.0,0.0,0.0,1.0,0.0,0.0
661
+ kix_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
662
+ kjb_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
663
+ kje_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
664
+ kjh_Cyrl,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
665
+ kjs_Latn,201,0,0,201,240040,0.0,0.0,0.0,1.0,0.0,0.0
666
+ kkc_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
667
+ kki_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
668
+ kkj_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
669
+ kkl_Latn,84,0,0,84,240157,0.0,0.0,0.0,1.0,0.0,0.0
670
+ klt_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
671
+ klv_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
672
+ kmb_Latn,119,118,438,1,239684,0.21223,0.991597,0.34963,0.998176,1824.072763,0.991597
673
+ kmg_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
674
+ kmh_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
675
+ kmk_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
676
+ kmm_Latn,19,0,0,19,240222,0.0,0.0,0.0,1.0,0.0,0.0
677
+ kmo_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
678
+ kmr_Cyrl,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
679
+ kmr_Latn,289,289,859,0,239093,0.251742,1.0,0.402227,0.99642,3579.882643,1.0
680
+ kms_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
681
+ kmu_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
682
+ knc_Arab,68,1,204,67,239969,0.004878,0.014706,0.007326,0.999151,849.387733,0.014706
683
+ knc_Latn,293,286,1972,7,237976,0.126661,0.976109,0.224226,0.991782,8218.44733,0.976109
684
+ kne_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
685
+ knf_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
686
+ kng_Latn,362,344,321,18,239558,0.517293,0.950276,0.669912,0.998662,1338.174663,0.950276
687
+ knj_Latn,188,0,0,188,240053,0.0,0.0,0.0,1.0,0.0,0.0
688
+ knk_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
689
+ knv_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
690
+ koi_Cyrl,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
691
+ koo_Latn,297,0,0,297,239944,0.0,0.0,0.0,1.0,0.0,0.0
692
+ kor_Hang,265,264,691,1,239285,0.27644,0.996226,0.432787,0.997121,2879.454612,0.996226
693
+ kos_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
694
+ kpe_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
695
+ kpf_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
696
+ kpg_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
697
+ kpj_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
698
+ kpr_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
699
+ kpv_Cyrl,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
700
+ kpw_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
701
+ kpx_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
702
+ kpz_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
703
+ kqc_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
704
+ kqe_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
705
+ kqf_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
706
+ kqn_Latn,286,0,0,286,239955,0.0,0.0,0.0,1.0,0.0,0.0
707
+ kqp_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
708
+ kqw_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
709
+ krc_Cyrl,159,158,1472,1,238610,0.096933,0.993711,0.176635,0.993869,6131.238494,0.993711
710
+ kri_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
711
+ krj_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
712
+ krl_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
713
+ kru_Deva,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
714
+ ksc_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
715
+ ksd_Latn,202,0,0,202,240039,0.0,0.0,0.0,1.0,0.0,0.0
716
+ ksh_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
717
+ ksp_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
718
+ ksr_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
719
+ kss_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
720
+ ksw_Mymr,299,0,0,299,239942,0.0,0.0,0.0,1.0,0.0,0.0
721
+ ktj_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
722
+ kto_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
723
+ ktu_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
724
+ ktz_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
725
+ kua_Latn,476,0,0,476,239765,0.0,0.0,0.0,1.0,0.0,0.0
726
+ kud_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
727
+ kue_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
728
+ kum_Cyrl,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
729
+ kup_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
730
+ kus_Latn,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
731
+ kvg_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
732
+ kvn_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
733
+ kwd_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
734
+ kwf_Latn,150,0,0,150,240091,0.0,0.0,0.0,1.0,0.0,0.0
735
+ kwi_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
736
+ kwj_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
737
+ kwn_Latn,275,0,0,275,239966,0.0,0.0,0.0,1.0,0.0,0.0
738
+ kwy_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
739
+ kxc_Ethi,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
740
+ kxw_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
741
+ kyc_Latn,219,0,0,219,240022,0.0,0.0,0.0,1.0,0.0,0.0
742
+ kyf_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
743
+ kyg_Latn,201,0,0,201,240040,0.0,0.0,0.0,1.0,0.0,0.0
744
+ kyq_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
745
+ kyu_Kali,215,0,0,215,240026,0.0,0.0,0.0,1.0,0.0,0.0
746
+ kyz_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
747
+ kze_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
748
+ kzj_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
749
+ lac_Latn,230,0,0,230,240011,0.0,0.0,0.0,1.0,0.0,0.0
750
+ lad_Hebr,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
751
+ lad_Latn,302,0,0,302,239939,0.0,0.0,0.0,1.0,0.0,0.0
752
+ lai_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
753
+ laj_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
754
+ lam_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
755
+ lao_Laoo,335,329,24,6,239882,0.932011,0.98209,0.956395,0.9999,100.039182,0.98209
756
+ lat_Latn,282,0,0,282,239959,0.0,0.0,0.0,1.0,0.0,0.0
757
+ lbb_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
758
+ lbe_Cyrl,219,0,0,219,240022,0.0,0.0,0.0,1.0,0.0,0.0
759
+ lbj_Tibt,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
760
+ lbk_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
761
+ lcm_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
762
+ lcp_Thai,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
763
+ ldi_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
764
+ lee_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
765
+ lef_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
766
+ leh_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
767
+ leu_Latn,157,0,0,157,240084,0.0,0.0,0.0,1.0,0.0,0.0
768
+ lew_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
769
+ lex_Latn,163,0,0,163,240078,0.0,0.0,0.0,1.0,0.0,0.0
770
+ lez_Cyrl,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
771
+ lfn_Cyrl,55,0,0,55,240186,0.0,0.0,0.0,1.0,0.0,0.0
772
+ lfn_Latn,150,0,0,150,240091,0.0,0.0,0.0,1.0,0.0,0.0
773
+ lgg_Latn,279,0,0,279,239962,0.0,0.0,0.0,1.0,0.0,0.0
774
+ lgl_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
775
+ lhu_Latn,167,0,0,167,240074,0.0,0.0,0.0,1.0,0.0,0.0
776
+ lia_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
777
+ lid_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
778
+ lif_Deva,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
779
+ lif_Limb,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
780
+ lij_Latn,245,189,853,56,239143,0.181382,0.771429,0.293706,0.996446,3554.225904,0.771429
781
+ lim_Latn,196,183,1204,13,238841,0.131939,0.933673,0.231207,0.994984,5015.726218,0.933673
782
+ lin_Latn,215,212,429,3,239597,0.330733,0.986047,0.495327,0.998213,1787.306375,0.986047
783
+ lip_Latn,33,0,0,33,240208,0.0,0.0,0.0,1.0,0.0,0.0
784
+ lis_Lisu,6,0,0,6,240235,0.0,0.0,0.0,1.0,0.0,0.0
785
+ lit_Latn,330,319,322,11,239589,0.49766,0.966667,0.657055,0.998658,1342.164386,0.966667
786
+ liv_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
787
+ ljp_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
788
+ lki_Arab,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
789
+ lld_Latn,275,0,0,275,239966,0.0,0.0,0.0,1.0,0.0,0.0
790
+ llg_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
791
+ lmk_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
792
+ lmo_Latn,276,252,3242,24,236723,0.072124,0.913043,0.133687,0.98649,13510.303586,0.913043
793
+ lmp_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
794
+ lnd_Latn,5,0,0,5,240236,0.0,0.0,0.0,1.0,0.0,0.0
795
+ log_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
796
+ loq_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
797
+ loz_Latn,268,0,0,268,239973,0.0,0.0,0.0,1.0,0.0,0.0
798
+ lrc_Arab,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
799
+ lsm_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
800
+ ltg_Latn,259,246,664,13,239318,0.27033,0.949807,0.420873,0.997233,2766.874182,0.949807
801
+ ltz_Latn,251,251,556,0,239434,0.311029,1.0,0.47448,0.997683,2316.763198,1.0
802
+ lua_Latn,346,328,578,18,239317,0.362031,0.947977,0.523962,0.997591,2409.38744,0.947977
803
+ lub_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
804
+ luc_Latn,67,0,0,67,240174,0.0,0.0,0.0,1.0,0.0,0.0
805
+ lue_Latn,327,0,0,327,239914,0.0,0.0,0.0,1.0,0.0,0.0
806
+ lug_Latn,405,396,2663,9,237173,0.129454,0.977778,0.228637,0.988897,11103.420671,0.977778
807
+ lun_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
808
+ luo_Latn,415,384,2040,31,237786,0.158416,0.925301,0.270518,0.991494,8506.166971,0.925301
809
+ lus_Latn,391,383,2506,8,237344,0.132572,0.97954,0.233537,0.989552,10448.19679,0.97954
810
+ lvs_Latn,298,278,491,20,239452,0.361508,0.932886,0.521087,0.997954,2046.319334,0.932886
811
+ lwg_Latn,233,0,0,233,240008,0.0,0.0,0.0,1.0,0.0,0.0
812
+ lwo_Latn,41,0,0,41,240200,0.0,0.0,0.0,1.0,0.0,0.0
813
+ lww_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
814
+ lzh_Hani,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
815
+ maa_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
816
+ mad_Latn,183,0,0,183,240058,0.0,0.0,0.0,1.0,0.0,0.0
817
+ mag_Deva,97,78,557,19,239587,0.122835,0.804124,0.213115,0.997681,2319.441668,0.804124
818
+ mah_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
819
+ mai_Deva,234,223,234,11,239773,0.487965,0.952991,0.645441,0.999025,974.971563,0.952991
820
+ maj_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
821
+ mak_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
822
+ mal_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
823
+ mal_Mlym,338,334,31,4,239872,0.915068,0.988166,0.950213,0.999871,129.218893,0.988166
824
+ mam_Latn,233,0,0,233,240008,0.0,0.0,0.0,1.0,0.0,0.0
825
+ maq_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
826
+ mar_Deva,589,575,78,14,239574,0.880551,0.976231,0.925926,0.999675,325.471934,0.976231
827
+ mar_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
828
+ mas_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
829
+ mau_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
830
+ mav_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
831
+ maz_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
832
+ mbb_Latn,212,0,0,212,240029,0.0,0.0,0.0,1.0,0.0,0.0
833
+ mbc_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
834
+ mbd_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
835
+ mbf_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
836
+ mbh_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
837
+ mbi_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
838
+ mbj_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
839
+ mbl_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
840
+ mbs_Latn,209,0,0,209,240032,0.0,0.0,0.0,1.0,0.0,0.0
841
+ mbt_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
842
+ mca_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
843
+ mcb_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
844
+ mcd_Latn,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
845
+ mcf_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
846
+ mck_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
847
+ mco_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
848
+ mcp_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
849
+ mcq_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
850
+ mcu_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
851
+ mdf_Cyrl,217,0,0,217,240024,0.0,0.0,0.0,1.0,0.0,0.0
852
+ mdy_Ethi,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
853
+ med_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
854
+ mee_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
855
+ mej_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
856
+ mek_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
857
+ men_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
858
+ meq_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
859
+ mer_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
860
+ meu_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
861
+ mfe_Latn,250,0,0,250,239991,0.0,0.0,0.0,1.0,0.0,0.0
862
+ mfi_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
863
+ mfq_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
864
+ mfy_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
865
+ mfz_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
866
+ mgh_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
867
+ mgr_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
868
+ mhi_Latn,23,0,0,23,240218,0.0,0.0,0.0,1.0,0.0,0.0
869
+ mhl_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
870
+ mhr_Cyrl,291,0,0,291,239950,0.0,0.0,0.0,1.0,0.0,0.0
871
+ mhx_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
872
+ mib_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
873
+ mic_Latn,255,0,0,255,239986,0.0,0.0,0.0,1.0,0.0,0.0
874
+ mie_Latn,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
875
+ mif_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
876
+ mig_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
877
+ mih_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
878
+ mil_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
879
+ mim_Latn,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
880
+ min_Latn,55,11,3,44,240183,0.785714,0.2,0.318841,0.999988,12.49032,0.2
881
+ mio_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
882
+ mip_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
883
+ miq_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
884
+ mir_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
885
+ mit_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
886
+ miy_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
887
+ miz_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
888
+ mjc_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
889
+ mjw_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
890
+ mkd_Cyrl,331,328,106,3,239804,0.75576,0.990937,0.857516,0.999558,441.832354,0.990937
891
+ mkl_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
892
+ mkn_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
893
+ mks_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
894
+ mlh_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
895
+ mlp_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
896
+ mlt_Latn,291,274,193,17,239757,0.586724,0.941581,0.722955,0.999196,804.334236,0.941581
897
+ mlu_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
898
+ mmn_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
899
+ mmo_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
900
+ mmx_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
901
+ mna_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
902
+ mnb_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
903
+ mni_Beng,304,275,7,29,239930,0.975177,0.904605,0.938567,0.999971,29.174325,0.904605
904
+ mni_Latn,280,0,0,280,239961,0.0,0.0,0.0,1.0,0.0,0.0
905
+ mni_Mtei,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
906
+ mnk_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
907
+ mns_Cyrl,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
908
+ mnw_Mymr,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
909
+ mny_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
910
+ mog_Latn,2,0,0,2,240239,0.0,0.0,0.0,1.0,0.0,0.0
911
+ moh_Latn,195,0,0,195,240046,0.0,0.0,0.0,1.0,0.0,0.0
912
+ mop_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
913
+ mor_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
914
+ mos_Latn,133,130,753,3,239355,0.147225,0.977444,0.255906,0.996864,3136.08876,0.977444
915
+ mox_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
916
+ mpm_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
917
+ mpp_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
918
+ mps_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
919
+ mpt_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
920
+ mpx_Latn,205,0,0,205,240036,0.0,0.0,0.0,1.0,0.0,0.0
921
+ mqb_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
922
+ mqj_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
923
+ mqy_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
924
+ mri_Latn,162,159,2755,3,237324,0.054564,0.981481,0.103381,0.988525,11475.389351,0.981481
925
+ mrj_Cyrl,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
926
+ mrq_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
927
+ mrw_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
928
+ msb_Latn,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
929
+ msk_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
930
+ msy_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
931
+ mta_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
932
+ mti_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
933
+ mto_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
934
+ mtp_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
935
+ muh_Latn,67,0,0,67,240174,0.0,0.0,0.0,1.0,0.0,0.0
936
+ mui_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
937
+ mup_Deva,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
938
+ mur_Latn,312,0,0,312,239929,0.0,0.0,0.0,1.0,0.0,0.0
939
+ mus_Latn,2,0,0,2,240239,0.0,0.0,0.0,1.0,0.0,0.0
940
+ mux_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
941
+ muy_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
942
+ mva_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
943
+ mvn_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
944
+ mvp_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
945
+ mwc_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
946
+ mwl_Latn,157,0,0,157,240084,0.0,0.0,0.0,1.0,0.0,0.0
947
+ mwn_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
948
+ mwp_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
949
+ mwq_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
950
+ mwv_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
951
+ mww_Latn,235,0,0,235,240006,0.0,0.0,0.0,1.0,0.0,0.0
952
+ mxb_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
953
+ mxp_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
954
+ mxq_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
955
+ mxt_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
956
+ mxv_Latn,202,0,0,202,240039,0.0,0.0,0.0,1.0,0.0,0.0
957
+ mya_Mymr,342,335,416,7,239483,0.446072,0.979532,0.612992,0.998266,1734.063085,0.979532
958
+ myk_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
959
+ myu_Latn,51,0,0,51,240190,0.0,0.0,0.0,1.0,0.0,0.0
960
+ myv_Cyrl,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
961
+ myw_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
962
+ myx_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
963
+ myy_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
964
+ mza_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
965
+ mzh_Latn,26,0,0,26,240215,0.0,0.0,0.0,1.0,0.0,0.0
966
+ mzn_Arab,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
967
+ mzw_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
968
+ mzz_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
969
+ naf_Latn,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
970
+ nah_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
971
+ nak_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
972
+ nan_Hani,75,0,0,75,240166,0.0,0.0,0.0,1.0,0.0,0.0
973
+ nan_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
974
+ nap_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
975
+ naq_Latn,274,0,0,274,239967,0.0,0.0,0.0,1.0,0.0,0.0
976
+ nas_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
977
+ nav_Latn,113,106,1283,7,238845,0.076314,0.938053,0.141145,0.994657,5342.983742,0.938053
978
+ nba_Latn,231,0,0,231,240010,0.0,0.0,0.0,1.0,0.0,0.0
979
+ nbe_Latn,72,0,0,72,240169,0.0,0.0,0.0,1.0,0.0,0.0
980
+ nbl_Latn,528,0,0,528,239713,0.0,0.0,0.0,1.0,0.0,0.0
981
+ nbq_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
982
+ nbu_Latn,351,0,0,351,239890,0.0,0.0,0.0,1.0,0.0,0.0
983
+ nca_Latn,215,0,0,215,240026,0.0,0.0,0.0,1.0,0.0,0.0
984
+ nch_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
985
+ ncj_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
986
+ ncl_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
987
+ ncq_Laoo,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
988
+ ncu_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
989
+ ncx_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
990
+ ndc_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
991
+ nde_Latn,256,0,0,256,239985,0.0,0.0,0.0,1.0,0.0,0.0
992
+ ndh_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
993
+ ndo_Latn,325,0,0,325,239916,0.0,0.0,0.0,1.0,0.0,0.0
994
+ nds_Latn,296,0,0,296,239945,0.0,0.0,0.0,1.0,0.0,0.0
995
+ neb_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
996
+ new_Deva,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
997
+ nfa_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
998
+ nfr_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
999
+ ngl_Latn,175,0,0,175,240066,0.0,0.0,0.0,1.0,0.0,0.0
1000
+ ngp_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1001
+ ngu_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
1002
+ nhe_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
1003
+ nhg_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1004
+ nhi_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
1005
+ nho_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
1006
+ nhr_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1007
+ nhu_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
1008
+ nhw_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
1009
+ nhx_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
1010
+ nhy_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
1011
+ nia_Latn,242,239,638,3,239361,0.27252,0.987603,0.427167,0.997342,2658.34441,0.987603
1012
+ nif_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
1013
+ nii_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
1014
+ nij_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1015
+ nim_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
1016
+ nin_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
1017
+ niu_Latn,204,0,0,204,240037,0.0,0.0,0.0,1.0,0.0,0.0
1018
+ njb_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
1019
+ njm_Latn,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
1020
+ njn_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1021
+ njo_Latn,256,0,0,256,239985,0.0,0.0,0.0,1.0,0.0,0.0
1022
+ njz_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
1023
+ nko_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1024
+ nld_Latn,259,250,609,9,239373,0.291036,0.965251,0.447227,0.997462,2537.690327,0.965251
1025
+ nlg_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1026
+ nmf_Latn,294,0,0,294,239947,0.0,0.0,0.0,1.0,0.0,0.0
1027
+ nmo_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1028
+ nmz_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1029
+ nnb_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1030
+ nno_Latn,427,406,68,21,239746,0.85654,0.95082,0.901221,0.999716,283.553087,0.95082
1031
+ nnq_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1032
+ nnw_Latn,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
1033
+ noa_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
1034
+ nob_Latn,265,241,102,24,239874,0.702624,0.909434,0.792763,0.999575,425.042504,0.909434
1035
+ nod_Thai,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1036
+ nog_Cyrl,219,0,0,219,240022,0.0,0.0,0.0,1.0,0.0,0.0
1037
+ non_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
1038
+ nop_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1039
+ not_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1040
+ nou_Latn,84,0,0,84,240157,0.0,0.0,0.0,1.0,0.0,0.0
1041
+ nov_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1042
+ nph_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1043
+ npi_Deva,273,268,305,5,239663,0.467714,0.981685,0.63357,0.998729,1271.0028,0.981685
1044
+ npi_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
1045
+ npl_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1046
+ npy_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1047
+ nqo_Nkoo,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
1048
+ nre_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
1049
+ nrf_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
1050
+ nrm_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
1051
+ nse_Latn,12,0,0,12,240229,0.0,0.0,0.0,1.0,0.0,0.0
1052
+ nsm_Latn,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
1053
+ nsn_Latn,198,0,0,198,240043,0.0,0.0,0.0,1.0,0.0,0.0
1054
+ nso_Latn,479,458,65,21,239697,0.875717,0.956159,0.914172,0.999729,271.102176,0.956159
1055
+ nss_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1056
+ nsu_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
1057
+ ntp_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1058
+ ntr_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1059
+ ntu_Latn,150,0,0,150,240091,0.0,0.0,0.0,1.0,0.0,0.0
1060
+ nuj_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
1061
+ nus_Latn,199,195,1197,4,238845,0.140086,0.979899,0.245129,0.995013,4986.62734,0.979899
1062
+ nuy_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
1063
+ nvm_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
1064
+ nwi_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
1065
+ nya_Latn,262,231,1132,31,238847,0.169479,0.881679,0.284308,0.995283,4717.079411,0.881679
1066
+ nyf_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1067
+ nyn_Latn,279,0,0,279,239962,0.0,0.0,0.0,1.0,0.0,0.0
1068
+ nyo_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1069
+ nyu_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
1070
+ nyy_Latn,259,0,0,259,239982,0.0,0.0,0.0,1.0,0.0,0.0
1071
+ nzi_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1072
+ obo_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1073
+ oci_Latn,333,328,934,5,238974,0.259905,0.984985,0.411285,0.996107,3893.159044,0.984985
1074
+ ogo_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
1075
+ ojb_Cans,237,0,0,237,240004,0.0,0.0,0.0,1.0,0.0,0.0
1076
+ ojb_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
1077
+ oke_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
1078
+ okv_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
1079
+ old_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
1080
+ olo_Latn,245,0,0,245,239996,0.0,0.0,0.0,1.0,0.0,0.0
1081
+ omw_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1082
+ ong_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1083
+ ons_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
1084
+ opm_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
1085
+ orv_Cyrl,239,0,0,239,240002,0.0,0.0,0.0,1.0,0.0,0.0
1086
+ ory_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1087
+ ory_Orya,511,507,21,4,239709,0.960227,0.992172,0.975938,0.999912,87.598548,0.992172
1088
+ oss_Cyrl,152,152,94,0,239995,0.617886,1.0,0.763819,0.999608,391.521477,1.0
1089
+ ota_Arab,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
1090
+ ote_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1091
+ otm_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1092
+ otq_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
1093
+ ots_Latn,44,0,0,44,240197,0.0,0.0,0.0,1.0,0.0,0.0
1094
+ otw_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
1095
+ ozm_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1096
+ pab_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
1097
+ pad_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1098
+ pag_Latn,122,117,1310,5,238809,0.08199,0.959016,0.151065,0.994544,5455.628251,0.959016
1099
+ pah_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1100
+ pam_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1101
+ pan_Guru,460,451,0,9,239781,1.0,0.980435,0.990121,1.0,0.0,0.980435
1102
+ pan_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
1103
+ pao_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
1104
+ pap_Latn,423,416,590,7,239228,0.413519,0.983452,0.582225,0.99754,2460.198984,0.983452
1105
+ pau_Latn,265,0,0,265,239976,0.0,0.0,0.0,1.0,0.0,0.0
1106
+ pbb_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
1107
+ pbt_Arab,419,403,13,16,239809,0.96875,0.961814,0.965269,0.999946,54.20687,0.961814
1108
+ pcd_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
1109
+ pck_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
1110
+ pcm_Latn,251,93,138,158,239852,0.402597,0.370518,0.385892,0.999425,575.023959,0.370518
1111
+ pdc_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
1112
+ pdt_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
1113
+ pem_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1114
+ pfl_Latn,222,0,0,222,240019,0.0,0.0,0.0,1.0,0.0,0.0
1115
+ pib_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1116
+ pio_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
1117
+ pir_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1118
+ pis_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
1119
+ pjt_Latn,179,0,0,179,240062,0.0,0.0,0.0,1.0,0.0,0.0
1120
+ plg_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1121
+ pls_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
1122
+ plt_Latn,248,243,356,5,239637,0.405676,0.979839,0.57379,0.998517,1483.376598,0.979839
1123
+ plu_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1124
+ plw_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
1125
+ pma_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1126
+ pmf_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1127
+ pmq_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
1128
+ pms_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
1129
+ pnb_Arab,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
1130
+ pnt_Grek,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
1131
+ poe_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1132
+ poh_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1133
+ poi_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
1134
+ pol_Latn,254,253,1182,1,238805,0.176307,0.996063,0.299586,0.995075,4925.266785,0.996063
1135
+ pon_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
1136
+ por_Latn,657,637,393,20,239191,0.618447,0.969559,0.755187,0.99836,1640.343262,0.969559
1137
+ pot_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
1138
+ pov_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
1139
+ poy_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1140
+ ppk_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1141
+ ppo_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
1142
+ prf_Latn,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
1143
+ prg_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1144
+ pri_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1145
+ ptp_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1146
+ ptu_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
1147
+ pwg_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
1148
+ pwn_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1149
+ pxm_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
1150
+ qub_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
1151
+ quc_Latn,310,0,0,310,239931,0.0,0.0,0.0,1.0,0.0,0.0
1152
+ quf_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
1153
+ qug_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1154
+ quh_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1155
+ qup_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
1156
+ quw_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
1157
+ quy_Latn,271,262,3808,9,236162,0.064373,0.96679,0.12071,0.984131,15868.650248,0.96679
1158
+ quz_Latn,205,0,0,205,240036,0.0,0.0,0.0,1.0,0.0,0.0
1159
+ qva_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1160
+ qvc_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
1161
+ qve_Latn,54,0,0,54,240187,0.0,0.0,0.0,1.0,0.0,0.0
1162
+ qvh_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
1163
+ qvi_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1164
+ qvm_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
1165
+ qvn_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
1166
+ qvs_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1167
+ qvw_Latn,175,0,0,175,240066,0.0,0.0,0.0,1.0,0.0,0.0
1168
+ qvz_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
1169
+ qwh_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1170
+ qxh_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
1171
+ qxl_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
1172
+ qxn_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1173
+ qxo_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1174
+ qxr_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1175
+ rad_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
1176
+ rai_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
1177
+ rap_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
1178
+ rar_Latn,368,0,0,368,239873,0.0,0.0,0.0,1.0,0.0,0.0
1179
+ rav_Deva,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
1180
+ raw_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
1181
+ rcf_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
1182
+ rej_Latn,33,0,0,33,240208,0.0,0.0,0.0,1.0,0.0,0.0
1183
+ rgu_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
1184
+ ria_Latn,23,0,0,23,240218,0.0,0.0,0.0,1.0,0.0,0.0
1185
+ rim_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1186
+ rkb_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1187
+ rmc_Latn,341,0,0,341,239900,0.0,0.0,0.0,1.0,0.0,0.0
1188
+ rml_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1189
+ rmn_Cyrl,223,0,0,223,240018,0.0,0.0,0.0,1.0,0.0,0.0
1190
+ rmn_Grek,185,0,0,185,240056,0.0,0.0,0.0,1.0,0.0,0.0
1191
+ rmn_Latn,236,0,0,236,240005,0.0,0.0,0.0,1.0,0.0,0.0
1192
+ rmo_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1193
+ rmq_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
1194
+ rmy_Cyrl,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
1195
+ rmy_Latn,265,0,0,265,239976,0.0,0.0,0.0,1.0,0.0,0.0
1196
+ rnd_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
1197
+ rng_Latn,209,0,0,209,240032,0.0,0.0,0.0,1.0,0.0,0.0
1198
+ roh_Latn,307,302,306,5,239628,0.496711,0.983713,0.660109,0.998725,1275.350721,0.983713
1199
+ ron_Cyrl,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1200
+ ron_Latn,369,365,133,4,239739,0.732932,0.98916,0.841984,0.999446,554.46238,0.98916
1201
+ roo_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
1202
+ rop_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1203
+ row_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
1204
+ rro_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1205
+ rtm_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
1206
+ rub_Latn,31,0,0,31,240210,0.0,0.0,0.0,1.0,0.0,0.0
1207
+ rue_Cyrl,301,0,0,301,239940,0.0,0.0,0.0,1.0,0.0,0.0
1208
+ ruf_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
1209
+ rug_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
1210
+ run_Latn,291,229,674,62,239276,0.253599,0.786942,0.383585,0.997191,2808.918525,0.786942
1211
+ rup_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
1212
+ rus_Cyrl,528,483,1080,45,238633,0.309021,0.914773,0.46198,0.995495,4505.387693,0.914773
1213
+ rwo_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
1214
+ sab_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1215
+ sag_Latn,237,230,186,7,239818,0.552885,0.970464,0.704441,0.999225,774.987084,0.970464
1216
+ sah_Cyrl,260,0,0,260,239981,0.0,0.0,0.0,1.0,0.0,0.0
1217
+ san_Deva,239,230,116,9,239886,0.66474,0.962343,0.786325,0.999517,483.329306,0.962343
1218
+ san_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
1219
+ sas_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
1220
+ sat_Latn,239,0,0,239,240002,0.0,0.0,0.0,1.0,0.0,0.0
1221
+ sat_Olck,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1222
+ sbe_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
1223
+ sbl_Latn,74,0,0,74,240167,0.0,0.0,0.0,1.0,0.0,0.0
1224
+ sby_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1225
+ sck_Deva,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
1226
+ scn_Latn,172,171,1616,1,238453,0.095691,0.994186,0.174579,0.993269,6731.398056,0.994186
1227
+ sco_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
1228
+ sda_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1229
+ sdc_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1230
+ sdh_Arab,400,0,0,400,239841,0.0,0.0,0.0,1.0,0.0,0.0
1231
+ seh_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
1232
+ ses_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
1233
+ sey_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
1234
+ sgb_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1235
+ sgc_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1236
+ sgh_Cyrl,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
1237
+ sgs_Latn,218,0,0,218,240023,0.0,0.0,0.0,1.0,0.0,0.0
1238
+ sgw_Ethi,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1239
+ sgz_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1240
+ shi_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
1241
+ shn_Mymr,174,169,11,5,240056,0.938889,0.971264,0.954802,0.999954,45.820542,0.971264
1242
+ shp_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1243
+ sid_Latn,193,0,0,193,240048,0.0,0.0,0.0,1.0,0.0,0.0
1244
+ sig_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
1245
+ sil_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1246
+ sim_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1247
+ sin_Sinh,232,231,0,1,240009,1.0,0.99569,0.99784,1.0,0.0,0.99569
1248
+ sja_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
1249
+ skg_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1250
+ skr_Arab,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1251
+ slk_Latn,374,357,510,17,239357,0.411765,0.954545,0.575342,0.997874,2126.178257,0.954545
1252
+ sll_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
1253
+ slv_Latn,338,320,646,18,239257,0.331263,0.946746,0.490798,0.997307,2692.754988,0.946746
1254
+ sma_Latn,327,0,0,327,239914,0.0,0.0,0.0,1.0,0.0,0.0
1255
+ sme_Latn,246,0,0,246,239995,0.0,0.0,0.0,1.0,0.0,0.0
1256
+ smj_Latn,407,0,0,407,239834,0.0,0.0,0.0,1.0,0.0,0.0
1257
+ smk_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
1258
+ sml_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1259
+ smn_Latn,293,0,0,293,239948,0.0,0.0,0.0,1.0,0.0,0.0
1260
+ smo_Latn,426,418,1186,8,238629,0.260599,0.981221,0.411823,0.995055,4945.478807,0.981221
1261
+ sms_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
1262
+ sna_Latn,415,408,2016,7,237810,0.168317,0.983133,0.287425,0.991594,8406.094418,0.983133
1263
+ snc_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1264
+ snd_Arab,325,324,29,1,239887,0.917847,0.996923,0.955752,0.999879,120.87564,0.996923
1265
+ snd_Deva,267,0,0,267,239974,0.0,0.0,0.0,1.0,0.0,0.0
1266
+ snd_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
1267
+ snf_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1268
+ snn_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1269
+ snp_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1270
+ snw_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
1271
+ sny_Latn,163,0,0,163,240078,0.0,0.0,0.0,1.0,0.0,0.0
1272
+ som_Latn,439,436,917,3,238885,0.322247,0.993166,0.486607,0.996176,3823.988124,0.993166
1273
+ sop_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1274
+ soq_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
1275
+ sot_Latn,491,375,270,116,239480,0.581395,0.763747,0.660211,0.998874,1126.173097,0.763747
1276
+ soy_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
1277
+ spa_Latn,1136,1031,1423,105,237682,0.42013,0.90757,0.574373,0.994049,5951.360281,0.90757
1278
+ spl_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1279
+ spm_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
1280
+ spp_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
1281
+ sps_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
1282
+ spy_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1283
+ srd_Latn,139,125,181,14,239921,0.408497,0.899281,0.561798,0.999246,753.846282,0.899281
1284
+ srm_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
1285
+ srn_Latn,303,0,0,303,239938,0.0,0.0,0.0,1.0,0.0,0.0
1286
+ srp_Cyrl,269,266,174,3,239798,0.604545,0.988848,0.750353,0.999275,725.084593,0.988848
1287
+ srp_Latn,235,0,0,235,240006,0.0,0.0,0.0,1.0,0.0,0.0
1288
+ srq_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
1289
+ srr_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1290
+ ssd_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1291
+ ssg_Latn,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
1292
+ ssw_Latn,322,314,440,8,239479,0.416446,0.975155,0.583643,0.998166,1833.952292,0.975155
1293
+ ssx_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1294
+ stp_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
1295
+ stq_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1296
+ sua_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
1297
+ suc_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
1298
+ sue_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1299
+ suk_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1300
+ sun_Latn,143,142,1694,1,238404,0.077342,0.993007,0.143507,0.992945,7055.452357,0.993007
1301
+ sur_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
1302
+ sus_Arab,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1303
+ sus_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
1304
+ suz_Deva,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1305
+ swc_Latn,273,0,0,273,239968,0.0,0.0,0.0,1.0,0.0,0.0
1306
+ swe_Latn,328,314,94,14,239819,0.769608,0.957317,0.853261,0.999608,391.808697,0.957317
1307
+ swg_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1308
+ swh_Latn,592,571,2139,21,237510,0.210701,0.964527,0.345851,0.991074,8925.553622,0.964527
1309
+ swp_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
1310
+ sxb_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1311
+ sxn_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1312
+ syb_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1313
+ syc_Syrc,193,0,0,193,240048,0.0,0.0,0.0,1.0,0.0,0.0
1314
+ syl_Beng,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1315
+ syl_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1316
+ szl_Latn,320,279,1242,41,238679,0.183432,0.871875,0.303096,0.994823,5176.703998,0.871875
1317
+ szy_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
1318
+ tab_Cyrl,196,0,0,196,240045,0.0,0.0,0.0,1.0,0.0,0.0
1319
+ tac_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1320
+ tah_Latn,242,238,638,4,239361,0.271689,0.983471,0.42576,0.997342,2658.34441,0.983471
1321
+ taj_Deva,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
1322
+ tam_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1323
+ tam_Taml,754,750,51,4,239436,0.93633,0.994695,0.96463,0.999787,212.955192,0.994695
1324
+ taq_Latn,106,80,1134,26,239001,0.065898,0.754717,0.121212,0.995278,4722.343682,0.754717
1325
+ taq_Tfng,104,0,1,104,240136,0.0,0.0,0.0,0.999996,4.16429,0.0
1326
+ tar_Latn,190,0,0,190,240051,0.0,0.0,0.0,1.0,0.0,0.0
1327
+ tat_Cyrl,201,200,941,1,239099,0.175285,0.995025,0.298063,0.99608,3920.17997,0.995025
1328
+ tat_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
1329
+ tav_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
1330
+ taw_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1331
+ tay_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
1332
+ tbc_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
1333
+ tbg_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1334
+ tbo_Latn,202,0,0,202,240039,0.0,0.0,0.0,1.0,0.0,0.0
1335
+ tby_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
1336
+ tbz_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1337
+ tca_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
1338
+ tcf_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
1339
+ tcs_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1340
+ tcy_Knda,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1341
+ tcz_Latn,291,0,0,291,239950,0.0,0.0,0.0,1.0,0.0,0.0
1342
+ tdt_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1343
+ ted_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
1344
+ tee_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
1345
+ tel_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
1346
+ tel_Telu,555,554,56,1,239630,0.908197,0.998198,0.951073,0.999766,233.639011,0.998198
1347
+ tem_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1348
+ teo_Latn,225,0,0,225,240016,0.0,0.0,0.0,1.0,0.0,0.0
1349
+ ter_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1350
+ tet_Latn,395,0,0,395,239846,0.0,0.0,0.0,1.0,0.0,0.0
1351
+ tew_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1352
+ tfr_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1353
+ tgk_Cyrl,413,404,394,9,239434,0.506266,0.978208,0.667217,0.998357,1642.844038,0.978208
1354
+ tgo_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1355
+ tgp_Latn,189,0,0,189,240052,0.0,0.0,0.0,1.0,0.0,0.0
1356
+ tha_Thai,431,415,430,16,239380,0.491124,0.962877,0.65047,0.998207,1793.086193,0.962877
1357
+ thk_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
1358
+ thl_Deva,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
1359
+ tif_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
1360
+ tih_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1361
+ tim_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
1362
+ tir_Ethi,339,336,279,3,239623,0.546341,0.99115,0.704403,0.998837,1162.974881,0.99115
1363
+ tiv_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
1364
+ tiy_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1365
+ tkl_Latn,208,0,0,208,240033,0.0,0.0,0.0,1.0,0.0,0.0
1366
+ tkr_Cyrl,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
1367
+ tku_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1368
+ tlf_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
1369
+ tlh_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
1370
+ tll_Latn,186,0,0,186,240055,0.0,0.0,0.0,1.0,0.0,0.0
1371
+ tly_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
1372
+ tmd_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
1373
+ tna_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1374
+ tnk_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1375
+ tnn_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1376
+ tnp_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
1377
+ tob_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1378
+ toc_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
1379
+ tod_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1380
+ tog_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
1381
+ toh_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
1382
+ toi_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
1383
+ toj_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1384
+ tok_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
1385
+ ton_Latn,298,0,734,298,239209,0.0,0.0,0.0,0.996941,3059.05986,0.0
1386
+ too_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
1387
+ top_Latn,259,0,0,259,239982,0.0,0.0,0.0,1.0,0.0,0.0
1388
+ tos_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1389
+ tpi_Latn,302,296,167,6,239772,0.639309,0.980132,0.773856,0.999304,696.010236,0.980132
1390
+ tpm_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
1391
+ tpp_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
1392
+ tpt_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1393
+ tpz_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1394
+ trc_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
1395
+ trn_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1396
+ trp_Latn,186,0,0,186,240055,0.0,0.0,0.0,1.0,0.0,0.0
1397
+ trq_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1398
+ trv_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1399
+ tsc_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1400
+ tsg_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1401
+ tsn_Latn,456,441,456,15,239329,0.491639,0.967105,0.651885,0.998098,1901.703609,0.967105
1402
+ tso_Latn,581,567,1517,14,238143,0.272073,0.975904,0.425516,0.99367,6329.800551,0.975904
1403
+ tsw_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
1404
+ tsz_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1405
+ ttc_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
1406
+ tte_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
1407
+ ttj_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1408
+ tuc_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1409
+ tue_Latn,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
1410
+ tuf_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
1411
+ tui_Latn,4,0,0,4,240237,0.0,0.0,0.0,1.0,0.0,0.0
1412
+ tuk_Arab,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1413
+ tuk_Cyrl,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1414
+ tuk_Latn,227,219,85,8,239929,0.720395,0.964758,0.824859,0.999646,354.146008,0.964758
1415
+ tum_Latn,265,257,429,8,239547,0.374636,0.969811,0.540484,0.998212,1787.678768,0.969811
1416
+ tuo_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1417
+ tur_Latn,430,423,396,7,239415,0.516484,0.983721,0.677342,0.998349,1651.300399,0.983721
1418
+ tuv_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
1419
+ tvk_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1420
+ tvl_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
1421
+ twi_Latn,359,353,3406,6,236476,0.093908,0.983287,0.171442,0.985801,14198.647668,0.983287
1422
+ twu_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1423
+ txq_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
1424
+ txu_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
1425
+ tyv_Cyrl,273,0,0,273,239968,0.0,0.0,0.0,1.0,0.0,0.0
1426
+ tzh_Latn,347,0,0,347,239894,0.0,0.0,0.0,1.0,0.0,0.0
1427
+ tzj_Latn,190,0,0,190,240051,0.0,0.0,0.0,1.0,0.0,0.0
1428
+ tzm_Tfng,157,157,238,0,239846,0.397468,1.0,0.568841,0.999009,991.319705,1.0
1429
+ tzo_Latn,294,0,0,294,239947,0.0,0.0,0.0,1.0,0.0,0.0
1430
+ ubr_Latn,194,0,0,194,240047,0.0,0.0,0.0,1.0,0.0,0.0
1431
+ ubu_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
1432
+ udm_Cyrl,159,115,172,44,239910,0.400697,0.72327,0.515695,0.999284,716.421889,0.72327
1433
+ udu_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1434
+ uig_Arab,334,333,65,1,239842,0.836683,0.997006,0.909836,0.999729,270.938322,0.997006
1435
+ uig_Cyrl,253,0,0,253,239988,0.0,0.0,0.0,1.0,0.0,0.0
1436
+ uig_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
1437
+ ukr_Cyrl,322,316,463,6,239456,0.405648,0.981366,0.574024,0.99807,1929.81798,0.981366
1438
+ umb_Latn,100,96,1345,4,238796,0.06662,0.96,0.124594,0.994399,5600.876152,0.96
1439
+ und_Bali,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1440
+ und_Bamu,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
1441
+ und_Bopo,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
1442
+ und_Cans,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
1443
+ und_Cher,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
1444
+ und_Cyrl,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
1445
+ und_Deva,5,0,0,5,240236,0.0,0.0,0.0,1.0,0.0,0.0
1446
+ und_Egyp,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1447
+ und_Ethi,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
1448
+ und_Geor,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
1449
+ und_Goth,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
1450
+ und_Grek,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1451
+ und_Hebr,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
1452
+ und_Hluw,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
1453
+ und_Hung,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1454
+ und_Kana,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1455
+ und_Khmr,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
1456
+ und_Lana,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
1457
+ und_Laoo,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1458
+ und_Lina,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
1459
+ und_Mlym,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1460
+ und_Mong,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1461
+ und_Mymr,27,0,0,27,240214,0.0,0.0,0.0,1.0,0.0,0.0
1462
+ und_Newa,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
1463
+ und_Orya,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
1464
+ und_Shaw,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1465
+ und_Sylo,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
1466
+ und_Syrc,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
1467
+ und_Taml,52,0,0,52,240189,0.0,0.0,0.0,1.0,0.0,0.0
1468
+ und_Tang,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1469
+ und_Telu,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1470
+ und_Thaa,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
1471
+ und_Thai,23,0,0,23,240218,0.0,0.0,0.0,1.0,0.0,0.0
1472
+ und_Tibt,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
1473
+ und_Vaii,12,0,0,12,240229,0.0,0.0,0.0,1.0,0.0,0.0
1474
+ und_Xsux,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
1475
+ und_Yiii,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1476
+ upv_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1477
+ ura_Latn,75,0,0,75,240166,0.0,0.0,0.0,1.0,0.0,0.0
1478
+ urb_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
1479
+ urd_Arab,257,257,796,0,239188,0.244065,1.0,0.392366,0.996683,3316.887793,1.0
1480
+ urd_Latn,204,0,0,204,240037,0.0,0.0,0.0,1.0,0.0,0.0
1481
+ urh_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1482
+ urk_Thai,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1483
+ urt_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1484
+ usa_Latn,157,0,0,157,240084,0.0,0.0,0.0,1.0,0.0,0.0
1485
+ usp_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1486
+ uth_Latn,19,0,0,19,240222,0.0,0.0,0.0,1.0,0.0,0.0
1487
+ uvh_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1488
+ uvl_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
1489
+ uzn_Cyrl,213,0,0,213,240028,0.0,0.0,0.0,1.0,0.0,0.0
1490
+ uzn_Latn,436,425,1033,11,238772,0.291495,0.974771,0.448786,0.995692,4307.666646,0.974771
1491
+ uzs_Arab,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
1492
+ vap_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1493
+ var_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1494
+ vec_Latn,49,40,664,9,239528,0.056818,0.816327,0.106242,0.997236,2764.455103,0.816327
1495
+ ven_Latn,387,0,0,387,239854,0.0,0.0,0.0,1.0,0.0,0.0
1496
+ vep_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
1497
+ vid_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1498
+ vie_Latn,338,329,681,9,239222,0.325743,0.973373,0.488131,0.997161,2838.647287,0.973373
1499
+ viv_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
1500
+ vls_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1501
+ vmw_Latn,386,0,0,386,239855,0.0,0.0,0.0,1.0,0.0,0.0
1502
+ vmy_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1503
+ vol_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1504
+ vro_Latn,448,0,0,448,239793,0.0,0.0,0.0,1.0,0.0,0.0
1505
+ vun_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1506
+ waj_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1507
+ wal_Latn,284,0,0,284,239957,0.0,0.0,0.0,1.0,0.0,0.0
1508
+ wap_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1509
+ war_Latn,193,175,521,18,239527,0.251437,0.906736,0.393701,0.99783,2170.399253,0.906736
1510
+ way_Latn,27,0,0,27,240214,0.0,0.0,0.0,1.0,0.0,0.0
1511
+ wba_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
1512
+ wbm_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
1513
+ wbp_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1514
+ wed_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1515
+ wer_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
1516
+ whk_Latn,13,0,0,13,240228,0.0,0.0,0.0,1.0,0.0,0.0
1517
+ wib_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
1518
+ wim_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
1519
+ wiu_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
1520
+ wln_Latn,305,0,0,305,239936,0.0,0.0,0.0,1.0,0.0,0.0
1521
+ wls_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
1522
+ wlv_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1523
+ wmt_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
1524
+ wmw_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1525
+ wnc_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
1526
+ wnu_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1527
+ wol_Latn,214,205,5439,9,234588,0.036322,0.957944,0.06999,0.97734,22659.950756,0.957944
1528
+ wos_Latn,183,0,0,183,240058,0.0,0.0,0.0,1.0,0.0,0.0
1529
+ wrk_Latn,185,0,0,185,240056,0.0,0.0,0.0,1.0,0.0,0.0
1530
+ wrs_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
1531
+ wsk_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1532
+ wuu_Hani,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1533
+ wuv_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1534
+ xal_Cyrl,295,0,0,295,239946,0.0,0.0,0.0,1.0,0.0,0.0
1535
+ xav_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
1536
+ xbi_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
1537
+ xbr_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
1538
+ xed_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
1539
+ xho_Latn,367,350,921,17,238953,0.275374,0.953678,0.42735,0.99616,3839.515746,0.953678
1540
+ xla_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
1541
+ xmf_Geor,132,130,19,2,240090,0.872483,0.984848,0.925267,0.999921,79.130728,0.984848
1542
+ xmm_Latn,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
1543
+ xmv_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
1544
+ xnn_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1545
+ xog_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1546
+ xon_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
1547
+ xrb_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1548
+ xsi_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1549
+ xsm_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1550
+ xsr_Deva,167,0,0,167,240074,0.0,0.0,0.0,1.0,0.0,0.0
1551
+ xsu_Latn,3,0,0,3,240238,0.0,0.0,0.0,1.0,0.0,0.0
1552
+ xtd_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
1553
+ xtm_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1554
+ xtn_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1555
+ xuo_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
1556
+ yaa_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
1557
+ yad_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
1558
+ yal_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1559
+ yan_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
1560
+ yao_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1561
+ yap_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
1562
+ yaq_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
1563
+ ybb_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1564
+ yby_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
1565
+ ycn_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
1566
+ ydd_Hebr,430,429,20,1,239791,0.955457,0.997674,0.976109,0.999917,83.39901,0.997674
1567
+ yka_Latn,215,0,0,215,240026,0.0,0.0,0.0,1.0,0.0,0.0
1568
+ yle_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
1569
+ yli_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
1570
+ yml_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
1571
+ yom_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1572
+ yon_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
1573
+ yor_Latn,308,305,2049,3,237884,0.129567,0.99026,0.229151,0.99146,8539.884051,0.99026
1574
+ yrb_Latn,188,0,0,188,240053,0.0,0.0,0.0,1.0,0.0,0.0
1575
+ yre_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1576
+ yrk_Cyrl,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
1577
+ yss_Latn,231,0,0,231,240010,0.0,0.0,0.0,1.0,0.0,0.0
1578
+ yua_Latn,326,0,0,326,239915,0.0,0.0,0.0,1.0,0.0,0.0
1579
+ yue_Hani,194,188,5940,6,234107,0.030679,0.969072,0.059475,0.975255,24745.154074,0.969072
1580
+ yuj_Latn,205,0,0,205,240036,0.0,0.0,0.0,1.0,0.0,0.0
1581
+ yut_Latn,262,0,0,262,239979,0.0,0.0,0.0,1.0,0.0,0.0
1582
+ yuw_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1583
+ yva_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
1584
+ zaa_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
1585
+ zab_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1586
+ zac_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
1587
+ zad_Latn,12,0,0,12,240229,0.0,0.0,0.0,1.0,0.0,0.0
1588
+ zae_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1589
+ zai_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1590
+ zam_Latn,52,0,0,52,240189,0.0,0.0,0.0,1.0,0.0,0.0
1591
+ zao_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1592
+ zar_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1593
+ zas_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
1594
+ zat_Latn,261,0,0,261,239980,0.0,0.0,0.0,1.0,0.0,0.0
1595
+ zav_Latn,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
1596
+ zaw_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1597
+ zdj_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1598
+ zea_Latn,192,0,0,192,240049,0.0,0.0,0.0,1.0,0.0,0.0
1599
+ zgh_Tfng,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1600
+ zia_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
1601
+ ziw_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
1602
+ zne_Latn,195,0,0,195,240046,0.0,0.0,0.0,1.0,0.0,0.0
1603
+ zom_Latn,260,0,0,260,239981,0.0,0.0,0.0,1.0,0.0,0.0
1604
+ zos_Latn,171,0,0,171,240070,0.0,0.0,0.0,1.0,0.0,0.0
1605
+ zpa_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
1606
+ zpc_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1607
+ zpg_Latn,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
1608
+ zpi_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1609
+ zpl_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1610
+ zpm_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1611
+ zpo_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1612
+ zpt_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
1613
+ zpu_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1614
+ zpv_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1615
+ zpz_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
1616
+ zsm_Latn,244,217,898,27,239099,0.194619,0.889344,0.319352,0.996258,3741.713438,0.889344
1617
+ zsr_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
1618
+ ztq_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
1619
+ zty_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
1620
+ zul_Latn,594,573,960,21,238687,0.373777,0.964646,0.538787,0.995994,4005.891999,0.964646
1621
+ zyb_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
1622
+ zyp_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
reports/test/fasttext@millid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.2514599922577745,
3
+ "top3_accuracy": 0.2610753368492472,
4
+ "top5_accuracy": 0.2625197197813862,
5
+ "passages": 240241,
6
+ "languages": 1621,
7
+ "macro_precision": 0.05205991842533006,
8
+ "macro_recall": 0.12089826722608317,
9
+ "macro_f1": 0.06593662879256669,
10
+ "macro_specificity": 0.9995376539627219,
11
+ "weighted_f1": 0.1498625447047829,
12
+ "median_f1": 0.0,
13
+ "languages_f1_at_least_0_9": 26,
14
+ "languages_f1_below_0_5": 1517,
15
+ "mean_fp_per_million": 462.34603727812436,
16
+ "micro_f1": 0.2514599922577745,
17
+ "top1_by_size": {
18
+ "paragraph": 0.19587104647615172,
19
+ "sentence": 0.25056634510143305,
20
+ "short": 0.27637730884784273
21
+ }
22
+ }
reports/test/fasttext_per_language.csv ADDED
@@ -0,0 +1,1622 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aai_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
3
+ aak_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
4
+ aau_Latn,214,0,0,214,240027,0.0,0.0,0.0,1.0,0.0,0.0
5
+ aaz_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
6
+ aba_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
7
+ abk_Cyrl,285,285,139,0,239817,0.67217,1.0,0.803949,0.999421,579.272867,1.0
8
+ abn_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
9
+ abq_Cyrl,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
10
+ abs_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
11
+ abt_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
12
+ abx_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
13
+ aby_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
14
+ abz_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
15
+ aca_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
16
+ acd_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
17
+ ace_Latn,113,110,1824,3,238304,0.056877,0.973451,0.107474,0.992404,7595.948827,0.973451
18
+ acf_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
19
+ ach_Latn,242,0,0,242,239999,0.0,0.0,0.0,1.0,0.0,0.0
20
+ acm_Arab,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
21
+ acn_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
22
+ acr_Latn,255,0,0,255,239986,0.0,0.0,0.0,1.0,0.0,0.0
23
+ acu_Latn,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
24
+ ada_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
25
+ ade_Latn,31,0,0,31,240210,0.0,0.0,0.0,1.0,0.0,0.0
26
+ adh_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
27
+ adj_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
28
+ ady_Cyrl,135,132,222,3,239884,0.372881,0.977778,0.539877,0.999075,924.591639,0.977778
29
+ adz_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
30
+ aeb_Arab,244,0,0,244,239997,0.0,0.0,0.0,1.0,0.0,0.0
31
+ aeb_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
32
+ aer_Latn,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
33
+ aeu_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
34
+ aey_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
35
+ afr_Latn,569,557,168,12,239504,0.768276,0.97891,0.860896,0.999299,700.957976,0.97891
36
+ agd_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
37
+ agg_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
38
+ agm_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
39
+ agn_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
40
+ agr_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
41
+ agt_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
42
+ agu_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
43
+ agx_Cyrl,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
44
+ ahk_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
45
+ aia_Latn,163,0,0,163,240078,0.0,0.0,0.0,1.0,0.0,0.0
46
+ aii_Syrc,234,0,0,234,240007,0.0,0.0,0.0,1.0,0.0,0.0
47
+ ain_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
48
+ ajg_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
49
+ aji_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
50
+ ajp_Arab,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
51
+ akb_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
52
+ ake_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
53
+ akh_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
54
+ akp_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
55
+ aln_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
56
+ alp_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
57
+ alq_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
58
+ als_Latn,213,209,788,4,239240,0.209629,0.981221,0.345455,0.996717,3282.950322,0.981221
59
+ alt_Cyrl,208,169,142,39,239891,0.543408,0.8125,0.651252,0.999408,591.585324,0.8125
60
+ aly_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
61
+ alz_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
62
+ ame_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
63
+ amf_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
64
+ amh_Ethi,458,458,219,0,239564,0.676514,1.0,0.807048,0.999087,913.325799,1.0
65
+ ami_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
66
+ amk_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
67
+ amm_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
68
+ amn_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
69
+ amp_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
70
+ amr_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
71
+ amu_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
72
+ amx_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
73
+ ang_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
74
+ ann_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
75
+ anp_Deva,252,0,0,252,239989,0.0,0.0,0.0,1.0,0.0,0.0
76
+ anv_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
77
+ any_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
78
+ aoi_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
79
+ aoj_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
80
+ aom_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
81
+ aoz_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
82
+ apb_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
83
+ apc_Arab,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
84
+ ape_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
85
+ apn_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
86
+ apr_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
87
+ apt_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
88
+ apu_Latn,213,0,0,213,240028,0.0,0.0,0.0,1.0,0.0,0.0
89
+ apw_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
90
+ apy_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
91
+ apz_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
92
+ arb_Arab,745,739,1395,6,238101,0.346298,0.991946,0.513373,0.994175,5824.731937,0.991946
93
+ arb_Latn,163,124,895,39,239183,0.121688,0.760736,0.209814,0.996272,3727.955081,0.760736
94
+ are_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
95
+ arg_Latn,194,0,0,194,240047,0.0,0.0,0.0,1.0,0.0,0.0
96
+ arl_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
97
+ arn_Latn,250,231,359,19,239632,0.391525,0.924,0.55,0.998504,1495.889429,0.924
98
+ arp_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
99
+ arq_Arab,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
100
+ ars_Arab,309,0,0,309,239932,0.0,0.0,0.0,1.0,0.0,0.0
101
+ ary_Arab,192,0,0,192,240049,0.0,0.0,0.0,1.0,0.0,0.0
102
+ arz_Arab,229,0,0,229,240012,0.0,0.0,0.0,1.0,0.0,0.0
103
+ asm_Beng,467,465,7,2,239767,0.985169,0.995717,0.990415,0.999971,29.194158,0.995717
104
+ asm_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
105
+ aso_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
106
+ ast_Latn,244,231,1094,13,238903,0.17434,0.946721,0.294455,0.995442,4558.390313,0.946721
107
+ ata_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
108
+ atb_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
109
+ atd_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
110
+ atg_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
111
+ ati_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
112
+ atj_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
113
+ att_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
114
+ auc_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
115
+ aui_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
116
+ auy_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
117
+ ava_Cyrl,240,0,0,240,240001,0.0,0.0,0.0,1.0,0.0,0.0
118
+ avk_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
119
+ avt_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
120
+ avu_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
121
+ awa_Deva,91,67,184,24,239966,0.266932,0.736264,0.391813,0.999234,766.187799,0.736264
122
+ awb_Latn,167,0,0,167,240074,0.0,0.0,0.0,1.0,0.0,0.0
123
+ awx_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
124
+ ayp_Arab,72,0,0,72,240169,0.0,0.0,0.0,1.0,0.0,0.0
125
+ ayr_Latn,309,295,463,14,239469,0.389182,0.954693,0.552952,0.99807,1929.713419,0.954693
126
+ azb_Arab,369,353,389,16,239483,0.475741,0.95664,0.635464,0.998378,1621.698239,0.95664
127
+ azg_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
128
+ azj_Cyrl,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
129
+ azj_Latn,187,184,1097,3,238957,0.143638,0.983957,0.250681,0.99543,4569.805127,0.983957
130
+ azz_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
131
+ bak_Cyrl,289,287,237,2,239715,0.54771,0.99308,0.706027,0.999012,987.69754,0.99308
132
+ bam_Latn,287,267,3772,20,236182,0.066105,0.930314,0.12344,0.98428,15719.679605,0.930314
133
+ ban_Latn,202,178,1326,24,238713,0.118351,0.881188,0.208675,0.994476,5524.102333,0.881188
134
+ bao_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
135
+ bar_Latn,331,0,0,331,239910,0.0,0.0,0.0,1.0,0.0,0.0
136
+ bas_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
137
+ bba_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
138
+ bbb_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
139
+ bbc_Latn,247,0,0,247,239994,0.0,0.0,0.0,1.0,0.0,0.0
140
+ bbr_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
141
+ bcc_Arab,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
142
+ bch_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
143
+ bci_Latn,193,0,0,193,240048,0.0,0.0,0.0,1.0,0.0,0.0
144
+ bcl_Latn,231,0,0,231,240010,0.0,0.0,0.0,1.0,0.0,0.0
145
+ bco_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
146
+ bcw_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
147
+ bdd_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
148
+ bdh_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
149
+ bdq_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
150
+ bea_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
151
+ bef_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
152
+ bel_Cyrl,157,157,307,0,239777,0.338362,1.0,0.505636,0.998721,1278.719115,1.0
153
+ bem_Latn,222,216,1736,6,238283,0.110656,0.972973,0.198712,0.992767,7232.76074,0.972973
154
+ ben_Beng,466,465,364,1,239411,0.560917,0.997854,0.718147,0.998482,1518.089876,0.997854
155
+ ben_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
156
+ beq_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
157
+ bew_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
158
+ bfd_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
159
+ bgr_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
160
+ bgs_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
161
+ bgt_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
162
+ bgz_Latn,13,0,0,13,240228,0.0,0.0,0.0,1.0,0.0,0.0
163
+ bhg_Latn,19,0,0,19,240222,0.0,0.0,0.0,1.0,0.0,0.0
164
+ bhl_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
165
+ bho_Deva,290,241,166,49,239785,0.592138,0.831034,0.691535,0.999308,691.807911,0.831034
166
+ bhw_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
167
+ bib_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
168
+ big_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
169
+ bim_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
170
+ bin_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
171
+ bis_Latn,257,243,274,14,239710,0.470019,0.945525,0.627907,0.998858,1141.742783,0.945525
172
+ biu_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
173
+ biv_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
174
+ bjn_Arab,116,34,12,82,240113,0.73913,0.293103,0.419753,0.99995,49.973972,0.293103
175
+ bjn_Latn,153,139,1531,14,238557,0.083234,0.908497,0.152496,0.993623,6376.828496,0.908497
176
+ bjp_Latn,171,0,0,171,240070,0.0,0.0,0.0,1.0,0.0,0.0
177
+ bjr_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
178
+ bjv_Latn,84,0,0,84,240157,0.0,0.0,0.0,1.0,0.0,0.0
179
+ bkd_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
180
+ bkq_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
181
+ bku_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
182
+ bla_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
183
+ blh_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
184
+ blk_Mymr,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
185
+ blt_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
186
+ blw_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
187
+ blz_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
188
+ bmh_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
189
+ bmk_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
190
+ bmq_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
191
+ bmr_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
192
+ bmu_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
193
+ bno_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
194
+ bnp_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
195
+ boa_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
196
+ bod_Tibt,406,385,200,21,239635,0.65812,0.948276,0.776993,0.999166,833.906644,0.948276
197
+ boj_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
198
+ bon_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
199
+ bos_Latn,198,178,1589,20,238454,0.100736,0.89899,0.18117,0.99338,6619.647313,0.89899
200
+ box_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
201
+ bpr_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
202
+ bps_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
203
+ bpy_Beng,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
204
+ bqc_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
205
+ bqp_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
206
+ bre_Latn,277,0,0,277,239964,0.0,0.0,0.0,1.0,0.0,0.0
207
+ brh_Arab,311,0,0,311,239930,0.0,0.0,0.0,1.0,0.0,0.0
208
+ bru_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
209
+ brx_Deva,351,0,0,351,239890,0.0,0.0,0.0,1.0,0.0,0.0
210
+ bsn_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
211
+ bsp_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
212
+ bsq_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
213
+ bss_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
214
+ btd_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
215
+ bth_Latn,33,0,0,33,240208,0.0,0.0,0.0,1.0,0.0,0.0
216
+ bts_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
217
+ btx_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
218
+ bud_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
219
+ bug_Latn,78,75,5469,3,234694,0.013528,0.961538,0.026681,0.977228,22772.033994,0.961538
220
+ buk_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
221
+ bul_Cyrl,289,284,150,5,239802,0.654378,0.982699,0.785615,0.999375,625.125025,0.982699
222
+ bum_Latn,245,0,0,245,239996,0.0,0.0,0.0,1.0,0.0,0.0
223
+ bus_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
224
+ bvd_Latn,206,0,0,206,240035,0.0,0.0,0.0,1.0,0.0,0.0
225
+ bvr_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
226
+ bvz_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
227
+ bwd_Latn,51,0,0,51,240190,0.0,0.0,0.0,1.0,0.0,0.0
228
+ bwu_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
229
+ bxh_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
230
+ bxr_Cyrl,277,245,201,32,239763,0.549327,0.884477,0.677732,0.999162,837.625644,0.884477
231
+ byr_Latn,194,0,0,194,240047,0.0,0.0,0.0,1.0,0.0,0.0
232
+ byx_Latn,206,0,0,206,240035,0.0,0.0,0.0,1.0,0.0,0.0
233
+ bzd_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
234
+ bzh_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
235
+ bzi_Thai,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
236
+ bzj_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
237
+ caa_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
238
+ cab_Latn,201,0,0,201,240040,0.0,0.0,0.0,1.0,0.0,0.0
239
+ cac_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
240
+ caf_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
241
+ cag_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
242
+ cak_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
243
+ cao_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
244
+ cap_Latn,226,0,0,226,240015,0.0,0.0,0.0,1.0,0.0,0.0
245
+ caq_Latn,189,0,0,189,240052,0.0,0.0,0.0,1.0,0.0,0.0
246
+ car_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
247
+ cas_Latn,74,0,0,74,240167,0.0,0.0,0.0,1.0,0.0,0.0
248
+ cat_Latn,318,303,646,15,239277,0.319283,0.95283,0.478295,0.997307,2692.53052,0.95283
249
+ cav_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
250
+ cax_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
251
+ cbc_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
252
+ cbi_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
253
+ cbk_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
254
+ cbr_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
255
+ cbs_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
256
+ cbt_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
257
+ cbu_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
258
+ cbv_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
259
+ cce_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
260
+ cco_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
261
+ ccp_Latn,3,0,0,3,240238,0.0,0.0,0.0,1.0,0.0,0.0
262
+ ceb_Latn,338,337,1068,1,238835,0.239858,0.997041,0.38669,0.995548,4451.799269,0.997041
263
+ ceg_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
264
+ cek_Latn,67,0,0,67,240174,0.0,0.0,0.0,1.0,0.0,0.0
265
+ ces_Latn,183,183,481,0,239577,0.275602,1.0,0.432113,0.997996,2003.682443,1.0
266
+ cfm_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
267
+ cgc_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
268
+ cha_Latn,348,0,0,348,239893,0.0,0.0,0.0,1.0,0.0,0.0
269
+ chd_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
270
+ che_Cyrl,345,338,476,7,239420,0.415233,0.97971,0.583261,0.998016,1984.19315,0.97971
271
+ chf_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
272
+ chk_Latn,294,0,0,294,239947,0.0,0.0,0.0,1.0,0.0,0.0
273
+ cho_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
274
+ chq_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
275
+ chr_Cher,44,0,0,44,240197,0.0,0.0,0.0,1.0,0.0,0.0
276
+ chu_Cyrl,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
277
+ chv_Cyrl,335,335,96,0,239810,0.777262,1.0,0.874674,0.9996,400.156728,1.0
278
+ chw_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
279
+ chz_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
280
+ cjk_Latn,24,23,1102,1,239115,0.020444,0.958333,0.040035,0.995412,4587.518785,0.958333
281
+ cjp_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
282
+ cjs_Cyrl,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
283
+ cjv_Latn,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
284
+ ckb_Arab,421,417,734,4,239086,0.362294,0.990499,0.530534,0.996939,3060.628805,0.990499
285
+ ckm_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
286
+ cko_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
287
+ ckt_Cyrl,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
288
+ clu_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
289
+ cme_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
290
+ cmn_Hani,288,95,180,193,239773,0.345455,0.329861,0.337478,0.99925,750.146904,0.329861
291
+ cmo_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
292
+ cnh_Latn,286,0,0,286,239955,0.0,0.0,0.0,1.0,0.0,0.0
293
+ cni_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
294
+ cnk_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
295
+ cnr_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
296
+ cnw_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
297
+ coe_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
298
+ cof_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
299
+ cok_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
300
+ con_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
301
+ cop_Copt,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
302
+ cor_Latn,290,0,0,290,239951,0.0,0.0,0.0,1.0,0.0,0.0
303
+ cos_Latn,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
304
+ cot_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
305
+ cpb_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
306
+ cpc_Latn,389,0,0,389,239852,0.0,0.0,0.0,1.0,0.0,0.0
307
+ cpu_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
308
+ cpy_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
309
+ crh_Cyrl,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
310
+ crh_Latn,189,183,664,6,239388,0.216057,0.968254,0.353282,0.997234,2766.067352,0.968254
311
+ crj_Cans,21,0,0,21,240220,0.0,0.0,0.0,1.0,0.0,0.0
312
+ crk_Cans,27,0,0,27,240214,0.0,0.0,0.0,1.0,0.0,0.0
313
+ crk_Latn,225,0,0,225,240016,0.0,0.0,0.0,1.0,0.0,0.0
314
+ crl_Cans,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
315
+ crm_Cans,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
316
+ crn_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
317
+ crs_Latn,218,0,0,218,240023,0.0,0.0,0.0,1.0,0.0,0.0
318
+ crx_Latn,322,0,0,322,239919,0.0,0.0,0.0,1.0,0.0,0.0
319
+ csb_Latn,307,0,0,307,239934,0.0,0.0,0.0,1.0,0.0,0.0
320
+ csw_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
321
+ csy_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
322
+ cta_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
323
+ ctd_Latn,196,0,0,196,240045,0.0,0.0,0.0,1.0,0.0,0.0
324
+ cto_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
325
+ ctp_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
326
+ ctu_Latn,243,0,0,243,239998,0.0,0.0,0.0,1.0,0.0,0.0
327
+ cub_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
328
+ cui_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
329
+ cuk_Latn,245,0,0,245,239996,0.0,0.0,0.0,1.0,0.0,0.0
330
+ cul_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
331
+ cut_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
332
+ cux_Latn,54,0,0,54,240187,0.0,0.0,0.0,1.0,0.0,0.0
333
+ cwe_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
334
+ cwt_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
335
+ cya_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
336
+ cym_Latn,189,185,356,4,239696,0.341959,0.978836,0.506849,0.998517,1483.012014,0.978836
337
+ czt_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
338
+ daa_Latn,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
339
+ dad_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
340
+ daf_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
341
+ dag_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
342
+ dah_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
343
+ dak_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
344
+ dan_Latn,242,230,92,12,239907,0.714286,0.950413,0.815603,0.999617,383.334931,0.950413
345
+ dar_Cyrl,227,0,0,227,240014,0.0,0.0,0.0,1.0,0.0,0.0
346
+ ded_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
347
+ des_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
348
+ deu_Latn,356,356,1031,0,238854,0.256669,1.0,0.408491,0.995702,4297.89274,1.0
349
+ dga_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
350
+ dgc_Latn,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
351
+ dgi_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
352
+ dgr_Latn,305,0,0,305,239936,0.0,0.0,0.0,1.0,0.0,0.0
353
+ dgz_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
354
+ dhm_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
355
+ dhv_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
356
+ dig_Latn,224,0,0,224,240017,0.0,0.0,0.0,1.0,0.0,0.0
357
+ dik_Latn,350,348,2881,2,237010,0.107773,0.994286,0.194468,0.98799,12009.621036,0.994286
358
+ diq_Latn,134,119,1066,15,239041,0.100422,0.88806,0.18044,0.99556,4439.687306,0.88806
359
+ div_Thaa,238,0,0,238,240003,0.0,0.0,0.0,1.0,0.0,0.0
360
+ dje_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
361
+ djk_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
362
+ djr_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
363
+ dks_Latn,3,0,0,3,240238,0.0,0.0,0.0,1.0,0.0,0.0
364
+ dng_Cyrl,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
365
+ dnj_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
366
+ dnw_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
367
+ dob_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
368
+ doi_Deva,254,0,0,254,239987,0.0,0.0,0.0,1.0,0.0,0.0
369
+ dop_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
370
+ dos_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
371
+ drg_Latn,13,0,0,13,240228,0.0,0.0,0.0,1.0,0.0,0.0
372
+ dru_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
373
+ dsb_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
374
+ dtp_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
375
+ dts_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
376
+ dua_Latn,176,0,0,176,240065,0.0,0.0,0.0,1.0,0.0,0.0
377
+ duo_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
378
+ dur_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
379
+ dwr_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
380
+ dww_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
381
+ dyi_Latn,249,0,0,249,239992,0.0,0.0,0.0,1.0,0.0,0.0
382
+ dyo_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
383
+ dyu_Latn,390,280,386,110,239465,0.42042,0.717949,0.530303,0.998391,1609.332461,0.717949
384
+ dzo_Tibt,346,191,139,155,239756,0.578788,0.552023,0.565089,0.999421,579.420163,0.552023
385
+ ebk_Latn,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
386
+ efi_Latn,268,0,0,268,239973,0.0,0.0,0.0,1.0,0.0,0.0
387
+ ekk_Latn,419,415,2395,4,237427,0.147687,0.990453,0.257046,0.990013,9986.573375,0.990453
388
+ eko_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
389
+ ell_Grek,394,372,760,22,239087,0.328622,0.944162,0.487549,0.996831,3168.686704,0.944162
390
+ emi_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
391
+ eml_Latn,198,0,0,198,240043,0.0,0.0,0.0,1.0,0.0,0.0
392
+ emp_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
393
+ enb_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
394
+ eng_Latn,1444,1203,1039,241,237758,0.536574,0.833102,0.65274,0.995649,4350.975934,0.833102
395
+ enl_Latn,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
396
+ enm_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
397
+ enq_Latn,222,0,0,222,240019,0.0,0.0,0.0,1.0,0.0,0.0
398
+ epo_Latn,294,293,1929,1,238018,0.131863,0.996599,0.232909,0.991961,8039.27534,0.996599
399
+ eri_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
400
+ ese_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
401
+ esi_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
402
+ esk_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
403
+ ess_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
404
+ esu_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
405
+ etr_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
406
+ eus_Latn,254,251,234,3,239753,0.517526,0.988189,0.679296,0.999025,975.052815,0.988189
407
+ eve_Cyrl,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
408
+ ewe_Latn,308,300,494,8,239439,0.377834,0.974026,0.544465,0.997941,2058.908112,0.974026
409
+ ewo_Latn,134,101,704,33,239403,0.125466,0.753731,0.215122,0.997068,2932.026138,0.753731
410
+ ext_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
411
+ eza_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
412
+ faa_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
413
+ fai_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
414
+ fal_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
415
+ fan_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
416
+ fao_Latn,237,75,161,162,239843,0.317797,0.316456,0.317125,0.999329,670.822153,0.316456
417
+ far_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
418
+ fas_Arab,396,387,1406,9,238439,0.215839,0.977273,0.353586,0.994138,5862.119285,0.977273
419
+ fat_Latn,396,0,0,396,239845,0.0,0.0,0.0,1.0,0.0,0.0
420
+ ffm_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
421
+ fij_Latn,344,340,803,4,239094,0.297463,0.988372,0.457297,0.996653,3347.26987,0.988372
422
+ fil_Latn,137,135,722,2,239382,0.157526,0.985401,0.27163,0.996993,3007.030287,0.985401
423
+ fin_Latn,368,365,2008,3,237865,0.153814,0.991848,0.266326,0.991629,8371.096372,0.991848
424
+ fit_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
425
+ fkv_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
426
+ fon_Latn,180,164,1287,16,238774,0.113025,0.911111,0.201104,0.994639,5361.137378,0.911111
427
+ for_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
428
+ fra_Latn,1652,1545,626,107,237963,0.711654,0.93523,0.808266,0.997376,2623.758849,0.93523
429
+ frd_Latn,51,0,0,51,240190,0.0,0.0,0.0,1.0,0.0,0.0
430
+ fro_Latn,287,0,0,287,239954,0.0,0.0,0.0,1.0,0.0,0.0
431
+ frp_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
432
+ frr_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
433
+ fry_Latn,241,0,0,241,240000,0.0,0.0,0.0,1.0,0.0,0.0
434
+ fub_Latn,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
435
+ fue_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
436
+ fuf_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
437
+ fuh_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
438
+ fur_Latn,221,196,445,25,239575,0.305772,0.886878,0.454756,0.998146,1854.012166,0.886878
439
+ fuv_Arab,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
440
+ fuv_Latn,164,161,6745,3,233332,0.023313,0.981707,0.045545,0.971905,28095.152805,0.981707
441
+ gaa_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
442
+ gag_Cyrl,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
443
+ gag_Latn,41,0,0,41,240200,0.0,0.0,0.0,1.0,0.0,0.0
444
+ gah_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
445
+ gai_Latn,175,0,0,175,240066,0.0,0.0,0.0,1.0,0.0,0.0
446
+ gam_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
447
+ gaw_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
448
+ gaz_Latn,441,420,1203,21,238597,0.25878,0.952381,0.406977,0.994983,5016.680567,0.952381
449
+ gbi_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
450
+ gbo_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
451
+ gcf_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
452
+ gcr_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
453
+ gde_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
454
+ gdg_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
455
+ gdn_Latn,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
456
+ gdr_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
457
+ geb_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
458
+ gfk_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
459
+ ghs_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
460
+ gil_Latn,298,0,0,298,239943,0.0,0.0,0.0,1.0,0.0,0.0
461
+ gjn_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
462
+ gkn_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
463
+ gla_Latn,223,216,117,7,239901,0.648649,0.96861,0.776978,0.999513,487.46344,0.96861
464
+ gle_Latn,203,198,24,5,240014,0.891892,0.975369,0.931765,0.9999,99.984169,0.975369
465
+ glg_Latn,215,211,516,4,239510,0.290234,0.981395,0.447983,0.99785,2149.767109,0.981395
466
+ glk_Arab,319,0,0,319,239922,0.0,0.0,0.0,1.0,0.0,0.0
467
+ glv_Latn,357,0,0,357,239884,0.0,0.0,0.0,1.0,0.0,0.0
468
+ gmh_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
469
+ gmv_Ethi,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
470
+ gmv_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
471
+ gnb_Latn,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
472
+ gnd_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
473
+ gng_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
474
+ gnn_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
475
+ gnw_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
476
+ gof_Ethi,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
477
+ gof_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
478
+ gog_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
479
+ goh_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
480
+ gom_Deva,170,170,1561,0,238510,0.098209,1.0,0.178853,0.993498,6502.243086,1.0
481
+ gom_Latn,221,0,0,221,240020,0.0,0.0,0.0,1.0,0.0,0.0
482
+ gor_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
483
+ gos_Latn,74,0,0,74,240167,0.0,0.0,0.0,1.0,0.0,0.0
484
+ got_Goth,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
485
+ grc_Grek,317,0,0,317,239924,0.0,0.0,0.0,1.0,0.0,0.0
486
+ grt_Beng,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
487
+ gso_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
488
+ gsw_Latn,208,0,0,208,240033,0.0,0.0,0.0,1.0,0.0,0.0
489
+ gub_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
490
+ guc_Latn,252,0,0,252,239989,0.0,0.0,0.0,1.0,0.0,0.0
491
+ gug_Latn,228,202,2834,26,237179,0.066535,0.885965,0.123775,0.988192,11807.69375,0.885965
492
+ guh_Latn,207,0,0,207,240034,0.0,0.0,0.0,1.0,0.0,0.0
493
+ gui_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
494
+ guj_Gujr,354,343,0,11,239887,1.0,0.968927,0.984218,1.0,0.0,0.968927
495
+ guj_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
496
+ guk_Ethi,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
497
+ gul_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
498
+ gum_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
499
+ gun_Latn,54,0,0,54,240187,0.0,0.0,0.0,1.0,0.0,0.0
500
+ guo_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
501
+ guq_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
502
+ gur_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
503
+ guw_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
504
+ gux_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
505
+ guz_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
506
+ gvc_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
507
+ gvf_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
508
+ gvl_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
509
+ gvn_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
510
+ gwi_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
511
+ gym_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
512
+ gyr_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
513
+ hac_Arab,382,0,0,382,239859,0.0,0.0,0.0,1.0,0.0,0.0
514
+ hae_Latn,75,0,0,75,240166,0.0,0.0,0.0,1.0,0.0,0.0
515
+ hag_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
516
+ hak_Hani,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
517
+ hak_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
518
+ hat_Latn,338,325,846,13,239057,0.277541,0.961538,0.430749,0.996474,3526.425264,0.961538
519
+ hau_Latn,367,363,983,4,238891,0.269688,0.989101,0.423818,0.995902,4097.984775,0.989101
520
+ hav_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
521
+ haw_Latn,214,0,0,214,240027,0.0,0.0,0.0,1.0,0.0,0.0
522
+ hay_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
523
+ hbo_Hebr,189,0,0,189,240052,0.0,0.0,0.0,1.0,0.0,0.0
524
+ hch_Latn,259,0,0,259,239982,0.0,0.0,0.0,1.0,0.0,0.0
525
+ heb_Hebr,203,203,229,0,239809,0.469907,1.0,0.63937,0.999046,954.015614,1.0
526
+ heg_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
527
+ heh_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
528
+ her_Latn,235,0,0,235,240006,0.0,0.0,0.0,1.0,0.0,0.0
529
+ hif_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
530
+ hig_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
531
+ hil_Latn,266,0,0,266,239975,0.0,0.0,0.0,1.0,0.0,0.0
532
+ hin_Deva,392,359,872,33,238977,0.291633,0.915816,0.442391,0.996364,3635.620745,0.915816
533
+ hin_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
534
+ hix_Latn,222,0,0,222,240019,0.0,0.0,0.0,1.0,0.0,0.0
535
+ hla_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
536
+ hmo_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
537
+ hmr_Latn,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
538
+ hne_Deva,198,174,212,24,239831,0.450777,0.878788,0.59589,0.999117,883.175098,0.878788
539
+ hnj_Latn,300,0,0,300,239941,0.0,0.0,0.0,1.0,0.0,0.0
540
+ hnn_Latn,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
541
+ hns_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
542
+ hop_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
543
+ hot_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
544
+ hra_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
545
+ hrv_Latn,168,146,1324,22,238749,0.09932,0.869048,0.178266,0.994485,5514.989191,0.869048
546
+ hrx_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
547
+ hsb_Latn,269,0,0,269,239972,0.0,0.0,0.0,1.0,0.0,0.0
548
+ hto_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
549
+ hub_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
550
+ hui_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
551
+ hun_Latn,576,576,3806,0,235859,0.131447,1.0,0.232352,0.98412,15880.499864,1.0
552
+ hus_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
553
+ huu_Latn,72,0,0,72,240169,0.0,0.0,0.0,1.0,0.0,0.0
554
+ huv_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
555
+ hvn_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
556
+ hwc_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
557
+ hye_Armn,178,170,225,8,239838,0.43038,0.955056,0.593368,0.999063,937.253971,0.955056
558
+ hyw_Armn,233,0,0,233,240008,0.0,0.0,0.0,1.0,0.0,0.0
559
+ ian_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
560
+ iba_Latn,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
561
+ ibg_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
562
+ ibo_Latn,257,254,1120,3,238864,0.184862,0.988327,0.311465,0.995333,4666.977799,0.988327
563
+ icr_Latn,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
564
+ ido_Latn,270,0,0,270,239971,0.0,0.0,0.0,1.0,0.0,0.0
565
+ idu_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
566
+ ifb_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
567
+ ife_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
568
+ ifk_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
569
+ ifu_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
570
+ ify_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
571
+ ige_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
572
+ ign_Latn,44,0,0,44,240197,0.0,0.0,0.0,1.0,0.0,0.0
573
+ ike_Cans,310,0,0,310,239931,0.0,0.0,0.0,1.0,0.0,0.0
574
+ ikk_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
575
+ ikt_Latn,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
576
+ ikw_Latn,21,0,0,21,240220,0.0,0.0,0.0,1.0,0.0,0.0
577
+ ile_Latn,252,0,0,252,239989,0.0,0.0,0.0,1.0,0.0,0.0
578
+ ilo_Latn,252,239,413,13,239576,0.366564,0.948413,0.528761,0.998279,1720.912208,0.948413
579
+ imo_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
580
+ ina_Latn,234,0,0,234,240007,0.0,0.0,0.0,1.0,0.0,0.0
581
+ inb_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
582
+ ind_Latn,335,311,1875,24,238031,0.142269,0.928358,0.246727,0.992184,7815.561095,0.928358
583
+ inh_Cyrl,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
584
+ ino_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
585
+ iou_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
586
+ ipi_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
587
+ irk_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
588
+ isd_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
589
+ ish_Latn,21,0,0,21,240220,0.0,0.0,0.0,1.0,0.0,0.0
590
+ isl_Latn,276,276,324,0,239641,0.46,1.0,0.630137,0.99865,1350.196904,1.0
591
+ iso_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
592
+ ita_Latn,342,335,508,7,239391,0.39739,0.979532,0.565401,0.997882,2117.557806,0.979532
593
+ itv_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
594
+ ium_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
595
+ ivv_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
596
+ iws_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
597
+ ixl_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
598
+ izr_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
599
+ izz_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
600
+ jac_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
601
+ jae_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
602
+ jam_Latn,196,0,0,196,240045,0.0,0.0,0.0,1.0,0.0,0.0
603
+ jav_Latn,158,156,2820,2,237263,0.052419,0.987342,0.099553,0.988254,11745.937863,0.987342
604
+ jbo_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
605
+ jbu_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
606
+ jic_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
607
+ jiv_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
608
+ jpn_Jpan,323,254,169,69,239749,0.600473,0.786378,0.680965,0.999296,704.407339,0.786378
609
+ jra_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
610
+ jvn_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
611
+ kaa_Cyrl,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
612
+ kaa_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
613
+ kab_Latn,165,162,378,3,239698,0.3,0.981818,0.459574,0.998425,1574.501408,0.981818
614
+ kac_Latn,216,211,133,5,239892,0.613372,0.976852,0.753571,0.999446,554.108947,0.976852
615
+ kal_Latn,369,364,857,5,239015,0.298116,0.98645,0.457862,0.996427,3572.738794,0.98645
616
+ kam_Latn,272,207,228,65,239741,0.475862,0.761029,0.585573,0.99905,950.122724,0.761029
617
+ kan_Knda,601,600,100,1,239540,0.857143,0.998336,0.922367,0.999583,417.292606,0.998336
618
+ kan_Latn,264,0,0,264,239977,0.0,0.0,0.0,1.0,0.0,0.0
619
+ kao_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
620
+ kaq_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
621
+ kas_Arab,118,113,15,5,240108,0.882812,0.957627,0.918699,0.999938,62.467985,0.957627
622
+ kas_Deva,47,22,441,25,239753,0.047516,0.468085,0.086275,0.998164,1836.015887,0.468085
623
+ kat_Geor,324,315,16,9,239901,0.951662,0.972222,0.961832,0.999933,66.68973,0.972222
624
+ kaz_Cyrl,340,337,399,3,239502,0.45788,0.991176,0.626394,0.998337,1663.186064,0.991176
625
+ kbc_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
626
+ kbd_Cyrl,238,0,0,238,240003,0.0,0.0,0.0,1.0,0.0,0.0
627
+ kbh_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
628
+ kbm_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
629
+ kbp_Latn,130,125,1965,5,238146,0.059809,0.961538,0.112613,0.991816,8183.715032,0.961538
630
+ kbq_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
631
+ kbr_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
632
+ kby_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
633
+ kca_Cyrl,345,0,0,345,239896,0.0,0.0,0.0,1.0,0.0,0.0
634
+ kcg_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
635
+ kck_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
636
+ kdc_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
637
+ kde_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
638
+ kdh_Latn,34,0,0,34,240207,0.0,0.0,0.0,1.0,0.0,0.0
639
+ kdi_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
640
+ kdl_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
641
+ kea_Latn,205,159,434,46,239602,0.268128,0.77561,0.398496,0.998192,1808.062124,0.77561
642
+ kek_Latn,183,0,0,183,240058,0.0,0.0,0.0,1.0,0.0,0.0
643
+ ken_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
644
+ keo_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
645
+ kew_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
646
+ kez_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
647
+ kff_Telu,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
648
+ kgf_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
649
+ kgk_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
650
+ kgp_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
651
+ kha_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
652
+ khk_Cyrl,262,249,244,13,239735,0.505071,0.950382,0.659603,0.998983,1016.755633,0.950382
653
+ khm_Khmr,187,187,23,0,240031,0.890476,1.0,0.942065,0.999904,95.811776,1.0
654
+ khs_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
655
+ khz_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
656
+ kij_Latn,226,0,0,226,240015,0.0,0.0,0.0,1.0,0.0,0.0
657
+ kik_Latn,193,142,244,51,239804,0.367876,0.735751,0.490501,0.998984,1016.463374,0.735751
658
+ kin_Latn,210,201,377,9,239654,0.347751,0.957143,0.510152,0.998429,1570.63046,0.957143
659
+ kir_Cyrl,242,238,555,4,239444,0.300126,0.983471,0.459903,0.997687,2312.509635,0.983471
660
+ kiu_Latn,293,0,0,293,239948,0.0,0.0,0.0,1.0,0.0,0.0
661
+ kix_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
662
+ kjb_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
663
+ kje_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
664
+ kjh_Cyrl,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
665
+ kjs_Latn,201,0,0,201,240040,0.0,0.0,0.0,1.0,0.0,0.0
666
+ kkc_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
667
+ kki_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
668
+ kkj_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
669
+ kkl_Latn,84,0,0,84,240157,0.0,0.0,0.0,1.0,0.0,0.0
670
+ klt_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
671
+ klv_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
672
+ kmb_Latn,119,118,437,1,239685,0.212613,0.991597,0.350148,0.99818,1819.908213,0.991597
673
+ kmg_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
674
+ kmh_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
675
+ kmk_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
676
+ kmm_Latn,19,0,0,19,240222,0.0,0.0,0.0,1.0,0.0,0.0
677
+ kmo_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
678
+ kmr_Cyrl,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
679
+ kmr_Latn,289,289,855,0,239097,0.252622,1.0,0.40335,0.996437,3563.212643,1.0
680
+ kms_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
681
+ kmu_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
682
+ knc_Arab,68,1,204,67,239969,0.004878,0.014706,0.007326,0.999151,849.387733,0.014706
683
+ knc_Latn,293,286,1970,7,237978,0.126773,0.976109,0.224402,0.99179,8210.112191,0.976109
684
+ kne_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
685
+ knf_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
686
+ kng_Latn,362,344,321,18,239558,0.517293,0.950276,0.669912,0.998662,1338.174663,0.950276
687
+ knj_Latn,188,0,0,188,240053,0.0,0.0,0.0,1.0,0.0,0.0
688
+ knk_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
689
+ knv_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
690
+ koi_Cyrl,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
691
+ koo_Latn,297,0,0,297,239944,0.0,0.0,0.0,1.0,0.0,0.0
692
+ kor_Hang,265,264,690,1,239286,0.27673,0.996226,0.433142,0.997125,2875.287529,0.996226
693
+ kos_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
694
+ kpe_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
695
+ kpf_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
696
+ kpg_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
697
+ kpj_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
698
+ kpr_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
699
+ kpv_Cyrl,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
700
+ kpw_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
701
+ kpx_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
702
+ kpz_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
703
+ kqc_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
704
+ kqe_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
705
+ kqf_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
706
+ kqn_Latn,286,0,0,286,239955,0.0,0.0,0.0,1.0,0.0,0.0
707
+ kqp_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
708
+ kqw_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
709
+ krc_Cyrl,159,158,1472,1,238610,0.096933,0.993711,0.176635,0.993869,6131.238494,0.993711
710
+ kri_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
711
+ krj_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
712
+ krl_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
713
+ kru_Deva,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
714
+ ksc_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
715
+ ksd_Latn,202,0,0,202,240039,0.0,0.0,0.0,1.0,0.0,0.0
716
+ ksh_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
717
+ ksp_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
718
+ ksr_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
719
+ kss_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
720
+ ksw_Mymr,299,0,0,299,239942,0.0,0.0,0.0,1.0,0.0,0.0
721
+ ktj_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
722
+ kto_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
723
+ ktu_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
724
+ ktz_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
725
+ kua_Latn,476,0,0,476,239765,0.0,0.0,0.0,1.0,0.0,0.0
726
+ kud_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
727
+ kue_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
728
+ kum_Cyrl,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
729
+ kup_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
730
+ kus_Latn,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
731
+ kvg_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
732
+ kvn_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
733
+ kwd_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
734
+ kwf_Latn,150,0,0,150,240091,0.0,0.0,0.0,1.0,0.0,0.0
735
+ kwi_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
736
+ kwj_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
737
+ kwn_Latn,275,0,0,275,239966,0.0,0.0,0.0,1.0,0.0,0.0
738
+ kwy_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
739
+ kxc_Ethi,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
740
+ kxw_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
741
+ kyc_Latn,219,0,0,219,240022,0.0,0.0,0.0,1.0,0.0,0.0
742
+ kyf_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
743
+ kyg_Latn,201,0,0,201,240040,0.0,0.0,0.0,1.0,0.0,0.0
744
+ kyq_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
745
+ kyu_Kali,215,0,0,215,240026,0.0,0.0,0.0,1.0,0.0,0.0
746
+ kyz_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
747
+ kze_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
748
+ kzj_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
749
+ lac_Latn,230,0,0,230,240011,0.0,0.0,0.0,1.0,0.0,0.0
750
+ lad_Hebr,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
751
+ lad_Latn,302,0,0,302,239939,0.0,0.0,0.0,1.0,0.0,0.0
752
+ lai_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
753
+ laj_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
754
+ lam_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
755
+ lao_Laoo,335,329,24,6,239882,0.932011,0.98209,0.956395,0.9999,100.039182,0.98209
756
+ lat_Latn,282,0,0,282,239959,0.0,0.0,0.0,1.0,0.0,0.0
757
+ lbb_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
758
+ lbe_Cyrl,219,0,0,219,240022,0.0,0.0,0.0,1.0,0.0,0.0
759
+ lbj_Tibt,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
760
+ lbk_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
761
+ lcm_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
762
+ lcp_Thai,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
763
+ ldi_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
764
+ lee_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
765
+ lef_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
766
+ leh_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
767
+ leu_Latn,157,0,0,157,240084,0.0,0.0,0.0,1.0,0.0,0.0
768
+ lew_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
769
+ lex_Latn,163,0,0,163,240078,0.0,0.0,0.0,1.0,0.0,0.0
770
+ lez_Cyrl,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
771
+ lfn_Cyrl,55,0,0,55,240186,0.0,0.0,0.0,1.0,0.0,0.0
772
+ lfn_Latn,150,0,0,150,240091,0.0,0.0,0.0,1.0,0.0,0.0
773
+ lgg_Latn,279,0,0,279,239962,0.0,0.0,0.0,1.0,0.0,0.0
774
+ lgl_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
775
+ lhu_Latn,167,0,0,167,240074,0.0,0.0,0.0,1.0,0.0,0.0
776
+ lia_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
777
+ lid_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
778
+ lif_Deva,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
779
+ lif_Limb,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
780
+ lij_Latn,245,189,843,56,239153,0.18314,0.771429,0.296006,0.996487,3512.558543,0.771429
781
+ lim_Latn,196,183,1202,13,238843,0.13213,0.933673,0.231499,0.994993,5007.394447,0.933673
782
+ lin_Latn,215,212,429,3,239597,0.330733,0.986047,0.495327,0.998213,1787.306375,0.986047
783
+ lip_Latn,33,0,0,33,240208,0.0,0.0,0.0,1.0,0.0,0.0
784
+ lis_Lisu,6,0,0,6,240235,0.0,0.0,0.0,1.0,0.0,0.0
785
+ lit_Latn,330,319,322,11,239589,0.49766,0.966667,0.657055,0.998658,1342.164386,0.966667
786
+ liv_Latn,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
787
+ ljp_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
788
+ lki_Arab,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
789
+ lld_Latn,275,0,0,275,239966,0.0,0.0,0.0,1.0,0.0,0.0
790
+ llg_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
791
+ lmk_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
792
+ lmo_Latn,276,252,3239,24,236726,0.072186,0.913043,0.133793,0.986502,13497.801763,0.913043
793
+ lmp_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
794
+ lnd_Latn,5,0,0,5,240236,0.0,0.0,0.0,1.0,0.0,0.0
795
+ log_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
796
+ loq_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
797
+ loz_Latn,268,0,0,268,239973,0.0,0.0,0.0,1.0,0.0,0.0
798
+ lrc_Arab,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
799
+ lsm_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
800
+ ltg_Latn,259,246,664,13,239318,0.27033,0.949807,0.420873,0.997233,2766.874182,0.949807
801
+ ltz_Latn,251,251,553,0,239437,0.312189,1.0,0.475829,0.997696,2304.262678,1.0
802
+ lua_Latn,346,328,578,18,239317,0.362031,0.947977,0.523962,0.997591,2409.38744,0.947977
803
+ lub_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
804
+ luc_Latn,67,0,0,67,240174,0.0,0.0,0.0,1.0,0.0,0.0
805
+ lue_Latn,327,0,0,327,239914,0.0,0.0,0.0,1.0,0.0,0.0
806
+ lug_Latn,405,396,2663,9,237173,0.129454,0.977778,0.228637,0.988897,11103.420671,0.977778
807
+ lun_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
808
+ luo_Latn,415,384,2039,31,237787,0.158481,0.925301,0.270613,0.991498,8501.997281,0.925301
809
+ lus_Latn,391,383,2491,8,237359,0.133264,0.97954,0.234609,0.989614,10385.657703,0.97954
810
+ lvs_Latn,298,278,491,20,239452,0.361508,0.932886,0.521087,0.997954,2046.319334,0.932886
811
+ lwg_Latn,233,0,0,233,240008,0.0,0.0,0.0,1.0,0.0,0.0
812
+ lwo_Latn,41,0,0,41,240200,0.0,0.0,0.0,1.0,0.0,0.0
813
+ lww_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
814
+ lzh_Hani,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
815
+ maa_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
816
+ mad_Latn,183,0,0,183,240058,0.0,0.0,0.0,1.0,0.0,0.0
817
+ mag_Deva,97,78,554,19,239590,0.123418,0.804124,0.213992,0.997693,2306.949164,0.804124
818
+ mah_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
819
+ mai_Deva,234,223,234,11,239773,0.487965,0.952991,0.645441,0.999025,974.971563,0.952991
820
+ maj_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
821
+ mak_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
822
+ mal_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
823
+ mal_Mlym,338,334,31,4,239872,0.915068,0.988166,0.950213,0.999871,129.218893,0.988166
824
+ mam_Latn,233,0,0,233,240008,0.0,0.0,0.0,1.0,0.0,0.0
825
+ maq_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
826
+ mar_Deva,589,575,78,14,239574,0.880551,0.976231,0.925926,0.999675,325.471934,0.976231
827
+ mar_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
828
+ mas_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
829
+ mau_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
830
+ mav_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
831
+ maz_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
832
+ mbb_Latn,212,0,0,212,240029,0.0,0.0,0.0,1.0,0.0,0.0
833
+ mbc_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
834
+ mbd_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
835
+ mbf_Latn,48,0,0,48,240193,0.0,0.0,0.0,1.0,0.0,0.0
836
+ mbh_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
837
+ mbi_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
838
+ mbj_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
839
+ mbl_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
840
+ mbs_Latn,209,0,0,209,240032,0.0,0.0,0.0,1.0,0.0,0.0
841
+ mbt_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
842
+ mca_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
843
+ mcb_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
844
+ mcd_Latn,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
845
+ mcf_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
846
+ mck_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
847
+ mco_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
848
+ mcp_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
849
+ mcq_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
850
+ mcu_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
851
+ mdf_Cyrl,217,0,0,217,240024,0.0,0.0,0.0,1.0,0.0,0.0
852
+ mdy_Ethi,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
853
+ med_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
854
+ mee_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
855
+ mej_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
856
+ mek_Latn,65,0,0,65,240176,0.0,0.0,0.0,1.0,0.0,0.0
857
+ men_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
858
+ meq_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
859
+ mer_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
860
+ meu_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
861
+ mfe_Latn,250,0,0,250,239991,0.0,0.0,0.0,1.0,0.0,0.0
862
+ mfi_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
863
+ mfq_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
864
+ mfy_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
865
+ mfz_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
866
+ mgh_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
867
+ mgr_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
868
+ mhi_Latn,23,0,0,23,240218,0.0,0.0,0.0,1.0,0.0,0.0
869
+ mhl_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
870
+ mhr_Cyrl,291,0,0,291,239950,0.0,0.0,0.0,1.0,0.0,0.0
871
+ mhx_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
872
+ mib_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
873
+ mic_Latn,255,0,0,255,239986,0.0,0.0,0.0,1.0,0.0,0.0
874
+ mie_Latn,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
875
+ mif_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
876
+ mig_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
877
+ mih_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
878
+ mil_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
879
+ mim_Latn,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
880
+ min_Latn,55,11,3,44,240183,0.785714,0.2,0.318841,0.999988,12.49032,0.2
881
+ mio_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
882
+ mip_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
883
+ miq_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
884
+ mir_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
885
+ mit_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
886
+ miy_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
887
+ miz_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
888
+ mjc_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
889
+ mjw_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
890
+ mkd_Cyrl,331,328,106,3,239804,0.75576,0.990937,0.857516,0.999558,441.832354,0.990937
891
+ mkl_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
892
+ mkn_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
893
+ mks_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
894
+ mlh_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
895
+ mlp_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
896
+ mlt_Latn,291,274,193,17,239757,0.586724,0.941581,0.722955,0.999196,804.334236,0.941581
897
+ mlu_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
898
+ mmn_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
899
+ mmo_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
900
+ mmx_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
901
+ mna_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
902
+ mnb_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
903
+ mni_Beng,304,275,7,29,239930,0.975177,0.904605,0.938567,0.999971,29.174325,0.904605
904
+ mni_Latn,280,0,0,280,239961,0.0,0.0,0.0,1.0,0.0,0.0
905
+ mni_Mtei,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
906
+ mnk_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
907
+ mns_Cyrl,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
908
+ mnw_Mymr,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
909
+ mny_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
910
+ mog_Latn,2,0,0,2,240239,0.0,0.0,0.0,1.0,0.0,0.0
911
+ moh_Latn,195,0,0,195,240046,0.0,0.0,0.0,1.0,0.0,0.0
912
+ mop_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
913
+ mor_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
914
+ mos_Latn,133,130,752,3,239356,0.147392,0.977444,0.256158,0.996868,3131.923968,0.977444
915
+ mox_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
916
+ mpm_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
917
+ mpp_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
918
+ mps_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
919
+ mpt_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
920
+ mpx_Latn,205,0,0,205,240036,0.0,0.0,0.0,1.0,0.0,0.0
921
+ mqb_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
922
+ mqj_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
923
+ mqy_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
924
+ mri_Latn,162,159,2753,3,237326,0.054602,0.981481,0.103448,0.988533,11467.05876,0.981481
925
+ mrj_Cyrl,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
926
+ mrq_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
927
+ mrw_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
928
+ msb_Latn,71,0,0,71,240170,0.0,0.0,0.0,1.0,0.0,0.0
929
+ msk_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
930
+ msy_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
931
+ mta_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
932
+ mti_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
933
+ mto_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
934
+ mtp_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
935
+ muh_Latn,67,0,0,67,240174,0.0,0.0,0.0,1.0,0.0,0.0
936
+ mui_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
937
+ mup_Deva,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
938
+ mur_Latn,312,0,0,312,239929,0.0,0.0,0.0,1.0,0.0,0.0
939
+ mus_Latn,2,0,0,2,240239,0.0,0.0,0.0,1.0,0.0,0.0
940
+ mux_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
941
+ muy_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
942
+ mva_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
943
+ mvn_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
944
+ mvp_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
945
+ mwc_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
946
+ mwl_Latn,157,0,0,157,240084,0.0,0.0,0.0,1.0,0.0,0.0
947
+ mwn_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
948
+ mwp_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
949
+ mwq_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
950
+ mwv_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
951
+ mww_Latn,235,0,0,235,240006,0.0,0.0,0.0,1.0,0.0,0.0
952
+ mxb_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
953
+ mxp_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
954
+ mxq_Latn,87,0,0,87,240154,0.0,0.0,0.0,1.0,0.0,0.0
955
+ mxt_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
956
+ mxv_Latn,202,0,0,202,240039,0.0,0.0,0.0,1.0,0.0,0.0
957
+ mya_Mymr,342,335,416,7,239483,0.446072,0.979532,0.612992,0.998266,1734.063085,0.979532
958
+ myk_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
959
+ myu_Latn,51,0,0,51,240190,0.0,0.0,0.0,1.0,0.0,0.0
960
+ myv_Cyrl,156,0,0,156,240085,0.0,0.0,0.0,1.0,0.0,0.0
961
+ myw_Latn,182,0,0,182,240059,0.0,0.0,0.0,1.0,0.0,0.0
962
+ myx_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
963
+ myy_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
964
+ mza_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
965
+ mzh_Latn,26,0,0,26,240215,0.0,0.0,0.0,1.0,0.0,0.0
966
+ mzn_Arab,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
967
+ mzw_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
968
+ mzz_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
969
+ naf_Latn,203,0,0,203,240038,0.0,0.0,0.0,1.0,0.0,0.0
970
+ nah_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
971
+ nak_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
972
+ nan_Hani,75,0,0,75,240166,0.0,0.0,0.0,1.0,0.0,0.0
973
+ nan_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
974
+ nap_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
975
+ naq_Latn,274,0,0,274,239967,0.0,0.0,0.0,1.0,0.0,0.0
976
+ nas_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
977
+ nav_Latn,113,106,1282,7,238846,0.076369,0.938053,0.141239,0.994661,5338.819296,0.938053
978
+ nba_Latn,231,0,0,231,240010,0.0,0.0,0.0,1.0,0.0,0.0
979
+ nbe_Latn,72,0,0,72,240169,0.0,0.0,0.0,1.0,0.0,0.0
980
+ nbl_Latn,528,0,0,528,239713,0.0,0.0,0.0,1.0,0.0,0.0
981
+ nbq_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
982
+ nbu_Latn,351,0,0,351,239890,0.0,0.0,0.0,1.0,0.0,0.0
983
+ nca_Latn,215,0,0,215,240026,0.0,0.0,0.0,1.0,0.0,0.0
984
+ nch_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
985
+ ncj_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
986
+ ncl_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
987
+ ncq_Laoo,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
988
+ ncu_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
989
+ ncx_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
990
+ ndc_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
991
+ nde_Latn,256,0,0,256,239985,0.0,0.0,0.0,1.0,0.0,0.0
992
+ ndh_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
993
+ ndo_Latn,325,0,0,325,239916,0.0,0.0,0.0,1.0,0.0,0.0
994
+ nds_Latn,296,0,0,296,239945,0.0,0.0,0.0,1.0,0.0,0.0
995
+ neb_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
996
+ new_Deva,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
997
+ nfa_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
998
+ nfr_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
999
+ ngl_Latn,175,0,0,175,240066,0.0,0.0,0.0,1.0,0.0,0.0
1000
+ ngp_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1001
+ ngu_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
1002
+ nhe_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
1003
+ nhg_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1004
+ nhi_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
1005
+ nho_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
1006
+ nhr_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1007
+ nhu_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
1008
+ nhw_Latn,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
1009
+ nhx_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
1010
+ nhy_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
1011
+ nia_Latn,242,239,636,3,239363,0.273143,0.987603,0.427932,0.99735,2650.011042,0.987603
1012
+ nif_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
1013
+ nii_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
1014
+ nij_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1015
+ nim_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
1016
+ nin_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
1017
+ niu_Latn,204,0,0,204,240037,0.0,0.0,0.0,1.0,0.0,0.0
1018
+ njb_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
1019
+ njm_Latn,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
1020
+ njn_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1021
+ njo_Latn,256,0,0,256,239985,0.0,0.0,0.0,1.0,0.0,0.0
1022
+ njz_Latn,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
1023
+ nko_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1024
+ nld_Latn,259,250,608,9,239374,0.291375,0.965251,0.447628,0.997466,2533.523348,0.965251
1025
+ nlg_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1026
+ nmf_Latn,294,0,0,294,239947,0.0,0.0,0.0,1.0,0.0,0.0
1027
+ nmo_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1028
+ nmz_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1029
+ nnb_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1030
+ nno_Latn,427,406,68,21,239746,0.85654,0.95082,0.901221,0.999716,283.553087,0.95082
1031
+ nnq_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1032
+ nnw_Latn,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
1033
+ noa_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
1034
+ nob_Latn,265,241,102,24,239874,0.702624,0.909434,0.792763,0.999575,425.042504,0.909434
1035
+ nod_Thai,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1036
+ nog_Cyrl,219,0,0,219,240022,0.0,0.0,0.0,1.0,0.0,0.0
1037
+ non_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
1038
+ nop_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1039
+ not_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1040
+ nou_Latn,84,0,0,84,240157,0.0,0.0,0.0,1.0,0.0,0.0
1041
+ nov_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1042
+ nph_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1043
+ npi_Deva,273,268,305,5,239663,0.467714,0.981685,0.63357,0.998729,1271.0028,0.981685
1044
+ npi_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
1045
+ npl_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1046
+ npy_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1047
+ nqo_Nkoo,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
1048
+ nre_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
1049
+ nrf_Latn,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
1050
+ nrm_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
1051
+ nse_Latn,12,0,0,12,240229,0.0,0.0,0.0,1.0,0.0,0.0
1052
+ nsm_Latn,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
1053
+ nsn_Latn,198,0,0,198,240043,0.0,0.0,0.0,1.0,0.0,0.0
1054
+ nso_Latn,479,458,64,21,239698,0.877395,0.956159,0.915085,0.999733,266.931374,0.956159
1055
+ nss_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1056
+ nsu_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
1057
+ ntp_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1058
+ ntr_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1059
+ ntu_Latn,150,0,0,150,240091,0.0,0.0,0.0,1.0,0.0,0.0
1060
+ nuj_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
1061
+ nus_Latn,199,195,1196,4,238846,0.140187,0.979899,0.245283,0.995018,4982.461403,0.979899
1062
+ nuy_Latn,81,0,0,81,240160,0.0,0.0,0.0,1.0,0.0,0.0
1063
+ nvm_Latn,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
1064
+ nwi_Latn,152,0,0,152,240089,0.0,0.0,0.0,1.0,0.0,0.0
1065
+ nya_Latn,262,231,1132,31,238847,0.169479,0.881679,0.284308,0.995283,4717.079411,0.881679
1066
+ nyf_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1067
+ nyn_Latn,279,0,0,279,239962,0.0,0.0,0.0,1.0,0.0,0.0
1068
+ nyo_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1069
+ nyu_Latn,149,0,0,149,240092,0.0,0.0,0.0,1.0,0.0,0.0
1070
+ nyy_Latn,259,0,0,259,239982,0.0,0.0,0.0,1.0,0.0,0.0
1071
+ nzi_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1072
+ obo_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1073
+ oci_Latn,333,328,934,5,238974,0.259905,0.984985,0.411285,0.996107,3893.159044,0.984985
1074
+ ogo_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
1075
+ ojb_Cans,237,0,0,237,240004,0.0,0.0,0.0,1.0,0.0,0.0
1076
+ ojb_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
1077
+ oke_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
1078
+ okv_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
1079
+ old_Latn,11,0,0,11,240230,0.0,0.0,0.0,1.0,0.0,0.0
1080
+ olo_Latn,245,0,0,245,239996,0.0,0.0,0.0,1.0,0.0,0.0
1081
+ omw_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1082
+ ong_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1083
+ ons_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
1084
+ opm_Latn,92,0,0,92,240149,0.0,0.0,0.0,1.0,0.0,0.0
1085
+ orv_Cyrl,239,0,0,239,240002,0.0,0.0,0.0,1.0,0.0,0.0
1086
+ ory_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1087
+ ory_Orya,511,507,21,4,239709,0.960227,0.992172,0.975938,0.999912,87.598548,0.992172
1088
+ oss_Cyrl,152,152,94,0,239995,0.617886,1.0,0.763819,0.999608,391.521477,1.0
1089
+ ota_Arab,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
1090
+ ote_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1091
+ otm_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1092
+ otq_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
1093
+ ots_Latn,44,0,0,44,240197,0.0,0.0,0.0,1.0,0.0,0.0
1094
+ otw_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
1095
+ ozm_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1096
+ pab_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
1097
+ pad_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1098
+ pag_Latn,122,117,1308,5,238811,0.082105,0.959016,0.151261,0.994553,5447.299048,0.959016
1099
+ pah_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1100
+ pam_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1101
+ pan_Guru,460,451,0,9,239781,1.0,0.980435,0.990121,1.0,0.0,0.980435
1102
+ pan_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
1103
+ pao_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
1104
+ pap_Latn,423,416,586,7,239232,0.41517,0.983452,0.58386,0.997556,2443.519669,0.983452
1105
+ pau_Latn,265,0,0,265,239976,0.0,0.0,0.0,1.0,0.0,0.0
1106
+ pbb_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
1107
+ pbt_Arab,419,403,12,16,239810,0.971084,0.961814,0.966427,0.99995,50.037111,0.961814
1108
+ pcd_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
1109
+ pck_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
1110
+ pcm_Latn,251,84,112,167,239878,0.428571,0.334661,0.375839,0.999533,466.686112,0.334661
1111
+ pdc_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
1112
+ pdt_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
1113
+ pem_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1114
+ pfl_Latn,222,0,0,222,240019,0.0,0.0,0.0,1.0,0.0,0.0
1115
+ pib_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1116
+ pio_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
1117
+ pir_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1118
+ pis_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
1119
+ pjt_Latn,179,0,0,179,240062,0.0,0.0,0.0,1.0,0.0,0.0
1120
+ plg_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1121
+ pls_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
1122
+ plt_Latn,248,243,356,5,239637,0.405676,0.979839,0.57379,0.998517,1483.376598,0.979839
1123
+ plu_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1124
+ plw_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
1125
+ pma_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1126
+ pmf_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1127
+ pmq_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
1128
+ pms_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
1129
+ pnb_Arab,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
1130
+ pnt_Grek,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
1131
+ poe_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1132
+ poh_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1133
+ poi_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
1134
+ pol_Latn,254,253,1182,1,238805,0.176307,0.996063,0.299586,0.995075,4925.266785,0.996063
1135
+ pon_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
1136
+ por_Latn,657,637,391,20,239193,0.61965,0.969559,0.756083,0.998368,1631.995459,0.969559
1137
+ pot_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
1138
+ pov_Latn,70,0,0,70,240171,0.0,0.0,0.0,1.0,0.0,0.0
1139
+ poy_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1140
+ ppk_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1141
+ ppo_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
1142
+ prf_Latn,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
1143
+ prg_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1144
+ pri_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1145
+ ptp_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1146
+ ptu_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
1147
+ pwg_Latn,141,0,0,141,240100,0.0,0.0,0.0,1.0,0.0,0.0
1148
+ pwn_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1149
+ pxm_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
1150
+ qub_Latn,180,0,0,180,240061,0.0,0.0,0.0,1.0,0.0,0.0
1151
+ quc_Latn,310,0,0,310,239931,0.0,0.0,0.0,1.0,0.0,0.0
1152
+ quf_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
1153
+ qug_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1154
+ quh_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1155
+ qup_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
1156
+ quw_Latn,139,0,0,139,240102,0.0,0.0,0.0,1.0,0.0,0.0
1157
+ quy_Latn,271,262,3808,9,236162,0.064373,0.96679,0.12071,0.984131,15868.650248,0.96679
1158
+ quz_Latn,205,0,0,205,240036,0.0,0.0,0.0,1.0,0.0,0.0
1159
+ qva_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1160
+ qvc_Latn,53,0,0,53,240188,0.0,0.0,0.0,1.0,0.0,0.0
1161
+ qve_Latn,54,0,0,54,240187,0.0,0.0,0.0,1.0,0.0,0.0
1162
+ qvh_Latn,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
1163
+ qvi_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1164
+ qvm_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
1165
+ qvn_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
1166
+ qvs_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1167
+ qvw_Latn,175,0,0,175,240066,0.0,0.0,0.0,1.0,0.0,0.0
1168
+ qvz_Latn,191,0,0,191,240050,0.0,0.0,0.0,1.0,0.0,0.0
1169
+ qwh_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1170
+ qxh_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
1171
+ qxl_Latn,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
1172
+ qxn_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1173
+ qxo_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1174
+ qxr_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1175
+ rad_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
1176
+ rai_Latn,168,0,0,168,240073,0.0,0.0,0.0,1.0,0.0,0.0
1177
+ rap_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
1178
+ rar_Latn,368,0,0,368,239873,0.0,0.0,0.0,1.0,0.0,0.0
1179
+ rav_Deva,45,0,0,45,240196,0.0,0.0,0.0,1.0,0.0,0.0
1180
+ raw_Latn,97,0,0,97,240144,0.0,0.0,0.0,1.0,0.0,0.0
1181
+ rcf_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
1182
+ rej_Latn,33,0,0,33,240208,0.0,0.0,0.0,1.0,0.0,0.0
1183
+ rgu_Latn,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
1184
+ ria_Latn,23,0,0,23,240218,0.0,0.0,0.0,1.0,0.0,0.0
1185
+ rim_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1186
+ rkb_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1187
+ rmc_Latn,341,0,0,341,239900,0.0,0.0,0.0,1.0,0.0,0.0
1188
+ rml_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1189
+ rmn_Cyrl,223,0,0,223,240018,0.0,0.0,0.0,1.0,0.0,0.0
1190
+ rmn_Grek,185,0,0,185,240056,0.0,0.0,0.0,1.0,0.0,0.0
1191
+ rmn_Latn,236,0,0,236,240005,0.0,0.0,0.0,1.0,0.0,0.0
1192
+ rmo_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1193
+ rmq_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
1194
+ rmy_Cyrl,101,0,0,101,240140,0.0,0.0,0.0,1.0,0.0,0.0
1195
+ rmy_Latn,265,0,0,265,239976,0.0,0.0,0.0,1.0,0.0,0.0
1196
+ rnd_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
1197
+ rng_Latn,209,0,0,209,240032,0.0,0.0,0.0,1.0,0.0,0.0
1198
+ roh_Latn,307,302,305,5,239629,0.497529,0.983713,0.660832,0.998729,1271.182909,0.983713
1199
+ ron_Cyrl,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1200
+ ron_Latn,369,365,132,4,239740,0.734406,0.98916,0.842956,0.99945,550.29349,0.98916
1201
+ roo_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
1202
+ rop_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1203
+ row_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
1204
+ rro_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1205
+ rtm_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
1206
+ rub_Latn,31,0,0,31,240210,0.0,0.0,0.0,1.0,0.0,0.0
1207
+ rue_Cyrl,301,0,0,301,239940,0.0,0.0,0.0,1.0,0.0,0.0
1208
+ ruf_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
1209
+ rug_Latn,181,0,0,181,240060,0.0,0.0,0.0,1.0,0.0,0.0
1210
+ run_Latn,291,229,674,62,239276,0.253599,0.786942,0.383585,0.997191,2808.918525,0.786942
1211
+ rup_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
1212
+ rus_Cyrl,528,483,1080,45,238633,0.309021,0.914773,0.46198,0.995495,4505.387693,0.914773
1213
+ rwo_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
1214
+ sab_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1215
+ sag_Latn,237,230,186,7,239818,0.552885,0.970464,0.704441,0.999225,774.987084,0.970464
1216
+ sah_Cyrl,260,0,0,260,239981,0.0,0.0,0.0,1.0,0.0,0.0
1217
+ san_Deva,239,230,116,9,239886,0.66474,0.962343,0.786325,0.999517,483.329306,0.962343
1218
+ san_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
1219
+ sas_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
1220
+ sat_Latn,239,0,0,239,240002,0.0,0.0,0.0,1.0,0.0,0.0
1221
+ sat_Olck,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1222
+ sbe_Latn,94,0,0,94,240147,0.0,0.0,0.0,1.0,0.0,0.0
1223
+ sbl_Latn,74,0,0,74,240167,0.0,0.0,0.0,1.0,0.0,0.0
1224
+ sby_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1225
+ sck_Deva,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
1226
+ scn_Latn,172,171,1615,1,238454,0.095745,0.994186,0.174668,0.993273,6727.232587,0.994186
1227
+ sco_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
1228
+ sda_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1229
+ sdc_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1230
+ sdh_Arab,400,0,0,400,239841,0.0,0.0,0.0,1.0,0.0,0.0
1231
+ seh_Latn,162,0,0,162,240079,0.0,0.0,0.0,1.0,0.0,0.0
1232
+ ses_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
1233
+ sey_Latn,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
1234
+ sgb_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1235
+ sgc_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1236
+ sgh_Cyrl,9,0,0,9,240232,0.0,0.0,0.0,1.0,0.0,0.0
1237
+ sgs_Latn,218,0,0,218,240023,0.0,0.0,0.0,1.0,0.0,0.0
1238
+ sgw_Ethi,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1239
+ sgz_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1240
+ shi_Latn,133,0,0,133,240108,0.0,0.0,0.0,1.0,0.0,0.0
1241
+ shn_Mymr,174,169,11,5,240056,0.938889,0.971264,0.954802,0.999954,45.820542,0.971264
1242
+ shp_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1243
+ sid_Latn,193,0,0,193,240048,0.0,0.0,0.0,1.0,0.0,0.0
1244
+ sig_Latn,89,0,0,89,240152,0.0,0.0,0.0,1.0,0.0,0.0
1245
+ sil_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1246
+ sim_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1247
+ sin_Sinh,232,231,0,1,240009,1.0,0.99569,0.99784,1.0,0.0,0.99569
1248
+ sja_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
1249
+ skg_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1250
+ skr_Arab,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1251
+ slk_Latn,374,357,510,17,239357,0.411765,0.954545,0.575342,0.997874,2126.178257,0.954545
1252
+ sll_Latn,160,0,0,160,240081,0.0,0.0,0.0,1.0,0.0,0.0
1253
+ slv_Latn,338,320,646,18,239257,0.331263,0.946746,0.490798,0.997307,2692.754988,0.946746
1254
+ sma_Latn,327,0,0,327,239914,0.0,0.0,0.0,1.0,0.0,0.0
1255
+ sme_Latn,246,0,0,246,239995,0.0,0.0,0.0,1.0,0.0,0.0
1256
+ smj_Latn,407,0,0,407,239834,0.0,0.0,0.0,1.0,0.0,0.0
1257
+ smk_Latn,172,0,0,172,240069,0.0,0.0,0.0,1.0,0.0,0.0
1258
+ sml_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1259
+ smn_Latn,293,0,0,293,239948,0.0,0.0,0.0,1.0,0.0,0.0
1260
+ smo_Latn,426,418,1185,8,238630,0.260761,0.981221,0.412026,0.995059,4941.308926,0.981221
1261
+ sms_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
1262
+ sna_Latn,415,408,2016,7,237810,0.168317,0.983133,0.287425,0.991594,8406.094418,0.983133
1263
+ snc_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1264
+ snd_Arab,325,324,28,1,239888,0.920455,0.996923,0.957164,0.999883,116.707514,0.996923
1265
+ snd_Deva,267,0,0,267,239974,0.0,0.0,0.0,1.0,0.0,0.0
1266
+ snd_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
1267
+ snf_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1268
+ snn_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1269
+ snp_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1270
+ snw_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
1271
+ sny_Latn,163,0,0,163,240078,0.0,0.0,0.0,1.0,0.0,0.0
1272
+ som_Latn,439,436,916,3,238886,0.322485,0.993166,0.486879,0.99618,3819.818017,0.993166
1273
+ sop_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1274
+ soq_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
1275
+ sot_Latn,491,375,270,116,239480,0.581395,0.763747,0.660211,0.998874,1126.173097,0.763747
1276
+ soy_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
1277
+ spa_Latn,1136,1031,1423,105,237682,0.42013,0.90757,0.574373,0.994049,5951.360281,0.90757
1278
+ spl_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1279
+ spm_Latn,59,0,0,59,240182,0.0,0.0,0.0,1.0,0.0,0.0
1280
+ spp_Latn,155,0,0,155,240086,0.0,0.0,0.0,1.0,0.0,0.0
1281
+ sps_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
1282
+ spy_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1283
+ srd_Latn,139,125,181,14,239921,0.408497,0.899281,0.561798,0.999246,753.846282,0.899281
1284
+ srm_Latn,125,0,0,125,240116,0.0,0.0,0.0,1.0,0.0,0.0
1285
+ srn_Latn,303,0,0,303,239938,0.0,0.0,0.0,1.0,0.0,0.0
1286
+ srp_Cyrl,269,266,174,3,239798,0.604545,0.988848,0.750353,0.999275,725.084593,0.988848
1287
+ srp_Latn,235,0,0,235,240006,0.0,0.0,0.0,1.0,0.0,0.0
1288
+ srq_Latn,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
1289
+ srr_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1290
+ ssd_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1291
+ ssg_Latn,220,0,0,220,240021,0.0,0.0,0.0,1.0,0.0,0.0
1292
+ ssw_Latn,322,314,440,8,239479,0.416446,0.975155,0.583643,0.998166,1833.952292,0.975155
1293
+ ssx_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1294
+ stp_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
1295
+ stq_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1296
+ sua_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
1297
+ suc_Latn,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
1298
+ sue_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1299
+ suk_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1300
+ sun_Latn,143,142,1692,1,238406,0.077426,0.993007,0.143652,0.992953,7047.122425,0.993007
1301
+ sur_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
1302
+ sus_Arab,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1303
+ sus_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
1304
+ suz_Deva,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1305
+ swc_Latn,273,0,0,273,239968,0.0,0.0,0.0,1.0,0.0,0.0
1306
+ swe_Latn,328,314,94,14,239819,0.769608,0.957317,0.853261,0.999608,391.808697,0.957317
1307
+ swg_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1308
+ swh_Latn,592,571,2139,21,237510,0.210701,0.964527,0.345851,0.991074,8925.553622,0.964527
1309
+ swp_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
1310
+ sxb_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1311
+ sxn_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1312
+ syb_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1313
+ syc_Syrc,193,0,0,193,240048,0.0,0.0,0.0,1.0,0.0,0.0
1314
+ syl_Beng,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1315
+ syl_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1316
+ szl_Latn,320,279,1230,41,238691,0.184891,0.871875,0.305085,0.994873,5126.687535,0.871875
1317
+ szy_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
1318
+ tab_Cyrl,196,0,0,196,240045,0.0,0.0,0.0,1.0,0.0,0.0
1319
+ tac_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1320
+ tah_Latn,242,238,638,4,239361,0.271689,0.983471,0.42576,0.997342,2658.34441,0.983471
1321
+ taj_Deva,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
1322
+ tam_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1323
+ tam_Taml,754,750,51,4,239436,0.93633,0.994695,0.96463,0.999787,212.955192,0.994695
1324
+ taq_Latn,106,80,1126,26,239009,0.066335,0.754717,0.121951,0.995311,4689.029088,0.754717
1325
+ taq_Tfng,104,0,1,104,240136,0.0,0.0,0.0,0.999996,4.16429,0.0
1326
+ tar_Latn,190,0,0,190,240051,0.0,0.0,0.0,1.0,0.0,0.0
1327
+ tat_Cyrl,201,200,941,1,239099,0.175285,0.995025,0.298063,0.99608,3920.17997,0.995025
1328
+ tat_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
1329
+ tav_Latn,36,0,0,36,240205,0.0,0.0,0.0,1.0,0.0,0.0
1330
+ taw_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1331
+ tay_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
1332
+ tbc_Latn,131,0,0,131,240110,0.0,0.0,0.0,1.0,0.0,0.0
1333
+ tbg_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1334
+ tbo_Latn,202,0,0,202,240039,0.0,0.0,0.0,1.0,0.0,0.0
1335
+ tby_Latn,107,0,0,107,240134,0.0,0.0,0.0,1.0,0.0,0.0
1336
+ tbz_Latn,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1337
+ tca_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
1338
+ tcf_Latn,146,0,0,146,240095,0.0,0.0,0.0,1.0,0.0,0.0
1339
+ tcs_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1340
+ tcy_Knda,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1341
+ tcz_Latn,291,0,0,291,239950,0.0,0.0,0.0,1.0,0.0,0.0
1342
+ tdt_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1343
+ ted_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
1344
+ tee_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
1345
+ tel_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
1346
+ tel_Telu,555,554,56,1,239630,0.908197,0.998198,0.951073,0.999766,233.639011,0.998198
1347
+ tem_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1348
+ teo_Latn,225,0,0,225,240016,0.0,0.0,0.0,1.0,0.0,0.0
1349
+ ter_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1350
+ tet_Latn,395,0,0,395,239846,0.0,0.0,0.0,1.0,0.0,0.0
1351
+ tew_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1352
+ tfr_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1353
+ tgk_Cyrl,413,404,394,9,239434,0.506266,0.978208,0.667217,0.998357,1642.844038,0.978208
1354
+ tgo_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1355
+ tgp_Latn,189,0,0,189,240052,0.0,0.0,0.0,1.0,0.0,0.0
1356
+ tha_Thai,431,415,430,16,239380,0.491124,0.962877,0.65047,0.998207,1793.086193,0.962877
1357
+ thk_Latn,126,0,0,126,240115,0.0,0.0,0.0,1.0,0.0,0.0
1358
+ thl_Deva,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
1359
+ tif_Latn,161,0,0,161,240080,0.0,0.0,0.0,1.0,0.0,0.0
1360
+ tih_Latn,10,0,0,10,240231,0.0,0.0,0.0,1.0,0.0,0.0
1361
+ tim_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
1362
+ tir_Ethi,339,336,279,3,239623,0.546341,0.99115,0.704403,0.998837,1162.974881,0.99115
1363
+ tiv_Latn,199,0,0,199,240042,0.0,0.0,0.0,1.0,0.0,0.0
1364
+ tiy_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1365
+ tkl_Latn,208,0,0,208,240033,0.0,0.0,0.0,1.0,0.0,0.0
1366
+ tkr_Cyrl,69,0,0,69,240172,0.0,0.0,0.0,1.0,0.0,0.0
1367
+ tku_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1368
+ tlf_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
1369
+ tlh_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
1370
+ tll_Latn,186,0,0,186,240055,0.0,0.0,0.0,1.0,0.0,0.0
1371
+ tly_Latn,123,0,0,123,240118,0.0,0.0,0.0,1.0,0.0,0.0
1372
+ tmd_Latn,109,0,0,109,240132,0.0,0.0,0.0,1.0,0.0,0.0
1373
+ tna_Latn,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1374
+ tnk_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1375
+ tnn_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1376
+ tnp_Latn,169,0,0,169,240072,0.0,0.0,0.0,1.0,0.0,0.0
1377
+ tob_Latn,85,0,0,85,240156,0.0,0.0,0.0,1.0,0.0,0.0
1378
+ toc_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
1379
+ tod_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1380
+ tog_Latn,105,0,0,105,240136,0.0,0.0,0.0,1.0,0.0,0.0
1381
+ toh_Latn,88,0,0,88,240153,0.0,0.0,0.0,1.0,0.0,0.0
1382
+ toi_Latn,232,0,0,232,240009,0.0,0.0,0.0,1.0,0.0,0.0
1383
+ toj_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1384
+ tok_Latn,106,0,0,106,240135,0.0,0.0,0.0,1.0,0.0,0.0
1385
+ ton_Latn,298,0,734,298,239209,0.0,0.0,0.0,0.996941,3059.05986,0.0
1386
+ too_Latn,102,0,0,102,240139,0.0,0.0,0.0,1.0,0.0,0.0
1387
+ top_Latn,259,0,0,259,239982,0.0,0.0,0.0,1.0,0.0,0.0
1388
+ tos_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1389
+ tpi_Latn,302,296,161,6,239778,0.647702,0.980132,0.779974,0.999329,671.00388,0.980132
1390
+ tpm_Latn,7,0,0,7,240234,0.0,0.0,0.0,1.0,0.0,0.0
1391
+ tpp_Latn,86,0,0,86,240155,0.0,0.0,0.0,1.0,0.0,0.0
1392
+ tpt_Latn,115,0,0,115,240126,0.0,0.0,0.0,1.0,0.0,0.0
1393
+ tpz_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1394
+ trc_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
1395
+ trn_Latn,57,0,0,57,240184,0.0,0.0,0.0,1.0,0.0,0.0
1396
+ trp_Latn,186,0,0,186,240055,0.0,0.0,0.0,1.0,0.0,0.0
1397
+ trq_Latn,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1398
+ trv_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1399
+ tsc_Latn,184,0,0,184,240057,0.0,0.0,0.0,1.0,0.0,0.0
1400
+ tsg_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1401
+ tsn_Latn,456,441,455,15,239330,0.492188,0.967105,0.652367,0.998102,1897.533207,0.967105
1402
+ tso_Latn,581,567,1517,14,238143,0.272073,0.975904,0.425516,0.99367,6329.800551,0.975904
1403
+ tsw_Latn,64,0,0,64,240177,0.0,0.0,0.0,1.0,0.0,0.0
1404
+ tsz_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1405
+ ttc_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
1406
+ tte_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
1407
+ ttj_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1408
+ tuc_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1409
+ tue_Latn,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
1410
+ tuf_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
1411
+ tui_Latn,4,0,0,4,240237,0.0,0.0,0.0,1.0,0.0,0.0
1412
+ tuk_Arab,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1413
+ tuk_Cyrl,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1414
+ tuk_Latn,227,219,85,8,239929,0.720395,0.964758,0.824859,0.999646,354.146008,0.964758
1415
+ tum_Latn,265,257,429,8,239547,0.374636,0.969811,0.540484,0.998212,1787.678768,0.969811
1416
+ tuo_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1417
+ tur_Latn,430,423,396,7,239415,0.516484,0.983721,0.677342,0.998349,1651.300399,0.983721
1418
+ tuv_Latn,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
1419
+ tvk_Latn,170,0,0,170,240071,0.0,0.0,0.0,1.0,0.0,0.0
1420
+ tvl_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
1421
+ twi_Latn,359,353,3372,6,236510,0.094765,0.983287,0.17287,0.985943,14056.911315,0.983287
1422
+ twu_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1423
+ txq_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
1424
+ txu_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
1425
+ tyv_Cyrl,273,0,0,273,239968,0.0,0.0,0.0,1.0,0.0,0.0
1426
+ tzh_Latn,347,0,0,347,239894,0.0,0.0,0.0,1.0,0.0,0.0
1427
+ tzj_Latn,190,0,0,190,240051,0.0,0.0,0.0,1.0,0.0,0.0
1428
+ tzm_Tfng,157,157,238,0,239846,0.397468,1.0,0.568841,0.999009,991.319705,1.0
1429
+ tzo_Latn,294,0,0,294,239947,0.0,0.0,0.0,1.0,0.0,0.0
1430
+ ubr_Latn,194,0,0,194,240047,0.0,0.0,0.0,1.0,0.0,0.0
1431
+ ubu_Latn,211,0,0,211,240030,0.0,0.0,0.0,1.0,0.0,0.0
1432
+ udm_Cyrl,159,115,172,44,239910,0.400697,0.72327,0.515695,0.999284,716.421889,0.72327
1433
+ udu_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1434
+ uig_Arab,334,333,64,1,239843,0.838791,0.997006,0.911081,0.999733,266.77004,0.997006
1435
+ uig_Cyrl,253,0,0,253,239988,0.0,0.0,0.0,1.0,0.0,0.0
1436
+ uig_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
1437
+ ukr_Cyrl,322,316,463,6,239456,0.405648,0.981366,0.574024,0.99807,1929.81798,0.981366
1438
+ umb_Latn,100,96,1345,4,238796,0.06662,0.96,0.124594,0.994399,5600.876152,0.96
1439
+ und_Bali,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1440
+ und_Bamu,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
1441
+ und_Bopo,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
1442
+ und_Cans,83,0,0,83,240158,0.0,0.0,0.0,1.0,0.0,0.0
1443
+ und_Cher,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
1444
+ und_Cyrl,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
1445
+ und_Deva,5,0,0,5,240236,0.0,0.0,0.0,1.0,0.0,0.0
1446
+ und_Egyp,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1447
+ und_Ethi,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
1448
+ und_Geor,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
1449
+ und_Goth,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
1450
+ und_Grek,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1451
+ und_Hebr,47,0,0,47,240194,0.0,0.0,0.0,1.0,0.0,0.0
1452
+ und_Hluw,16,0,0,16,240225,0.0,0.0,0.0,1.0,0.0,0.0
1453
+ und_Hung,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1454
+ und_Kana,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1455
+ und_Khmr,18,0,0,18,240223,0.0,0.0,0.0,1.0,0.0,0.0
1456
+ und_Lana,40,0,0,40,240201,0.0,0.0,0.0,1.0,0.0,0.0
1457
+ und_Laoo,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1458
+ und_Lina,22,0,0,22,240219,0.0,0.0,0.0,1.0,0.0,0.0
1459
+ und_Mlym,35,0,0,35,240206,0.0,0.0,0.0,1.0,0.0,0.0
1460
+ und_Mong,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1461
+ und_Mymr,27,0,0,27,240214,0.0,0.0,0.0,1.0,0.0,0.0
1462
+ und_Newa,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
1463
+ und_Orya,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
1464
+ und_Shaw,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1465
+ und_Sylo,95,0,0,95,240146,0.0,0.0,0.0,1.0,0.0,0.0
1466
+ und_Syrc,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
1467
+ und_Taml,52,0,0,52,240189,0.0,0.0,0.0,1.0,0.0,0.0
1468
+ und_Tang,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1469
+ und_Telu,49,0,0,49,240192,0.0,0.0,0.0,1.0,0.0,0.0
1470
+ und_Thaa,29,0,0,29,240212,0.0,0.0,0.0,1.0,0.0,0.0
1471
+ und_Thai,23,0,0,23,240218,0.0,0.0,0.0,1.0,0.0,0.0
1472
+ und_Tibt,24,0,0,24,240217,0.0,0.0,0.0,1.0,0.0,0.0
1473
+ und_Vaii,12,0,0,12,240229,0.0,0.0,0.0,1.0,0.0,0.0
1474
+ und_Xsux,43,0,0,43,240198,0.0,0.0,0.0,1.0,0.0,0.0
1475
+ und_Yiii,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1476
+ upv_Latn,50,0,0,50,240191,0.0,0.0,0.0,1.0,0.0,0.0
1477
+ ura_Latn,75,0,0,75,240166,0.0,0.0,0.0,1.0,0.0,0.0
1478
+ urb_Latn,112,0,0,112,240129,0.0,0.0,0.0,1.0,0.0,0.0
1479
+ urd_Arab,257,257,796,0,239188,0.244065,1.0,0.392366,0.996683,3316.887793,1.0
1480
+ urd_Latn,204,0,0,204,240037,0.0,0.0,0.0,1.0,0.0,0.0
1481
+ urh_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1482
+ urk_Thai,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1483
+ urt_Latn,96,0,0,96,240145,0.0,0.0,0.0,1.0,0.0,0.0
1484
+ usa_Latn,157,0,0,157,240084,0.0,0.0,0.0,1.0,0.0,0.0
1485
+ usp_Latn,90,0,0,90,240151,0.0,0.0,0.0,1.0,0.0,0.0
1486
+ uth_Latn,19,0,0,19,240222,0.0,0.0,0.0,1.0,0.0,0.0
1487
+ uvh_Latn,100,0,0,100,240141,0.0,0.0,0.0,1.0,0.0,0.0
1488
+ uvl_Latn,164,0,0,164,240077,0.0,0.0,0.0,1.0,0.0,0.0
1489
+ uzn_Cyrl,213,0,0,213,240028,0.0,0.0,0.0,1.0,0.0,0.0
1490
+ uzn_Latn,436,425,1033,11,238772,0.291495,0.974771,0.448786,0.995692,4307.666646,0.974771
1491
+ uzs_Arab,283,0,0,283,239958,0.0,0.0,0.0,1.0,0.0,0.0
1492
+ vap_Latn,140,0,0,140,240101,0.0,0.0,0.0,1.0,0.0,0.0
1493
+ var_Latn,38,0,0,38,240203,0.0,0.0,0.0,1.0,0.0,0.0
1494
+ vec_Latn,49,40,664,9,239528,0.056818,0.816327,0.106242,0.997236,2764.455103,0.816327
1495
+ ven_Latn,387,0,0,387,239854,0.0,0.0,0.0,1.0,0.0,0.0
1496
+ vep_Latn,113,0,0,113,240128,0.0,0.0,0.0,1.0,0.0,0.0
1497
+ vid_Latn,104,0,0,104,240137,0.0,0.0,0.0,1.0,0.0,0.0
1498
+ vie_Latn,338,329,675,9,239228,0.327689,0.973373,0.490313,0.997186,2813.637178,0.973373
1499
+ viv_Latn,166,0,0,166,240075,0.0,0.0,0.0,1.0,0.0,0.0
1500
+ vls_Latn,98,0,0,98,240143,0.0,0.0,0.0,1.0,0.0,0.0
1501
+ vmw_Latn,386,0,0,386,239855,0.0,0.0,0.0,1.0,0.0,0.0
1502
+ vmy_Latn,120,0,0,120,240121,0.0,0.0,0.0,1.0,0.0,0.0
1503
+ vol_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1504
+ vro_Latn,448,0,0,448,239793,0.0,0.0,0.0,1.0,0.0,0.0
1505
+ vun_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1506
+ waj_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1507
+ wal_Latn,284,0,0,284,239957,0.0,0.0,0.0,1.0,0.0,0.0
1508
+ wap_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1509
+ war_Latn,193,175,519,18,239529,0.252161,0.906736,0.394589,0.997838,2162.067586,0.906736
1510
+ way_Latn,27,0,0,27,240214,0.0,0.0,0.0,1.0,0.0,0.0
1511
+ wba_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
1512
+ wbm_Latn,42,0,0,42,240199,0.0,0.0,0.0,1.0,0.0,0.0
1513
+ wbp_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1514
+ wed_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1515
+ wer_Latn,143,0,0,143,240098,0.0,0.0,0.0,1.0,0.0,0.0
1516
+ whk_Latn,13,0,0,13,240228,0.0,0.0,0.0,1.0,0.0,0.0
1517
+ wib_Latn,17,0,0,17,240224,0.0,0.0,0.0,1.0,0.0,0.0
1518
+ wim_Latn,110,0,0,110,240131,0.0,0.0,0.0,1.0,0.0,0.0
1519
+ wiu_Latn,132,0,0,132,240109,0.0,0.0,0.0,1.0,0.0,0.0
1520
+ wln_Latn,305,0,0,305,239936,0.0,0.0,0.0,1.0,0.0,0.0
1521
+ wls_Latn,68,0,0,68,240173,0.0,0.0,0.0,1.0,0.0,0.0
1522
+ wlv_Latn,82,0,0,82,240159,0.0,0.0,0.0,1.0,0.0,0.0
1523
+ wmt_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
1524
+ wmw_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1525
+ wnc_Latn,197,0,0,197,240044,0.0,0.0,0.0,1.0,0.0,0.0
1526
+ wnu_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1527
+ wol_Latn,214,204,5395,10,234632,0.036435,0.953271,0.070188,0.977523,22476.638045,0.953271
1528
+ wos_Latn,183,0,0,183,240058,0.0,0.0,0.0,1.0,0.0,0.0
1529
+ wrk_Latn,185,0,0,185,240056,0.0,0.0,0.0,1.0,0.0,0.0
1530
+ wrs_Latn,158,0,0,158,240083,0.0,0.0,0.0,1.0,0.0,0.0
1531
+ wsk_Latn,128,0,0,128,240113,0.0,0.0,0.0,1.0,0.0,0.0
1532
+ wuu_Hani,148,0,0,148,240093,0.0,0.0,0.0,1.0,0.0,0.0
1533
+ wuv_Latn,144,0,0,144,240097,0.0,0.0,0.0,1.0,0.0,0.0
1534
+ xal_Cyrl,295,0,0,295,239946,0.0,0.0,0.0,1.0,0.0,0.0
1535
+ xav_Latn,103,0,0,103,240138,0.0,0.0,0.0,1.0,0.0,0.0
1536
+ xbi_Latn,165,0,0,165,240076,0.0,0.0,0.0,1.0,0.0,0.0
1537
+ xbr_Latn,8,0,0,8,240233,0.0,0.0,0.0,1.0,0.0,0.0
1538
+ xed_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
1539
+ xho_Latn,367,350,921,17,238953,0.275374,0.953678,0.42735,0.99616,3839.515746,0.953678
1540
+ xla_Latn,151,0,0,151,240090,0.0,0.0,0.0,1.0,0.0,0.0
1541
+ xmf_Geor,132,130,19,2,240090,0.872483,0.984848,0.925267,0.999921,79.130728,0.984848
1542
+ xmm_Latn,32,0,0,32,240209,0.0,0.0,0.0,1.0,0.0,0.0
1543
+ xmv_Latn,130,0,0,130,240111,0.0,0.0,0.0,1.0,0.0,0.0
1544
+ xnn_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1545
+ xog_Latn,93,0,0,93,240148,0.0,0.0,0.0,1.0,0.0,0.0
1546
+ xon_Latn,118,0,0,118,240123,0.0,0.0,0.0,1.0,0.0,0.0
1547
+ xrb_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1548
+ xsi_Latn,154,0,0,154,240087,0.0,0.0,0.0,1.0,0.0,0.0
1549
+ xsm_Latn,159,0,0,159,240082,0.0,0.0,0.0,1.0,0.0,0.0
1550
+ xsr_Deva,167,0,0,167,240074,0.0,0.0,0.0,1.0,0.0,0.0
1551
+ xsu_Latn,3,0,0,3,240238,0.0,0.0,0.0,1.0,0.0,0.0
1552
+ xtd_Latn,73,0,0,73,240168,0.0,0.0,0.0,1.0,0.0,0.0
1553
+ xtm_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1554
+ xtn_Latn,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1555
+ xuo_Latn,62,0,0,62,240179,0.0,0.0,0.0,1.0,0.0,0.0
1556
+ yaa_Latn,56,0,0,56,240185,0.0,0.0,0.0,1.0,0.0,0.0
1557
+ yad_Latn,46,0,0,46,240195,0.0,0.0,0.0,1.0,0.0,0.0
1558
+ yal_Latn,129,0,0,129,240112,0.0,0.0,0.0,1.0,0.0,0.0
1559
+ yan_Latn,14,0,0,14,240227,0.0,0.0,0.0,1.0,0.0,0.0
1560
+ yao_Latn,137,0,0,137,240104,0.0,0.0,0.0,1.0,0.0,0.0
1561
+ yap_Latn,210,0,0,210,240031,0.0,0.0,0.0,1.0,0.0,0.0
1562
+ yaq_Latn,60,0,0,60,240181,0.0,0.0,0.0,1.0,0.0,0.0
1563
+ ybb_Latn,20,0,0,20,240221,0.0,0.0,0.0,1.0,0.0,0.0
1564
+ yby_Latn,121,0,0,121,240120,0.0,0.0,0.0,1.0,0.0,0.0
1565
+ ycn_Latn,79,0,0,79,240162,0.0,0.0,0.0,1.0,0.0,0.0
1566
+ ydd_Hebr,430,429,20,1,239791,0.955457,0.997674,0.976109,0.999917,83.39901,0.997674
1567
+ yka_Latn,215,0,0,215,240026,0.0,0.0,0.0,1.0,0.0,0.0
1568
+ yle_Latn,119,0,0,119,240122,0.0,0.0,0.0,1.0,0.0,0.0
1569
+ yli_Latn,145,0,0,145,240096,0.0,0.0,0.0,1.0,0.0,0.0
1570
+ yml_Latn,173,0,0,173,240068,0.0,0.0,0.0,1.0,0.0,0.0
1571
+ yom_Latn,117,0,0,117,240124,0.0,0.0,0.0,1.0,0.0,0.0
1572
+ yon_Latn,127,0,0,127,240114,0.0,0.0,0.0,1.0,0.0,0.0
1573
+ yor_Latn,308,305,2048,3,237885,0.129622,0.99026,0.229237,0.991464,8535.716221,0.99026
1574
+ yrb_Latn,188,0,0,188,240053,0.0,0.0,0.0,1.0,0.0,0.0
1575
+ yre_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1576
+ yrk_Cyrl,61,0,0,61,240180,0.0,0.0,0.0,1.0,0.0,0.0
1577
+ yss_Latn,231,0,0,231,240010,0.0,0.0,0.0,1.0,0.0,0.0
1578
+ yua_Latn,326,0,0,326,239915,0.0,0.0,0.0,1.0,0.0,0.0
1579
+ yue_Hani,194,188,5936,6,234111,0.030699,0.969072,0.059513,0.975272,24728.490671,0.969072
1580
+ yuj_Latn,205,0,0,205,240036,0.0,0.0,0.0,1.0,0.0,0.0
1581
+ yut_Latn,262,0,0,262,239979,0.0,0.0,0.0,1.0,0.0,0.0
1582
+ yuw_Latn,136,0,0,136,240105,0.0,0.0,0.0,1.0,0.0,0.0
1583
+ yva_Latn,25,0,0,25,240216,0.0,0.0,0.0,1.0,0.0,0.0
1584
+ zaa_Latn,63,0,0,63,240178,0.0,0.0,0.0,1.0,0.0,0.0
1585
+ zab_Latn,116,0,0,116,240125,0.0,0.0,0.0,1.0,0.0,0.0
1586
+ zac_Latn,138,0,0,138,240103,0.0,0.0,0.0,1.0,0.0,0.0
1587
+ zad_Latn,12,0,0,12,240229,0.0,0.0,0.0,1.0,0.0,0.0
1588
+ zae_Latn,37,0,0,37,240204,0.0,0.0,0.0,1.0,0.0,0.0
1589
+ zai_Latn,80,0,0,80,240161,0.0,0.0,0.0,1.0,0.0,0.0
1590
+ zam_Latn,52,0,0,52,240189,0.0,0.0,0.0,1.0,0.0,0.0
1591
+ zao_Latn,77,0,0,77,240164,0.0,0.0,0.0,1.0,0.0,0.0
1592
+ zar_Latn,108,0,0,108,240133,0.0,0.0,0.0,1.0,0.0,0.0
1593
+ zas_Latn,58,0,0,58,240183,0.0,0.0,0.0,1.0,0.0,0.0
1594
+ zat_Latn,261,0,0,261,239980,0.0,0.0,0.0,1.0,0.0,0.0
1595
+ zav_Latn,78,0,0,78,240163,0.0,0.0,0.0,1.0,0.0,0.0
1596
+ zaw_Latn,99,0,0,99,240142,0.0,0.0,0.0,1.0,0.0,0.0
1597
+ zdj_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1598
+ zea_Latn,192,0,0,192,240049,0.0,0.0,0.0,1.0,0.0,0.0
1599
+ zgh_Tfng,135,0,0,135,240106,0.0,0.0,0.0,1.0,0.0,0.0
1600
+ zia_Latn,76,0,0,76,240165,0.0,0.0,0.0,1.0,0.0,0.0
1601
+ ziw_Latn,142,0,0,142,240099,0.0,0.0,0.0,1.0,0.0,0.0
1602
+ zne_Latn,195,0,0,195,240046,0.0,0.0,0.0,1.0,0.0,0.0
1603
+ zom_Latn,260,0,0,260,239981,0.0,0.0,0.0,1.0,0.0,0.0
1604
+ zos_Latn,171,0,0,171,240070,0.0,0.0,0.0,1.0,0.0,0.0
1605
+ zpa_Latn,174,0,0,174,240067,0.0,0.0,0.0,1.0,0.0,0.0
1606
+ zpc_Latn,134,0,0,134,240107,0.0,0.0,0.0,1.0,0.0,0.0
1607
+ zpg_Latn,15,0,0,15,240226,0.0,0.0,0.0,1.0,0.0,0.0
1608
+ zpi_Latn,28,0,0,28,240213,0.0,0.0,0.0,1.0,0.0,0.0
1609
+ zpl_Latn,91,0,0,91,240150,0.0,0.0,0.0,1.0,0.0,0.0
1610
+ zpm_Latn,111,0,0,111,240130,0.0,0.0,0.0,1.0,0.0,0.0
1611
+ zpo_Latn,39,0,0,39,240202,0.0,0.0,0.0,1.0,0.0,0.0
1612
+ zpt_Latn,30,0,0,30,240211,0.0,0.0,0.0,1.0,0.0,0.0
1613
+ zpu_Latn,122,0,0,122,240119,0.0,0.0,0.0,1.0,0.0,0.0
1614
+ zpv_Latn,147,0,0,147,240094,0.0,0.0,0.0,1.0,0.0,0.0
1615
+ zpz_Latn,114,0,0,114,240127,0.0,0.0,0.0,1.0,0.0,0.0
1616
+ zsm_Latn,244,217,892,27,239105,0.195672,0.889344,0.320769,0.996283,3716.713126,0.889344
1617
+ zsr_Latn,124,0,0,124,240117,0.0,0.0,0.0,1.0,0.0,0.0
1618
+ ztq_Latn,187,0,0,187,240054,0.0,0.0,0.0,1.0,0.0,0.0
1619
+ zty_Latn,177,0,0,177,240064,0.0,0.0,0.0,1.0,0.0,0.0
1620
+ zul_Latn,594,573,960,21,238687,0.373777,0.964646,0.538787,0.995994,4005.891999,0.964646
1621
+ zyb_Latn,153,0,0,153,240088,0.0,0.0,0.0,1.0,0.0,0.0
1622
+ zyp_Latn,178,0,0,178,240063,0.0,0.0,0.0,1.0,0.0,0.0
reports/test/fasttext_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.25110201838986684,
3
+ "top3_accuracy": 0.2610045745730329,
4
+ "top5_accuracy": 0.262482257399861,
5
+ "passages": 240241,
6
+ "languages": 1621,
7
+ "macro_precision": 0.05202750834127428,
8
+ "macro_recall": 0.12048375928156996,
9
+ "macro_f1": 0.06567764337804372,
10
+ "macro_specificity": 0.9995388522643763,
11
+ "weighted_f1": 0.14972995387859817,
12
+ "median_f1": 0.0,
13
+ "languages_f1_at_least_0_9": 25,
14
+ "languages_f1_below_0_5": 1518,
15
+ "mean_fp_per_million": 461.14773562356646,
16
+ "micro_f1": 0.25110201838986684,
17
+ "top1_by_size": {
18
+ "paragraph": 0.19578968778602665,
19
+ "sentence": 0.2500699977091659,
20
+ "short": 0.2759950934205614
21
+ }
22
+ }
reports/test/glotlid@millid_per_language.csv ADDED
@@ -0,0 +1,1622 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aai_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
3
+ aak_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
4
+ aau_Latn,214,214,0,0,240027,1.0,1.0,1.0,1.0,0.0,1.0
5
+ aaz_Latn,98,98,1,0,240142,0.989899,1.0,0.994924,0.999996,4.164186,1.0
6
+ aba_Latn,176,176,0,0,240065,1.0,1.0,1.0,1.0,0.0,1.0
7
+ abk_Cyrl,285,285,0,0,239956,1.0,1.0,1.0,1.0,0.0,1.0
8
+ abn_Latn,174,174,0,0,240067,1.0,1.0,1.0,1.0,0.0,1.0
9
+ abq_Cyrl,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
10
+ abs_Latn,142,124,5,18,240094,0.96124,0.873239,0.915129,0.999979,20.824743,0.873239
11
+ abt_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
12
+ abx_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
13
+ aby_Latn,161,161,0,0,240080,1.0,1.0,1.0,1.0,0.0,1.0
14
+ abz_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
15
+ aca_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
16
+ acd_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
17
+ ace_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
18
+ acf_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
19
+ ach_Latn,242,242,2,0,239997,0.991803,1.0,0.995885,0.999992,8.333368,1.0
20
+ acm_Arab,109,78,32,31,240100,0.709091,0.715596,0.712329,0.999867,133.26004,0.715596
21
+ acn_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
22
+ acr_Latn,255,255,0,0,239986,1.0,1.0,1.0,1.0,0.0,1.0
23
+ acu_Latn,220,220,0,0,240021,1.0,1.0,1.0,1.0,0.0,1.0
24
+ ada_Latn,145,145,1,0,240095,0.993151,1.0,0.996564,0.999996,4.165001,1.0
25
+ ade_Latn,31,31,0,0,240210,1.0,1.0,1.0,1.0,0.0,1.0
26
+ adh_Latn,77,72,0,5,240164,1.0,0.935065,0.966443,1.0,0.0,0.935065
27
+ adj_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
28
+ ady_Cyrl,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
29
+ adz_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
30
+ aeb_Arab,244,198,54,46,239943,0.785714,0.811475,0.798387,0.999775,225.002813,0.811475
31
+ aeb_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
32
+ aer_Latn,16,16,0,0,240225,1.0,1.0,1.0,1.0,0.0,1.0
33
+ aeu_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
34
+ aey_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
35
+ afr_Latn,569,555,3,14,239669,0.994624,0.975395,0.984916,0.999987,12.517107,0.975395
36
+ agd_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
37
+ agg_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
38
+ agm_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
39
+ agn_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
40
+ agr_Latn,182,182,1,0,240058,0.994536,1.0,0.99726,0.999996,4.165643,1.0
41
+ agt_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
42
+ agu_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
43
+ agx_Cyrl,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
44
+ ahk_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
45
+ aia_Latn,163,163,0,0,240078,1.0,1.0,1.0,1.0,0.0,1.0
46
+ aii_Syrc,234,234,0,0,240007,1.0,1.0,1.0,1.0,0.0,1.0
47
+ ain_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
48
+ ajg_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
49
+ aji_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
50
+ ajp_Arab,28,27,38,1,240175,0.415385,0.964286,0.580645,0.999842,158.192937,0.964286
51
+ akb_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
52
+ ake_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
53
+ akh_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
54
+ akp_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
55
+ aln_Latn,117,71,0,46,240124,1.0,0.606838,0.755319,1.0,0.0,0.606838
56
+ alp_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
57
+ alq_Latn,124,124,1,0,240116,0.992,1.0,0.995984,0.999996,4.164636,1.0
58
+ als_Latn,213,213,43,0,239985,0.832031,1.0,0.908316,0.999821,179.145766,1.0
59
+ alt_Cyrl,208,208,3,0,240030,0.985782,1.0,0.99284,0.999988,12.498281,1.0
60
+ aly_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
61
+ alz_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
62
+ ame_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
63
+ amf_Latn,59,59,1,0,240181,0.983333,1.0,0.991597,0.999996,4.163509,1.0
64
+ amh_Ethi,458,458,0,0,239783,1.0,1.0,1.0,1.0,0.0,1.0
65
+ ami_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
66
+ amk_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
67
+ amm_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
68
+ amn_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
69
+ amp_Latn,172,172,0,0,240069,1.0,1.0,1.0,1.0,0.0,1.0
70
+ amr_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
71
+ amu_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
72
+ amx_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
73
+ ang_Latn,197,197,1,0,240043,0.994949,1.0,0.997468,0.999996,4.165903,1.0
74
+ ann_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
75
+ anp_Deva,252,192,193,60,239796,0.498701,0.761905,0.602826,0.999196,804.203526,0.761905
76
+ anv_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
77
+ any_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
78
+ aoi_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
79
+ aoj_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
80
+ aom_Latn,156,156,0,0,240085,1.0,1.0,1.0,1.0,0.0,1.0
81
+ aoz_Latn,25,24,0,1,240216,1.0,0.96,0.979592,1.0,0.0,0.96
82
+ apb_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
83
+ apc_Arab,143,94,18,49,240080,0.839286,0.657343,0.737255,0.999925,74.969388,0.657343
84
+ ape_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
85
+ apn_Latn,105,105,0,0,240136,1.0,1.0,1.0,1.0,0.0,1.0
86
+ apr_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
87
+ apt_Latn,22,22,0,0,240219,1.0,1.0,1.0,1.0,0.0,1.0
88
+ apu_Latn,213,213,0,0,240028,1.0,1.0,1.0,1.0,0.0,1.0
89
+ apw_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
90
+ apy_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
91
+ apz_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
92
+ arb_Arab,745,593,172,152,239324,0.775163,0.795973,0.78543,0.999282,718.174834,0.795973
93
+ arb_Latn,163,137,1,26,240077,0.992754,0.840491,0.910299,0.999996,4.165313,0.840491
94
+ are_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
95
+ arg_Latn,194,194,4,0,240043,0.979798,1.0,0.989796,0.999983,16.663403,1.0
96
+ arl_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
97
+ arn_Latn,250,250,0,0,239991,1.0,1.0,1.0,1.0,0.0,1.0
98
+ arp_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
99
+ arq_Arab,113,95,2,18,240126,0.979381,0.840708,0.904762,0.999992,8.328891,0.840708
100
+ ars_Arab,309,226,58,83,239874,0.795775,0.731392,0.762226,0.999758,241.735158,0.731392
101
+ ary_Arab,192,120,109,72,239940,0.524017,0.625,0.570071,0.999546,454.07396,0.625
102
+ arz_Arab,229,133,47,96,239965,0.738889,0.580786,0.650367,0.999804,195.823542,0.580786
103
+ asm_Beng,467,466,0,1,239774,1.0,0.997859,0.998928,1.0,0.0,0.997859
104
+ asm_Latn,59,58,3,1,240179,0.95082,0.983051,0.966667,0.999988,12.490528,0.983051
105
+ aso_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
106
+ ast_Latn,244,244,17,0,239980,0.934866,1.0,0.966337,0.999929,70.834219,1.0
107
+ ata_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
108
+ atb_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
109
+ atd_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
110
+ atg_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
111
+ ati_Latn,94,94,4,0,240143,0.959184,1.0,0.979167,0.999983,16.656465,1.0
112
+ atj_Latn,108,108,14,0,240119,0.885246,1.0,0.93913,0.999942,58.301025,1.0
113
+ att_Latn,121,121,0,0,240120,1.0,1.0,1.0,1.0,0.0,1.0
114
+ auc_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
115
+ aui_Latn,114,114,1,0,240126,0.991304,1.0,0.995633,0.999996,4.164463,1.0
116
+ auy_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
117
+ ava_Cyrl,240,240,0,0,240001,1.0,1.0,1.0,1.0,0.0,1.0
118
+ avk_Latn,111,106,0,5,240130,1.0,0.954955,0.976959,1.0,0.0,0.954955
119
+ avt_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
120
+ avu_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
121
+ awa_Deva,91,91,20,0,240130,0.81982,1.0,0.90099,0.999917,83.281283,1.0
122
+ awb_Latn,167,167,0,0,240074,1.0,1.0,1.0,1.0,0.0,1.0
123
+ awx_Latn,53,53,0,0,240188,1.0,1.0,1.0,1.0,0.0,1.0
124
+ ayp_Arab,72,52,1,20,240168,0.981132,0.722222,0.832,0.999996,4.163735,0.722222
125
+ ayr_Latn,309,309,0,0,239932,1.0,1.0,1.0,1.0,0.0,1.0
126
+ azb_Arab,369,367,42,2,239830,0.897311,0.99458,0.943445,0.999825,175.093383,0.99458
127
+ azg_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
128
+ azj_Cyrl,144,144,3,0,240094,0.979592,1.0,0.989691,0.999988,12.49495,1.0
129
+ azj_Latn,187,187,3,0,240051,0.984211,1.0,0.992042,0.999988,12.497188,1.0
130
+ azz_Latn,73,73,0,0,240168,1.0,1.0,1.0,1.0,0.0,1.0
131
+ bak_Cyrl,289,289,0,0,239952,1.0,1.0,1.0,1.0,0.0,1.0
132
+ bam_Latn,287,287,1,0,239953,0.996528,1.0,0.998261,0.999996,4.167465,1.0
133
+ ban_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
134
+ bao_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
135
+ bar_Latn,331,331,6,0,239904,0.982196,1.0,0.991018,0.999975,25.009379,1.0
136
+ bas_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
137
+ bba_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
138
+ bbb_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
139
+ bbc_Latn,247,247,0,0,239994,1.0,1.0,1.0,1.0,0.0,1.0
140
+ bbr_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
141
+ bcc_Arab,173,134,17,39,240051,0.887417,0.774566,0.82716,0.999929,70.81327,0.774566
142
+ bch_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
143
+ bci_Latn,193,193,0,0,240048,1.0,1.0,1.0,1.0,0.0,1.0
144
+ bcl_Latn,231,231,0,0,240010,1.0,1.0,1.0,1.0,0.0,1.0
145
+ bco_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
146
+ bcw_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
147
+ bdd_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
148
+ bdh_Latn,180,180,0,0,240061,1.0,1.0,1.0,1.0,0.0,1.0
149
+ bdq_Latn,9,6,0,3,240232,1.0,0.666667,0.8,1.0,0.0,0.666667
150
+ bea_Latn,10,10,1,0,240230,0.909091,1.0,0.952381,0.999996,4.16266,1.0
151
+ bef_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
152
+ bel_Cyrl,157,157,1,0,240083,0.993671,1.0,0.996825,0.999996,4.165209,1.0
153
+ bem_Latn,222,216,4,6,240015,0.981818,0.972973,0.977376,0.999983,16.665347,0.972973
154
+ ben_Beng,466,464,1,2,239774,0.997849,0.995708,0.996778,0.999996,4.170577,0.995708
155
+ ben_Latn,126,109,12,17,240103,0.900826,0.865079,0.882591,0.99995,49.976053,0.865079
156
+ beq_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
157
+ bew_Latn,165,106,33,59,240043,0.76259,0.642424,0.697368,0.999863,137.456472,0.642424
158
+ bfd_Latn,92,92,0,0,240149,1.0,1.0,1.0,1.0,0.0,1.0
159
+ bgr_Latn,143,143,1,0,240097,0.993056,1.0,0.996516,0.999996,4.164966,1.0
160
+ bgs_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
161
+ bgt_Latn,144,144,2,0,240095,0.986301,1.0,0.993103,0.999992,8.329967,1.0
162
+ bgz_Latn,13,13,1,0,240227,0.928571,1.0,0.962963,0.999996,4.162712,1.0
163
+ bhg_Latn,19,19,0,0,240222,1.0,1.0,1.0,1.0,0.0,1.0
164
+ bhl_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
165
+ bho_Deva,290,290,7,0,239944,0.976431,1.0,0.988075,0.999971,29.172623,1.0
166
+ bhw_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
167
+ bib_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
168
+ big_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
169
+ bim_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
170
+ bin_Latn,182,182,0,0,240059,1.0,1.0,1.0,1.0,0.0,1.0
171
+ bis_Latn,257,257,0,0,239984,1.0,1.0,1.0,1.0,0.0,1.0
172
+ biu_Latn,7,7,0,0,240234,1.0,1.0,1.0,1.0,0.0,1.0
173
+ biv_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
174
+ bjn_Arab,116,113,1,3,240124,0.991228,0.974138,0.982609,0.999996,4.164498,0.974138
175
+ bjn_Latn,153,153,5,0,240083,0.968354,1.0,0.983923,0.999979,20.825697,1.0
176
+ bjp_Latn,171,171,0,0,240070,1.0,1.0,1.0,1.0,0.0,1.0
177
+ bjr_Latn,176,176,0,0,240065,1.0,1.0,1.0,1.0,0.0,1.0
178
+ bjv_Latn,84,84,0,0,240157,1.0,1.0,1.0,1.0,0.0,1.0
179
+ bkd_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
180
+ bkq_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
181
+ bku_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
182
+ bla_Latn,11,11,0,0,240230,1.0,1.0,1.0,1.0,0.0,1.0
183
+ blh_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
184
+ blk_Mymr,159,135,0,24,240082,1.0,0.849057,0.918367,1.0,0.0,0.849057
185
+ blt_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
186
+ blw_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
187
+ blz_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
188
+ bmh_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
189
+ bmk_Latn,11,11,0,0,240230,1.0,1.0,1.0,1.0,0.0,1.0
190
+ bmq_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
191
+ bmr_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
192
+ bmu_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
193
+ bno_Latn,176,176,1,0,240064,0.99435,1.0,0.997167,0.999996,4.165538,1.0
194
+ bnp_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
195
+ boa_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
196
+ bod_Tibt,406,405,11,1,239824,0.973558,0.997537,0.985401,0.999954,45.864865,0.997537
197
+ boj_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
198
+ bon_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
199
+ bos_Latn,198,198,43,0,240000,0.821577,1.0,0.90205,0.999821,179.134572,1.0
200
+ box_Latn,50,50,1,0,240190,0.980392,1.0,0.990099,0.999996,4.163353,1.0
201
+ bpr_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
202
+ bps_Latn,110,110,2,0,240129,0.982143,1.0,0.990991,0.999992,8.328787,1.0
203
+ bpy_Beng,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
204
+ bqc_Latn,161,161,0,0,240080,1.0,1.0,1.0,1.0,0.0,1.0
205
+ bqp_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
206
+ bre_Latn,277,277,0,0,239964,1.0,1.0,1.0,1.0,0.0,1.0
207
+ brh_Arab,311,279,4,32,239926,0.985866,0.897106,0.939394,0.999983,16.671529,0.897106
208
+ bru_Latn,141,141,1,0,240099,0.992958,1.0,0.996466,0.999996,4.164931,1.0
209
+ brx_Deva,351,351,0,0,239890,1.0,1.0,1.0,1.0,0.0,1.0
210
+ bsn_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
211
+ bsp_Latn,48,48,0,0,240193,1.0,1.0,1.0,1.0,0.0,1.0
212
+ bsq_Latn,73,73,2,0,240166,0.973333,1.0,0.986486,0.999992,8.327504,1.0
213
+ bss_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
214
+ btd_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
215
+ bth_Latn,33,33,0,0,240208,1.0,1.0,1.0,1.0,0.0,1.0
216
+ bts_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
217
+ btx_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
218
+ bud_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
219
+ bug_Latn,78,78,9,0,240154,0.896552,1.0,0.945455,0.999963,37.474549,1.0
220
+ buk_Latn,211,211,0,0,240030,1.0,1.0,1.0,1.0,0.0,1.0
221
+ bul_Cyrl,289,289,2,0,239950,0.993127,1.0,0.996552,0.999992,8.335,1.0
222
+ bum_Latn,245,245,4,0,239992,0.983936,1.0,0.991903,0.999983,16.666944,1.0
223
+ bus_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
224
+ bvd_Latn,206,206,0,0,240035,1.0,1.0,1.0,1.0,0.0,1.0
225
+ bvr_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
226
+ bvz_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
227
+ bwd_Latn,51,51,0,0,240190,1.0,1.0,1.0,1.0,0.0,1.0
228
+ bwu_Latn,56,56,1,0,240184,0.982456,1.0,0.99115,0.999996,4.163457,1.0
229
+ bxh_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
230
+ bxr_Cyrl,277,277,5,0,239959,0.98227,1.0,0.991055,0.999979,20.836459,1.0
231
+ byr_Latn,194,194,0,0,240047,1.0,1.0,1.0,1.0,0.0,1.0
232
+ byx_Latn,206,206,0,0,240035,1.0,1.0,1.0,1.0,0.0,1.0
233
+ bzd_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
234
+ bzh_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
235
+ bzi_Thai,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
236
+ bzj_Latn,164,164,1,0,240076,0.993939,1.0,0.99696,0.999996,4.16533,1.0
237
+ caa_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
238
+ cab_Latn,201,201,0,0,240040,1.0,1.0,1.0,1.0,0.0,1.0
239
+ cac_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
240
+ caf_Latn,174,174,0,0,240067,1.0,1.0,1.0,1.0,0.0,1.0
241
+ cag_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
242
+ cak_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
243
+ cao_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
244
+ cap_Latn,226,226,0,0,240015,1.0,1.0,1.0,1.0,0.0,1.0
245
+ caq_Latn,189,189,0,0,240052,1.0,1.0,1.0,1.0,0.0,1.0
246
+ car_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
247
+ cas_Latn,74,74,0,0,240167,1.0,1.0,1.0,1.0,0.0,1.0
248
+ cat_Latn,318,318,12,0,239911,0.963636,1.0,0.981481,0.99995,50.016047,1.0
249
+ cav_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
250
+ cax_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
251
+ cbc_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
252
+ cbi_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
253
+ cbk_Latn,155,128,9,27,240077,0.934307,0.825806,0.876712,0.999963,37.486567,0.825806
254
+ cbr_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
255
+ cbs_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
256
+ cbt_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
257
+ cbu_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
258
+ cbv_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
259
+ cce_Latn,133,130,2,3,240106,0.984848,0.977444,0.981132,0.999992,8.329585,0.977444
260
+ cco_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
261
+ ccp_Latn,3,3,0,0,240238,1.0,1.0,1.0,1.0,0.0,1.0
262
+ ceb_Latn,338,338,0,0,239903,1.0,1.0,1.0,1.0,0.0,1.0
263
+ ceg_Latn,53,53,1,0,240187,0.981481,1.0,0.990654,0.999996,4.163405,1.0
264
+ cek_Latn,67,52,33,15,240141,0.611765,0.776119,0.684211,0.999863,137.400385,0.776119
265
+ ces_Latn,183,183,0,0,240058,1.0,1.0,1.0,1.0,0.0,1.0
266
+ cfm_Latn,133,133,7,0,240101,0.95,1.0,0.974359,0.999971,29.153548,1.0
267
+ cgc_Latn,169,169,2,0,240070,0.988304,1.0,0.994118,0.999992,8.330834,1.0
268
+ cha_Latn,348,348,0,0,239893,1.0,1.0,1.0,1.0,0.0,1.0
269
+ chd_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
270
+ che_Cyrl,345,345,0,0,239896,1.0,1.0,1.0,1.0,0.0,1.0
271
+ chf_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
272
+ chk_Latn,294,294,0,0,239947,1.0,1.0,1.0,1.0,0.0,1.0
273
+ cho_Latn,36,33,0,3,240205,1.0,0.916667,0.956522,1.0,0.0,0.916667
274
+ chq_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
275
+ chr_Cher,44,44,0,0,240197,1.0,1.0,1.0,1.0,0.0,1.0
276
+ chu_Cyrl,168,145,14,23,240059,0.91195,0.863095,0.88685,0.999942,58.315596,0.863095
277
+ chv_Cyrl,335,335,0,0,239906,1.0,1.0,1.0,1.0,0.0,1.0
278
+ chw_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
279
+ chz_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
280
+ cjk_Latn,24,24,3,0,240214,0.888889,1.0,0.941176,0.999988,12.488708,1.0
281
+ cjp_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
282
+ cjs_Cyrl,20,14,1,6,240220,0.933333,0.7,0.8,0.999996,4.162833,0.7
283
+ cjv_Latn,78,78,0,0,240163,1.0,1.0,1.0,1.0,0.0,1.0
284
+ ckb_Arab,421,402,25,19,239795,0.941452,0.954869,0.948113,0.999896,104.24485,0.954869
285
+ ckm_Latn,119,87,16,32,240106,0.84466,0.731092,0.783784,0.999933,66.632795,0.731092
286
+ cko_Latn,63,63,0,0,240178,1.0,1.0,1.0,1.0,0.0,1.0
287
+ ckt_Cyrl,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
288
+ clu_Latn,76,76,1,0,240164,0.987013,1.0,0.993464,0.999996,4.163804,1.0
289
+ cme_Latn,63,63,2,0,240176,0.969231,1.0,0.984375,0.999992,8.327157,1.0
290
+ cmn_Hani,288,287,66,1,239887,0.813031,0.996528,0.895476,0.999725,275.053865,0.996528
291
+ cmo_Latn,117,117,0,0,240124,1.0,1.0,1.0,1.0,0.0,1.0
292
+ cnh_Latn,286,286,4,0,239951,0.986207,1.0,0.993056,0.999983,16.669792,1.0
293
+ cni_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
294
+ cnk_Latn,115,80,6,35,240120,0.930233,0.695652,0.79602,0.999975,24.986882,0.695652
295
+ cnr_Latn,147,147,36,0,240058,0.803279,1.0,0.890909,0.99985,149.941273,1.0
296
+ cnw_Latn,8,8,1,0,240232,0.888889,1.0,0.941176,0.999996,4.162625,1.0
297
+ coe_Latn,112,112,0,0,240129,1.0,1.0,1.0,1.0,0.0,1.0
298
+ cof_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
299
+ cok_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
300
+ con_Latn,89,89,1,0,240151,0.988889,1.0,0.994413,0.999996,4.164029,1.0
301
+ cop_Copt,92,92,0,0,240149,1.0,1.0,1.0,1.0,0.0,1.0
302
+ cor_Latn,290,290,1,0,239950,0.996564,1.0,0.998279,0.999996,4.167518,1.0
303
+ cos_Latn,220,220,3,0,240018,0.986547,1.0,0.993228,0.999988,12.498906,1.0
304
+ cot_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
305
+ cpb_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
306
+ cpc_Latn,389,389,0,0,239852,1.0,1.0,1.0,1.0,0.0,1.0
307
+ cpu_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
308
+ cpy_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
309
+ crh_Cyrl,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
310
+ crh_Latn,189,189,22,0,240030,0.895735,1.0,0.945,0.999908,91.64681,1.0
311
+ crj_Cans,21,21,0,0,240220,1.0,1.0,1.0,1.0,0.0,1.0
312
+ crk_Cans,27,27,0,0,240214,1.0,1.0,1.0,1.0,0.0,1.0
313
+ crk_Latn,225,225,12,0,240004,0.949367,1.0,0.974026,0.99995,49.996667,1.0
314
+ crl_Cans,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
315
+ crm_Cans,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
316
+ crn_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
317
+ crs_Latn,218,218,4,0,240019,0.981982,1.0,0.990909,0.999983,16.66507,1.0
318
+ crx_Latn,322,322,1,0,239918,0.996904,1.0,0.99845,0.999996,4.168073,1.0
319
+ csb_Latn,307,307,1,0,239933,0.996753,1.0,0.998374,0.999996,4.167813,1.0
320
+ csw_Latn,56,41,0,15,240185,1.0,0.732143,0.845361,1.0,0.0,0.732143
321
+ csy_Latn,146,146,2,0,240093,0.986486,1.0,0.993197,0.999992,8.330036,1.0
322
+ cta_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
323
+ ctd_Latn,196,196,39,0,240006,0.834043,1.0,0.909513,0.999838,162.469537,1.0
324
+ cto_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
325
+ ctp_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
326
+ ctu_Latn,243,243,0,0,239998,1.0,1.0,1.0,1.0,0.0,1.0
327
+ cub_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
328
+ cui_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
329
+ cuk_Latn,245,245,1,0,239995,0.995935,1.0,0.997963,0.999996,4.166736,1.0
330
+ cul_Latn,9,9,0,0,240232,1.0,1.0,1.0,1.0,0.0,1.0
331
+ cut_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
332
+ cux_Latn,54,54,0,0,240187,1.0,1.0,1.0,1.0,0.0,1.0
333
+ cwe_Latn,115,115,3,0,240123,0.974576,1.0,0.987124,0.999988,12.493441,1.0
334
+ cwt_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
335
+ cya_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
336
+ cym_Latn,189,189,0,0,240052,1.0,1.0,1.0,1.0,0.0,1.0
337
+ czt_Latn,135,135,11,0,240095,0.924658,1.0,0.960854,0.999954,45.813099,1.0
338
+ daa_Latn,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
339
+ dad_Latn,142,142,1,0,240098,0.993007,1.0,0.996491,0.999996,4.164949,1.0
340
+ daf_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
341
+ dag_Latn,149,131,117,18,239975,0.528226,0.879195,0.65995,0.999513,487.313197,0.879195
342
+ dah_Latn,172,172,1,0,240068,0.99422,1.0,0.997101,0.999996,4.165469,1.0
343
+ dak_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
344
+ dan_Latn,242,237,20,5,239979,0.922179,0.979339,0.9499,0.999917,83.333681,0.979339
345
+ dar_Cyrl,227,227,0,0,240014,1.0,1.0,1.0,1.0,0.0,1.0
346
+ ded_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
347
+ des_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
348
+ deu_Latn,356,356,50,0,239835,0.876847,1.0,0.934383,0.999792,208.433208,1.0
349
+ dga_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
350
+ dgc_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
351
+ dgi_Latn,81,81,0,0,240160,1.0,1.0,1.0,1.0,0.0,1.0
352
+ dgr_Latn,305,305,0,0,239936,1.0,1.0,1.0,1.0,0.0,1.0
353
+ dgz_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
354
+ dhm_Latn,59,59,5,0,240177,0.921875,1.0,0.95935,0.999979,20.817547,1.0
355
+ dhv_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
356
+ dig_Latn,224,224,2,0,240015,0.99115,1.0,0.995556,0.999992,8.332743,1.0
357
+ dik_Latn,350,350,0,0,239891,1.0,1.0,1.0,1.0,0.0,1.0
358
+ diq_Latn,134,134,21,0,240086,0.864516,1.0,0.927336,0.999913,87.461007,1.0
359
+ div_Thaa,238,238,15,0,239988,0.940711,1.0,0.96945,0.999938,62.499219,1.0
360
+ dje_Latn,131,127,0,4,240110,1.0,0.969466,0.984496,1.0,0.0,0.969466
361
+ djk_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
362
+ djr_Latn,156,156,1,0,240084,0.993631,1.0,0.996805,0.999996,4.165191,1.0
363
+ dks_Latn,3,3,0,0,240238,1.0,1.0,1.0,1.0,0.0,1.0
364
+ dng_Cyrl,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
365
+ dnj_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
366
+ dnw_Latn,22,22,0,0,240219,1.0,1.0,1.0,1.0,0.0,1.0
367
+ dob_Latn,77,77,0,0,240164,1.0,1.0,1.0,1.0,0.0,1.0
368
+ doi_Deva,254,254,0,0,239987,1.0,1.0,1.0,1.0,0.0,1.0
369
+ dop_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
370
+ dos_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
371
+ drg_Latn,13,13,0,0,240228,1.0,1.0,1.0,1.0,0.0,1.0
372
+ dru_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
373
+ dsb_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
374
+ dtp_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
375
+ dts_Latn,113,113,1,0,240127,0.991228,1.0,0.995595,0.999996,4.164446,1.0
376
+ dua_Latn,176,176,2,0,240063,0.988764,1.0,0.99435,0.999992,8.331077,1.0
377
+ duo_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
378
+ dur_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
379
+ dwr_Latn,144,144,2,0,240095,0.986301,1.0,0.993103,0.999992,8.329967,1.0
380
+ dww_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
381
+ dyi_Latn,249,249,0,0,239992,1.0,1.0,1.0,1.0,0.0,1.0
382
+ dyo_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
383
+ dyu_Latn,390,390,0,0,239851,1.0,1.0,1.0,1.0,0.0,1.0
384
+ dzo_Tibt,346,346,57,0,239838,0.858561,1.0,0.923899,0.999762,237.603952,1.0
385
+ ebk_Latn,24,24,0,0,240217,1.0,1.0,1.0,1.0,0.0,1.0
386
+ efi_Latn,268,268,0,0,239973,1.0,1.0,1.0,1.0,0.0,1.0
387
+ ekk_Latn,419,419,6,0,239816,0.985882,1.0,0.992891,0.999975,25.018555,1.0
388
+ eko_Latn,136,136,1,0,240104,0.992701,1.0,0.996337,0.999996,4.164845,1.0
389
+ ell_Grek,394,393,52,1,239795,0.883146,0.997462,0.93683,0.999783,216.80488,0.997462
390
+ emi_Latn,161,161,0,0,240080,1.0,1.0,1.0,1.0,0.0,1.0
391
+ eml_Latn,198,198,5,0,240038,0.975369,1.0,0.987531,0.999979,20.829601,1.0
392
+ emp_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
393
+ enb_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
394
+ eng_Latn,1444,1157,92,287,238705,0.926341,0.801247,0.859265,0.999615,385.264471,0.801247
395
+ enl_Latn,24,24,1,0,240216,0.96,1.0,0.979592,0.999996,4.162903,1.0
396
+ enm_Latn,81,58,1,23,240159,0.983051,0.716049,0.828571,0.999996,4.163891,0.716049
397
+ enq_Latn,222,222,1,0,240018,0.995516,1.0,0.997753,0.999996,4.166337,1.0
398
+ epo_Latn,294,293,0,1,239947,1.0,0.996599,0.998296,1.0,0.0,0.996599
399
+ eri_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
400
+ ese_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
401
+ esi_Latn,9,9,5,0,240227,0.642857,1.0,0.782609,0.999979,20.813214,1.0
402
+ esk_Latn,117,117,26,0,240098,0.818182,1.0,0.9,0.999892,108.27739,1.0
403
+ ess_Latn,10,10,3,0,240228,0.769231,1.0,0.869565,0.999988,12.48798,1.0
404
+ esu_Latn,232,232,1,0,240008,0.995708,1.0,0.997849,0.999996,4.16651,1.0
405
+ etr_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
406
+ eus_Latn,254,254,7,0,239980,0.97318,1.0,0.986408,0.999971,29.168247,1.0
407
+ eve_Cyrl,77,61,1,16,240163,0.983871,0.792208,0.877698,0.999996,4.163821,0.792208
408
+ ewe_Latn,308,308,1,0,239932,0.996764,1.0,0.998379,0.999996,4.16783,1.0
409
+ ewo_Latn,134,106,0,28,240107,1.0,0.791045,0.883333,1.0,0.0,0.791045
410
+ ext_Latn,139,139,2,0,240100,0.985816,1.0,0.992857,0.999992,8.329793,1.0
411
+ eza_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
412
+ faa_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
413
+ fai_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
414
+ fal_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
415
+ fan_Latn,57,57,12,0,240172,0.826087,1.0,0.904762,0.99995,49.961696,1.0
416
+ fao_Latn,237,237,0,0,240004,1.0,1.0,1.0,1.0,0.0,1.0
417
+ far_Latn,43,43,0,0,240198,1.0,1.0,1.0,1.0,0.0,1.0
418
+ fas_Arab,396,385,50,11,239795,0.885057,0.972222,0.926594,0.999792,208.467969,0.972222
419
+ fat_Latn,396,390,7,6,239838,0.982368,0.984848,0.983607,0.999971,29.185516,0.984848
420
+ ffm_Latn,104,61,10,43,240127,0.859155,0.586538,0.697143,0.999958,41.642896,0.586538
421
+ fij_Latn,344,344,0,0,239897,1.0,1.0,1.0,1.0,0.0,1.0
422
+ fil_Latn,137,133,1,4,240103,0.992537,0.970803,0.98155,0.999996,4.164862,0.970803
423
+ fin_Latn,368,368,6,0,239867,0.983957,1.0,0.991914,0.999975,25.013236,1.0
424
+ fit_Latn,106,106,19,0,240116,0.848,1.0,0.917749,0.999921,79.12216,1.0
425
+ fkv_Latn,156,129,4,27,240081,0.969925,0.826923,0.892734,0.999983,16.660766,0.826923
426
+ fon_Latn,180,180,0,0,240061,1.0,1.0,1.0,1.0,0.0,1.0
427
+ for_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
428
+ fra_Latn,1652,1509,91,143,238498,0.943125,0.913438,0.928044,0.999619,381.409034,0.913438
429
+ frd_Latn,51,51,0,0,240190,1.0,1.0,1.0,1.0,0.0,1.0
430
+ fro_Latn,287,236,3,51,239951,0.987448,0.8223,0.897338,0.999987,12.502396,0.8223
431
+ frp_Latn,137,95,56,42,240048,0.629139,0.693431,0.659722,0.999767,233.232266,0.693431
432
+ frr_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
433
+ fry_Latn,241,241,0,0,240000,1.0,1.0,1.0,1.0,0.0,1.0
434
+ fub_Latn,16,16,4,0,240221,0.8,1.0,0.888889,0.999983,16.651056,1.0
435
+ fue_Latn,25,25,0,0,240216,1.0,1.0,1.0,1.0,0.0,1.0
436
+ fuf_Latn,166,166,24,0,240051,0.873684,1.0,0.932584,0.9999,99.96876,1.0
437
+ fuh_Latn,146,146,27,0,240068,0.843931,1.0,0.915361,0.999888,112.455486,1.0
438
+ fur_Latn,221,221,2,0,240018,0.991031,1.0,0.995495,0.999992,8.332639,1.0
439
+ fuv_Arab,9,9,1,0,240231,0.9,1.0,0.947368,0.999996,4.162643,1.0
440
+ fuv_Latn,164,132,14,32,240063,0.90411,0.804878,0.851613,0.999942,58.314624,0.804878
441
+ gaa_Latn,168,166,0,2,240073,1.0,0.988095,0.994012,1.0,0.0,0.988095
442
+ gag_Cyrl,128,103,7,25,240106,0.936364,0.804688,0.865546,0.999971,29.15294,0.804688
443
+ gag_Latn,41,41,2,0,240198,0.953488,1.0,0.97619,0.999992,8.326395,1.0
444
+ gah_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
445
+ gai_Latn,175,175,0,0,240066,1.0,1.0,1.0,1.0,0.0,1.0
446
+ gam_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
447
+ gaw_Latn,151,151,1,0,240089,0.993421,1.0,0.9967,0.999996,4.165105,1.0
448
+ gaz_Latn,441,419,33,22,239767,0.926991,0.950113,0.93841,0.999862,137.614679,0.950113
449
+ gbi_Latn,81,81,0,0,240160,1.0,1.0,1.0,1.0,0.0,1.0
450
+ gbo_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
451
+ gcf_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
452
+ gcr_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
453
+ gde_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
454
+ gdg_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
455
+ gdn_Latn,156,156,0,0,240085,1.0,1.0,1.0,1.0,0.0,1.0
456
+ gdr_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
457
+ geb_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
458
+ gfk_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
459
+ ghs_Latn,125,125,1,0,240115,0.992063,1.0,0.996016,0.999996,4.164654,1.0
460
+ gil_Latn,298,298,0,0,239943,1.0,1.0,1.0,1.0,0.0,1.0
461
+ gjn_Latn,85,80,1,5,240155,0.987654,0.941176,0.963855,0.999996,4.16396,0.941176
462
+ gkn_Latn,123,123,1,0,240117,0.991935,1.0,0.995951,0.999996,4.164619,1.0
463
+ gla_Latn,223,223,2,0,240016,0.991111,1.0,0.995536,0.999992,8.332708,1.0
464
+ gle_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
465
+ glg_Latn,215,215,17,0,240009,0.926724,1.0,0.961969,0.999929,70.825661,1.0
466
+ glk_Arab,319,250,24,69,239898,0.912409,0.783699,0.84317,0.9999,100.032511,0.783699
467
+ glv_Latn,357,357,0,0,239884,1.0,1.0,1.0,1.0,0.0,1.0
468
+ gmh_Latn,177,116,2,61,240062,0.983051,0.655367,0.786441,0.999992,8.331112,0.655367
469
+ gmv_Ethi,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
470
+ gmv_Latn,134,134,3,0,240104,0.978102,1.0,0.98893,0.999988,12.49443,1.0
471
+ gnb_Latn,45,45,11,0,240185,0.803571,1.0,0.891089,0.999954,45.795933,1.0
472
+ gnd_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
473
+ gng_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
474
+ gnn_Latn,191,191,0,0,240050,1.0,1.0,1.0,1.0,0.0,1.0
475
+ gnw_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
476
+ gof_Ethi,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
477
+ gof_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
478
+ gog_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
479
+ goh_Latn,93,71,2,22,240146,0.972603,0.763441,0.855422,0.999992,8.328198,0.763441
480
+ gom_Deva,170,170,9,0,240062,0.949721,1.0,0.974212,0.999963,37.48891,1.0
481
+ gom_Latn,221,221,18,0,240002,0.924686,1.0,0.96087,0.999925,74.993751,1.0
482
+ gor_Latn,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
483
+ gos_Latn,74,74,1,0,240166,0.986667,1.0,0.993289,0.999996,4.163769,1.0
484
+ got_Goth,70,70,5,0,240166,0.933333,1.0,0.965517,0.999979,20.8185,1.0
485
+ grc_Grek,317,317,0,0,239924,1.0,1.0,1.0,1.0,0.0,1.0
486
+ grt_Beng,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
487
+ gso_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
488
+ gsw_Latn,208,208,23,0,240010,0.900433,1.0,0.947608,0.999904,95.820158,1.0
489
+ gub_Latn,180,180,0,0,240061,1.0,1.0,1.0,1.0,0.0,1.0
490
+ guc_Latn,252,252,1,0,239988,0.996047,1.0,0.99802,0.999996,4.166858,1.0
491
+ gug_Latn,228,228,2,0,240011,0.991304,1.0,0.995633,0.999992,8.332882,1.0
492
+ guh_Latn,207,207,0,0,240034,1.0,1.0,1.0,1.0,0.0,1.0
493
+ gui_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
494
+ guj_Gujr,354,354,0,0,239887,1.0,1.0,1.0,1.0,0.0,1.0
495
+ guj_Latn,42,38,13,4,240186,0.745098,0.904762,0.817204,0.999946,54.121791,0.904762
496
+ guk_Ethi,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
497
+ gul_Latn,136,136,1,0,240104,0.992701,1.0,0.996337,0.999996,4.164845,1.0
498
+ gum_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
499
+ gun_Latn,54,54,0,0,240187,1.0,1.0,1.0,1.0,0.0,1.0
500
+ guo_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
501
+ guq_Latn,18,18,1,0,240222,0.947368,1.0,0.972973,0.999996,4.162799,1.0
502
+ gur_Latn,161,159,2,2,240078,0.987578,0.987578,0.987578,0.999992,8.330556,0.987578
503
+ guw_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
504
+ gux_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
505
+ guz_Latn,232,232,1,0,240008,0.995708,1.0,0.997849,0.999996,4.16651,1.0
506
+ gvc_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
507
+ gvf_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
508
+ gvl_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
509
+ gvn_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
510
+ gwi_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
511
+ gym_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
512
+ gyr_Latn,48,48,0,0,240193,1.0,1.0,1.0,1.0,0.0,1.0
513
+ hac_Arab,382,330,5,52,239854,0.985075,0.863874,0.920502,0.999979,20.84558,0.863874
514
+ hae_Latn,75,44,15,31,240151,0.745763,0.586667,0.656716,0.999938,62.456801,0.586667
515
+ hag_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
516
+ hak_Hani,29,21,1,8,240211,0.954545,0.724138,0.823529,0.999996,4.162989,0.724138
517
+ hak_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
518
+ hat_Latn,338,337,2,1,239901,0.9941,0.997041,0.995569,0.999992,8.336703,0.997041
519
+ hau_Latn,367,366,6,1,239868,0.983871,0.997275,0.990528,0.999975,25.013132,0.997275
520
+ hav_Latn,61,61,3,0,240177,0.953125,1.0,0.976,0.999988,12.490632,1.0
521
+ haw_Latn,214,214,1,0,240026,0.995349,1.0,0.997669,0.999996,4.166198,1.0
522
+ hay_Latn,92,92,37,0,240112,0.713178,1.0,0.832579,0.999846,154.071014,1.0
523
+ hbo_Hebr,189,189,6,0,240046,0.969231,1.0,0.984375,0.999975,24.994585,1.0
524
+ hch_Latn,259,259,0,0,239982,1.0,1.0,1.0,1.0,0.0,1.0
525
+ heb_Hebr,203,203,3,0,240035,0.985437,1.0,0.992665,0.999988,12.498021,1.0
526
+ heg_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
527
+ heh_Latn,135,135,2,0,240104,0.985401,1.0,0.992647,0.999992,8.329654,1.0
528
+ her_Latn,235,233,0,2,240006,1.0,0.991489,0.995726,1.0,0.0,0.991489
529
+ hif_Latn,115,73,58,42,240068,0.557252,0.634783,0.593496,0.999758,241.539858,0.634783
530
+ hig_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
531
+ hil_Latn,266,266,3,0,239972,0.988848,1.0,0.994393,0.999987,12.501302,1.0
532
+ hin_Deva,392,306,53,86,239796,0.852368,0.780612,0.814913,0.999779,220.972362,0.780612
533
+ hin_Latn,164,91,40,73,240037,0.694656,0.554878,0.616949,0.999833,166.613212,0.554878
534
+ hix_Latn,222,222,0,0,240019,1.0,1.0,1.0,1.0,0.0,1.0
535
+ hla_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
536
+ hmo_Latn,143,143,0,0,240098,1.0,1.0,1.0,1.0,0.0,1.0
537
+ hmr_Latn,283,240,0,43,239958,1.0,0.848057,0.917782,1.0,0.0,0.848057
538
+ hne_Deva,198,198,7,0,240036,0.965854,1.0,0.98263,0.999971,29.161442,1.0
539
+ hnj_Latn,300,300,0,0,239941,1.0,1.0,1.0,1.0,0.0,1.0
540
+ hnn_Latn,32,24,0,8,240209,1.0,0.75,0.857143,1.0,0.0,0.75
541
+ hns_Latn,73,61,7,12,240161,0.897059,0.835616,0.865248,0.999971,29.146264,0.835616
542
+ hop_Latn,8,8,2,0,240231,0.8,1.0,0.888889,0.999992,8.325251,1.0
543
+ hot_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
544
+ hra_Latn,56,56,3,0,240182,0.949153,1.0,0.973913,0.999988,12.490372,1.0
545
+ hrv_Latn,168,168,20,0,240053,0.893617,1.0,0.94382,0.999917,83.307994,1.0
546
+ hrx_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
547
+ hsb_Latn,269,269,4,0,239968,0.985348,1.0,0.99262,0.999983,16.668611,1.0
548
+ hto_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
549
+ hub_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
550
+ hui_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
551
+ hun_Latn,576,576,1,0,239664,0.998267,1.0,0.999133,0.999996,4.172491,1.0
552
+ hus_Latn,109,106,1,3,240131,0.990654,0.972477,0.981481,0.999996,4.164376,0.972477
553
+ huu_Latn,72,72,0,0,240169,1.0,1.0,1.0,1.0,0.0,1.0
554
+ huv_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
555
+ hvn_Latn,11,11,0,0,240230,1.0,1.0,1.0,1.0,0.0,1.0
556
+ hwc_Latn,165,165,5,0,240071,0.970588,1.0,0.985075,0.999979,20.826738,1.0
557
+ hye_Armn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
558
+ hyw_Armn,233,233,0,0,240008,1.0,1.0,1.0,1.0,0.0,1.0
559
+ ian_Latn,112,112,2,0,240127,0.982456,1.0,0.99115,0.999992,8.328857,1.0
560
+ iba_Latn,283,283,0,0,239958,1.0,1.0,1.0,1.0,0.0,1.0
561
+ ibg_Latn,85,85,1,0,240155,0.988372,1.0,0.994152,0.999996,4.16396,1.0
562
+ ibo_Latn,257,257,1,0,239983,0.996124,1.0,0.998058,0.999996,4.166944,1.0
563
+ icr_Latn,24,13,1,11,240216,0.928571,0.541667,0.684211,0.999996,4.162903,0.541667
564
+ ido_Latn,270,270,1,0,239970,0.99631,1.0,0.998152,0.999996,4.16717,1.0
565
+ idu_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
566
+ ifb_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
567
+ ife_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
568
+ ifk_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
569
+ ifu_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
570
+ ify_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
571
+ ige_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
572
+ ign_Latn,44,44,0,0,240197,1.0,1.0,1.0,1.0,0.0,1.0
573
+ ike_Cans,310,310,0,0,239931,1.0,1.0,1.0,1.0,0.0,1.0
574
+ ikk_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
575
+ ikt_Latn,283,227,1,56,239957,0.995614,0.80212,0.888454,0.999996,4.167396,0.80212
576
+ ikw_Latn,21,21,0,0,240220,1.0,1.0,1.0,1.0,0.0,1.0
577
+ ile_Latn,252,252,1,0,239988,0.996047,1.0,0.99802,0.999996,4.166858,1.0
578
+ ilo_Latn,252,252,0,0,239989,1.0,1.0,1.0,1.0,0.0,1.0
579
+ imo_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
580
+ ina_Latn,234,234,5,0,240002,0.979079,1.0,0.989429,0.999979,20.832726,1.0
581
+ inb_Latn,89,89,1,0,240151,0.988889,1.0,0.994413,0.999996,4.164029,1.0
582
+ ind_Latn,335,335,55,0,239851,0.858974,1.0,0.924138,0.999771,229.256459,1.0
583
+ inh_Cyrl,139,139,9,0,240093,0.939189,1.0,0.968641,0.999963,37.484069,1.0
584
+ ino_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
585
+ iou_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
586
+ ipi_Latn,63,63,0,0,240178,1.0,1.0,1.0,1.0,0.0,1.0
587
+ irk_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
588
+ isd_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
589
+ ish_Latn,21,21,0,0,240220,1.0,1.0,1.0,1.0,0.0,1.0
590
+ isl_Latn,276,276,31,0,239934,0.899023,1.0,0.946827,0.999871,129.185506,1.0
591
+ iso_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
592
+ ita_Latn,342,333,29,9,239870,0.91989,0.973684,0.946023,0.999879,120.884205,0.973684
593
+ itv_Latn,86,86,1,0,240154,0.988506,1.0,0.99422,0.999996,4.163977,1.0
594
+ ium_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
595
+ ivv_Latn,17,17,0,0,240224,1.0,1.0,1.0,1.0,0.0,1.0
596
+ iws_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
597
+ ixl_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
598
+ izr_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
599
+ izz_Latn,38,38,1,0,240202,0.974359,1.0,0.987013,0.999996,4.163145,1.0
600
+ jac_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
601
+ jae_Latn,211,211,0,0,240030,1.0,1.0,1.0,1.0,0.0,1.0
602
+ jam_Latn,196,177,29,19,240016,0.859223,0.903061,0.880597,0.999879,120.810681,0.903061
603
+ jav_Latn,158,158,2,0,240081,0.9875,1.0,0.993711,0.999992,8.330452,1.0
604
+ jbo_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
605
+ jbu_Latn,87,87,1,0,240153,0.988636,1.0,0.994286,0.999996,4.163995,1.0
606
+ jic_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
607
+ jiv_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
608
+ jpn_Jpan,323,323,39,0,239879,0.892265,1.0,0.943066,0.999837,162.55554,1.0
609
+ jra_Latn,177,177,2,0,240062,0.988827,1.0,0.994382,0.999992,8.331112,1.0
610
+ jvn_Latn,115,115,1,0,240125,0.991379,1.0,0.995671,0.999996,4.16448,1.0
611
+ kaa_Cyrl,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
612
+ kaa_Latn,182,138,0,44,240059,1.0,0.758242,0.8625,1.0,0.0,0.758242
613
+ kab_Latn,165,165,5,0,240071,0.970588,1.0,0.985075,0.999979,20.826738,1.0
614
+ kac_Latn,216,216,0,0,240025,1.0,1.0,1.0,1.0,0.0,1.0
615
+ kal_Latn,369,369,19,0,239853,0.951031,1.0,0.974901,0.999921,79.208911,1.0
616
+ kam_Latn,272,258,0,14,239969,1.0,0.948529,0.973585,1.0,0.0,0.948529
617
+ kan_Knda,601,594,1,7,239639,0.998319,0.988353,0.993311,0.999996,4.172926,0.988353
618
+ kan_Latn,264,240,4,24,239973,0.983607,0.909091,0.944882,0.999983,16.668264,0.909091
619
+ kao_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
620
+ kaq_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
621
+ kas_Arab,118,118,1,0,240122,0.991597,1.0,0.995781,0.999996,4.164532,1.0
622
+ kas_Deva,47,26,5,21,240189,0.83871,0.553191,0.666667,0.999979,20.816507,0.553191
623
+ kat_Geor,324,324,15,0,239902,0.955752,1.0,0.977376,0.999937,62.521622,1.0
624
+ kaz_Cyrl,340,340,2,0,239899,0.994152,1.0,0.997067,0.999992,8.336772,1.0
625
+ kbc_Latn,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
626
+ kbd_Cyrl,238,238,1,0,240002,0.995816,1.0,0.997904,0.999996,4.166615,1.0
627
+ kbh_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
628
+ kbm_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
629
+ kbp_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
630
+ kbq_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
631
+ kbr_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
632
+ kby_Latn,7,7,29,0,240205,0.194444,1.0,0.325581,0.999879,120.715636,1.0
633
+ kca_Cyrl,345,345,1,0,239895,0.99711,1.0,0.998553,0.999996,4.168473,1.0
634
+ kcg_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
635
+ kck_Latn,82,82,8,0,240151,0.911111,1.0,0.953488,0.999967,33.311265,1.0
636
+ kdc_Latn,92,92,1,0,240148,0.989247,1.0,0.994595,0.999996,4.164081,1.0
637
+ kde_Latn,178,178,1,0,240062,0.994413,1.0,0.997199,0.999996,4.165573,1.0
638
+ kdh_Latn,34,34,0,0,240207,1.0,1.0,1.0,1.0,0.0,1.0
639
+ kdi_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
640
+ kdl_Latn,64,64,1,0,240176,0.984615,1.0,0.992248,0.999996,4.163596,1.0
641
+ kea_Latn,205,205,1,0,240035,0.995146,1.0,0.997567,0.999996,4.166042,1.0
642
+ kek_Latn,183,183,1,0,240057,0.994565,1.0,0.997275,0.999996,4.16566,1.0
643
+ ken_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
644
+ keo_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
645
+ kew_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
646
+ kez_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
647
+ kff_Telu,9,9,1,0,240231,0.9,1.0,0.947368,0.999996,4.162643,1.0
648
+ kgf_Latn,166,166,0,0,240075,1.0,1.0,1.0,1.0,0.0,1.0
649
+ kgk_Latn,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
650
+ kgp_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
651
+ kha_Latn,191,191,0,0,240050,1.0,1.0,1.0,1.0,0.0,1.0
652
+ khk_Cyrl,262,262,1,0,239978,0.996198,1.0,0.998095,0.999996,4.167031,1.0
653
+ khm_Khmr,187,187,4,0,240050,0.979058,1.0,0.989418,0.999983,16.662918,1.0
654
+ khs_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
655
+ khz_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
656
+ kij_Latn,226,226,0,0,240015,1.0,1.0,1.0,1.0,0.0,1.0
657
+ kik_Latn,193,193,0,0,240048,1.0,1.0,1.0,1.0,0.0,1.0
658
+ kin_Latn,210,203,1,7,240030,0.995098,0.966667,0.980676,0.999996,4.166129,0.966667
659
+ kir_Cyrl,242,242,2,0,239997,0.991803,1.0,0.995885,0.999992,8.333368,1.0
660
+ kiu_Latn,293,238,31,55,239917,0.884758,0.812287,0.846975,0.999871,129.194659,0.812287
661
+ kix_Latn,153,153,0,0,240088,1.0,1.0,1.0,1.0,0.0,1.0
662
+ kjb_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
663
+ kje_Latn,119,119,5,0,240117,0.959677,1.0,0.979424,0.999979,20.822748,1.0
664
+ kjh_Cyrl,154,154,4,0,240083,0.974684,1.0,0.987179,0.999983,16.660627,1.0
665
+ kjs_Latn,201,201,0,0,240040,1.0,1.0,1.0,1.0,0.0,1.0
666
+ kkc_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
667
+ kki_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
668
+ kkj_Latn,127,127,4,0,240110,0.969466,1.0,0.984496,0.999983,16.658754,1.0
669
+ kkl_Latn,84,84,0,0,240157,1.0,1.0,1.0,1.0,0.0,1.0
670
+ klt_Latn,28,28,1,0,240212,0.965517,1.0,0.982456,0.999996,4.162972,1.0
671
+ klv_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
672
+ kmb_Latn,119,119,3,0,240119,0.97541,1.0,0.987552,0.999988,12.493649,1.0
673
+ kmg_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
674
+ kmh_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
675
+ kmk_Latn,20,20,5,0,240216,0.8,1.0,0.888889,0.999979,20.814167,1.0
676
+ kmm_Latn,19,19,1,0,240221,0.95,1.0,0.974359,0.999996,4.162816,1.0
677
+ kmo_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
678
+ kmr_Cyrl,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
679
+ kmr_Latn,289,289,27,0,239925,0.914557,1.0,0.955372,0.999887,112.522505,1.0
680
+ kms_Latn,98,98,1,0,240142,0.989899,1.0,0.994924,0.999996,4.164186,1.0
681
+ kmu_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
682
+ knc_Arab,68,52,6,16,240167,0.896552,0.764706,0.825397,0.999975,24.981992,0.764706
683
+ knc_Latn,293,266,0,27,239948,1.0,0.90785,0.951699,1.0,0.0,0.90785
684
+ kne_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
685
+ knf_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
686
+ kng_Latn,362,362,0,0,239879,1.0,1.0,1.0,1.0,0.0,1.0
687
+ knj_Latn,188,188,0,0,240053,1.0,1.0,1.0,1.0,0.0,1.0
688
+ knk_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
689
+ knv_Latn,153,153,0,0,240088,1.0,1.0,1.0,1.0,0.0,1.0
690
+ koi_Cyrl,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
691
+ koo_Latn,297,292,2,5,239942,0.993197,0.983165,0.988156,0.999992,8.335278,0.983165
692
+ kor_Hang,265,265,5,0,239971,0.981481,1.0,0.990654,0.999979,20.835417,1.0
693
+ kos_Latn,144,144,2,0,240095,0.986301,1.0,0.993103,0.999992,8.329967,1.0
694
+ kpe_Latn,177,177,1,0,240063,0.994382,1.0,0.997183,0.999996,4.165556,1.0
695
+ kpf_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
696
+ kpg_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
697
+ kpj_Latn,8,8,0,0,240233,1.0,1.0,1.0,1.0,0.0,1.0
698
+ kpr_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
699
+ kpv_Cyrl,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
700
+ kpw_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
701
+ kpx_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
702
+ kpz_Latn,89,85,0,4,240152,1.0,0.955056,0.977011,1.0,0.0,0.955056
703
+ kqc_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
704
+ kqe_Latn,43,43,1,0,240197,0.977273,1.0,0.988506,0.999996,4.163232,1.0
705
+ kqf_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
706
+ kqn_Latn,286,276,3,10,239952,0.989247,0.965035,0.976991,0.999987,12.502344,0.965035
707
+ kqp_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
708
+ kqw_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
709
+ krc_Cyrl,159,159,1,0,240081,0.99375,1.0,0.996865,0.999996,4.165244,1.0
710
+ kri_Latn,161,160,0,1,240080,1.0,0.993789,0.996885,1.0,0.0,0.993789
711
+ krj_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
712
+ krl_Latn,199,199,2,0,240040,0.99005,1.0,0.995,0.999992,8.331875,1.0
713
+ kru_Deva,56,56,4,0,240181,0.933333,1.0,0.965517,0.999983,16.653829,1.0
714
+ ksc_Latn,14,10,0,4,240227,1.0,0.714286,0.833333,1.0,0.0,0.714286
715
+ ksd_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
716
+ ksh_Latn,169,169,1,0,240071,0.994118,1.0,0.99705,0.999996,4.165417,1.0
717
+ ksp_Latn,20,20,1,0,240220,0.952381,1.0,0.97561,0.999996,4.162833,1.0
718
+ ksr_Latn,127,127,1,0,240113,0.992188,1.0,0.996078,0.999996,4.164688,1.0
719
+ kss_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
720
+ ksw_Mymr,299,299,0,0,239942,1.0,1.0,1.0,1.0,0.0,1.0
721
+ ktj_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
722
+ kto_Latn,144,144,1,0,240096,0.993103,1.0,0.99654,0.999996,4.164983,1.0
723
+ ktu_Latn,120,120,1,0,240120,0.991736,1.0,0.995851,0.999996,4.164567,1.0
724
+ ktz_Latn,56,55,0,1,240185,1.0,0.982143,0.990991,1.0,0.0,0.982143
725
+ kua_Latn,476,466,3,10,239762,0.993603,0.978992,0.986243,0.999987,12.512252,0.978992
726
+ kud_Latn,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
727
+ kue_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
728
+ kum_Cyrl,169,169,1,0,240071,0.994118,1.0,0.99705,0.999996,4.165417,1.0
729
+ kup_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
730
+ kus_Latn,45,45,0,0,240196,1.0,1.0,1.0,1.0,0.0,1.0
731
+ kvg_Latn,53,53,0,0,240188,1.0,1.0,1.0,1.0,0.0,1.0
732
+ kvn_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
733
+ kwd_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
734
+ kwf_Latn,150,150,0,0,240091,1.0,1.0,1.0,1.0,0.0,1.0
735
+ kwi_Latn,83,83,1,0,240157,0.988095,1.0,0.994012,0.999996,4.163925,1.0
736
+ kwj_Latn,182,182,0,0,240059,1.0,1.0,1.0,1.0,0.0,1.0
737
+ kwn_Latn,275,275,2,0,239964,0.99278,1.0,0.996377,0.999992,8.334514,1.0
738
+ kwy_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
739
+ kxc_Ethi,53,53,0,0,240188,1.0,1.0,1.0,1.0,0.0,1.0
740
+ kxw_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
741
+ kyc_Latn,219,219,0,0,240022,1.0,1.0,1.0,1.0,0.0,1.0
742
+ kyf_Latn,105,105,0,0,240136,1.0,1.0,1.0,1.0,0.0,1.0
743
+ kyg_Latn,201,201,0,0,240040,1.0,1.0,1.0,1.0,0.0,1.0
744
+ kyq_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
745
+ kyu_Kali,215,215,0,0,240026,1.0,1.0,1.0,1.0,0.0,1.0
746
+ kyz_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
747
+ kze_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
748
+ kzj_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
749
+ lac_Latn,230,230,0,0,240011,1.0,1.0,1.0,1.0,0.0,1.0
750
+ lad_Hebr,16,16,0,0,240225,1.0,1.0,1.0,1.0,0.0,1.0
751
+ lad_Latn,302,302,1,0,239938,0.9967,1.0,0.998347,0.999996,4.167726,1.0
752
+ lai_Latn,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
753
+ laj_Latn,85,85,1,0,240155,0.988372,1.0,0.994152,0.999996,4.16396,1.0
754
+ lam_Latn,127,127,9,0,240105,0.933824,1.0,0.965779,0.999963,37.482196,1.0
755
+ lao_Laoo,335,335,10,0,239896,0.971014,1.0,0.985294,0.999958,41.682993,1.0
756
+ lat_Latn,282,282,0,0,239959,1.0,1.0,1.0,1.0,0.0,1.0
757
+ lbb_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
758
+ lbe_Cyrl,219,219,0,0,240022,1.0,1.0,1.0,1.0,0.0,1.0
759
+ lbj_Tibt,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
760
+ lbk_Latn,48,48,0,0,240193,1.0,1.0,1.0,1.0,0.0,1.0
761
+ lcm_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
762
+ lcp_Thai,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
763
+ ldi_Latn,62,62,1,0,240178,0.984127,1.0,0.992,0.999996,4.163561,1.0
764
+ lee_Latn,102,102,1,0,240138,0.990291,1.0,0.995122,0.999996,4.164255,1.0
765
+ lef_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
766
+ leh_Latn,106,106,11,0,240124,0.905983,1.0,0.950673,0.999954,45.807567,1.0
767
+ leu_Latn,157,157,0,0,240084,1.0,1.0,1.0,1.0,0.0,1.0
768
+ lew_Latn,155,155,1,0,240085,0.99359,1.0,0.996785,0.999996,4.165174,1.0
769
+ lex_Latn,163,163,0,0,240078,1.0,1.0,1.0,1.0,0.0,1.0
770
+ lez_Cyrl,134,134,5,0,240102,0.964029,1.0,0.981685,0.999979,20.824049,1.0
771
+ lfn_Cyrl,55,42,2,13,240184,0.954545,0.763636,0.848485,0.999992,8.32688,0.763636
772
+ lfn_Latn,150,150,0,0,240091,1.0,1.0,1.0,1.0,0.0,1.0
773
+ lgg_Latn,279,278,3,1,239959,0.989324,0.996416,0.992857,0.999987,12.501979,0.996416
774
+ lgl_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
775
+ lhu_Latn,167,167,0,0,240074,1.0,1.0,1.0,1.0,0.0,1.0
776
+ lia_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
777
+ lid_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
778
+ lif_Deva,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
779
+ lif_Limb,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
780
+ lij_Latn,245,245,4,0,239992,0.983936,1.0,0.991903,0.999983,16.666944,1.0
781
+ lim_Latn,196,196,1,0,240044,0.994924,1.0,0.997455,0.999996,4.165886,1.0
782
+ lin_Latn,215,214,1,1,240025,0.995349,0.995349,0.995349,0.999996,4.166215,0.995349
783
+ lip_Latn,33,33,0,0,240208,1.0,1.0,1.0,1.0,0.0,1.0
784
+ lis_Lisu,6,6,0,0,240235,1.0,1.0,1.0,1.0,0.0,1.0
785
+ lit_Latn,330,330,3,0,239908,0.990991,1.0,0.995475,0.999987,12.504637,1.0
786
+ liv_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
787
+ ljp_Latn,112,112,0,0,240129,1.0,1.0,1.0,1.0,0.0,1.0
788
+ lki_Arab,15,8,11,7,240215,0.421053,0.533333,0.470588,0.999954,45.790214,0.533333
789
+ lld_Latn,275,275,0,0,239966,1.0,1.0,1.0,1.0,0.0,1.0
790
+ llg_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
791
+ lmk_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
792
+ lmo_Latn,276,276,16,0,239949,0.945205,1.0,0.971831,0.999933,66.67639,1.0
793
+ lmp_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
794
+ lnd_Latn,5,5,0,0,240236,1.0,1.0,1.0,1.0,0.0,1.0
795
+ log_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
796
+ loq_Latn,42,35,1,7,240198,0.972222,0.833333,0.897436,0.999996,4.163215,0.833333
797
+ loz_Latn,268,266,4,2,239969,0.985185,0.992537,0.988848,0.999983,16.668542,0.992537
798
+ lrc_Arab,40,30,12,10,240189,0.714286,0.75,0.731707,0.99995,49.95816,0.75
799
+ lsm_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
800
+ ltg_Latn,259,259,1,0,239981,0.996154,1.0,0.998073,0.999996,4.166979,1.0
801
+ ltz_Latn,251,251,0,0,239990,1.0,1.0,1.0,1.0,0.0,1.0
802
+ lua_Latn,346,346,2,0,239893,0.994253,1.0,0.997118,0.999992,8.336981,1.0
803
+ lub_Latn,147,147,4,0,240090,0.97351,1.0,0.986577,0.999983,16.660141,1.0
804
+ luc_Latn,67,67,0,0,240174,1.0,1.0,1.0,1.0,0.0,1.0
805
+ lue_Latn,327,324,4,3,239910,0.987805,0.990826,0.989313,0.999983,16.672641,0.990826
806
+ lug_Latn,405,397,3,8,239833,0.9925,0.980247,0.986335,0.999987,12.508548,0.980247
807
+ lun_Latn,86,84,0,2,240155,1.0,0.976744,0.988235,1.0,0.0,0.976744
808
+ luo_Latn,415,415,1,0,239825,0.997596,1.0,0.998797,0.999996,4.16969,1.0
809
+ lus_Latn,391,391,13,0,239837,0.967822,1.0,0.983648,0.999946,54.200542,1.0
810
+ lvs_Latn,298,298,3,0,239940,0.990033,1.0,0.994992,0.999987,12.502969,1.0
811
+ lwg_Latn,233,228,8,5,240000,0.966102,0.978541,0.972281,0.999967,33.332222,0.978541
812
+ lwo_Latn,41,41,0,0,240200,1.0,1.0,1.0,1.0,0.0,1.0
813
+ lww_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
814
+ lzh_Hani,143,83,0,60,240098,1.0,0.58042,0.734513,1.0,0.0,0.58042
815
+ maa_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
816
+ mad_Latn,183,183,4,0,240054,0.97861,1.0,0.989189,0.999983,16.66264,1.0
817
+ mag_Deva,97,97,3,0,240141,0.97,1.0,0.984772,0.999988,12.492504,1.0
818
+ mah_Latn,143,143,1,0,240097,0.993056,1.0,0.996516,0.999996,4.164966,1.0
819
+ mai_Deva,234,234,9,0,239998,0.962963,1.0,0.981132,0.999963,37.498906,1.0
820
+ maj_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
821
+ mak_Latn,94,84,0,10,240147,1.0,0.893617,0.94382,1.0,0.0,0.893617
822
+ mal_Latn,180,180,1,0,240060,0.994475,1.0,0.99723,0.999996,4.165608,1.0
823
+ mal_Mlym,338,338,0,0,239903,1.0,1.0,1.0,1.0,0.0,1.0
824
+ mam_Latn,233,233,0,0,240008,1.0,1.0,1.0,1.0,0.0,1.0
825
+ maq_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
826
+ mar_Deva,589,577,0,12,239652,1.0,0.979626,0.989708,1.0,0.0,0.979626
827
+ mar_Latn,98,79,2,19,240141,0.975309,0.806122,0.882682,0.999992,8.328371,0.806122
828
+ mas_Latn,154,153,1,1,240086,0.993506,0.993506,0.993506,0.999996,4.165157,0.993506
829
+ mau_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
830
+ mav_Latn,59,59,2,0,240180,0.967213,1.0,0.983333,0.999992,8.327019,1.0
831
+ maz_Latn,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
832
+ mbb_Latn,212,212,0,0,240029,1.0,1.0,1.0,1.0,0.0,1.0
833
+ mbc_Latn,46,46,1,0,240194,0.978723,1.0,0.989247,0.999996,4.163284,1.0
834
+ mbd_Latn,14,14,0,0,240227,1.0,1.0,1.0,1.0,0.0,1.0
835
+ mbf_Latn,48,42,0,6,240193,1.0,0.875,0.933333,1.0,0.0,0.875
836
+ mbh_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
837
+ mbi_Latn,162,162,1,0,240078,0.993865,1.0,0.996923,0.999996,4.165296,1.0
838
+ mbj_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
839
+ mbl_Latn,210,210,0,0,240031,1.0,1.0,1.0,1.0,0.0,1.0
840
+ mbs_Latn,209,209,0,0,240032,1.0,1.0,1.0,1.0,0.0,1.0
841
+ mbt_Latn,165,165,0,0,240076,1.0,1.0,1.0,1.0,0.0,1.0
842
+ mca_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
843
+ mcb_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
844
+ mcd_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
845
+ mcf_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
846
+ mck_Latn,25,25,2,0,240214,0.925926,1.0,0.961538,0.999992,8.32584,1.0
847
+ mco_Latn,128,128,13,0,240100,0.907801,1.0,0.951673,0.999946,54.141175,1.0
848
+ mcp_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
849
+ mcq_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
850
+ mcu_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
851
+ mdf_Cyrl,217,217,3,0,240021,0.986364,1.0,0.993135,0.999988,12.49875,1.0
852
+ mdy_Ethi,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
853
+ med_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
854
+ mee_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
855
+ mej_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
856
+ mek_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
857
+ men_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
858
+ meq_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
859
+ mer_Latn,97,96,1,1,240143,0.989691,0.989691,0.989691,0.999996,4.164168,0.989691
860
+ meu_Latn,82,82,0,0,240159,1.0,1.0,1.0,1.0,0.0,1.0
861
+ mfe_Latn,250,250,9,0,239982,0.965251,1.0,0.982318,0.999962,37.501406,1.0
862
+ mfi_Latn,115,115,1,0,240125,0.991379,1.0,0.995671,0.999996,4.16448,1.0
863
+ mfq_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
864
+ mfy_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
865
+ mfz_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
866
+ mgh_Latn,88,88,1,0,240152,0.988764,1.0,0.99435,0.999996,4.164012,1.0
867
+ mgr_Latn,119,119,5,0,240117,0.959677,1.0,0.979424,0.999979,20.822748,1.0
868
+ mhi_Latn,23,23,1,0,240217,0.958333,1.0,0.978723,0.999996,4.162885,1.0
869
+ mhl_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
870
+ mhr_Cyrl,291,291,0,0,239950,1.0,1.0,1.0,1.0,0.0,1.0
871
+ mhx_Latn,61,61,0,0,240180,1.0,1.0,1.0,1.0,0.0,1.0
872
+ mib_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
873
+ mic_Latn,255,255,2,0,239984,0.992218,1.0,0.996094,0.999992,8.333819,1.0
874
+ mie_Latn,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
875
+ mif_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
876
+ mig_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
877
+ mih_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
878
+ mil_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
879
+ mim_Latn,16,16,0,0,240225,1.0,1.0,1.0,1.0,0.0,1.0
880
+ min_Latn,55,55,5,0,240181,0.916667,1.0,0.956522,0.999979,20.8172,1.0
881
+ mio_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
882
+ mip_Latn,17,17,0,0,240224,1.0,1.0,1.0,1.0,0.0,1.0
883
+ miq_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
884
+ mir_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
885
+ mit_Latn,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
886
+ miy_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
887
+ miz_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
888
+ mjc_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
889
+ mjw_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
890
+ mkd_Cyrl,331,331,4,0,239906,0.98806,1.0,0.993994,0.999983,16.672919,1.0
891
+ mkl_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
892
+ mkn_Latn,114,114,5,0,240122,0.957983,1.0,0.978541,0.999979,20.822315,1.0
893
+ mks_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
894
+ mlh_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
895
+ mlp_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
896
+ mlt_Latn,291,291,4,0,239946,0.986441,1.0,0.993174,0.999983,16.67014,1.0
897
+ mlu_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
898
+ mmn_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
899
+ mmo_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
900
+ mmx_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
901
+ mna_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
902
+ mnb_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
903
+ mni_Beng,304,304,0,0,239937,1.0,1.0,1.0,1.0,0.0,1.0
904
+ mni_Latn,280,280,4,0,239957,0.985915,1.0,0.992908,0.999983,16.669375,1.0
905
+ mni_Mtei,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
906
+ mnk_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
907
+ mns_Cyrl,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
908
+ mnw_Mymr,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
909
+ mny_Latn,56,48,2,8,240183,0.96,0.857143,0.90566,0.999992,8.326915,0.857143
910
+ mog_Latn,2,2,0,0,240239,1.0,1.0,1.0,1.0,0.0,1.0
911
+ moh_Latn,195,195,0,0,240046,1.0,1.0,1.0,1.0,0.0,1.0
912
+ mop_Latn,128,128,1,0,240112,0.992248,1.0,0.996109,0.999996,4.164706,1.0
913
+ mor_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
914
+ mos_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
915
+ mox_Latn,100,100,0,0,240141,1.0,1.0,1.0,1.0,0.0,1.0
916
+ mpm_Latn,177,177,0,0,240064,1.0,1.0,1.0,1.0,0.0,1.0
917
+ mpp_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
918
+ mps_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
919
+ mpt_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
920
+ mpx_Latn,205,205,0,0,240036,1.0,1.0,1.0,1.0,0.0,1.0
921
+ mqb_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
922
+ mqj_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
923
+ mqy_Latn,35,33,0,2,240206,1.0,0.942857,0.970588,1.0,0.0,0.942857
924
+ mri_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
925
+ mrj_Cyrl,120,120,1,0,240120,0.991736,1.0,0.995851,0.999996,4.164567,1.0
926
+ mrq_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
927
+ mrw_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
928
+ msb_Latn,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
929
+ msk_Latn,129,129,1,0,240111,0.992308,1.0,0.996139,0.999996,4.164723,1.0
930
+ msy_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
931
+ mta_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
932
+ mti_Latn,170,170,1,0,240070,0.994152,1.0,0.997067,0.999996,4.165434,1.0
933
+ mto_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
934
+ mtp_Latn,85,85,0,0,240156,1.0,1.0,1.0,1.0,0.0,1.0
935
+ muh_Latn,67,67,0,0,240174,1.0,1.0,1.0,1.0,0.0,1.0
936
+ mui_Latn,107,72,9,35,240125,0.888889,0.672897,0.765957,0.999963,37.479074,0.672897
937
+ mup_Deva,115,72,1,43,240125,0.986301,0.626087,0.765957,0.999996,4.16448,0.626087
938
+ mur_Latn,312,312,0,0,239929,1.0,1.0,1.0,1.0,0.0,1.0
939
+ mus_Latn,2,2,0,0,240239,1.0,1.0,1.0,1.0,0.0,1.0
940
+ mux_Latn,191,191,1,0,240049,0.994792,1.0,0.997389,0.999996,4.165799,1.0
941
+ muy_Latn,61,61,1,0,240179,0.983871,1.0,0.99187,0.999996,4.163544,1.0
942
+ mva_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
943
+ mvn_Latn,73,73,0,0,240168,1.0,1.0,1.0,1.0,0.0,1.0
944
+ mvp_Latn,22,22,0,0,240219,1.0,1.0,1.0,1.0,0.0,1.0
945
+ mwc_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
946
+ mwl_Latn,157,150,4,7,240080,0.974026,0.955414,0.96463,0.999983,16.660835,0.955414
947
+ mwn_Latn,121,121,1,0,240119,0.991803,1.0,0.995885,0.999996,4.164584,1.0
948
+ mwp_Latn,116,116,1,0,240124,0.991453,1.0,0.995708,0.999996,4.164498,1.0
949
+ mwq_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
950
+ mwv_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
951
+ mww_Latn,235,235,0,0,240006,1.0,1.0,1.0,1.0,0.0,1.0
952
+ mxb_Latn,92,92,0,0,240149,1.0,1.0,1.0,1.0,0.0,1.0
953
+ mxp_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
954
+ mxq_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
955
+ mxt_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
956
+ mxv_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
957
+ mya_Mymr,342,342,26,0,239873,0.929348,1.0,0.96338,0.999892,108.378943,1.0
958
+ myk_Latn,43,43,0,0,240198,1.0,1.0,1.0,1.0,0.0,1.0
959
+ myu_Latn,51,51,1,0,240189,0.980769,1.0,0.990291,0.999996,4.163371,1.0
960
+ myv_Cyrl,156,156,0,0,240085,1.0,1.0,1.0,1.0,0.0,1.0
961
+ myw_Latn,182,182,0,0,240059,1.0,1.0,1.0,1.0,0.0,1.0
962
+ myx_Latn,113,113,18,0,240110,0.862595,1.0,0.92623,0.999925,74.960021,1.0
963
+ myy_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
964
+ mza_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
965
+ mzh_Latn,26,25,0,1,240215,1.0,0.961538,0.980392,1.0,0.0,0.961538
966
+ mzn_Arab,141,141,6,0,240094,0.959184,1.0,0.979167,0.999975,24.989588,1.0
967
+ mzw_Latn,117,117,1,0,240123,0.991525,1.0,0.995745,0.999996,4.164515,1.0
968
+ mzz_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
969
+ naf_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
970
+ nah_Latn,64,54,0,10,240177,1.0,0.84375,0.915254,1.0,0.0,0.84375
971
+ nak_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
972
+ nan_Hani,75,67,17,8,240149,0.797619,0.893333,0.842767,0.999929,70.784374,0.893333
973
+ nan_Latn,180,180,1,0,240060,0.994475,1.0,0.99723,0.999996,4.165608,1.0
974
+ nap_Latn,172,131,8,41,240061,0.942446,0.761628,0.842444,0.999967,33.323753,0.761628
975
+ naq_Latn,274,274,2,0,239965,0.992754,1.0,0.996364,0.999992,8.334479,1.0
976
+ nas_Latn,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
977
+ nav_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
978
+ nba_Latn,231,231,5,0,240005,0.978814,1.0,0.989293,0.999979,20.832465,1.0
979
+ nbe_Latn,72,72,0,0,240169,1.0,1.0,1.0,1.0,0.0,1.0
980
+ nbl_Latn,528,499,25,29,239688,0.95229,0.945076,0.948669,0.999896,104.291382,0.945076
981
+ nbq_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
982
+ nbu_Latn,351,351,0,0,239890,1.0,1.0,1.0,1.0,0.0,1.0
983
+ nca_Latn,215,215,0,0,240026,1.0,1.0,1.0,1.0,0.0,1.0
984
+ nch_Latn,121,121,0,0,240120,1.0,1.0,1.0,1.0,0.0,1.0
985
+ ncj_Latn,152,152,4,0,240085,0.974359,1.0,0.987013,0.999983,16.660488,1.0
986
+ ncl_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
987
+ ncq_Laoo,10,10,1,0,240230,0.909091,1.0,0.952381,0.999996,4.16266,1.0
988
+ ncu_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
989
+ ncx_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
990
+ ndc_Latn,191,191,1,0,240049,0.994792,1.0,0.997389,0.999996,4.165799,1.0
991
+ nde_Latn,256,256,63,0,239922,0.802508,1.0,0.890435,0.999737,262.516407,1.0
992
+ ndh_Latn,30,30,1,0,240210,0.967742,1.0,0.983607,0.999996,4.163007,1.0
993
+ ndo_Latn,325,318,4,7,239912,0.987578,0.978462,0.982998,0.999983,16.672502,0.978462
994
+ nds_Latn,296,296,2,0,239943,0.993289,1.0,0.996633,0.999992,8.335243,1.0
995
+ neb_Latn,11,8,0,3,240230,1.0,0.727273,0.842105,1.0,0.0,0.727273
996
+ new_Deva,112,112,4,0,240125,0.965517,1.0,0.982456,0.999983,16.657713,1.0
997
+ nfa_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
998
+ nfr_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
999
+ ngl_Latn,175,175,1,0,240065,0.994318,1.0,0.997151,0.999996,4.165521,1.0
1000
+ ngp_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1001
+ ngu_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
1002
+ nhe_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
1003
+ nhg_Latn,128,128,1,0,240112,0.992248,1.0,0.996109,0.999996,4.164706,1.0
1004
+ nhi_Latn,102,102,1,0,240138,0.990291,1.0,0.995122,0.999996,4.164255,1.0
1005
+ nho_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
1006
+ nhr_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
1007
+ nhu_Latn,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
1008
+ nhw_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
1009
+ nhx_Latn,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
1010
+ nhy_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
1011
+ nia_Latn,242,242,0,0,239999,1.0,1.0,1.0,1.0,0.0,1.0
1012
+ nif_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
1013
+ nii_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
1014
+ nij_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1015
+ nim_Latn,76,76,1,0,240164,0.987013,1.0,0.993464,0.999996,4.163804,1.0
1016
+ nin_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
1017
+ niu_Latn,204,204,0,0,240037,1.0,1.0,1.0,1.0,0.0,1.0
1018
+ njb_Latn,9,9,1,0,240231,0.9,1.0,0.947368,0.999996,4.162643,1.0
1019
+ njm_Latn,15,15,0,0,240226,1.0,1.0,1.0,1.0,0.0,1.0
1020
+ njn_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
1021
+ njo_Latn,256,256,1,0,239984,0.996109,1.0,0.998051,0.999996,4.166927,1.0
1022
+ njz_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
1023
+ nko_Latn,85,85,0,0,240156,1.0,1.0,1.0,1.0,0.0,1.0
1024
+ nld_Latn,259,259,15,0,239967,0.945255,1.0,0.971857,0.999937,62.504688,1.0
1025
+ nlg_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1026
+ nmf_Latn,294,294,0,0,239947,1.0,1.0,1.0,1.0,0.0,1.0
1027
+ nmo_Latn,38,38,1,0,240202,0.974359,1.0,0.987013,0.999996,4.163145,1.0
1028
+ nmz_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1029
+ nnb_Latn,108,108,2,0,240131,0.981818,1.0,0.990826,0.999992,8.328718,1.0
1030
+ nno_Latn,427,414,0,13,239814,1.0,0.969555,0.984542,1.0,0.0,0.969555
1031
+ nnq_Latn,100,100,2,0,240139,0.980392,1.0,0.990099,0.999992,8.32844,1.0
1032
+ nnw_Latn,40,40,0,0,240201,1.0,1.0,1.0,1.0,0.0,1.0
1033
+ noa_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
1034
+ nob_Latn,265,260,20,5,239956,0.928571,0.981132,0.954128,0.999917,83.341668,0.981132
1035
+ nod_Thai,99,99,1,0,240141,0.99,1.0,0.994975,0.999996,4.164203,1.0
1036
+ nog_Cyrl,219,219,0,0,240022,1.0,1.0,1.0,1.0,0.0,1.0
1037
+ non_Latn,180,146,1,34,240060,0.993197,0.811111,0.892966,0.999996,4.165608,0.811111
1038
+ nop_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1039
+ not_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1040
+ nou_Latn,84,84,0,0,240157,1.0,1.0,1.0,1.0,0.0,1.0
1041
+ nov_Latn,147,147,3,0,240091,0.98,1.0,0.989899,0.999988,12.495106,1.0
1042
+ nph_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1043
+ npi_Deva,273,271,3,2,239965,0.989051,0.992674,0.990859,0.999987,12.501667,0.992674
1044
+ npi_Latn,53,45,8,8,240180,0.849057,0.849057,0.849057,0.999967,33.307243,0.849057
1045
+ npl_Latn,93,93,1,0,240147,0.989362,1.0,0.994652,0.999996,4.164099,1.0
1046
+ npy_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1047
+ nqo_Nkoo,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
1048
+ nre_Latn,42,42,0,0,240199,1.0,1.0,1.0,1.0,0.0,1.0
1049
+ nrf_Latn,61,41,1,20,240179,0.97619,0.672131,0.796117,0.999996,4.163544,0.672131
1050
+ nrm_Latn,107,64,57,43,240077,0.528926,0.598131,0.561404,0.999763,237.36747,0.598131
1051
+ nse_Latn,12,9,3,3,240226,0.75,0.75,0.75,0.999988,12.488084,0.75
1052
+ nsm_Latn,32,32,1,0,240208,0.969697,1.0,0.984615,0.999996,4.163041,1.0
1053
+ nsn_Latn,198,198,0,0,240043,1.0,1.0,1.0,1.0,0.0,1.0
1054
+ nso_Latn,479,461,12,18,239750,0.97463,0.962422,0.968487,0.99995,50.049633,0.962422
1055
+ nss_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
1056
+ nsu_Latn,14,14,1,0,240226,0.933333,1.0,0.965517,0.999996,4.162729,1.0
1057
+ ntp_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
1058
+ ntr_Latn,117,117,1,0,240123,0.991525,1.0,0.995745,0.999996,4.164515,1.0
1059
+ ntu_Latn,150,150,0,0,240091,1.0,1.0,1.0,1.0,0.0,1.0
1060
+ nuj_Latn,153,152,1,1,240087,0.993464,0.993464,0.993464,0.999996,4.165139,0.993464
1061
+ nus_Latn,199,199,0,0,240042,1.0,1.0,1.0,1.0,0.0,1.0
1062
+ nuy_Latn,81,81,0,0,240160,1.0,1.0,1.0,1.0,0.0,1.0
1063
+ nvm_Latn,9,9,0,0,240232,1.0,1.0,1.0,1.0,0.0,1.0
1064
+ nwi_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
1065
+ nya_Latn,262,252,2,10,239977,0.992126,0.961832,0.976744,0.999992,8.334063,0.961832
1066
+ nyf_Latn,10,10,3,0,240228,0.769231,1.0,0.869565,0.999988,12.48798,1.0
1067
+ nyn_Latn,279,278,1,1,239961,0.996416,0.996416,0.996416,0.999996,4.167326,0.996416
1068
+ nyo_Latn,100,100,7,0,240134,0.934579,1.0,0.966184,0.999971,29.149541,1.0
1069
+ nyu_Latn,149,149,7,0,240085,0.955128,1.0,0.977049,0.999971,29.15549,1.0
1070
+ nyy_Latn,259,259,0,0,239982,1.0,1.0,1.0,1.0,0.0,1.0
1071
+ nzi_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
1072
+ obo_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
1073
+ oci_Latn,333,333,10,0,239898,0.970845,1.0,0.985207,0.999958,41.682645,1.0
1074
+ ogo_Latn,177,177,0,0,240064,1.0,1.0,1.0,1.0,0.0,1.0
1075
+ ojb_Cans,237,237,1,0,240003,0.995798,1.0,0.997895,0.999996,4.166597,1.0
1076
+ ojb_Latn,62,62,3,0,240176,0.953846,1.0,0.976378,0.999988,12.490684,1.0
1077
+ oke_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
1078
+ okv_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
1079
+ old_Latn,11,11,2,0,240228,0.846154,1.0,0.916667,0.999992,8.325355,1.0
1080
+ olo_Latn,245,245,0,0,239996,1.0,1.0,1.0,1.0,0.0,1.0
1081
+ omw_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1082
+ ong_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
1083
+ ons_Latn,7,7,0,0,240234,1.0,1.0,1.0,1.0,0.0,1.0
1084
+ opm_Latn,92,92,0,0,240149,1.0,1.0,1.0,1.0,0.0,1.0
1085
+ orv_Cyrl,239,170,16,69,239986,0.913978,0.711297,0.8,0.999933,66.666111,0.711297
1086
+ ory_Latn,96,94,2,2,240143,0.979167,0.979167,0.979167,0.999992,8.328302,0.979167
1087
+ ory_Orya,511,511,6,0,239724,0.988395,1.0,0.994163,0.999975,25.028157,1.0
1088
+ oss_Cyrl,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
1089
+ ota_Arab,66,44,0,22,240175,1.0,0.666667,0.8,1.0,0.0,0.666667
1090
+ ote_Latn,85,85,1,0,240155,0.988372,1.0,0.994152,0.999996,4.16396,1.0
1091
+ otm_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1092
+ otq_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
1093
+ ots_Latn,44,44,0,0,240197,1.0,1.0,1.0,1.0,0.0,1.0
1094
+ otw_Latn,29,26,0,3,240212,1.0,0.896552,0.945455,1.0,0.0,0.896552
1095
+ ozm_Latn,82,82,0,0,240159,1.0,1.0,1.0,1.0,0.0,1.0
1096
+ pab_Latn,126,126,1,0,240114,0.992126,1.0,0.996047,0.999996,4.164671,1.0
1097
+ pad_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1098
+ pag_Latn,122,122,1,0,240118,0.99187,1.0,0.995918,0.999996,4.164602,1.0
1099
+ pah_Latn,144,144,1,0,240096,0.993103,1.0,0.99654,0.999996,4.164983,1.0
1100
+ pam_Latn,90,90,2,0,240149,0.978261,1.0,0.989011,0.999992,8.328094,1.0
1101
+ pan_Guru,460,460,0,0,239781,1.0,1.0,1.0,1.0,0.0,1.0
1102
+ pan_Latn,232,196,12,36,239997,0.942308,0.844828,0.890909,0.99995,49.998125,0.844828
1103
+ pao_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
1104
+ pap_Latn,423,423,3,0,239815,0.992958,1.0,0.996466,0.999987,12.509486,1.0
1105
+ pau_Latn,265,265,0,0,239976,1.0,1.0,1.0,1.0,0.0,1.0
1106
+ pbb_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
1107
+ pbt_Arab,419,419,6,0,239816,0.985882,1.0,0.992891,0.999975,25.018555,1.0
1108
+ pcd_Latn,199,199,7,0,240035,0.966019,1.0,0.982716,0.999971,29.161563,1.0
1109
+ pck_Latn,164,143,8,21,240069,0.94702,0.871951,0.907937,0.999967,33.322642,0.871951
1110
+ pcm_Latn,251,202,38,49,239952,0.841667,0.804781,0.822811,0.999842,158.339931,0.804781
1111
+ pdc_Latn,139,139,1,0,240101,0.992857,1.0,0.996416,0.999996,4.164897,1.0
1112
+ pdt_Latn,180,180,1,0,240060,0.994475,1.0,0.99723,0.999996,4.165608,1.0
1113
+ pem_Latn,111,111,1,0,240129,0.991071,1.0,0.995516,0.999996,4.164411,1.0
1114
+ pfl_Latn,222,222,7,0,240012,0.969432,1.0,0.984479,0.999971,29.164358,1.0
1115
+ pib_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
1116
+ pio_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
1117
+ pir_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1118
+ pis_Latn,197,197,10,0,240034,0.951691,1.0,0.975248,0.999958,41.659029,1.0
1119
+ pjt_Latn,179,179,0,0,240062,1.0,1.0,1.0,1.0,0.0,1.0
1120
+ plg_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
1121
+ pls_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
1122
+ plt_Latn,248,248,26,0,239967,0.905109,1.0,0.950192,0.999892,108.336493,1.0
1123
+ plu_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1124
+ plw_Latn,8,8,0,0,240233,1.0,1.0,1.0,1.0,0.0,1.0
1125
+ pma_Latn,120,120,1,0,240120,0.991736,1.0,0.995851,0.999996,4.164567,1.0
1126
+ pmf_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
1127
+ pmq_Latn,46,42,0,4,240195,1.0,0.913043,0.954545,1.0,0.0,0.913043
1128
+ pms_Latn,174,174,1,0,240066,0.994286,1.0,0.997135,0.999996,4.165504,1.0
1129
+ pnb_Arab,220,220,21,0,240000,0.912863,1.0,0.954447,0.999913,87.492344,1.0
1130
+ pnt_Grek,181,181,1,0,240059,0.994505,1.0,0.997245,0.999996,4.165625,1.0
1131
+ poe_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1132
+ poh_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
1133
+ poi_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
1134
+ pol_Latn,254,253,8,1,239979,0.969349,0.996063,0.982524,0.999967,33.335139,0.996063
1135
+ pon_Latn,178,178,1,0,240062,0.994413,1.0,0.997199,0.999996,4.165573,1.0
1136
+ por_Latn,657,633,44,24,239540,0.935007,0.96347,0.949025,0.999816,183.651663,0.96347
1137
+ pot_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
1138
+ pov_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
1139
+ poy_Latn,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
1140
+ ppk_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1141
+ ppo_Latn,210,210,0,0,240031,1.0,1.0,1.0,1.0,0.0,1.0
1142
+ prf_Latn,45,45,0,0,240196,1.0,1.0,1.0,1.0,0.0,1.0
1143
+ prg_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
1144
+ pri_Latn,159,156,2,3,240080,0.987342,0.981132,0.984227,0.999992,8.330487,0.981132
1145
+ ptp_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
1146
+ ptu_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
1147
+ pwg_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
1148
+ pwn_Latn,77,77,4,0,240160,0.950617,1.0,0.974684,0.999983,16.655286,1.0
1149
+ pxm_Latn,63,49,1,14,240177,0.98,0.777778,0.867257,0.999996,4.163579,0.777778
1150
+ qub_Latn,180,170,8,10,240053,0.955056,0.944444,0.949721,0.999967,33.324863,0.944444
1151
+ quc_Latn,310,310,0,0,239931,1.0,1.0,1.0,1.0,0.0,1.0
1152
+ quf_Latn,211,211,1,0,240029,0.995283,1.0,0.997636,0.999996,4.166146,1.0
1153
+ qug_Latn,90,85,0,5,240151,1.0,0.944444,0.971429,1.0,0.0,0.944444
1154
+ quh_Latn,159,130,4,29,240078,0.970149,0.81761,0.887372,0.999983,16.660974,0.81761
1155
+ qup_Latn,79,68,5,11,240157,0.931507,0.860759,0.894737,0.999979,20.81928,0.860759
1156
+ quw_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
1157
+ quy_Latn,271,237,50,34,239920,0.825784,0.874539,0.849462,0.999792,208.359378,0.874539
1158
+ quz_Latn,205,146,39,59,239997,0.789189,0.712195,0.748718,0.999838,162.475629,0.712195
1159
+ qva_Latn,39,39,3,0,240199,0.928571,1.0,0.962963,0.999988,12.489488,1.0
1160
+ qvc_Latn,53,53,5,0,240183,0.913793,1.0,0.954955,0.999979,20.817027,1.0
1161
+ qve_Latn,54,54,13,0,240174,0.80597,1.0,0.892562,0.999946,54.124495,1.0
1162
+ qvh_Latn,95,95,3,0,240143,0.969388,1.0,0.984456,0.999988,12.4924,1.0
1163
+ qvi_Latn,98,98,3,0,240140,0.970297,1.0,0.984925,0.999988,12.492557,1.0
1164
+ qvm_Latn,88,88,1,0,240152,0.988764,1.0,0.99435,0.999996,4.164012,1.0
1165
+ qvn_Latn,106,106,1,0,240134,0.990654,1.0,0.995305,0.999996,4.164324,1.0
1166
+ qvs_Latn,148,148,8,0,240085,0.948718,1.0,0.973684,0.999967,33.320422,1.0
1167
+ qvw_Latn,175,175,0,0,240066,1.0,1.0,1.0,1.0,0.0,1.0
1168
+ qvz_Latn,191,191,0,0,240050,1.0,1.0,1.0,1.0,0.0,1.0
1169
+ qwh_Latn,117,110,0,7,240124,1.0,0.940171,0.969163,1.0,0.0,0.940171
1170
+ qxh_Latn,105,105,1,0,240135,0.990566,1.0,0.995261,0.999996,4.164307,1.0
1171
+ qxl_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
1172
+ qxn_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1173
+ qxo_Latn,93,93,1,0,240147,0.989362,1.0,0.994652,0.999996,4.164099,1.0
1174
+ qxr_Latn,93,93,2,0,240146,0.978947,1.0,0.989362,0.999992,8.328198,1.0
1175
+ rad_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
1176
+ rai_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
1177
+ rap_Latn,107,107,1,0,240133,0.990741,1.0,0.995349,0.999996,4.164342,1.0
1178
+ rar_Latn,368,368,0,0,239873,1.0,1.0,1.0,1.0,0.0,1.0
1179
+ rav_Deva,45,45,0,0,240196,1.0,1.0,1.0,1.0,0.0,1.0
1180
+ raw_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
1181
+ rcf_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
1182
+ rej_Latn,33,29,0,4,240208,1.0,0.878788,0.935484,1.0,0.0,0.878788
1183
+ rgu_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
1184
+ ria_Latn,23,23,0,0,240218,1.0,1.0,1.0,1.0,0.0,1.0
1185
+ rim_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
1186
+ rkb_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1187
+ rmc_Latn,341,341,1,0,239899,0.997076,1.0,0.998536,0.999996,4.168404,1.0
1188
+ rml_Latn,37,30,0,7,240204,1.0,0.810811,0.895522,1.0,0.0,0.810811
1189
+ rmn_Cyrl,223,223,0,0,240018,1.0,1.0,1.0,1.0,0.0,1.0
1190
+ rmn_Grek,185,128,2,57,240054,0.984615,0.691892,0.812698,0.999992,8.331389,0.691892
1191
+ rmn_Latn,236,236,2,0,240003,0.991597,1.0,0.995781,0.999992,8.33316,1.0
1192
+ rmo_Latn,85,85,2,0,240154,0.977011,1.0,0.988372,0.999992,8.32792,1.0
1193
+ rmq_Latn,17,17,1,0,240223,0.944444,1.0,0.971429,0.999996,4.162781,1.0
1194
+ rmy_Cyrl,101,74,8,27,240132,0.902439,0.732673,0.808743,0.999967,33.3139,0.732673
1195
+ rmy_Latn,265,265,3,0,239973,0.988806,1.0,0.994371,0.999987,12.50125,1.0
1196
+ rnd_Latn,164,164,1,0,240076,0.993939,1.0,0.99696,0.999996,4.16533,1.0
1197
+ rng_Latn,209,209,6,0,240026,0.972093,1.0,0.985849,0.999975,24.996667,1.0
1198
+ roh_Latn,307,307,0,0,239934,1.0,1.0,1.0,1.0,0.0,1.0
1199
+ ron_Cyrl,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1200
+ ron_Latn,369,368,2,1,239870,0.994595,0.99729,0.99594,0.999992,8.33778,0.99729
1201
+ roo_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
1202
+ rop_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
1203
+ row_Latn,138,138,1,0,240102,0.992806,1.0,0.99639,0.999996,4.164879,1.0
1204
+ rro_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1205
+ rtm_Latn,174,174,0,0,240067,1.0,1.0,1.0,1.0,0.0,1.0
1206
+ rub_Latn,31,31,0,0,240210,1.0,1.0,1.0,1.0,0.0,1.0
1207
+ rue_Cyrl,301,301,13,0,239927,0.958599,1.0,0.978862,0.999946,54.180212,1.0
1208
+ ruf_Latn,173,173,1,0,240067,0.994253,1.0,0.997118,0.999996,4.165486,1.0
1209
+ rug_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
1210
+ run_Latn,291,291,13,0,239937,0.957237,1.0,0.978151,0.999946,54.177954,1.0
1211
+ rup_Latn,166,166,1,0,240074,0.994012,1.0,0.996997,0.999996,4.165365,1.0
1212
+ rus_Cyrl,528,512,39,16,239674,0.92922,0.969697,0.949027,0.999837,162.694556,0.969697
1213
+ rwo_Latn,177,177,1,0,240063,0.994382,1.0,0.997183,0.999996,4.165556,1.0
1214
+ sab_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
1215
+ sag_Latn,237,237,0,0,240004,1.0,1.0,1.0,1.0,0.0,1.0
1216
+ sah_Cyrl,260,260,12,0,239969,0.955882,1.0,0.977444,0.99995,50.003959,1.0
1217
+ san_Deva,239,235,1,4,240001,0.995763,0.983264,0.989474,0.999996,4.166632,0.983264
1218
+ san_Latn,146,140,4,6,240091,0.972222,0.958904,0.965517,0.999983,16.660072,0.958904
1219
+ sas_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
1220
+ sat_Latn,239,239,3,0,239999,0.987603,1.0,0.993763,0.999988,12.499896,1.0
1221
+ sat_Olck,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1222
+ sbe_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
1223
+ sbl_Latn,74,74,0,0,240167,1.0,1.0,1.0,1.0,0.0,1.0
1224
+ sby_Latn,100,81,0,19,240141,1.0,0.81,0.895028,1.0,0.0,0.81
1225
+ sck_Deva,15,10,4,5,240222,0.714286,0.666667,0.689655,0.999983,16.650987,0.666667
1226
+ scn_Latn,172,172,6,0,240063,0.966292,1.0,0.982857,0.999975,24.992815,1.0
1227
+ sco_Latn,210,210,19,0,240012,0.917031,1.0,0.95672,0.999921,79.156442,1.0
1228
+ sda_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1229
+ sdc_Latn,39,39,2,0,240200,0.95122,1.0,0.975,0.999992,8.326325,1.0
1230
+ sdh_Arab,400,399,38,1,239803,0.913043,0.9975,0.953405,0.999842,158.438299,0.9975
1231
+ seh_Latn,162,162,3,0,240076,0.981818,1.0,0.990826,0.999988,12.495887,1.0
1232
+ ses_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
1233
+ sey_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
1234
+ sgb_Latn,115,115,5,0,240121,0.958333,1.0,0.978723,0.999979,20.822402,1.0
1235
+ sgc_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
1236
+ sgh_Cyrl,9,7,5,2,240227,0.583333,0.777778,0.666667,0.999979,20.813214,0.777778
1237
+ sgs_Latn,218,218,0,0,240023,1.0,1.0,1.0,1.0,0.0,1.0
1238
+ sgw_Ethi,96,96,1,0,240144,0.989691,1.0,0.994819,0.999996,4.164151,1.0
1239
+ sgz_Latn,136,136,2,0,240103,0.985507,1.0,0.992701,0.999992,8.329689,1.0
1240
+ shi_Latn,133,121,0,12,240108,1.0,0.909774,0.952756,1.0,0.0,0.909774
1241
+ shn_Mymr,174,174,2,0,240065,0.988636,1.0,0.994286,0.999992,8.331008,1.0
1242
+ shp_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
1243
+ sid_Latn,193,193,0,0,240048,1.0,1.0,1.0,1.0,0.0,1.0
1244
+ sig_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
1245
+ sil_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1246
+ sim_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
1247
+ sin_Sinh,232,232,0,0,240009,1.0,1.0,1.0,1.0,0.0,1.0
1248
+ sja_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
1249
+ skg_Latn,104,104,4,0,240133,0.962963,1.0,0.981132,0.999983,16.657158,1.0
1250
+ skr_Arab,116,95,0,21,240125,1.0,0.818966,0.900474,1.0,0.0,0.818966
1251
+ slk_Latn,374,374,1,0,239866,0.997333,1.0,0.998665,0.999996,4.168977,1.0
1252
+ sll_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
1253
+ slv_Latn,338,338,11,0,239892,0.968481,1.0,0.983988,0.999954,45.851865,1.0
1254
+ sma_Latn,327,327,1,0,239913,0.996951,1.0,0.998473,0.999996,4.16816,1.0
1255
+ sme_Latn,246,246,3,0,239992,0.987952,1.0,0.993939,0.999987,12.50026,1.0
1256
+ smj_Latn,407,407,0,0,239834,1.0,1.0,1.0,1.0,0.0,1.0
1257
+ smk_Latn,172,172,2,0,240067,0.988506,1.0,0.99422,0.999992,8.330938,1.0
1258
+ sml_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1259
+ smn_Latn,293,293,0,0,239948,1.0,1.0,1.0,1.0,0.0,1.0
1260
+ smo_Latn,426,426,1,0,239814,0.997658,1.0,0.998828,0.999996,4.169881,1.0
1261
+ sms_Latn,178,178,2,0,240061,0.988889,1.0,0.994413,0.999992,8.331146,1.0
1262
+ sna_Latn,415,415,0,0,239826,1.0,1.0,1.0,1.0,0.0,1.0
1263
+ snc_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1264
+ snd_Arab,325,325,2,0,239914,0.993884,1.0,0.996933,0.999992,8.336251,1.0
1265
+ snd_Deva,267,267,1,0,239973,0.996269,1.0,0.998131,0.999996,4.167118,1.0
1266
+ snd_Latn,155,122,18,33,240068,0.871429,0.787097,0.827119,0.999925,74.973135,0.787097
1267
+ snf_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1268
+ snn_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
1269
+ snp_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
1270
+ snw_Latn,25,25,0,0,240216,1.0,1.0,1.0,1.0,0.0,1.0
1271
+ sny_Latn,163,163,0,0,240078,1.0,1.0,1.0,1.0,0.0,1.0
1272
+ som_Latn,439,435,1,4,239801,0.997706,0.990888,0.994286,0.999996,4.170107,0.990888
1273
+ sop_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
1274
+ soq_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
1275
+ sot_Latn,491,476,6,15,239744,0.987552,0.96945,0.978417,0.999975,25.026069,0.96945
1276
+ soy_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
1277
+ spa_Latn,1136,1046,19,90,239086,0.98216,0.920775,0.950477,0.999921,79.462997,0.920775
1278
+ spl_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1279
+ spm_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
1280
+ spp_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
1281
+ sps_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
1282
+ spy_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
1283
+ srd_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
1284
+ srm_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
1285
+ srn_Latn,303,303,0,0,239938,1.0,1.0,1.0,1.0,0.0,1.0
1286
+ srp_Cyrl,269,269,6,0,239966,0.978182,1.0,0.988971,0.999975,25.002917,1.0
1287
+ srp_Latn,235,160,0,75,240006,1.0,0.680851,0.810127,1.0,0.0,0.680851
1288
+ srq_Latn,43,43,0,0,240198,1.0,1.0,1.0,1.0,0.0,1.0
1289
+ srr_Latn,49,49,1,0,240191,0.98,1.0,0.989899,0.999996,4.163336,1.0
1290
+ ssd_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1291
+ ssg_Latn,220,220,0,0,240021,1.0,1.0,1.0,1.0,0.0,1.0
1292
+ ssw_Latn,322,307,8,15,239911,0.974603,0.953416,0.963893,0.999967,33.344587,0.953416
1293
+ ssx_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1294
+ stp_Latn,62,62,0,0,240179,1.0,1.0,1.0,1.0,0.0,1.0
1295
+ stq_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1296
+ sua_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
1297
+ suc_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
1298
+ sue_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
1299
+ suk_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
1300
+ sun_Latn,143,143,4,0,240094,0.972789,1.0,0.986207,0.999983,16.659864,1.0
1301
+ sur_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
1302
+ sus_Arab,116,116,1,0,240124,0.991453,1.0,0.995708,0.999996,4.164498,1.0
1303
+ sus_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
1304
+ suz_Deva,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1305
+ swc_Latn,273,188,29,85,239939,0.866359,0.688645,0.767347,0.999879,120.849447,0.688645
1306
+ swe_Latn,328,326,18,2,239895,0.947674,0.993902,0.970238,0.999925,75.027197,0.993902
1307
+ swg_Latn,134,109,0,25,240107,1.0,0.813433,0.897119,1.0,0.0,0.813433
1308
+ swh_Latn,592,545,53,47,239596,0.911371,0.920608,0.915966,0.999779,221.156775,0.920608
1309
+ swp_Latn,143,143,1,0,240097,0.993056,1.0,0.996516,0.999996,4.164966,1.0
1310
+ sxb_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
1311
+ sxn_Latn,137,137,1,0,240103,0.992754,1.0,0.996364,0.999996,4.164862,1.0
1312
+ syb_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
1313
+ syc_Syrc,193,193,13,0,240035,0.936893,1.0,0.967419,0.999946,54.155835,1.0
1314
+ syl_Beng,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
1315
+ syl_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1316
+ szl_Latn,320,320,2,0,239919,0.993789,1.0,0.996885,0.999992,8.336077,1.0
1317
+ szy_Latn,123,123,1,0,240117,0.991935,1.0,0.995951,0.999996,4.164619,1.0
1318
+ tab_Cyrl,196,196,0,0,240045,1.0,1.0,1.0,1.0,0.0,1.0
1319
+ tac_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1320
+ tah_Latn,242,242,1,0,239998,0.995885,1.0,0.997938,0.999996,4.166684,1.0
1321
+ taj_Deva,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
1322
+ tam_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
1323
+ tam_Taml,754,754,10,0,239477,0.986911,1.0,0.993412,0.999958,41.75592,1.0
1324
+ taq_Latn,106,106,7,0,240128,0.938053,1.0,0.968037,0.999971,29.15027,1.0
1325
+ taq_Tfng,104,70,21,34,240116,0.769231,0.673077,0.717949,0.999913,87.450081,0.673077
1326
+ tar_Latn,190,190,0,0,240051,1.0,1.0,1.0,1.0,0.0,1.0
1327
+ tat_Cyrl,201,201,4,0,240036,0.980488,1.0,0.990148,0.999983,16.663889,1.0
1328
+ tat_Latn,161,161,2,0,240078,0.98773,1.0,0.993827,0.999992,8.330556,1.0
1329
+ tav_Latn,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
1330
+ taw_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
1331
+ tay_Latn,106,106,1,0,240134,0.990654,1.0,0.995305,0.999996,4.164324,1.0
1332
+ tbc_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
1333
+ tbg_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
1334
+ tbo_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
1335
+ tby_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
1336
+ tbz_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
1337
+ tca_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
1338
+ tcf_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
1339
+ tcs_Latn,128,128,0,0,240113,1.0,1.0,1.0,1.0,0.0,1.0
1340
+ tcy_Knda,99,99,7,0,240135,0.933962,1.0,0.965854,0.999971,29.14942,1.0
1341
+ tcz_Latn,291,291,6,0,239944,0.979798,1.0,0.989796,0.999975,25.005209,1.0
1342
+ tdt_Latn,57,57,75,0,240109,0.431818,1.0,0.603175,0.999688,312.2606,1.0
1343
+ ted_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
1344
+ tee_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
1345
+ tel_Latn,199,179,3,20,240039,0.983516,0.899497,0.939633,0.999988,12.497813,0.899497
1346
+ tel_Telu,555,553,5,2,239681,0.991039,0.996396,0.993711,0.999979,20.860626,0.996396
1347
+ tem_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1348
+ teo_Latn,225,222,0,3,240016,1.0,0.986667,0.993289,1.0,0.0,0.986667
1349
+ ter_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1350
+ tet_Latn,395,315,0,80,239846,1.0,0.797468,0.887324,1.0,0.0,0.797468
1351
+ tew_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1352
+ tfr_Latn,99,99,1,0,240141,0.99,1.0,0.994975,0.999996,4.164203,1.0
1353
+ tgk_Cyrl,413,413,2,0,239826,0.995181,1.0,0.997585,0.999992,8.33931,1.0
1354
+ tgo_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1355
+ tgp_Latn,189,189,0,0,240052,1.0,1.0,1.0,1.0,0.0,1.0
1356
+ tha_Thai,431,414,0,17,239810,1.0,0.960557,0.979882,1.0,0.0,0.960557
1357
+ thk_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
1358
+ thl_Deva,121,97,1,24,240119,0.989796,0.801653,0.885845,0.999996,4.164584,0.801653
1359
+ tif_Latn,161,161,1,0,240079,0.993827,1.0,0.996904,0.999996,4.165278,1.0
1360
+ tih_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
1361
+ tim_Latn,143,143,0,0,240098,1.0,1.0,1.0,1.0,0.0,1.0
1362
+ tir_Ethi,339,338,0,1,239902,1.0,0.99705,0.998523,1.0,0.0,0.99705
1363
+ tiv_Latn,199,199,4,0,240038,0.980296,1.0,0.99005,0.999983,16.663751,1.0
1364
+ tiy_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
1365
+ tkl_Latn,208,208,0,0,240033,1.0,1.0,1.0,1.0,0.0,1.0
1366
+ tkr_Cyrl,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
1367
+ tku_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1368
+ tlf_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
1369
+ tlh_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
1370
+ tll_Latn,186,186,0,0,240055,1.0,1.0,1.0,1.0,0.0,1.0
1371
+ tly_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
1372
+ tmd_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
1373
+ tna_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1374
+ tnk_Latn,117,117,1,0,240123,0.991525,1.0,0.995745,0.999996,4.164515,1.0
1375
+ tnn_Latn,140,140,1,0,240100,0.992908,1.0,0.996441,0.999996,4.164914,1.0
1376
+ tnp_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
1377
+ tob_Latn,85,85,0,0,240156,1.0,1.0,1.0,1.0,0.0,1.0
1378
+ toc_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
1379
+ tod_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1380
+ tog_Latn,105,105,0,0,240136,1.0,1.0,1.0,1.0,0.0,1.0
1381
+ toh_Latn,88,88,4,0,240149,0.956522,1.0,0.977778,0.999983,16.656048,1.0
1382
+ toi_Latn,232,231,4,1,240005,0.982979,0.99569,0.989293,0.999983,16.666042,0.99569
1383
+ toj_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1384
+ tok_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
1385
+ ton_Latn,298,298,0,0,239943,1.0,1.0,1.0,1.0,0.0,1.0
1386
+ too_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
1387
+ top_Latn,259,259,0,0,239982,1.0,1.0,1.0,1.0,0.0,1.0
1388
+ tos_Latn,77,77,0,0,240164,1.0,1.0,1.0,1.0,0.0,1.0
1389
+ tpi_Latn,302,302,1,0,239938,0.9967,1.0,0.998347,0.999996,4.167726,1.0
1390
+ tpm_Latn,7,7,0,0,240234,1.0,1.0,1.0,1.0,0.0,1.0
1391
+ tpp_Latn,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
1392
+ tpt_Latn,115,115,1,0,240125,0.991379,1.0,0.995671,0.999996,4.16448,1.0
1393
+ tpz_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
1394
+ trc_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
1395
+ trn_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1396
+ trp_Latn,186,186,0,0,240055,1.0,1.0,1.0,1.0,0.0,1.0
1397
+ trq_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1398
+ trv_Latn,159,159,5,0,240077,0.969512,1.0,0.98452,0.999979,20.826218,1.0
1399
+ tsc_Latn,184,183,20,1,240037,0.901478,0.994565,0.945736,0.999917,83.313546,0.994565
1400
+ tsg_Latn,170,170,1,0,240070,0.994152,1.0,0.997067,0.999996,4.165434,1.0
1401
+ tsn_Latn,456,438,18,18,239767,0.960526,0.960526,0.960526,0.999925,75.067248,0.960526
1402
+ tso_Latn,581,532,0,49,239660,1.0,0.915663,0.955975,1.0,0.0,0.915663
1403
+ tsw_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
1404
+ tsz_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
1405
+ ttc_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
1406
+ tte_Latn,132,132,1,0,240108,0.992481,1.0,0.996226,0.999996,4.164775,1.0
1407
+ ttj_Latn,28,26,1,2,240212,0.962963,0.928571,0.945455,0.999996,4.162972,0.928571
1408
+ tuc_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1409
+ tue_Latn,78,78,0,0,240163,1.0,1.0,1.0,1.0,0.0,1.0
1410
+ tuf_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
1411
+ tui_Latn,4,4,0,0,240237,1.0,1.0,1.0,1.0,0.0,1.0
1412
+ tuk_Arab,135,89,10,46,240096,0.89899,0.659259,0.760684,0.999958,41.648272,0.659259
1413
+ tuk_Cyrl,129,109,4,20,240108,0.964602,0.844961,0.900826,0.999983,16.658893,0.844961
1414
+ tuk_Latn,227,227,1,0,240013,0.995614,1.0,0.997802,0.999996,4.166424,1.0
1415
+ tum_Latn,265,264,1,1,239975,0.996226,0.996226,0.996226,0.999996,4.167083,0.996226
1416
+ tuo_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1417
+ tur_Latn,430,429,1,1,239810,0.997674,0.997674,0.997674,0.999996,4.169951,0.997674
1418
+ tuv_Latn,22,22,4,0,240215,0.846154,1.0,0.916667,0.999983,16.651472,1.0
1419
+ tvk_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
1420
+ tvl_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
1421
+ twi_Latn,359,353,6,6,239876,0.983287,0.983287,0.983287,0.999975,25.012298,0.983287
1422
+ twu_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1423
+ txq_Latn,145,145,3,0,240093,0.97973,1.0,0.989761,0.999988,12.495002,1.0
1424
+ txu_Latn,166,166,0,0,240075,1.0,1.0,1.0,1.0,0.0,1.0
1425
+ tyv_Cyrl,273,273,5,0,239963,0.982014,1.0,0.990926,0.999979,20.836111,1.0
1426
+ tzh_Latn,347,347,0,0,239894,1.0,1.0,1.0,1.0,0.0,1.0
1427
+ tzj_Latn,190,190,0,0,240051,1.0,1.0,1.0,1.0,0.0,1.0
1428
+ tzm_Tfng,157,157,71,0,240013,0.688596,1.0,0.815584,0.999704,295.729828,1.0
1429
+ tzo_Latn,294,294,0,0,239947,1.0,1.0,1.0,1.0,0.0,1.0
1430
+ ubr_Latn,194,194,0,0,240047,1.0,1.0,1.0,1.0,0.0,1.0
1431
+ ubu_Latn,211,211,0,0,240030,1.0,1.0,1.0,1.0,0.0,1.0
1432
+ udm_Cyrl,159,159,3,0,240079,0.981481,1.0,0.990654,0.999988,12.495731,1.0
1433
+ udu_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
1434
+ uig_Arab,334,334,0,0,239907,1.0,1.0,1.0,1.0,0.0,1.0
1435
+ uig_Cyrl,253,253,1,0,239987,0.996063,1.0,0.998028,0.999996,4.166875,1.0
1436
+ uig_Latn,197,197,8,0,240036,0.960976,1.0,0.9801,0.999967,33.327223,1.0
1437
+ ukr_Cyrl,322,322,2,0,239917,0.993827,1.0,0.996904,0.999992,8.336147,1.0
1438
+ umb_Latn,100,100,1,0,240140,0.990099,1.0,0.995025,0.999996,4.16422,1.0
1439
+ und_Bali,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1440
+ und_Bamu,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
1441
+ und_Bopo,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
1442
+ und_Cans,83,77,1,6,240157,0.987179,0.927711,0.956522,0.999996,4.163925,0.927711
1443
+ und_Cher,40,40,0,0,240201,1.0,1.0,1.0,1.0,0.0,1.0
1444
+ und_Cyrl,78,78,6,0,240157,0.928571,1.0,0.962963,0.999975,24.983032,1.0
1445
+ und_Deva,5,4,4,1,240232,0.5,0.8,0.615385,0.999983,16.650294,0.8
1446
+ und_Egyp,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
1447
+ und_Ethi,14,14,0,0,240227,1.0,1.0,1.0,1.0,0.0,1.0
1448
+ und_Geor,32,17,0,15,240209,1.0,0.53125,0.693878,1.0,0.0,0.53125
1449
+ und_Goth,22,17,0,5,240219,1.0,0.772727,0.871795,1.0,0.0,0.772727
1450
+ und_Grek,108,108,3,0,240130,0.972973,1.0,0.986301,0.999988,12.493077,1.0
1451
+ und_Hebr,47,37,0,10,240194,1.0,0.787234,0.880952,1.0,0.0,0.787234
1452
+ und_Hluw,16,16,2,0,240223,0.888889,1.0,0.941176,0.999992,8.325528,1.0
1453
+ und_Hung,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1454
+ und_Kana,136,103,0,33,240105,1.0,0.757353,0.861925,1.0,0.0,0.757353
1455
+ und_Khmr,18,13,0,5,240223,1.0,0.722222,0.83871,1.0,0.0,0.722222
1456
+ und_Lana,40,40,0,0,240201,1.0,1.0,1.0,1.0,0.0,1.0
1457
+ und_Laoo,20,9,0,11,240221,1.0,0.45,0.62069,1.0,0.0,0.45
1458
+ und_Lina,22,22,1,0,240218,0.956522,1.0,0.977778,0.999996,4.162868,1.0
1459
+ und_Mlym,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1460
+ und_Mong,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
1461
+ und_Mymr,27,18,0,9,240214,1.0,0.666667,0.8,1.0,0.0,0.666667
1462
+ und_Newa,153,153,0,0,240088,1.0,1.0,1.0,1.0,0.0,1.0
1463
+ und_Orya,25,17,1,8,240215,0.944444,0.68,0.790698,0.999996,4.16292,0.68
1464
+ und_Shaw,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1465
+ und_Sylo,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
1466
+ und_Syrc,43,30,0,13,240198,1.0,0.697674,0.821918,1.0,0.0,0.697674
1467
+ und_Taml,52,42,0,10,240189,1.0,0.807692,0.893617,1.0,0.0,0.807692
1468
+ und_Tang,28,28,3,0,240210,0.903226,1.0,0.949153,0.999988,12.488916,1.0
1469
+ und_Telu,49,44,0,5,240192,1.0,0.897959,0.946237,1.0,0.0,0.897959
1470
+ und_Thaa,29,14,0,15,240212,1.0,0.482759,0.651163,1.0,0.0,0.482759
1471
+ und_Thai,23,23,0,0,240218,1.0,1.0,1.0,1.0,0.0,1.0
1472
+ und_Tibt,24,23,0,1,240217,1.0,0.958333,0.978723,1.0,0.0,0.958333
1473
+ und_Vaii,12,12,1,0,240228,0.923077,1.0,0.96,0.999996,4.162695,1.0
1474
+ und_Xsux,43,43,1,0,240197,0.977273,1.0,0.988506,0.999996,4.163232,1.0
1475
+ und_Yiii,38,38,10,0,240193,0.791667,1.0,0.883721,0.999958,41.631453,1.0
1476
+ upv_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1477
+ ura_Latn,75,75,0,0,240166,1.0,1.0,1.0,1.0,0.0,1.0
1478
+ urb_Latn,112,112,0,0,240129,1.0,1.0,1.0,1.0,0.0,1.0
1479
+ urd_Arab,257,257,38,0,239946,0.871186,1.0,0.931159,0.999842,158.34389,1.0
1480
+ urd_Latn,204,167,56,37,239981,0.748879,0.818627,0.782201,0.999767,233.297367,0.818627
1481
+ urh_Latn,159,159,1,0,240081,0.99375,1.0,0.996865,0.999996,4.165244,1.0
1482
+ urk_Thai,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
1483
+ urt_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
1484
+ usa_Latn,157,157,0,0,240084,1.0,1.0,1.0,1.0,0.0,1.0
1485
+ usp_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1486
+ uth_Latn,19,19,0,0,240222,1.0,1.0,1.0,1.0,0.0,1.0
1487
+ uvh_Latn,100,100,0,0,240141,1.0,1.0,1.0,1.0,0.0,1.0
1488
+ uvl_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
1489
+ uzn_Cyrl,213,213,0,0,240028,1.0,1.0,1.0,1.0,0.0,1.0
1490
+ uzn_Latn,436,436,5,0,239800,0.988662,1.0,0.994299,0.999979,20.850274,1.0
1491
+ uzs_Arab,283,283,15,0,239943,0.949664,1.0,0.974182,0.999937,62.510939,1.0
1492
+ vap_Latn,140,119,4,21,240097,0.96748,0.85,0.904943,0.999983,16.659656,0.85
1493
+ var_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
1494
+ vec_Latn,49,37,1,12,240191,0.973684,0.755102,0.850575,0.999996,4.163336,0.755102
1495
+ ven_Latn,387,381,4,6,239850,0.98961,0.984496,0.987047,0.999983,16.676812,0.984496
1496
+ vep_Latn,113,113,1,0,240127,0.991228,1.0,0.995595,0.999996,4.164446,1.0
1497
+ vid_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1498
+ vie_Latn,338,338,2,0,239901,0.994118,1.0,0.99705,0.999992,8.336703,1.0
1499
+ viv_Latn,166,166,0,0,240075,1.0,1.0,1.0,1.0,0.0,1.0
1500
+ vls_Latn,98,98,2,0,240141,0.98,1.0,0.989899,0.999992,8.328371,1.0
1501
+ vmw_Latn,386,386,1,0,239854,0.997416,1.0,0.998706,0.999996,4.169186,1.0
1502
+ vmy_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
1503
+ vol_Latn,82,82,1,0,240158,0.987952,1.0,0.993939,0.999996,4.163908,1.0
1504
+ vro_Latn,448,448,9,0,239784,0.980306,1.0,0.990055,0.999962,37.532372,1.0
1505
+ vun_Latn,82,82,0,0,240159,1.0,1.0,1.0,1.0,0.0,1.0
1506
+ waj_Latn,128,128,0,0,240113,1.0,1.0,1.0,1.0,0.0,1.0
1507
+ wal_Latn,284,284,0,0,239957,1.0,1.0,1.0,1.0,0.0,1.0
1508
+ wap_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
1509
+ war_Latn,193,193,2,0,240046,0.989744,1.0,0.994845,0.999992,8.331667,1.0
1510
+ way_Latn,27,27,0,0,240214,1.0,1.0,1.0,1.0,0.0,1.0
1511
+ wba_Latn,63,63,1,0,240177,0.984375,1.0,0.992126,0.999996,4.163579,1.0
1512
+ wbm_Latn,42,42,0,0,240199,1.0,1.0,1.0,1.0,0.0,1.0
1513
+ wbp_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1514
+ wed_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1515
+ wer_Latn,143,143,0,0,240098,1.0,1.0,1.0,1.0,0.0,1.0
1516
+ whk_Latn,13,13,1,0,240227,0.928571,1.0,0.962963,0.999996,4.162712,1.0
1517
+ wib_Latn,17,17,0,0,240224,1.0,1.0,1.0,1.0,0.0,1.0
1518
+ wim_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
1519
+ wiu_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
1520
+ wln_Latn,305,305,2,0,239934,0.993485,1.0,0.996732,0.999992,8.335556,1.0
1521
+ wls_Latn,68,65,0,3,240173,1.0,0.955882,0.977444,1.0,0.0,0.955882
1522
+ wlv_Latn,82,82,1,0,240158,0.987952,1.0,0.993939,0.999996,4.163908,1.0
1523
+ wmt_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
1524
+ wmw_Latn,39,39,3,0,240199,0.928571,1.0,0.962963,0.999988,12.489488,1.0
1525
+ wnc_Latn,197,197,0,0,240044,1.0,1.0,1.0,1.0,0.0,1.0
1526
+ wnu_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
1527
+ wol_Latn,214,214,3,0,240024,0.986175,1.0,0.993039,0.999988,12.498594,1.0
1528
+ wos_Latn,183,183,1,0,240057,0.994565,1.0,0.997275,0.999996,4.16566,1.0
1529
+ wrk_Latn,185,185,0,0,240056,1.0,1.0,1.0,1.0,0.0,1.0
1530
+ wrs_Latn,158,158,1,0,240082,0.993711,1.0,0.996845,0.999996,4.165226,1.0
1531
+ wsk_Latn,128,128,0,0,240113,1.0,1.0,1.0,1.0,0.0,1.0
1532
+ wuu_Hani,148,148,6,0,240087,0.961039,1.0,0.980132,0.999975,24.990316,1.0
1533
+ wuv_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1534
+ xal_Cyrl,295,295,1,0,239945,0.996622,1.0,0.998308,0.999996,4.167604,1.0
1535
+ xav_Latn,103,103,2,0,240136,0.980952,1.0,0.990385,0.999992,8.328544,1.0
1536
+ xbi_Latn,165,165,0,0,240076,1.0,1.0,1.0,1.0,0.0,1.0
1537
+ xbr_Latn,8,8,0,0,240233,1.0,1.0,1.0,1.0,0.0,1.0
1538
+ xed_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
1539
+ xho_Latn,367,338,10,29,239864,0.971264,0.920981,0.945455,0.999958,41.688553,0.920981
1540
+ xla_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
1541
+ xmf_Geor,132,132,2,0,240107,0.985075,1.0,0.992481,0.999992,8.32955,1.0
1542
+ xmm_Latn,32,28,6,4,240203,0.823529,0.875,0.848485,0.999975,24.978248,0.875
1543
+ xmv_Latn,130,97,0,33,240111,1.0,0.746154,0.854626,1.0,0.0,0.746154
1544
+ xnn_Latn,77,77,1,0,240163,0.987179,1.0,0.993548,0.999996,4.163821,1.0
1545
+ xog_Latn,93,91,1,2,240147,0.98913,0.978495,0.983784,0.999996,4.164099,0.978495
1546
+ xon_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
1547
+ xrb_Latn,91,91,1,0,240149,0.98913,1.0,0.994536,0.999996,4.164064,1.0
1548
+ xsi_Latn,154,154,1,0,240086,0.993548,1.0,0.996764,0.999996,4.165157,1.0
1549
+ xsm_Latn,159,159,1,0,240081,0.99375,1.0,0.996865,0.999996,4.165244,1.0
1550
+ xsr_Deva,167,167,0,0,240074,1.0,1.0,1.0,1.0,0.0,1.0
1551
+ xsu_Latn,3,3,0,0,240238,1.0,1.0,1.0,1.0,0.0,1.0
1552
+ xtd_Latn,73,73,0,0,240168,1.0,1.0,1.0,1.0,0.0,1.0
1553
+ xtm_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
1554
+ xtn_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1555
+ xuo_Latn,62,62,0,0,240179,1.0,1.0,1.0,1.0,0.0,1.0
1556
+ yaa_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
1557
+ yad_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
1558
+ yal_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1559
+ yan_Latn,14,14,0,0,240227,1.0,1.0,1.0,1.0,0.0,1.0
1560
+ yao_Latn,137,137,2,0,240102,0.985612,1.0,0.992754,0.999992,8.329724,1.0
1561
+ yap_Latn,210,210,1,0,240030,0.995261,1.0,0.997625,0.999996,4.166129,1.0
1562
+ yaq_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
1563
+ ybb_Latn,20,12,1,8,240220,0.923077,0.6,0.727273,0.999996,4.162833,0.6
1564
+ yby_Latn,121,121,0,0,240120,1.0,1.0,1.0,1.0,0.0,1.0
1565
+ ycn_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
1566
+ ydd_Hebr,430,430,1,0,239810,0.99768,1.0,0.998839,0.999996,4.169951,1.0
1567
+ yka_Latn,215,215,1,0,240025,0.99537,1.0,0.99768,0.999996,4.166215,1.0
1568
+ yle_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
1569
+ yli_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
1570
+ yml_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
1571
+ yom_Latn,117,117,1,0,240123,0.991525,1.0,0.995745,0.999996,4.164515,1.0
1572
+ yon_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
1573
+ yor_Latn,308,308,2,0,239931,0.993548,1.0,0.996764,0.999992,8.33566,1.0
1574
+ yrb_Latn,188,188,0,0,240053,1.0,1.0,1.0,1.0,0.0,1.0
1575
+ yre_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
1576
+ yrk_Cyrl,61,58,0,3,240180,1.0,0.95082,0.97479,1.0,0.0,0.95082
1577
+ yss_Latn,231,231,0,0,240010,1.0,1.0,1.0,1.0,0.0,1.0
1578
+ yua_Latn,326,324,1,2,239914,0.996923,0.993865,0.995392,0.999996,4.168143,0.993865
1579
+ yue_Hani,194,160,3,34,240044,0.981595,0.824742,0.896359,0.999988,12.497553,0.824742
1580
+ yuj_Latn,205,205,0,0,240036,1.0,1.0,1.0,1.0,0.0,1.0
1581
+ yut_Latn,262,262,0,0,239979,1.0,1.0,1.0,1.0,0.0,1.0
1582
+ yuw_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
1583
+ yva_Latn,25,25,0,0,240216,1.0,1.0,1.0,1.0,0.0,1.0
1584
+ zaa_Latn,63,63,1,0,240177,0.984375,1.0,0.992126,0.999996,4.163579,1.0
1585
+ zab_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1586
+ zac_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
1587
+ zad_Latn,12,12,0,0,240229,1.0,1.0,1.0,1.0,0.0,1.0
1588
+ zae_Latn,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
1589
+ zai_Latn,80,80,1,0,240160,0.987654,1.0,0.993789,0.999996,4.163873,1.0
1590
+ zam_Latn,52,52,0,0,240189,1.0,1.0,1.0,1.0,0.0,1.0
1591
+ zao_Latn,77,77,0,0,240164,1.0,1.0,1.0,1.0,0.0,1.0
1592
+ zar_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
1593
+ zas_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
1594
+ zat_Latn,261,261,0,0,239980,1.0,1.0,1.0,1.0,0.0,1.0
1595
+ zav_Latn,78,78,0,0,240163,1.0,1.0,1.0,1.0,0.0,1.0
1596
+ zaw_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
1597
+ zdj_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
1598
+ zea_Latn,192,192,3,0,240046,0.984615,1.0,0.992248,0.999988,12.497448,1.0
1599
+ zgh_Tfng,135,64,12,71,240094,0.842105,0.474074,0.606635,0.99995,49.977926,0.474074
1600
+ zia_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
1601
+ ziw_Latn,142,142,1,0,240098,0.993007,1.0,0.996491,0.999996,4.164949,1.0
1602
+ zne_Latn,195,195,0,0,240046,1.0,1.0,1.0,1.0,0.0,1.0
1603
+ zom_Latn,260,214,10,46,239971,0.955357,0.823077,0.884298,0.999958,41.669966,0.823077
1604
+ zos_Latn,171,171,0,0,240070,1.0,1.0,1.0,1.0,0.0,1.0
1605
+ zpa_Latn,174,174,1,0,240066,0.994286,1.0,0.997135,0.999996,4.165504,1.0
1606
+ zpc_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
1607
+ zpg_Latn,15,15,0,0,240226,1.0,1.0,1.0,1.0,0.0,1.0
1608
+ zpi_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
1609
+ zpl_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1610
+ zpm_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
1611
+ zpo_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
1612
+ zpt_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
1613
+ zpu_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1614
+ zpv_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
1615
+ zpz_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
1616
+ zsm_Latn,244,244,22,0,239975,0.917293,1.0,0.956863,0.999908,91.667813,1.0
1617
+ zsr_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
1618
+ ztq_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
1619
+ zty_Latn,177,177,0,0,240064,1.0,1.0,1.0,1.0,0.0,1.0
1620
+ zul_Latn,594,500,22,94,239625,0.957854,0.841751,0.896057,0.999908,91.801692,0.841751
1621
+ zyb_Latn,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
1622
+ zyp_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
reports/test/glotlid@millid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.978292631149554,
3
+ "top3_accuracy": 0.9977897194900122,
4
+ "top5_accuracy": 0.9984557173837938,
5
+ "passages": 240241,
6
+ "languages": 1621,
7
+ "macro_precision": 0.9778492893480586,
8
+ "macro_recall": 0.9764998669631992,
9
+ "macro_f1": 0.9754780061637239,
10
+ "macro_specificity": 0.9999866076235475,
11
+ "weighted_f1": 0.9778914257911913,
12
+ "median_f1": 1.0,
13
+ "languages_f1_at_least_0_9": 1490,
14
+ "languages_f1_below_0_5": 5,
15
+ "mean_fp_per_million": 13.392376452534537,
16
+ "micro_f1": 0.978292631149554,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9911725821214279,
19
+ "sentence": 0.98578410161122,
20
+ "short": 0.967431690103287
21
+ }
22
+ }
reports/test/glotlid_per_language.csv ADDED
@@ -0,0 +1,1622 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aai_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
3
+ aak_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
4
+ aau_Latn,214,214,0,0,240027,1.0,1.0,1.0,1.0,0.0,1.0
5
+ aaz_Latn,98,98,1,0,240142,0.989899,1.0,0.994924,0.999996,4.164186,1.0
6
+ aba_Latn,176,176,0,0,240065,1.0,1.0,1.0,1.0,0.0,1.0
7
+ abk_Cyrl,285,285,0,0,239956,1.0,1.0,1.0,1.0,0.0,1.0
8
+ abn_Latn,174,174,0,0,240067,1.0,1.0,1.0,1.0,0.0,1.0
9
+ abq_Cyrl,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
10
+ abs_Latn,142,124,5,18,240094,0.96124,0.873239,0.915129,0.999979,20.824743,0.873239
11
+ abt_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
12
+ abx_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
13
+ aby_Latn,161,161,0,0,240080,1.0,1.0,1.0,1.0,0.0,1.0
14
+ abz_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
15
+ aca_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
16
+ acd_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
17
+ ace_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
18
+ acf_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
19
+ ach_Latn,242,242,2,0,239997,0.991803,1.0,0.995885,0.999992,8.333368,1.0
20
+ acm_Arab,109,78,32,31,240100,0.709091,0.715596,0.712329,0.999867,133.26004,0.715596
21
+ acn_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
22
+ acr_Latn,255,255,0,0,239986,1.0,1.0,1.0,1.0,0.0,1.0
23
+ acu_Latn,220,220,0,0,240021,1.0,1.0,1.0,1.0,0.0,1.0
24
+ ada_Latn,145,145,1,0,240095,0.993151,1.0,0.996564,0.999996,4.165001,1.0
25
+ ade_Latn,31,31,0,0,240210,1.0,1.0,1.0,1.0,0.0,1.0
26
+ adh_Latn,77,72,0,5,240164,1.0,0.935065,0.966443,1.0,0.0,0.935065
27
+ adj_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
28
+ ady_Cyrl,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
29
+ adz_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
30
+ aeb_Arab,244,198,54,46,239943,0.785714,0.811475,0.798387,0.999775,225.002813,0.811475
31
+ aeb_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
32
+ aer_Latn,16,16,0,0,240225,1.0,1.0,1.0,1.0,0.0,1.0
33
+ aeu_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
34
+ aey_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
35
+ afr_Latn,569,555,3,14,239669,0.994624,0.975395,0.984916,0.999987,12.517107,0.975395
36
+ agd_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
37
+ agg_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
38
+ agm_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
39
+ agn_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
40
+ agr_Latn,182,182,1,0,240058,0.994536,1.0,0.99726,0.999996,4.165643,1.0
41
+ agt_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
42
+ agu_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
43
+ agx_Cyrl,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
44
+ ahk_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
45
+ aia_Latn,163,163,0,0,240078,1.0,1.0,1.0,1.0,0.0,1.0
46
+ aii_Syrc,234,234,0,0,240007,1.0,1.0,1.0,1.0,0.0,1.0
47
+ ain_Latn,1,0,0,1,240240,0.0,0.0,0.0,1.0,0.0,0.0
48
+ ajg_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
49
+ aji_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
50
+ ajp_Arab,28,27,38,1,240175,0.415385,0.964286,0.580645,0.999842,158.192937,0.964286
51
+ akb_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
52
+ ake_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
53
+ akh_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
54
+ akp_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
55
+ aln_Latn,117,71,0,46,240124,1.0,0.606838,0.755319,1.0,0.0,0.606838
56
+ alp_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
57
+ alq_Latn,124,124,1,0,240116,0.992,1.0,0.995984,0.999996,4.164636,1.0
58
+ als_Latn,213,213,43,0,239985,0.832031,1.0,0.908316,0.999821,179.145766,1.0
59
+ alt_Cyrl,208,208,3,0,240030,0.985782,1.0,0.99284,0.999988,12.498281,1.0
60
+ aly_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
61
+ alz_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
62
+ ame_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
63
+ amf_Latn,59,59,1,0,240181,0.983333,1.0,0.991597,0.999996,4.163509,1.0
64
+ amh_Ethi,458,458,0,0,239783,1.0,1.0,1.0,1.0,0.0,1.0
65
+ ami_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
66
+ amk_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
67
+ amm_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
68
+ amn_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
69
+ amp_Latn,172,172,0,0,240069,1.0,1.0,1.0,1.0,0.0,1.0
70
+ amr_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
71
+ amu_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
72
+ amx_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
73
+ ang_Latn,197,197,1,0,240043,0.994949,1.0,0.997468,0.999996,4.165903,1.0
74
+ ann_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
75
+ anp_Deva,252,192,192,60,239797,0.5,0.761905,0.603774,0.9992,800.036668,0.761905
76
+ anv_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
77
+ any_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
78
+ aoi_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
79
+ aoj_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
80
+ aom_Latn,156,156,0,0,240085,1.0,1.0,1.0,1.0,0.0,1.0
81
+ aoz_Latn,25,24,0,1,240216,1.0,0.96,0.979592,1.0,0.0,0.96
82
+ apb_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
83
+ apc_Arab,143,94,17,49,240081,0.846847,0.657343,0.740157,0.999929,70.804422,0.657343
84
+ ape_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
85
+ apn_Latn,105,105,0,0,240136,1.0,1.0,1.0,1.0,0.0,1.0
86
+ apr_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
87
+ apt_Latn,22,22,0,0,240219,1.0,1.0,1.0,1.0,0.0,1.0
88
+ apu_Latn,213,213,0,0,240028,1.0,1.0,1.0,1.0,0.0,1.0
89
+ apw_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
90
+ apy_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
91
+ apz_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
92
+ arb_Arab,745,593,172,152,239324,0.775163,0.795973,0.78543,0.999282,718.174834,0.795973
93
+ arb_Latn,163,135,1,28,240077,0.992647,0.828221,0.90301,0.999996,4.165313,0.828221
94
+ are_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
95
+ arg_Latn,194,194,4,0,240043,0.979798,1.0,0.989796,0.999983,16.663403,1.0
96
+ arl_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
97
+ arn_Latn,250,250,0,0,239991,1.0,1.0,1.0,1.0,0.0,1.0
98
+ arp_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
99
+ arq_Arab,113,94,2,19,240126,0.979167,0.831858,0.899522,0.999992,8.328891,0.831858
100
+ ars_Arab,309,226,57,83,239875,0.798587,0.731392,0.763514,0.999762,237.567311,0.731392
101
+ ary_Arab,192,120,109,72,239940,0.524017,0.625,0.570071,0.999546,454.07396,0.625
102
+ arz_Arab,229,133,47,96,239965,0.738889,0.580786,0.650367,0.999804,195.823542,0.580786
103
+ asm_Beng,467,466,0,1,239774,1.0,0.997859,0.998928,1.0,0.0,0.997859
104
+ asm_Latn,59,58,3,1,240179,0.95082,0.983051,0.966667,0.999988,12.490528,0.983051
105
+ aso_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
106
+ ast_Latn,244,244,17,0,239980,0.934866,1.0,0.966337,0.999929,70.834219,1.0
107
+ ata_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
108
+ atb_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
109
+ atd_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
110
+ atg_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
111
+ ati_Latn,94,94,4,0,240143,0.959184,1.0,0.979167,0.999983,16.656465,1.0
112
+ atj_Latn,108,108,14,0,240119,0.885246,1.0,0.93913,0.999942,58.301025,1.0
113
+ att_Latn,121,121,0,0,240120,1.0,1.0,1.0,1.0,0.0,1.0
114
+ auc_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
115
+ aui_Latn,114,114,1,0,240126,0.991304,1.0,0.995633,0.999996,4.164463,1.0
116
+ auy_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
117
+ ava_Cyrl,240,240,0,0,240001,1.0,1.0,1.0,1.0,0.0,1.0
118
+ avk_Latn,111,106,0,5,240130,1.0,0.954955,0.976959,1.0,0.0,0.954955
119
+ avt_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
120
+ avu_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
121
+ awa_Deva,91,91,20,0,240130,0.81982,1.0,0.90099,0.999917,83.281283,1.0
122
+ awb_Latn,167,167,0,0,240074,1.0,1.0,1.0,1.0,0.0,1.0
123
+ awx_Latn,53,53,0,0,240188,1.0,1.0,1.0,1.0,0.0,1.0
124
+ ayp_Arab,72,51,0,21,240169,1.0,0.708333,0.829268,1.0,0.0,0.708333
125
+ ayr_Latn,309,309,0,0,239932,1.0,1.0,1.0,1.0,0.0,1.0
126
+ azb_Arab,369,367,42,2,239830,0.897311,0.99458,0.943445,0.999825,175.093383,0.99458
127
+ azg_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
128
+ azj_Cyrl,144,144,3,0,240094,0.979592,1.0,0.989691,0.999988,12.49495,1.0
129
+ azj_Latn,187,187,3,0,240051,0.984211,1.0,0.992042,0.999988,12.497188,1.0
130
+ azz_Latn,73,73,0,0,240168,1.0,1.0,1.0,1.0,0.0,1.0
131
+ bak_Cyrl,289,289,0,0,239952,1.0,1.0,1.0,1.0,0.0,1.0
132
+ bam_Latn,287,287,1,0,239953,0.996528,1.0,0.998261,0.999996,4.167465,1.0
133
+ ban_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
134
+ bao_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
135
+ bar_Latn,331,331,6,0,239904,0.982196,1.0,0.991018,0.999975,25.009379,1.0
136
+ bas_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
137
+ bba_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
138
+ bbb_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
139
+ bbc_Latn,247,247,0,0,239994,1.0,1.0,1.0,1.0,0.0,1.0
140
+ bbr_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
141
+ bcc_Arab,173,134,17,39,240051,0.887417,0.774566,0.82716,0.999929,70.81327,0.774566
142
+ bch_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
143
+ bci_Latn,193,193,0,0,240048,1.0,1.0,1.0,1.0,0.0,1.0
144
+ bcl_Latn,231,231,0,0,240010,1.0,1.0,1.0,1.0,0.0,1.0
145
+ bco_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
146
+ bcw_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
147
+ bdd_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
148
+ bdh_Latn,180,180,0,0,240061,1.0,1.0,1.0,1.0,0.0,1.0
149
+ bdq_Latn,9,6,0,3,240232,1.0,0.666667,0.8,1.0,0.0,0.666667
150
+ bea_Latn,10,10,1,0,240230,0.909091,1.0,0.952381,0.999996,4.16266,1.0
151
+ bef_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
152
+ bel_Cyrl,157,157,1,0,240083,0.993671,1.0,0.996825,0.999996,4.165209,1.0
153
+ bem_Latn,222,216,3,6,240016,0.986301,0.972973,0.979592,0.999988,12.49901,0.972973
154
+ ben_Beng,466,464,1,2,239774,0.997849,0.995708,0.996778,0.999996,4.170577,0.995708
155
+ ben_Latn,126,108,12,18,240103,0.9,0.857143,0.878049,0.99995,49.976053,0.857143
156
+ beq_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
157
+ bew_Latn,165,106,33,59,240043,0.76259,0.642424,0.697368,0.999863,137.456472,0.642424
158
+ bfd_Latn,92,92,0,0,240149,1.0,1.0,1.0,1.0,0.0,1.0
159
+ bgr_Latn,143,143,1,0,240097,0.993056,1.0,0.996516,0.999996,4.164966,1.0
160
+ bgs_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
161
+ bgt_Latn,144,144,2,0,240095,0.986301,1.0,0.993103,0.999992,8.329967,1.0
162
+ bgz_Latn,13,13,1,0,240227,0.928571,1.0,0.962963,0.999996,4.162712,1.0
163
+ bhg_Latn,19,19,0,0,240222,1.0,1.0,1.0,1.0,0.0,1.0
164
+ bhl_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
165
+ bho_Deva,290,290,7,0,239944,0.976431,1.0,0.988075,0.999971,29.172623,1.0
166
+ bhw_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
167
+ bib_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
168
+ big_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
169
+ bim_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
170
+ bin_Latn,182,182,0,0,240059,1.0,1.0,1.0,1.0,0.0,1.0
171
+ bis_Latn,257,257,0,0,239984,1.0,1.0,1.0,1.0,0.0,1.0
172
+ biu_Latn,7,7,0,0,240234,1.0,1.0,1.0,1.0,0.0,1.0
173
+ biv_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
174
+ bjn_Arab,116,83,1,33,240124,0.988095,0.715517,0.83,0.999996,4.164498,0.715517
175
+ bjn_Latn,153,153,5,0,240083,0.968354,1.0,0.983923,0.999979,20.825697,1.0
176
+ bjp_Latn,171,171,0,0,240070,1.0,1.0,1.0,1.0,0.0,1.0
177
+ bjr_Latn,176,176,0,0,240065,1.0,1.0,1.0,1.0,0.0,1.0
178
+ bjv_Latn,84,84,0,0,240157,1.0,1.0,1.0,1.0,0.0,1.0
179
+ bkd_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
180
+ bkq_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
181
+ bku_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
182
+ bla_Latn,11,11,0,0,240230,1.0,1.0,1.0,1.0,0.0,1.0
183
+ blh_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
184
+ blk_Mymr,159,135,0,24,240082,1.0,0.849057,0.918367,1.0,0.0,0.849057
185
+ blt_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
186
+ blw_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
187
+ blz_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
188
+ bmh_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
189
+ bmk_Latn,11,11,0,0,240230,1.0,1.0,1.0,1.0,0.0,1.0
190
+ bmq_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
191
+ bmr_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
192
+ bmu_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
193
+ bno_Latn,176,176,1,0,240064,0.99435,1.0,0.997167,0.999996,4.165538,1.0
194
+ bnp_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
195
+ boa_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
196
+ bod_Tibt,406,405,11,1,239824,0.973558,0.997537,0.985401,0.999954,45.864865,0.997537
197
+ boj_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
198
+ bon_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
199
+ bos_Latn,198,198,43,0,240000,0.821577,1.0,0.90205,0.999821,179.134572,1.0
200
+ box_Latn,50,50,1,0,240190,0.980392,1.0,0.990099,0.999996,4.163353,1.0
201
+ bpr_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
202
+ bps_Latn,110,110,2,0,240129,0.982143,1.0,0.990991,0.999992,8.328787,1.0
203
+ bpy_Beng,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
204
+ bqc_Latn,161,161,0,0,240080,1.0,1.0,1.0,1.0,0.0,1.0
205
+ bqp_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
206
+ bre_Latn,277,277,0,0,239964,1.0,1.0,1.0,1.0,0.0,1.0
207
+ brh_Arab,311,279,4,32,239926,0.985866,0.897106,0.939394,0.999983,16.671529,0.897106
208
+ bru_Latn,141,141,1,0,240099,0.992958,1.0,0.996466,0.999996,4.164931,1.0
209
+ brx_Deva,351,351,0,0,239890,1.0,1.0,1.0,1.0,0.0,1.0
210
+ bsn_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
211
+ bsp_Latn,48,48,0,0,240193,1.0,1.0,1.0,1.0,0.0,1.0
212
+ bsq_Latn,73,73,2,0,240166,0.973333,1.0,0.986486,0.999992,8.327504,1.0
213
+ bss_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
214
+ btd_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
215
+ bth_Latn,33,33,0,0,240208,1.0,1.0,1.0,1.0,0.0,1.0
216
+ bts_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
217
+ btx_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
218
+ bud_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
219
+ bug_Latn,78,78,9,0,240154,0.896552,1.0,0.945455,0.999963,37.474549,1.0
220
+ buk_Latn,211,211,0,0,240030,1.0,1.0,1.0,1.0,0.0,1.0
221
+ bul_Cyrl,289,289,2,0,239950,0.993127,1.0,0.996552,0.999992,8.335,1.0
222
+ bum_Latn,245,245,4,0,239992,0.983936,1.0,0.991903,0.999983,16.666944,1.0
223
+ bus_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
224
+ bvd_Latn,206,206,0,0,240035,1.0,1.0,1.0,1.0,0.0,1.0
225
+ bvr_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
226
+ bvz_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
227
+ bwd_Latn,51,51,0,0,240190,1.0,1.0,1.0,1.0,0.0,1.0
228
+ bwu_Latn,56,56,1,0,240184,0.982456,1.0,0.99115,0.999996,4.163457,1.0
229
+ bxh_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
230
+ bxr_Cyrl,277,277,4,0,239960,0.985765,1.0,0.992832,0.999983,16.669167,1.0
231
+ byr_Latn,194,194,0,0,240047,1.0,1.0,1.0,1.0,0.0,1.0
232
+ byx_Latn,206,206,0,0,240035,1.0,1.0,1.0,1.0,0.0,1.0
233
+ bzd_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
234
+ bzh_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
235
+ bzi_Thai,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
236
+ bzj_Latn,164,164,1,0,240076,0.993939,1.0,0.99696,0.999996,4.16533,1.0
237
+ caa_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
238
+ cab_Latn,201,201,0,0,240040,1.0,1.0,1.0,1.0,0.0,1.0
239
+ cac_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
240
+ caf_Latn,174,174,0,0,240067,1.0,1.0,1.0,1.0,0.0,1.0
241
+ cag_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
242
+ cak_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
243
+ cao_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
244
+ cap_Latn,226,226,0,0,240015,1.0,1.0,1.0,1.0,0.0,1.0
245
+ caq_Latn,189,189,0,0,240052,1.0,1.0,1.0,1.0,0.0,1.0
246
+ car_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
247
+ cas_Latn,74,74,0,0,240167,1.0,1.0,1.0,1.0,0.0,1.0
248
+ cat_Latn,318,318,12,0,239911,0.963636,1.0,0.981481,0.99995,50.016047,1.0
249
+ cav_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
250
+ cax_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
251
+ cbc_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
252
+ cbi_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
253
+ cbk_Latn,155,128,9,27,240077,0.934307,0.825806,0.876712,0.999963,37.486567,0.825806
254
+ cbr_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
255
+ cbs_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
256
+ cbt_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
257
+ cbu_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
258
+ cbv_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
259
+ cce_Latn,133,130,2,3,240106,0.984848,0.977444,0.981132,0.999992,8.329585,0.977444
260
+ cco_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
261
+ ccp_Latn,3,3,0,0,240238,1.0,1.0,1.0,1.0,0.0,1.0
262
+ ceb_Latn,338,338,0,0,239903,1.0,1.0,1.0,1.0,0.0,1.0
263
+ ceg_Latn,53,53,1,0,240187,0.981481,1.0,0.990654,0.999996,4.163405,1.0
264
+ cek_Latn,67,51,32,16,240142,0.614458,0.761194,0.68,0.999867,133.236737,0.761194
265
+ ces_Latn,183,183,0,0,240058,1.0,1.0,1.0,1.0,0.0,1.0
266
+ cfm_Latn,133,133,7,0,240101,0.95,1.0,0.974359,0.999971,29.153548,1.0
267
+ cgc_Latn,169,169,2,0,240070,0.988304,1.0,0.994118,0.999992,8.330834,1.0
268
+ cha_Latn,348,348,0,0,239893,1.0,1.0,1.0,1.0,0.0,1.0
269
+ chd_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
270
+ che_Cyrl,345,345,0,0,239896,1.0,1.0,1.0,1.0,0.0,1.0
271
+ chf_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
272
+ chk_Latn,294,294,0,0,239947,1.0,1.0,1.0,1.0,0.0,1.0
273
+ cho_Latn,36,33,0,3,240205,1.0,0.916667,0.956522,1.0,0.0,0.916667
274
+ chq_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
275
+ chr_Cher,44,44,0,0,240197,1.0,1.0,1.0,1.0,0.0,1.0
276
+ chu_Cyrl,168,144,14,24,240059,0.911392,0.857143,0.883436,0.999942,58.315596,0.857143
277
+ chv_Cyrl,335,335,0,0,239906,1.0,1.0,1.0,1.0,0.0,1.0
278
+ chw_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
279
+ chz_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
280
+ cjk_Latn,24,24,3,0,240214,0.888889,1.0,0.941176,0.999988,12.488708,1.0
281
+ cjp_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
282
+ cjs_Cyrl,20,14,1,6,240220,0.933333,0.7,0.8,0.999996,4.162833,0.7
283
+ cjv_Latn,78,78,0,0,240163,1.0,1.0,1.0,1.0,0.0,1.0
284
+ ckb_Arab,421,402,25,19,239795,0.941452,0.954869,0.948113,0.999896,104.24485,0.954869
285
+ ckm_Latn,119,87,16,32,240106,0.84466,0.731092,0.783784,0.999933,66.632795,0.731092
286
+ cko_Latn,63,63,0,0,240178,1.0,1.0,1.0,1.0,0.0,1.0
287
+ ckt_Cyrl,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
288
+ clu_Latn,76,76,1,0,240164,0.987013,1.0,0.993464,0.999996,4.163804,1.0
289
+ cme_Latn,63,63,2,0,240176,0.969231,1.0,0.984375,0.999992,8.327157,1.0
290
+ cmn_Hani,288,287,64,1,239889,0.817664,0.996528,0.898279,0.999733,266.718899,0.996528
291
+ cmo_Latn,117,117,0,0,240124,1.0,1.0,1.0,1.0,0.0,1.0
292
+ cnh_Latn,286,286,4,0,239951,0.986207,1.0,0.993056,0.999983,16.669792,1.0
293
+ cni_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
294
+ cnk_Latn,115,78,5,37,240121,0.939759,0.678261,0.787879,0.999979,20.822402,0.678261
295
+ cnr_Latn,147,147,36,0,240058,0.803279,1.0,0.890909,0.99985,149.941273,1.0
296
+ cnw_Latn,8,8,1,0,240232,0.888889,1.0,0.941176,0.999996,4.162625,1.0
297
+ coe_Latn,112,112,0,0,240129,1.0,1.0,1.0,1.0,0.0,1.0
298
+ cof_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
299
+ cok_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
300
+ con_Latn,89,89,1,0,240151,0.988889,1.0,0.994413,0.999996,4.164029,1.0
301
+ cop_Copt,92,91,0,1,240149,1.0,0.98913,0.994536,1.0,0.0,0.98913
302
+ cor_Latn,290,290,1,0,239950,0.996564,1.0,0.998279,0.999996,4.167518,1.0
303
+ cos_Latn,220,220,3,0,240018,0.986547,1.0,0.993228,0.999988,12.498906,1.0
304
+ cot_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
305
+ cpb_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
306
+ cpc_Latn,389,389,0,0,239852,1.0,1.0,1.0,1.0,0.0,1.0
307
+ cpu_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
308
+ cpy_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
309
+ crh_Cyrl,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
310
+ crh_Latn,189,189,22,0,240030,0.895735,1.0,0.945,0.999908,91.64681,1.0
311
+ crj_Cans,21,21,0,0,240220,1.0,1.0,1.0,1.0,0.0,1.0
312
+ crk_Cans,27,27,0,0,240214,1.0,1.0,1.0,1.0,0.0,1.0
313
+ crk_Latn,225,225,12,0,240004,0.949367,1.0,0.974026,0.99995,49.996667,1.0
314
+ crl_Cans,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
315
+ crm_Cans,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
316
+ crn_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
317
+ crs_Latn,218,218,4,0,240019,0.981982,1.0,0.990909,0.999983,16.66507,1.0
318
+ crx_Latn,322,322,1,0,239918,0.996904,1.0,0.99845,0.999996,4.168073,1.0
319
+ csb_Latn,307,307,1,0,239933,0.996753,1.0,0.998374,0.999996,4.167813,1.0
320
+ csw_Latn,56,41,0,15,240185,1.0,0.732143,0.845361,1.0,0.0,0.732143
321
+ csy_Latn,146,146,2,0,240093,0.986486,1.0,0.993197,0.999992,8.330036,1.0
322
+ cta_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
323
+ ctd_Latn,196,196,36,0,240009,0.844828,1.0,0.915888,0.99985,149.97188,1.0
324
+ cto_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
325
+ ctp_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
326
+ ctu_Latn,243,242,0,1,239998,1.0,0.995885,0.997938,1.0,0.0,0.995885
327
+ cub_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
328
+ cui_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
329
+ cuk_Latn,245,245,1,0,239995,0.995935,1.0,0.997963,0.999996,4.166736,1.0
330
+ cul_Latn,9,9,0,0,240232,1.0,1.0,1.0,1.0,0.0,1.0
331
+ cut_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
332
+ cux_Latn,54,54,0,0,240187,1.0,1.0,1.0,1.0,0.0,1.0
333
+ cwe_Latn,115,115,3,0,240123,0.974576,1.0,0.987124,0.999988,12.493441,1.0
334
+ cwt_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
335
+ cya_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
336
+ cym_Latn,189,189,0,0,240052,1.0,1.0,1.0,1.0,0.0,1.0
337
+ czt_Latn,135,135,11,0,240095,0.924658,1.0,0.960854,0.999954,45.813099,1.0
338
+ daa_Latn,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
339
+ dad_Latn,142,142,1,0,240098,0.993007,1.0,0.996491,0.999996,4.164949,1.0
340
+ daf_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
341
+ dag_Latn,149,131,116,18,239976,0.530364,0.879195,0.661616,0.999517,483.148127,0.879195
342
+ dah_Latn,172,172,1,0,240068,0.99422,1.0,0.997101,0.999996,4.165469,1.0
343
+ dak_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
344
+ dan_Latn,242,237,20,5,239979,0.922179,0.979339,0.9499,0.999917,83.333681,0.979339
345
+ dar_Cyrl,227,227,0,0,240014,1.0,1.0,1.0,1.0,0.0,1.0
346
+ ded_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
347
+ des_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
348
+ deu_Latn,356,356,50,0,239835,0.876847,1.0,0.934383,0.999792,208.433208,1.0
349
+ dga_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
350
+ dgc_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
351
+ dgi_Latn,81,81,0,0,240160,1.0,1.0,1.0,1.0,0.0,1.0
352
+ dgr_Latn,305,305,0,0,239936,1.0,1.0,1.0,1.0,0.0,1.0
353
+ dgz_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
354
+ dhm_Latn,59,59,4,0,240178,0.936508,1.0,0.967213,0.999983,16.654037,1.0
355
+ dhv_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
356
+ dig_Latn,224,224,2,0,240015,0.99115,1.0,0.995556,0.999992,8.332743,1.0
357
+ dik_Latn,350,350,0,0,239891,1.0,1.0,1.0,1.0,0.0,1.0
358
+ diq_Latn,134,134,21,0,240086,0.864516,1.0,0.927336,0.999913,87.461007,1.0
359
+ div_Thaa,238,238,15,0,239988,0.940711,1.0,0.96945,0.999938,62.499219,1.0
360
+ dje_Latn,131,127,0,4,240110,1.0,0.969466,0.984496,1.0,0.0,0.969466
361
+ djk_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
362
+ djr_Latn,156,156,1,0,240084,0.993631,1.0,0.996805,0.999996,4.165191,1.0
363
+ dks_Latn,3,3,0,0,240238,1.0,1.0,1.0,1.0,0.0,1.0
364
+ dng_Cyrl,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
365
+ dnj_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
366
+ dnw_Latn,22,22,0,0,240219,1.0,1.0,1.0,1.0,0.0,1.0
367
+ dob_Latn,77,77,0,0,240164,1.0,1.0,1.0,1.0,0.0,1.0
368
+ doi_Deva,254,254,0,0,239987,1.0,1.0,1.0,1.0,0.0,1.0
369
+ dop_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
370
+ dos_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
371
+ drg_Latn,13,13,0,0,240228,1.0,1.0,1.0,1.0,0.0,1.0
372
+ dru_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
373
+ dsb_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
374
+ dtp_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
375
+ dts_Latn,113,113,1,0,240127,0.991228,1.0,0.995595,0.999996,4.164446,1.0
376
+ dua_Latn,176,176,2,0,240063,0.988764,1.0,0.99435,0.999992,8.331077,1.0
377
+ duo_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
378
+ dur_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
379
+ dwr_Latn,144,144,2,0,240095,0.986301,1.0,0.993103,0.999992,8.329967,1.0
380
+ dww_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
381
+ dyi_Latn,249,249,0,0,239992,1.0,1.0,1.0,1.0,0.0,1.0
382
+ dyo_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
383
+ dyu_Latn,390,390,0,0,239851,1.0,1.0,1.0,1.0,0.0,1.0
384
+ dzo_Tibt,346,346,57,0,239838,0.858561,1.0,0.923899,0.999762,237.603952,1.0
385
+ ebk_Latn,24,24,0,0,240217,1.0,1.0,1.0,1.0,0.0,1.0
386
+ efi_Latn,268,268,0,0,239973,1.0,1.0,1.0,1.0,0.0,1.0
387
+ ekk_Latn,419,419,6,0,239816,0.985882,1.0,0.992891,0.999975,25.018555,1.0
388
+ eko_Latn,136,136,1,0,240104,0.992701,1.0,0.996337,0.999996,4.164845,1.0
389
+ ell_Grek,394,393,52,1,239795,0.883146,0.997462,0.93683,0.999783,216.80488,0.997462
390
+ emi_Latn,161,161,0,0,240080,1.0,1.0,1.0,1.0,0.0,1.0
391
+ eml_Latn,198,198,5,0,240038,0.975369,1.0,0.987531,0.999979,20.829601,1.0
392
+ emp_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
393
+ enb_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
394
+ eng_Latn,1444,1155,92,289,238705,0.926223,0.799861,0.858417,0.999615,385.264471,0.799861
395
+ enl_Latn,24,24,1,0,240216,0.96,1.0,0.979592,0.999996,4.162903,1.0
396
+ enm_Latn,81,58,1,23,240159,0.983051,0.716049,0.828571,0.999996,4.163891,0.716049
397
+ enq_Latn,222,222,1,0,240018,0.995516,1.0,0.997753,0.999996,4.166337,1.0
398
+ epo_Latn,294,293,0,1,239947,1.0,0.996599,0.998296,1.0,0.0,0.996599
399
+ eri_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
400
+ ese_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
401
+ esi_Latn,9,9,5,0,240227,0.642857,1.0,0.782609,0.999979,20.813214,1.0
402
+ esk_Latn,117,117,26,0,240098,0.818182,1.0,0.9,0.999892,108.27739,1.0
403
+ ess_Latn,10,10,3,0,240228,0.769231,1.0,0.869565,0.999988,12.48798,1.0
404
+ esu_Latn,232,232,1,0,240008,0.995708,1.0,0.997849,0.999996,4.16651,1.0
405
+ etr_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
406
+ eus_Latn,254,254,7,0,239980,0.97318,1.0,0.986408,0.999971,29.168247,1.0
407
+ eve_Cyrl,77,61,1,16,240163,0.983871,0.792208,0.877698,0.999996,4.163821,0.792208
408
+ ewe_Latn,308,308,1,0,239932,0.996764,1.0,0.998379,0.999996,4.16783,1.0
409
+ ewo_Latn,134,105,0,29,240107,1.0,0.783582,0.878661,1.0,0.0,0.783582
410
+ ext_Latn,139,139,2,0,240100,0.985816,1.0,0.992857,0.999992,8.329793,1.0
411
+ eza_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
412
+ faa_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
413
+ fai_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
414
+ fal_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
415
+ fan_Latn,57,57,12,0,240172,0.826087,1.0,0.904762,0.99995,49.961696,1.0
416
+ fao_Latn,237,237,0,0,240004,1.0,1.0,1.0,1.0,0.0,1.0
417
+ far_Latn,43,43,0,0,240198,1.0,1.0,1.0,1.0,0.0,1.0
418
+ fas_Arab,396,385,50,11,239795,0.885057,0.972222,0.926594,0.999792,208.467969,0.972222
419
+ fat_Latn,396,389,7,7,239838,0.982323,0.982323,0.982323,0.999971,29.185516,0.982323
420
+ ffm_Latn,104,59,10,45,240127,0.855072,0.567308,0.682081,0.999958,41.642896,0.567308
421
+ fij_Latn,344,344,0,0,239897,1.0,1.0,1.0,1.0,0.0,1.0
422
+ fil_Latn,137,133,1,4,240103,0.992537,0.970803,0.98155,0.999996,4.164862,0.970803
423
+ fin_Latn,368,368,6,0,239867,0.983957,1.0,0.991914,0.999975,25.013236,1.0
424
+ fit_Latn,106,106,19,0,240116,0.848,1.0,0.917749,0.999921,79.12216,1.0
425
+ fkv_Latn,156,129,4,27,240081,0.969925,0.826923,0.892734,0.999983,16.660766,0.826923
426
+ fon_Latn,180,180,0,0,240061,1.0,1.0,1.0,1.0,0.0,1.0
427
+ for_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
428
+ fra_Latn,1652,1509,91,143,238498,0.943125,0.913438,0.928044,0.999619,381.409034,0.913438
429
+ frd_Latn,51,51,0,0,240190,1.0,1.0,1.0,1.0,0.0,1.0
430
+ fro_Latn,287,236,3,51,239951,0.987448,0.8223,0.897338,0.999987,12.502396,0.8223
431
+ frp_Latn,137,95,56,42,240048,0.629139,0.693431,0.659722,0.999767,233.232266,0.693431
432
+ frr_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
433
+ fry_Latn,241,241,0,0,240000,1.0,1.0,1.0,1.0,0.0,1.0
434
+ fub_Latn,16,16,4,0,240221,0.8,1.0,0.888889,0.999983,16.651056,1.0
435
+ fue_Latn,25,25,0,0,240216,1.0,1.0,1.0,1.0,0.0,1.0
436
+ fuf_Latn,166,166,24,0,240051,0.873684,1.0,0.932584,0.9999,99.96876,1.0
437
+ fuh_Latn,146,146,27,0,240068,0.843931,1.0,0.915361,0.999888,112.455486,1.0
438
+ fur_Latn,221,221,2,0,240018,0.991031,1.0,0.995495,0.999992,8.332639,1.0
439
+ fuv_Arab,9,9,1,0,240231,0.9,1.0,0.947368,0.999996,4.162643,1.0
440
+ fuv_Latn,164,128,13,36,240064,0.907801,0.780488,0.839344,0.999946,54.149294,0.780488
441
+ gaa_Latn,168,166,0,2,240073,1.0,0.988095,0.994012,1.0,0.0,0.988095
442
+ gag_Cyrl,128,103,7,25,240106,0.936364,0.804688,0.865546,0.999971,29.15294,0.804688
443
+ gag_Latn,41,41,2,0,240198,0.953488,1.0,0.97619,0.999992,8.326395,1.0
444
+ gah_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
445
+ gai_Latn,175,175,0,0,240066,1.0,1.0,1.0,1.0,0.0,1.0
446
+ gam_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
447
+ gaw_Latn,151,151,1,0,240089,0.993421,1.0,0.9967,0.999996,4.165105,1.0
448
+ gaz_Latn,441,419,33,22,239767,0.926991,0.950113,0.93841,0.999862,137.614679,0.950113
449
+ gbi_Latn,81,81,0,0,240160,1.0,1.0,1.0,1.0,0.0,1.0
450
+ gbo_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
451
+ gcf_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
452
+ gcr_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
453
+ gde_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
454
+ gdg_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
455
+ gdn_Latn,156,156,0,0,240085,1.0,1.0,1.0,1.0,0.0,1.0
456
+ gdr_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
457
+ geb_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
458
+ gfk_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
459
+ ghs_Latn,125,125,1,0,240115,0.992063,1.0,0.996016,0.999996,4.164654,1.0
460
+ gil_Latn,298,298,0,0,239943,1.0,1.0,1.0,1.0,0.0,1.0
461
+ gjn_Latn,85,78,1,7,240155,0.987342,0.917647,0.95122,0.999996,4.16396,0.917647
462
+ gkn_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
463
+ gla_Latn,223,223,2,0,240016,0.991111,1.0,0.995536,0.999992,8.332708,1.0
464
+ gle_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
465
+ glg_Latn,215,215,17,0,240009,0.926724,1.0,0.961969,0.999929,70.825661,1.0
466
+ glk_Arab,319,250,24,69,239898,0.912409,0.783699,0.84317,0.9999,100.032511,0.783699
467
+ glv_Latn,357,357,0,0,239884,1.0,1.0,1.0,1.0,0.0,1.0
468
+ gmh_Latn,177,116,2,61,240062,0.983051,0.655367,0.786441,0.999992,8.331112,0.655367
469
+ gmv_Ethi,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
470
+ gmv_Latn,134,134,3,0,240104,0.978102,1.0,0.98893,0.999988,12.49443,1.0
471
+ gnb_Latn,45,45,11,0,240185,0.803571,1.0,0.891089,0.999954,45.795933,1.0
472
+ gnd_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
473
+ gng_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
474
+ gnn_Latn,191,191,0,0,240050,1.0,1.0,1.0,1.0,0.0,1.0
475
+ gnw_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
476
+ gof_Ethi,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
477
+ gof_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
478
+ gog_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
479
+ goh_Latn,93,71,2,22,240146,0.972603,0.763441,0.855422,0.999992,8.328198,0.763441
480
+ gom_Deva,170,170,9,0,240062,0.949721,1.0,0.974212,0.999963,37.48891,1.0
481
+ gom_Latn,221,221,18,0,240002,0.924686,1.0,0.96087,0.999925,74.993751,1.0
482
+ gor_Latn,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
483
+ gos_Latn,74,74,1,0,240166,0.986667,1.0,0.993289,0.999996,4.163769,1.0
484
+ got_Goth,70,70,5,0,240166,0.933333,1.0,0.965517,0.999979,20.8185,1.0
485
+ grc_Grek,317,317,0,0,239924,1.0,1.0,1.0,1.0,0.0,1.0
486
+ grt_Beng,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
487
+ gso_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
488
+ gsw_Latn,208,208,22,0,240011,0.904348,1.0,0.949772,0.999908,91.654064,1.0
489
+ gub_Latn,180,180,0,0,240061,1.0,1.0,1.0,1.0,0.0,1.0
490
+ guc_Latn,252,252,0,0,239989,1.0,1.0,1.0,1.0,0.0,1.0
491
+ gug_Latn,228,228,2,0,240011,0.991304,1.0,0.995633,0.999992,8.332882,1.0
492
+ guh_Latn,207,207,0,0,240034,1.0,1.0,1.0,1.0,0.0,1.0
493
+ gui_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
494
+ guj_Gujr,354,354,0,0,239887,1.0,1.0,1.0,1.0,0.0,1.0
495
+ guj_Latn,42,36,13,6,240186,0.734694,0.857143,0.791209,0.999946,54.121791,0.857143
496
+ guk_Ethi,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
497
+ gul_Latn,136,136,1,0,240104,0.992701,1.0,0.996337,0.999996,4.164845,1.0
498
+ gum_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
499
+ gun_Latn,54,54,0,0,240187,1.0,1.0,1.0,1.0,0.0,1.0
500
+ guo_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
501
+ guq_Latn,18,18,1,0,240222,0.947368,1.0,0.972973,0.999996,4.162799,1.0
502
+ gur_Latn,161,159,2,2,240078,0.987578,0.987578,0.987578,0.999992,8.330556,0.987578
503
+ guw_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
504
+ gux_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
505
+ guz_Latn,232,232,1,0,240008,0.995708,1.0,0.997849,0.999996,4.16651,1.0
506
+ gvc_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
507
+ gvf_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
508
+ gvl_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
509
+ gvn_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
510
+ gwi_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
511
+ gym_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
512
+ gyr_Latn,48,48,0,0,240193,1.0,1.0,1.0,1.0,0.0,1.0
513
+ hac_Arab,382,330,5,52,239854,0.985075,0.863874,0.920502,0.999979,20.84558,0.863874
514
+ hae_Latn,75,44,15,31,240151,0.745763,0.586667,0.656716,0.999938,62.456801,0.586667
515
+ hag_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
516
+ hak_Hani,29,21,1,8,240211,0.954545,0.724138,0.823529,0.999996,4.162989,0.724138
517
+ hak_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
518
+ hat_Latn,338,337,2,1,239901,0.9941,0.997041,0.995569,0.999992,8.336703,0.997041
519
+ hau_Latn,367,366,6,1,239868,0.983871,0.997275,0.990528,0.999975,25.013132,0.997275
520
+ hav_Latn,61,61,3,0,240177,0.953125,1.0,0.976,0.999988,12.490632,1.0
521
+ haw_Latn,214,214,1,0,240026,0.995349,1.0,0.997669,0.999996,4.166198,1.0
522
+ hay_Latn,92,92,37,0,240112,0.713178,1.0,0.832579,0.999846,154.071014,1.0
523
+ hbo_Hebr,189,189,6,0,240046,0.969231,1.0,0.984375,0.999975,24.994585,1.0
524
+ hch_Latn,259,259,0,0,239982,1.0,1.0,1.0,1.0,0.0,1.0
525
+ heb_Hebr,203,203,3,0,240035,0.985437,1.0,0.992665,0.999988,12.498021,1.0
526
+ heg_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
527
+ heh_Latn,135,135,1,0,240105,0.992647,1.0,0.99631,0.999996,4.164827,1.0
528
+ her_Latn,235,233,0,2,240006,1.0,0.991489,0.995726,1.0,0.0,0.991489
529
+ hif_Latn,115,73,57,42,240069,0.561538,0.634783,0.595918,0.999763,237.375378,0.634783
530
+ hig_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
531
+ hil_Latn,266,266,3,0,239972,0.988848,1.0,0.994393,0.999987,12.501302,1.0
532
+ hin_Deva,392,306,53,86,239796,0.852368,0.780612,0.814913,0.999779,220.972362,0.780612
533
+ hin_Latn,164,91,40,73,240037,0.694656,0.554878,0.616949,0.999833,166.613212,0.554878
534
+ hix_Latn,222,222,0,0,240019,1.0,1.0,1.0,1.0,0.0,1.0
535
+ hla_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
536
+ hmo_Latn,143,143,0,0,240098,1.0,1.0,1.0,1.0,0.0,1.0
537
+ hmr_Latn,283,234,0,49,239958,1.0,0.826855,0.905222,1.0,0.0,0.826855
538
+ hne_Deva,198,198,7,0,240036,0.965854,1.0,0.98263,0.999971,29.161442,1.0
539
+ hnj_Latn,300,300,0,0,239941,1.0,1.0,1.0,1.0,0.0,1.0
540
+ hnn_Latn,32,24,0,8,240209,1.0,0.75,0.857143,1.0,0.0,0.75
541
+ hns_Latn,73,61,7,12,240161,0.897059,0.835616,0.865248,0.999971,29.146264,0.835616
542
+ hop_Latn,8,8,2,0,240231,0.8,1.0,0.888889,0.999992,8.325251,1.0
543
+ hot_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
544
+ hra_Latn,56,56,3,0,240182,0.949153,1.0,0.973913,0.999988,12.490372,1.0
545
+ hrv_Latn,168,168,20,0,240053,0.893617,1.0,0.94382,0.999917,83.307994,1.0
546
+ hrx_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
547
+ hsb_Latn,269,269,4,0,239968,0.985348,1.0,0.99262,0.999983,16.668611,1.0
548
+ hto_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
549
+ hub_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
550
+ hui_Latn,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
551
+ hun_Latn,576,576,1,0,239664,0.998267,1.0,0.999133,0.999996,4.172491,1.0
552
+ hus_Latn,109,106,1,3,240131,0.990654,0.972477,0.981481,0.999996,4.164376,0.972477
553
+ huu_Latn,72,72,0,0,240169,1.0,1.0,1.0,1.0,0.0,1.0
554
+ huv_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
555
+ hvn_Latn,11,11,0,0,240230,1.0,1.0,1.0,1.0,0.0,1.0
556
+ hwc_Latn,165,165,5,0,240071,0.970588,1.0,0.985075,0.999979,20.826738,1.0
557
+ hye_Armn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
558
+ hyw_Armn,233,233,0,0,240008,1.0,1.0,1.0,1.0,0.0,1.0
559
+ ian_Latn,112,112,2,0,240127,0.982456,1.0,0.99115,0.999992,8.328857,1.0
560
+ iba_Latn,283,283,0,0,239958,1.0,1.0,1.0,1.0,0.0,1.0
561
+ ibg_Latn,85,85,0,0,240156,1.0,1.0,1.0,1.0,0.0,1.0
562
+ ibo_Latn,257,257,1,0,239983,0.996124,1.0,0.998058,0.999996,4.166944,1.0
563
+ icr_Latn,24,12,1,12,240216,0.923077,0.5,0.648649,0.999996,4.162903,0.5
564
+ ido_Latn,270,270,1,0,239970,0.99631,1.0,0.998152,0.999996,4.16717,1.0
565
+ idu_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
566
+ ifb_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
567
+ ife_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
568
+ ifk_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
569
+ ifu_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
570
+ ify_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
571
+ ige_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
572
+ ign_Latn,44,44,0,0,240197,1.0,1.0,1.0,1.0,0.0,1.0
573
+ ike_Cans,310,310,0,0,239931,1.0,1.0,1.0,1.0,0.0,1.0
574
+ ikk_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
575
+ ikt_Latn,283,227,0,56,239958,1.0,0.80212,0.890196,1.0,0.0,0.80212
576
+ ikw_Latn,21,21,0,0,240220,1.0,1.0,1.0,1.0,0.0,1.0
577
+ ile_Latn,252,252,1,0,239988,0.996047,1.0,0.99802,0.999996,4.166858,1.0
578
+ ilo_Latn,252,252,0,0,239989,1.0,1.0,1.0,1.0,0.0,1.0
579
+ imo_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
580
+ ina_Latn,234,234,5,0,240002,0.979079,1.0,0.989429,0.999979,20.832726,1.0
581
+ inb_Latn,89,89,1,0,240151,0.988889,1.0,0.994413,0.999996,4.164029,1.0
582
+ ind_Latn,335,335,55,0,239851,0.858974,1.0,0.924138,0.999771,229.256459,1.0
583
+ inh_Cyrl,139,139,9,0,240093,0.939189,1.0,0.968641,0.999963,37.484069,1.0
584
+ ino_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
585
+ iou_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
586
+ ipi_Latn,63,63,0,0,240178,1.0,1.0,1.0,1.0,0.0,1.0
587
+ irk_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
588
+ isd_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
589
+ ish_Latn,21,21,0,0,240220,1.0,1.0,1.0,1.0,0.0,1.0
590
+ isl_Latn,276,276,31,0,239934,0.899023,1.0,0.946827,0.999871,129.185506,1.0
591
+ iso_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
592
+ ita_Latn,342,333,29,9,239870,0.91989,0.973684,0.946023,0.999879,120.884205,0.973684
593
+ itv_Latn,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
594
+ ium_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
595
+ ivv_Latn,17,17,0,0,240224,1.0,1.0,1.0,1.0,0.0,1.0
596
+ iws_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
597
+ ixl_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
598
+ izr_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
599
+ izz_Latn,38,38,1,0,240202,0.974359,1.0,0.987013,0.999996,4.163145,1.0
600
+ jac_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
601
+ jae_Latn,211,211,0,0,240030,1.0,1.0,1.0,1.0,0.0,1.0
602
+ jam_Latn,196,177,29,19,240016,0.859223,0.903061,0.880597,0.999879,120.810681,0.903061
603
+ jav_Latn,158,158,2,0,240081,0.9875,1.0,0.993711,0.999992,8.330452,1.0
604
+ jbo_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
605
+ jbu_Latn,87,87,1,0,240153,0.988636,1.0,0.994286,0.999996,4.163995,1.0
606
+ jic_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
607
+ jiv_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
608
+ jpn_Jpan,323,323,39,0,239879,0.892265,1.0,0.943066,0.999837,162.55554,1.0
609
+ jra_Latn,177,177,2,0,240062,0.988827,1.0,0.994382,0.999992,8.331112,1.0
610
+ jvn_Latn,115,115,1,0,240125,0.991379,1.0,0.995671,0.999996,4.16448,1.0
611
+ kaa_Cyrl,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
612
+ kaa_Latn,182,137,0,45,240059,1.0,0.752747,0.858934,1.0,0.0,0.752747
613
+ kab_Latn,165,165,5,0,240071,0.970588,1.0,0.985075,0.999979,20.826738,1.0
614
+ kac_Latn,216,216,0,0,240025,1.0,1.0,1.0,1.0,0.0,1.0
615
+ kal_Latn,369,369,19,0,239853,0.951031,1.0,0.974901,0.999921,79.208911,1.0
616
+ kam_Latn,272,257,0,15,239969,1.0,0.944853,0.971645,1.0,0.0,0.944853
617
+ kan_Knda,601,594,1,7,239639,0.998319,0.988353,0.993311,0.999996,4.172926,0.988353
618
+ kan_Latn,264,240,4,24,239973,0.983607,0.909091,0.944882,0.999983,16.668264,0.909091
619
+ kao_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
620
+ kaq_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
621
+ kas_Arab,118,118,1,0,240122,0.991597,1.0,0.995781,0.999996,4.164532,1.0
622
+ kas_Deva,47,26,5,21,240189,0.83871,0.553191,0.666667,0.999979,20.816507,0.553191
623
+ kat_Geor,324,324,15,0,239902,0.955752,1.0,0.977376,0.999937,62.521622,1.0
624
+ kaz_Cyrl,340,340,2,0,239899,0.994152,1.0,0.997067,0.999992,8.336772,1.0
625
+ kbc_Latn,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
626
+ kbd_Cyrl,238,238,1,0,240002,0.995816,1.0,0.997904,0.999996,4.166615,1.0
627
+ kbh_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
628
+ kbm_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
629
+ kbp_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
630
+ kbq_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
631
+ kbr_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
632
+ kby_Latn,7,7,29,0,240205,0.194444,1.0,0.325581,0.999879,120.715636,1.0
633
+ kca_Cyrl,345,345,1,0,239895,0.99711,1.0,0.998553,0.999996,4.168473,1.0
634
+ kcg_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
635
+ kck_Latn,82,82,8,0,240151,0.911111,1.0,0.953488,0.999967,33.311265,1.0
636
+ kdc_Latn,92,92,1,0,240148,0.989247,1.0,0.994595,0.999996,4.164081,1.0
637
+ kde_Latn,178,178,1,0,240062,0.994413,1.0,0.997199,0.999996,4.165573,1.0
638
+ kdh_Latn,34,34,0,0,240207,1.0,1.0,1.0,1.0,0.0,1.0
639
+ kdi_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
640
+ kdl_Latn,64,64,1,0,240176,0.984615,1.0,0.992248,0.999996,4.163596,1.0
641
+ kea_Latn,205,205,1,0,240035,0.995146,1.0,0.997567,0.999996,4.166042,1.0
642
+ kek_Latn,183,183,1,0,240057,0.994565,1.0,0.997275,0.999996,4.16566,1.0
643
+ ken_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
644
+ keo_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
645
+ kew_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
646
+ kez_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
647
+ kff_Telu,9,9,1,0,240231,0.9,1.0,0.947368,0.999996,4.162643,1.0
648
+ kgf_Latn,166,166,0,0,240075,1.0,1.0,1.0,1.0,0.0,1.0
649
+ kgk_Latn,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
650
+ kgp_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
651
+ kha_Latn,191,191,0,0,240050,1.0,1.0,1.0,1.0,0.0,1.0
652
+ khk_Cyrl,262,262,1,0,239978,0.996198,1.0,0.998095,0.999996,4.167031,1.0
653
+ khm_Khmr,187,187,4,0,240050,0.979058,1.0,0.989418,0.999983,16.662918,1.0
654
+ khs_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
655
+ khz_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
656
+ kij_Latn,226,226,0,0,240015,1.0,1.0,1.0,1.0,0.0,1.0
657
+ kik_Latn,193,193,0,0,240048,1.0,1.0,1.0,1.0,0.0,1.0
658
+ kin_Latn,210,203,1,7,240030,0.995098,0.966667,0.980676,0.999996,4.166129,0.966667
659
+ kir_Cyrl,242,242,2,0,239997,0.991803,1.0,0.995885,0.999992,8.333368,1.0
660
+ kiu_Latn,293,238,31,55,239917,0.884758,0.812287,0.846975,0.999871,129.194659,0.812287
661
+ kix_Latn,153,153,0,0,240088,1.0,1.0,1.0,1.0,0.0,1.0
662
+ kjb_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
663
+ kje_Latn,119,119,5,0,240117,0.959677,1.0,0.979424,0.999979,20.822748,1.0
664
+ kjh_Cyrl,154,154,4,0,240083,0.974684,1.0,0.987179,0.999983,16.660627,1.0
665
+ kjs_Latn,201,201,0,0,240040,1.0,1.0,1.0,1.0,0.0,1.0
666
+ kkc_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
667
+ kki_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
668
+ kkj_Latn,127,127,4,0,240110,0.969466,1.0,0.984496,0.999983,16.658754,1.0
669
+ kkl_Latn,84,84,0,0,240157,1.0,1.0,1.0,1.0,0.0,1.0
670
+ klt_Latn,28,28,1,0,240212,0.965517,1.0,0.982456,0.999996,4.162972,1.0
671
+ klv_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
672
+ kmb_Latn,119,119,3,0,240119,0.97541,1.0,0.987552,0.999988,12.493649,1.0
673
+ kmg_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
674
+ kmh_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
675
+ kmk_Latn,20,20,5,0,240216,0.8,1.0,0.888889,0.999979,20.814167,1.0
676
+ kmm_Latn,19,19,1,0,240221,0.95,1.0,0.974359,0.999996,4.162816,1.0
677
+ kmo_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
678
+ kmr_Cyrl,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
679
+ kmr_Latn,289,289,27,0,239925,0.914557,1.0,0.955372,0.999887,112.522505,1.0
680
+ kms_Latn,98,98,1,0,240142,0.989899,1.0,0.994924,0.999996,4.164186,1.0
681
+ kmu_Latn,142,142,0,0,240099,1.0,1.0,1.0,1.0,0.0,1.0
682
+ knc_Arab,68,51,5,17,240168,0.910714,0.75,0.822581,0.999979,20.818327,0.75
683
+ knc_Latn,293,266,0,27,239948,1.0,0.90785,0.951699,1.0,0.0,0.90785
684
+ kne_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
685
+ knf_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
686
+ kng_Latn,362,362,0,0,239879,1.0,1.0,1.0,1.0,0.0,1.0
687
+ knj_Latn,188,188,0,0,240053,1.0,1.0,1.0,1.0,0.0,1.0
688
+ knk_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
689
+ knv_Latn,153,153,0,0,240088,1.0,1.0,1.0,1.0,0.0,1.0
690
+ koi_Cyrl,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
691
+ koo_Latn,297,292,2,5,239942,0.993197,0.983165,0.988156,0.999992,8.335278,0.983165
692
+ kor_Hang,265,265,5,0,239971,0.981481,1.0,0.990654,0.999979,20.835417,1.0
693
+ kos_Latn,144,144,2,0,240095,0.986301,1.0,0.993103,0.999992,8.329967,1.0
694
+ kpe_Latn,177,177,1,0,240063,0.994382,1.0,0.997183,0.999996,4.165556,1.0
695
+ kpf_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
696
+ kpg_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
697
+ kpj_Latn,8,8,0,0,240233,1.0,1.0,1.0,1.0,0.0,1.0
698
+ kpr_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
699
+ kpv_Cyrl,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
700
+ kpw_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
701
+ kpx_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
702
+ kpz_Latn,89,85,0,4,240152,1.0,0.955056,0.977011,1.0,0.0,0.955056
703
+ kqc_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
704
+ kqe_Latn,43,43,1,0,240197,0.977273,1.0,0.988506,0.999996,4.163232,1.0
705
+ kqf_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
706
+ kqn_Latn,286,275,3,11,239952,0.989209,0.961538,0.975177,0.999987,12.502344,0.961538
707
+ kqp_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
708
+ kqw_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
709
+ krc_Cyrl,159,159,1,0,240081,0.99375,1.0,0.996865,0.999996,4.165244,1.0
710
+ kri_Latn,161,160,0,1,240080,1.0,0.993789,0.996885,1.0,0.0,0.993789
711
+ krj_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
712
+ krl_Latn,199,199,2,0,240040,0.99005,1.0,0.995,0.999992,8.331875,1.0
713
+ kru_Deva,56,56,4,0,240181,0.933333,1.0,0.965517,0.999983,16.653829,1.0
714
+ ksc_Latn,14,10,0,4,240227,1.0,0.714286,0.833333,1.0,0.0,0.714286
715
+ ksd_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
716
+ ksh_Latn,169,169,1,0,240071,0.994118,1.0,0.99705,0.999996,4.165417,1.0
717
+ ksp_Latn,20,20,1,0,240220,0.952381,1.0,0.97561,0.999996,4.162833,1.0
718
+ ksr_Latn,127,127,1,0,240113,0.992188,1.0,0.996078,0.999996,4.164688,1.0
719
+ kss_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
720
+ ksw_Mymr,299,299,0,0,239942,1.0,1.0,1.0,1.0,0.0,1.0
721
+ ktj_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
722
+ kto_Latn,144,144,1,0,240096,0.993103,1.0,0.99654,0.999996,4.164983,1.0
723
+ ktu_Latn,120,120,1,0,240120,0.991736,1.0,0.995851,0.999996,4.164567,1.0
724
+ ktz_Latn,56,55,0,1,240185,1.0,0.982143,0.990991,1.0,0.0,0.982143
725
+ kua_Latn,476,466,3,10,239762,0.993603,0.978992,0.986243,0.999987,12.512252,0.978992
726
+ kud_Latn,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
727
+ kue_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
728
+ kum_Cyrl,169,169,1,0,240071,0.994118,1.0,0.99705,0.999996,4.165417,1.0
729
+ kup_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
730
+ kus_Latn,45,45,0,0,240196,1.0,1.0,1.0,1.0,0.0,1.0
731
+ kvg_Latn,53,53,0,0,240188,1.0,1.0,1.0,1.0,0.0,1.0
732
+ kvn_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
733
+ kwd_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
734
+ kwf_Latn,150,150,0,0,240091,1.0,1.0,1.0,1.0,0.0,1.0
735
+ kwi_Latn,83,83,1,0,240157,0.988095,1.0,0.994012,0.999996,4.163925,1.0
736
+ kwj_Latn,182,182,0,0,240059,1.0,1.0,1.0,1.0,0.0,1.0
737
+ kwn_Latn,275,275,2,0,239964,0.99278,1.0,0.996377,0.999992,8.334514,1.0
738
+ kwy_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
739
+ kxc_Ethi,53,53,0,0,240188,1.0,1.0,1.0,1.0,0.0,1.0
740
+ kxw_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
741
+ kyc_Latn,219,219,0,0,240022,1.0,1.0,1.0,1.0,0.0,1.0
742
+ kyf_Latn,105,105,0,0,240136,1.0,1.0,1.0,1.0,0.0,1.0
743
+ kyg_Latn,201,201,0,0,240040,1.0,1.0,1.0,1.0,0.0,1.0
744
+ kyq_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
745
+ kyu_Kali,215,215,0,0,240026,1.0,1.0,1.0,1.0,0.0,1.0
746
+ kyz_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
747
+ kze_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
748
+ kzj_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
749
+ lac_Latn,230,230,0,0,240011,1.0,1.0,1.0,1.0,0.0,1.0
750
+ lad_Hebr,16,16,0,0,240225,1.0,1.0,1.0,1.0,0.0,1.0
751
+ lad_Latn,302,302,1,0,239938,0.9967,1.0,0.998347,0.999996,4.167726,1.0
752
+ lai_Latn,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
753
+ laj_Latn,85,85,1,0,240155,0.988372,1.0,0.994152,0.999996,4.16396,1.0
754
+ lam_Latn,127,127,9,0,240105,0.933824,1.0,0.965779,0.999963,37.482196,1.0
755
+ lao_Laoo,335,335,10,0,239896,0.971014,1.0,0.985294,0.999958,41.682993,1.0
756
+ lat_Latn,282,282,0,0,239959,1.0,1.0,1.0,1.0,0.0,1.0
757
+ lbb_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
758
+ lbe_Cyrl,219,219,0,0,240022,1.0,1.0,1.0,1.0,0.0,1.0
759
+ lbj_Tibt,66,0,0,66,240175,0.0,0.0,0.0,1.0,0.0,0.0
760
+ lbk_Latn,48,48,0,0,240193,1.0,1.0,1.0,1.0,0.0,1.0
761
+ lcm_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
762
+ lcp_Thai,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
763
+ ldi_Latn,62,62,1,0,240178,0.984127,1.0,0.992,0.999996,4.163561,1.0
764
+ lee_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
765
+ lef_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
766
+ leh_Latn,106,106,11,0,240124,0.905983,1.0,0.950673,0.999954,45.807567,1.0
767
+ leu_Latn,157,157,0,0,240084,1.0,1.0,1.0,1.0,0.0,1.0
768
+ lew_Latn,155,155,1,0,240085,0.99359,1.0,0.996785,0.999996,4.165174,1.0
769
+ lex_Latn,163,163,0,0,240078,1.0,1.0,1.0,1.0,0.0,1.0
770
+ lez_Cyrl,134,134,5,0,240102,0.964029,1.0,0.981685,0.999979,20.824049,1.0
771
+ lfn_Cyrl,55,42,2,13,240184,0.954545,0.763636,0.848485,0.999992,8.32688,0.763636
772
+ lfn_Latn,150,150,0,0,240091,1.0,1.0,1.0,1.0,0.0,1.0
773
+ lgg_Latn,279,277,3,2,239959,0.989286,0.992832,0.991055,0.999987,12.501979,0.992832
774
+ lgl_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
775
+ lhu_Latn,167,167,0,0,240074,1.0,1.0,1.0,1.0,0.0,1.0
776
+ lia_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
777
+ lid_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
778
+ lif_Deva,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
779
+ lif_Limb,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
780
+ lij_Latn,245,245,4,0,239992,0.983936,1.0,0.991903,0.999983,16.666944,1.0
781
+ lim_Latn,196,196,1,0,240044,0.994924,1.0,0.997455,0.999996,4.165886,1.0
782
+ lin_Latn,215,214,1,1,240025,0.995349,0.995349,0.995349,0.999996,4.166215,0.995349
783
+ lip_Latn,33,33,0,0,240208,1.0,1.0,1.0,1.0,0.0,1.0
784
+ lis_Lisu,6,6,0,0,240235,1.0,1.0,1.0,1.0,0.0,1.0
785
+ lit_Latn,330,330,3,0,239908,0.990991,1.0,0.995475,0.999987,12.504637,1.0
786
+ liv_Latn,101,101,0,0,240140,1.0,1.0,1.0,1.0,0.0,1.0
787
+ ljp_Latn,112,112,0,0,240129,1.0,1.0,1.0,1.0,0.0,1.0
788
+ lki_Arab,15,8,11,7,240215,0.421053,0.533333,0.470588,0.999954,45.790214,0.533333
789
+ lld_Latn,275,275,0,0,239966,1.0,1.0,1.0,1.0,0.0,1.0
790
+ llg_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
791
+ lmk_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
792
+ lmo_Latn,276,276,16,0,239949,0.945205,1.0,0.971831,0.999933,66.67639,1.0
793
+ lmp_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
794
+ lnd_Latn,5,5,0,0,240236,1.0,1.0,1.0,1.0,0.0,1.0
795
+ log_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
796
+ loq_Latn,42,34,1,8,240198,0.971429,0.809524,0.883117,0.999996,4.163215,0.809524
797
+ loz_Latn,268,266,4,2,239969,0.985185,0.992537,0.988848,0.999983,16.668542,0.992537
798
+ lrc_Arab,40,30,12,10,240189,0.714286,0.75,0.731707,0.99995,49.95816,0.75
799
+ lsm_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
800
+ ltg_Latn,259,259,1,0,239981,0.996154,1.0,0.998073,0.999996,4.166979,1.0
801
+ ltz_Latn,251,251,0,0,239990,1.0,1.0,1.0,1.0,0.0,1.0
802
+ lua_Latn,346,346,2,0,239893,0.994253,1.0,0.997118,0.999992,8.336981,1.0
803
+ lub_Latn,147,147,4,0,240090,0.97351,1.0,0.986577,0.999983,16.660141,1.0
804
+ luc_Latn,67,67,0,0,240174,1.0,1.0,1.0,1.0,0.0,1.0
805
+ lue_Latn,327,324,4,3,239910,0.987805,0.990826,0.989313,0.999983,16.672641,0.990826
806
+ lug_Latn,405,396,3,9,239833,0.992481,0.977778,0.985075,0.999987,12.508548,0.977778
807
+ lun_Latn,86,84,0,2,240155,1.0,0.976744,0.988235,1.0,0.0,0.976744
808
+ luo_Latn,415,415,1,0,239825,0.997596,1.0,0.998797,0.999996,4.16969,1.0
809
+ lus_Latn,391,391,13,0,239837,0.967822,1.0,0.983648,0.999946,54.200542,1.0
810
+ lvs_Latn,298,298,3,0,239940,0.990033,1.0,0.994992,0.999987,12.502969,1.0
811
+ lwg_Latn,233,228,7,5,240001,0.970213,0.978541,0.974359,0.999971,29.165694,0.978541
812
+ lwo_Latn,41,41,0,0,240200,1.0,1.0,1.0,1.0,0.0,1.0
813
+ lww_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
814
+ lzh_Hani,143,82,0,61,240098,1.0,0.573427,0.728889,1.0,0.0,0.573427
815
+ maa_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
816
+ mad_Latn,183,183,3,0,240055,0.983871,1.0,0.99187,0.999988,12.49698,1.0
817
+ mag_Deva,97,97,3,0,240141,0.97,1.0,0.984772,0.999988,12.492504,1.0
818
+ mah_Latn,143,143,1,0,240097,0.993056,1.0,0.996516,0.999996,4.164966,1.0
819
+ mai_Deva,234,234,9,0,239998,0.962963,1.0,0.981132,0.999963,37.498906,1.0
820
+ maj_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
821
+ mak_Latn,94,83,0,11,240147,1.0,0.882979,0.937853,1.0,0.0,0.882979
822
+ mal_Latn,180,180,1,0,240060,0.994475,1.0,0.99723,0.999996,4.165608,1.0
823
+ mal_Mlym,338,338,0,0,239903,1.0,1.0,1.0,1.0,0.0,1.0
824
+ mam_Latn,233,233,0,0,240008,1.0,1.0,1.0,1.0,0.0,1.0
825
+ maq_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
826
+ mar_Deva,589,576,0,13,239652,1.0,0.977929,0.988841,1.0,0.0,0.977929
827
+ mar_Latn,98,79,2,19,240141,0.975309,0.806122,0.882682,0.999992,8.328371,0.806122
828
+ mas_Latn,154,152,1,2,240086,0.993464,0.987013,0.990228,0.999996,4.165157,0.987013
829
+ mau_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
830
+ mav_Latn,59,59,2,0,240180,0.967213,1.0,0.983333,0.999992,8.327019,1.0
831
+ maz_Latn,149,149,0,0,240092,1.0,1.0,1.0,1.0,0.0,1.0
832
+ mbb_Latn,212,212,0,0,240029,1.0,1.0,1.0,1.0,0.0,1.0
833
+ mbc_Latn,46,46,1,0,240194,0.978723,1.0,0.989247,0.999996,4.163284,1.0
834
+ mbd_Latn,14,14,0,0,240227,1.0,1.0,1.0,1.0,0.0,1.0
835
+ mbf_Latn,48,42,0,6,240193,1.0,0.875,0.933333,1.0,0.0,0.875
836
+ mbh_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
837
+ mbi_Latn,162,162,1,0,240078,0.993865,1.0,0.996923,0.999996,4.165296,1.0
838
+ mbj_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
839
+ mbl_Latn,210,210,0,0,240031,1.0,1.0,1.0,1.0,0.0,1.0
840
+ mbs_Latn,209,209,0,0,240032,1.0,1.0,1.0,1.0,0.0,1.0
841
+ mbt_Latn,165,165,0,0,240076,1.0,1.0,1.0,1.0,0.0,1.0
842
+ mca_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
843
+ mcb_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
844
+ mcd_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
845
+ mcf_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
846
+ mck_Latn,25,25,2,0,240214,0.925926,1.0,0.961538,0.999992,8.32584,1.0
847
+ mco_Latn,128,128,13,0,240100,0.907801,1.0,0.951673,0.999946,54.141175,1.0
848
+ mcp_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
849
+ mcq_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
850
+ mcu_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
851
+ mdf_Cyrl,217,217,3,0,240021,0.986364,1.0,0.993135,0.999988,12.49875,1.0
852
+ mdy_Ethi,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
853
+ med_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
854
+ mee_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
855
+ mej_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
856
+ mek_Latn,65,65,0,0,240176,1.0,1.0,1.0,1.0,0.0,1.0
857
+ men_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
858
+ meq_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
859
+ mer_Latn,97,96,1,1,240143,0.989691,0.989691,0.989691,0.999996,4.164168,0.989691
860
+ meu_Latn,82,82,0,0,240159,1.0,1.0,1.0,1.0,0.0,1.0
861
+ mfe_Latn,250,250,8,0,239983,0.968992,1.0,0.984252,0.999967,33.334583,1.0
862
+ mfi_Latn,115,115,1,0,240125,0.991379,1.0,0.995671,0.999996,4.16448,1.0
863
+ mfq_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
864
+ mfy_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
865
+ mfz_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
866
+ mgh_Latn,88,88,1,0,240152,0.988764,1.0,0.99435,0.999996,4.164012,1.0
867
+ mgr_Latn,119,119,5,0,240117,0.959677,1.0,0.979424,0.999979,20.822748,1.0
868
+ mhi_Latn,23,23,1,0,240217,0.958333,1.0,0.978723,0.999996,4.162885,1.0
869
+ mhl_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
870
+ mhr_Cyrl,291,291,0,0,239950,1.0,1.0,1.0,1.0,0.0,1.0
871
+ mhx_Latn,61,61,0,0,240180,1.0,1.0,1.0,1.0,0.0,1.0
872
+ mib_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
873
+ mic_Latn,255,255,2,0,239984,0.992218,1.0,0.996094,0.999992,8.333819,1.0
874
+ mie_Latn,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
875
+ mif_Latn,88,88,0,0,240153,1.0,1.0,1.0,1.0,0.0,1.0
876
+ mig_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
877
+ mih_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
878
+ mil_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
879
+ mim_Latn,16,16,0,0,240225,1.0,1.0,1.0,1.0,0.0,1.0
880
+ min_Latn,55,55,5,0,240181,0.916667,1.0,0.956522,0.999979,20.8172,1.0
881
+ mio_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
882
+ mip_Latn,17,17,0,0,240224,1.0,1.0,1.0,1.0,0.0,1.0
883
+ miq_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
884
+ mir_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
885
+ mit_Latn,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
886
+ miy_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
887
+ miz_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
888
+ mjc_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
889
+ mjw_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
890
+ mkd_Cyrl,331,331,4,0,239906,0.98806,1.0,0.993994,0.999983,16.672919,1.0
891
+ mkl_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
892
+ mkn_Latn,114,114,5,0,240122,0.957983,1.0,0.978541,0.999979,20.822315,1.0
893
+ mks_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
894
+ mlh_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
895
+ mlp_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
896
+ mlt_Latn,291,291,4,0,239946,0.986441,1.0,0.993174,0.999983,16.67014,1.0
897
+ mlu_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
898
+ mmn_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
899
+ mmo_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
900
+ mmx_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
901
+ mna_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
902
+ mnb_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
903
+ mni_Beng,304,304,0,0,239937,1.0,1.0,1.0,1.0,0.0,1.0
904
+ mni_Latn,280,280,4,0,239957,0.985915,1.0,0.992908,0.999983,16.669375,1.0
905
+ mni_Mtei,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
906
+ mnk_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
907
+ mns_Cyrl,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
908
+ mnw_Mymr,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
909
+ mny_Latn,56,48,2,8,240183,0.96,0.857143,0.90566,0.999992,8.326915,0.857143
910
+ mog_Latn,2,2,0,0,240239,1.0,1.0,1.0,1.0,0.0,1.0
911
+ moh_Latn,195,195,0,0,240046,1.0,1.0,1.0,1.0,0.0,1.0
912
+ mop_Latn,128,128,1,0,240112,0.992248,1.0,0.996109,0.999996,4.164706,1.0
913
+ mor_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
914
+ mos_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
915
+ mox_Latn,100,100,0,0,240141,1.0,1.0,1.0,1.0,0.0,1.0
916
+ mpm_Latn,177,177,0,0,240064,1.0,1.0,1.0,1.0,0.0,1.0
917
+ mpp_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
918
+ mps_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
919
+ mpt_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
920
+ mpx_Latn,205,205,0,0,240036,1.0,1.0,1.0,1.0,0.0,1.0
921
+ mqb_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
922
+ mqj_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
923
+ mqy_Latn,35,33,0,2,240206,1.0,0.942857,0.970588,1.0,0.0,0.942857
924
+ mri_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
925
+ mrj_Cyrl,120,120,1,0,240120,0.991736,1.0,0.995851,0.999996,4.164567,1.0
926
+ mrq_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
927
+ mrw_Latn,162,162,0,0,240079,1.0,1.0,1.0,1.0,0.0,1.0
928
+ msb_Latn,71,71,0,0,240170,1.0,1.0,1.0,1.0,0.0,1.0
929
+ msk_Latn,129,129,1,0,240111,0.992308,1.0,0.996139,0.999996,4.164723,1.0
930
+ msy_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
931
+ mta_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
932
+ mti_Latn,170,170,1,0,240070,0.994152,1.0,0.997067,0.999996,4.165434,1.0
933
+ mto_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
934
+ mtp_Latn,85,85,0,0,240156,1.0,1.0,1.0,1.0,0.0,1.0
935
+ muh_Latn,67,67,0,0,240174,1.0,1.0,1.0,1.0,0.0,1.0
936
+ mui_Latn,107,70,9,37,240125,0.886076,0.654206,0.752688,0.999963,37.479074,0.654206
937
+ mup_Deva,115,72,1,43,240125,0.986301,0.626087,0.765957,0.999996,4.16448,0.626087
938
+ mur_Latn,312,312,0,0,239929,1.0,1.0,1.0,1.0,0.0,1.0
939
+ mus_Latn,2,2,0,0,240239,1.0,1.0,1.0,1.0,0.0,1.0
940
+ mux_Latn,191,191,1,0,240049,0.994792,1.0,0.997389,0.999996,4.165799,1.0
941
+ muy_Latn,61,61,1,0,240179,0.983871,1.0,0.99187,0.999996,4.163544,1.0
942
+ mva_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
943
+ mvn_Latn,73,73,0,0,240168,1.0,1.0,1.0,1.0,0.0,1.0
944
+ mvp_Latn,22,22,0,0,240219,1.0,1.0,1.0,1.0,0.0,1.0
945
+ mwc_Latn,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
946
+ mwl_Latn,157,150,4,7,240080,0.974026,0.955414,0.96463,0.999983,16.660835,0.955414
947
+ mwn_Latn,121,121,1,0,240119,0.991803,1.0,0.995885,0.999996,4.164584,1.0
948
+ mwp_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
949
+ mwq_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
950
+ mwv_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
951
+ mww_Latn,235,235,0,0,240006,1.0,1.0,1.0,1.0,0.0,1.0
952
+ mxb_Latn,92,92,0,0,240149,1.0,1.0,1.0,1.0,0.0,1.0
953
+ mxp_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
954
+ mxq_Latn,87,87,0,0,240154,1.0,1.0,1.0,1.0,0.0,1.0
955
+ mxt_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
956
+ mxv_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
957
+ mya_Mymr,342,342,26,0,239873,0.929348,1.0,0.96338,0.999892,108.378943,1.0
958
+ myk_Latn,43,43,0,0,240198,1.0,1.0,1.0,1.0,0.0,1.0
959
+ myu_Latn,51,51,0,0,240190,1.0,1.0,1.0,1.0,0.0,1.0
960
+ myv_Cyrl,156,156,0,0,240085,1.0,1.0,1.0,1.0,0.0,1.0
961
+ myw_Latn,182,182,0,0,240059,1.0,1.0,1.0,1.0,0.0,1.0
962
+ myx_Latn,113,113,15,0,240113,0.882812,1.0,0.937759,0.999938,62.466684,1.0
963
+ myy_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
964
+ mza_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
965
+ mzh_Latn,26,25,0,1,240215,1.0,0.961538,0.980392,1.0,0.0,0.961538
966
+ mzn_Arab,141,141,6,0,240094,0.959184,1.0,0.979167,0.999975,24.989588,1.0
967
+ mzw_Latn,117,117,1,0,240123,0.991525,1.0,0.995745,0.999996,4.164515,1.0
968
+ mzz_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
969
+ naf_Latn,203,203,0,0,240038,1.0,1.0,1.0,1.0,0.0,1.0
970
+ nah_Latn,64,54,0,10,240177,1.0,0.84375,0.915254,1.0,0.0,0.84375
971
+ nak_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
972
+ nan_Hani,75,67,17,8,240149,0.797619,0.893333,0.842767,0.999929,70.784374,0.893333
973
+ nan_Latn,180,180,1,0,240060,0.994475,1.0,0.99723,0.999996,4.165608,1.0
974
+ nap_Latn,172,131,8,41,240061,0.942446,0.761628,0.842444,0.999967,33.323753,0.761628
975
+ naq_Latn,274,274,2,0,239965,0.992754,1.0,0.996364,0.999992,8.334479,1.0
976
+ nas_Latn,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
977
+ nav_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
978
+ nba_Latn,231,231,5,0,240005,0.978814,1.0,0.989293,0.999979,20.832465,1.0
979
+ nbe_Latn,72,72,0,0,240169,1.0,1.0,1.0,1.0,0.0,1.0
980
+ nbl_Latn,528,498,25,30,239688,0.952199,0.943182,0.947669,0.999896,104.291382,0.943182
981
+ nbq_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
982
+ nbu_Latn,351,351,0,0,239890,1.0,1.0,1.0,1.0,0.0,1.0
983
+ nca_Latn,215,215,0,0,240026,1.0,1.0,1.0,1.0,0.0,1.0
984
+ nch_Latn,121,121,0,0,240120,1.0,1.0,1.0,1.0,0.0,1.0
985
+ ncj_Latn,152,152,4,0,240085,0.974359,1.0,0.987013,0.999983,16.660488,1.0
986
+ ncl_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
987
+ ncq_Laoo,10,10,1,0,240230,0.909091,1.0,0.952381,0.999996,4.16266,1.0
988
+ ncu_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
989
+ ncx_Latn,103,103,0,0,240138,1.0,1.0,1.0,1.0,0.0,1.0
990
+ ndc_Latn,191,191,1,0,240049,0.994792,1.0,0.997389,0.999996,4.165799,1.0
991
+ nde_Latn,256,256,63,0,239922,0.802508,1.0,0.890435,0.999737,262.516407,1.0
992
+ ndh_Latn,30,30,1,0,240210,0.967742,1.0,0.983607,0.999996,4.163007,1.0
993
+ ndo_Latn,325,317,4,8,239912,0.987539,0.975385,0.981424,0.999983,16.672502,0.975385
994
+ nds_Latn,296,296,2,0,239943,0.993289,1.0,0.996633,0.999992,8.335243,1.0
995
+ neb_Latn,11,5,0,6,240230,1.0,0.454545,0.625,1.0,0.0,0.454545
996
+ new_Deva,112,112,3,0,240126,0.973913,1.0,0.986784,0.999988,12.493285,1.0
997
+ nfa_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
998
+ nfr_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
999
+ ngl_Latn,175,175,1,0,240065,0.994318,1.0,0.997151,0.999996,4.165521,1.0
1000
+ ngp_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1001
+ ngu_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
1002
+ nhe_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
1003
+ nhg_Latn,128,128,1,0,240112,0.992248,1.0,0.996109,0.999996,4.164706,1.0
1004
+ nhi_Latn,102,102,1,0,240138,0.990291,1.0,0.995122,0.999996,4.164255,1.0
1005
+ nho_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
1006
+ nhr_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
1007
+ nhu_Latn,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
1008
+ nhw_Latn,83,83,0,0,240158,1.0,1.0,1.0,1.0,0.0,1.0
1009
+ nhx_Latn,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
1010
+ nhy_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
1011
+ nia_Latn,242,242,0,0,239999,1.0,1.0,1.0,1.0,0.0,1.0
1012
+ nif_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
1013
+ nii_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
1014
+ nij_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1015
+ nim_Latn,76,76,1,0,240164,0.987013,1.0,0.993464,0.999996,4.163804,1.0
1016
+ nin_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
1017
+ niu_Latn,204,204,0,0,240037,1.0,1.0,1.0,1.0,0.0,1.0
1018
+ njb_Latn,9,9,1,0,240231,0.9,1.0,0.947368,0.999996,4.162643,1.0
1019
+ njm_Latn,15,15,0,0,240226,1.0,1.0,1.0,1.0,0.0,1.0
1020
+ njn_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
1021
+ njo_Latn,256,256,1,0,239984,0.996109,1.0,0.998051,0.999996,4.166927,1.0
1022
+ njz_Latn,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
1023
+ nko_Latn,85,85,0,0,240156,1.0,1.0,1.0,1.0,0.0,1.0
1024
+ nld_Latn,259,259,15,0,239967,0.945255,1.0,0.971857,0.999937,62.504688,1.0
1025
+ nlg_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1026
+ nmf_Latn,294,294,0,0,239947,1.0,1.0,1.0,1.0,0.0,1.0
1027
+ nmo_Latn,38,38,1,0,240202,0.974359,1.0,0.987013,0.999996,4.163145,1.0
1028
+ nmz_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1029
+ nnb_Latn,108,108,2,0,240131,0.981818,1.0,0.990826,0.999992,8.328718,1.0
1030
+ nno_Latn,427,414,0,13,239814,1.0,0.969555,0.984542,1.0,0.0,0.969555
1031
+ nnq_Latn,100,100,2,0,240139,0.980392,1.0,0.990099,0.999992,8.32844,1.0
1032
+ nnw_Latn,40,40,0,0,240201,1.0,1.0,1.0,1.0,0.0,1.0
1033
+ noa_Latn,113,113,0,0,240128,1.0,1.0,1.0,1.0,0.0,1.0
1034
+ nob_Latn,265,260,19,5,239957,0.9319,0.981132,0.955882,0.999921,79.174584,0.981132
1035
+ nod_Thai,99,99,1,0,240141,0.99,1.0,0.994975,0.999996,4.164203,1.0
1036
+ nog_Cyrl,219,219,0,0,240022,1.0,1.0,1.0,1.0,0.0,1.0
1037
+ non_Latn,180,144,1,36,240060,0.993103,0.8,0.886154,0.999996,4.165608,0.8
1038
+ nop_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1039
+ not_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1040
+ nou_Latn,84,84,0,0,240157,1.0,1.0,1.0,1.0,0.0,1.0
1041
+ nov_Latn,147,147,3,0,240091,0.98,1.0,0.989899,0.999988,12.495106,1.0
1042
+ nph_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1043
+ npi_Deva,273,270,3,3,239965,0.989011,0.989011,0.989011,0.999987,12.501667,0.989011
1044
+ npi_Latn,53,44,8,9,240180,0.846154,0.830189,0.838095,0.999967,33.307243,0.830189
1045
+ npl_Latn,93,93,1,0,240147,0.989362,1.0,0.994652,0.999996,4.164099,1.0
1046
+ npy_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1047
+ nqo_Nkoo,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
1048
+ nre_Latn,42,42,0,0,240199,1.0,1.0,1.0,1.0,0.0,1.0
1049
+ nrf_Latn,61,40,1,21,240179,0.97561,0.655738,0.784314,0.999996,4.163544,0.655738
1050
+ nrm_Latn,107,64,57,43,240077,0.528926,0.598131,0.561404,0.999763,237.36747,0.598131
1051
+ nse_Latn,12,9,3,3,240226,0.75,0.75,0.75,0.999988,12.488084,0.75
1052
+ nsm_Latn,32,32,1,0,240208,0.969697,1.0,0.984615,0.999996,4.163041,1.0
1053
+ nsn_Latn,198,198,0,0,240043,1.0,1.0,1.0,1.0,0.0,1.0
1054
+ nso_Latn,479,461,12,18,239750,0.97463,0.962422,0.968487,0.99995,50.049633,0.962422
1055
+ nss_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
1056
+ nsu_Latn,14,14,1,0,240226,0.933333,1.0,0.965517,0.999996,4.162729,1.0
1057
+ ntp_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
1058
+ ntr_Latn,117,117,1,0,240123,0.991525,1.0,0.995745,0.999996,4.164515,1.0
1059
+ ntu_Latn,150,150,0,0,240091,1.0,1.0,1.0,1.0,0.0,1.0
1060
+ nuj_Latn,153,152,1,1,240087,0.993464,0.993464,0.993464,0.999996,4.165139,0.993464
1061
+ nus_Latn,199,199,0,0,240042,1.0,1.0,1.0,1.0,0.0,1.0
1062
+ nuy_Latn,81,81,0,0,240160,1.0,1.0,1.0,1.0,0.0,1.0
1063
+ nvm_Latn,9,9,0,0,240232,1.0,1.0,1.0,1.0,0.0,1.0
1064
+ nwi_Latn,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
1065
+ nya_Latn,262,252,1,10,239978,0.996047,0.961832,0.978641,0.999996,4.167031,0.961832
1066
+ nyf_Latn,10,10,1,0,240230,0.909091,1.0,0.952381,0.999996,4.16266,1.0
1067
+ nyn_Latn,279,278,0,1,239962,1.0,0.996416,0.998205,1.0,0.0,0.996416
1068
+ nyo_Latn,100,100,7,0,240134,0.934579,1.0,0.966184,0.999971,29.149541,1.0
1069
+ nyu_Latn,149,149,7,0,240085,0.955128,1.0,0.977049,0.999971,29.15549,1.0
1070
+ nyy_Latn,259,259,0,0,239982,1.0,1.0,1.0,1.0,0.0,1.0
1071
+ nzi_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
1072
+ obo_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
1073
+ oci_Latn,333,333,10,0,239898,0.970845,1.0,0.985207,0.999958,41.682645,1.0
1074
+ ogo_Latn,177,177,0,0,240064,1.0,1.0,1.0,1.0,0.0,1.0
1075
+ ojb_Cans,237,237,1,0,240003,0.995798,1.0,0.997895,0.999996,4.166597,1.0
1076
+ ojb_Latn,62,62,3,0,240176,0.953846,1.0,0.976378,0.999988,12.490684,1.0
1077
+ oke_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
1078
+ okv_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
1079
+ old_Latn,11,11,2,0,240228,0.846154,1.0,0.916667,0.999992,8.325355,1.0
1080
+ olo_Latn,245,245,0,0,239996,1.0,1.0,1.0,1.0,0.0,1.0
1081
+ omw_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1082
+ ong_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
1083
+ ons_Latn,7,7,0,0,240234,1.0,1.0,1.0,1.0,0.0,1.0
1084
+ opm_Latn,92,92,0,0,240149,1.0,1.0,1.0,1.0,0.0,1.0
1085
+ orv_Cyrl,239,170,16,69,239986,0.913978,0.711297,0.8,0.999933,66.666111,0.711297
1086
+ ory_Latn,96,94,2,2,240143,0.979167,0.979167,0.979167,0.999992,8.328302,0.979167
1087
+ ory_Orya,511,508,6,3,239724,0.988327,0.994129,0.99122,0.999975,25.028157,0.994129
1088
+ oss_Cyrl,152,152,0,0,240089,1.0,1.0,1.0,1.0,0.0,1.0
1089
+ ota_Arab,66,44,0,22,240175,1.0,0.666667,0.8,1.0,0.0,0.666667
1090
+ ote_Latn,85,85,1,0,240155,0.988372,1.0,0.994152,0.999996,4.16396,1.0
1091
+ otm_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1092
+ otq_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
1093
+ ots_Latn,44,44,0,0,240197,1.0,1.0,1.0,1.0,0.0,1.0
1094
+ otw_Latn,29,26,0,3,240212,1.0,0.896552,0.945455,1.0,0.0,0.896552
1095
+ ozm_Latn,82,82,0,0,240159,1.0,1.0,1.0,1.0,0.0,1.0
1096
+ pab_Latn,126,126,1,0,240114,0.992126,1.0,0.996047,0.999996,4.164671,1.0
1097
+ pad_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1098
+ pag_Latn,122,122,1,0,240118,0.99187,1.0,0.995918,0.999996,4.164602,1.0
1099
+ pah_Latn,144,144,1,0,240096,0.993103,1.0,0.99654,0.999996,4.164983,1.0
1100
+ pam_Latn,90,90,2,0,240149,0.978261,1.0,0.989011,0.999992,8.328094,1.0
1101
+ pan_Guru,460,460,0,0,239781,1.0,1.0,1.0,1.0,0.0,1.0
1102
+ pan_Latn,232,193,12,39,239997,0.941463,0.831897,0.883295,0.99995,49.998125,0.831897
1103
+ pao_Latn,133,133,0,0,240108,1.0,1.0,1.0,1.0,0.0,1.0
1104
+ pap_Latn,423,423,3,0,239815,0.992958,1.0,0.996466,0.999987,12.509486,1.0
1105
+ pau_Latn,265,265,0,0,239976,1.0,1.0,1.0,1.0,0.0,1.0
1106
+ pbb_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
1107
+ pbt_Arab,419,419,6,0,239816,0.985882,1.0,0.992891,0.999975,25.018555,1.0
1108
+ pcd_Latn,199,199,7,0,240035,0.966019,1.0,0.982716,0.999971,29.161563,1.0
1109
+ pck_Latn,164,138,7,26,240070,0.951724,0.841463,0.893204,0.999971,29.157312,0.841463
1110
+ pcm_Latn,251,194,37,57,239953,0.839827,0.772908,0.804979,0.999846,154.173091,0.772908
1111
+ pdc_Latn,139,139,1,0,240101,0.992857,1.0,0.996416,0.999996,4.164897,1.0
1112
+ pdt_Latn,180,180,1,0,240060,0.994475,1.0,0.99723,0.999996,4.165608,1.0
1113
+ pem_Latn,111,111,1,0,240129,0.991071,1.0,0.995516,0.999996,4.164411,1.0
1114
+ pfl_Latn,222,222,7,0,240012,0.969432,1.0,0.984479,0.999971,29.164358,1.0
1115
+ pib_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
1116
+ pio_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
1117
+ pir_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1118
+ pis_Latn,197,197,10,0,240034,0.951691,1.0,0.975248,0.999958,41.659029,1.0
1119
+ pjt_Latn,179,179,0,0,240062,1.0,1.0,1.0,1.0,0.0,1.0
1120
+ plg_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
1121
+ pls_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
1122
+ plt_Latn,248,248,26,0,239967,0.905109,1.0,0.950192,0.999892,108.336493,1.0
1123
+ plu_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1124
+ plw_Latn,8,8,0,0,240233,1.0,1.0,1.0,1.0,0.0,1.0
1125
+ pma_Latn,120,120,1,0,240120,0.991736,1.0,0.995851,0.999996,4.164567,1.0
1126
+ pmf_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
1127
+ pmq_Latn,46,41,0,5,240195,1.0,0.891304,0.942529,1.0,0.0,0.891304
1128
+ pms_Latn,174,174,1,0,240066,0.994286,1.0,0.997135,0.999996,4.165504,1.0
1129
+ pnb_Arab,220,220,21,0,240000,0.912863,1.0,0.954447,0.999913,87.492344,1.0
1130
+ pnt_Grek,181,181,1,0,240059,0.994505,1.0,0.997245,0.999996,4.165625,1.0
1131
+ poe_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1132
+ poh_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
1133
+ poi_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
1134
+ pol_Latn,254,253,8,1,239979,0.969349,0.996063,0.982524,0.999967,33.335139,0.996063
1135
+ pon_Latn,178,178,1,0,240062,0.994413,1.0,0.997199,0.999996,4.165573,1.0
1136
+ por_Latn,657,630,44,27,239540,0.934718,0.958904,0.946657,0.999816,183.651663,0.958904
1137
+ pot_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
1138
+ pov_Latn,70,70,0,0,240171,1.0,1.0,1.0,1.0,0.0,1.0
1139
+ poy_Latn,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
1140
+ ppk_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1141
+ ppo_Latn,210,210,0,0,240031,1.0,1.0,1.0,1.0,0.0,1.0
1142
+ prf_Latn,45,45,0,0,240196,1.0,1.0,1.0,1.0,0.0,1.0
1143
+ prg_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
1144
+ pri_Latn,159,156,2,3,240080,0.987342,0.981132,0.984227,0.999992,8.330487,0.981132
1145
+ ptp_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
1146
+ ptu_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
1147
+ pwg_Latn,141,141,0,0,240100,1.0,1.0,1.0,1.0,0.0,1.0
1148
+ pwn_Latn,77,77,4,0,240160,0.950617,1.0,0.974684,0.999983,16.655286,1.0
1149
+ pxm_Latn,63,49,1,14,240177,0.98,0.777778,0.867257,0.999996,4.163579,0.777778
1150
+ qub_Latn,180,170,6,10,240055,0.965909,0.944444,0.955056,0.999975,24.993647,0.944444
1151
+ quc_Latn,310,310,0,0,239931,1.0,1.0,1.0,1.0,0.0,1.0
1152
+ quf_Latn,211,211,1,0,240029,0.995283,1.0,0.997636,0.999996,4.166146,1.0
1153
+ qug_Latn,90,85,0,5,240151,1.0,0.944444,0.971429,1.0,0.0,0.944444
1154
+ quh_Latn,159,117,3,42,240079,0.975,0.735849,0.83871,0.999988,12.495731,0.735849
1155
+ qup_Latn,79,68,5,11,240157,0.931507,0.860759,0.894737,0.999979,20.81928,0.860759
1156
+ quw_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
1157
+ quy_Latn,271,233,49,38,239921,0.826241,0.859779,0.842676,0.999796,204.192191,0.859779
1158
+ quz_Latn,205,144,34,61,240002,0.808989,0.702439,0.751958,0.999858,141.64542,0.702439
1159
+ qva_Latn,39,39,3,0,240199,0.928571,1.0,0.962963,0.999988,12.489488,1.0
1160
+ qvc_Latn,53,53,5,0,240183,0.913793,1.0,0.954955,0.999979,20.817027,1.0
1161
+ qve_Latn,54,54,12,0,240175,0.818182,1.0,0.9,0.99995,49.961072,1.0
1162
+ qvh_Latn,95,95,3,0,240143,0.969388,1.0,0.984456,0.999988,12.4924,1.0
1163
+ qvi_Latn,98,98,3,0,240140,0.970297,1.0,0.984925,0.999988,12.492557,1.0
1164
+ qvm_Latn,88,88,1,0,240152,0.988764,1.0,0.99435,0.999996,4.164012,1.0
1165
+ qvn_Latn,106,106,1,0,240134,0.990654,1.0,0.995305,0.999996,4.164324,1.0
1166
+ qvs_Latn,148,148,8,0,240085,0.948718,1.0,0.973684,0.999967,33.320422,1.0
1167
+ qvw_Latn,175,175,0,0,240066,1.0,1.0,1.0,1.0,0.0,1.0
1168
+ qvz_Latn,191,191,0,0,240050,1.0,1.0,1.0,1.0,0.0,1.0
1169
+ qwh_Latn,117,110,0,7,240124,1.0,0.940171,0.969163,1.0,0.0,0.940171
1170
+ qxh_Latn,105,105,1,0,240135,0.990566,1.0,0.995261,0.999996,4.164307,1.0
1171
+ qxl_Latn,66,66,0,0,240175,1.0,1.0,1.0,1.0,0.0,1.0
1172
+ qxn_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1173
+ qxo_Latn,93,93,1,0,240147,0.989362,1.0,0.994652,0.999996,4.164099,1.0
1174
+ qxr_Latn,93,93,2,0,240146,0.978947,1.0,0.989362,0.999992,8.328198,1.0
1175
+ rad_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
1176
+ rai_Latn,168,168,0,0,240073,1.0,1.0,1.0,1.0,0.0,1.0
1177
+ rap_Latn,107,107,1,0,240133,0.990741,1.0,0.995349,0.999996,4.164342,1.0
1178
+ rar_Latn,368,368,0,0,239873,1.0,1.0,1.0,1.0,0.0,1.0
1179
+ rav_Deva,45,45,0,0,240196,1.0,1.0,1.0,1.0,0.0,1.0
1180
+ raw_Latn,97,97,0,0,240144,1.0,1.0,1.0,1.0,0.0,1.0
1181
+ rcf_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
1182
+ rej_Latn,33,29,0,4,240208,1.0,0.878788,0.935484,1.0,0.0,0.878788
1183
+ rgu_Latn,47,47,0,0,240194,1.0,1.0,1.0,1.0,0.0,1.0
1184
+ ria_Latn,23,23,0,0,240218,1.0,1.0,1.0,1.0,0.0,1.0
1185
+ rim_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
1186
+ rkb_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1187
+ rmc_Latn,341,341,1,0,239899,0.997076,1.0,0.998536,0.999996,4.168404,1.0
1188
+ rml_Latn,37,30,0,7,240204,1.0,0.810811,0.895522,1.0,0.0,0.810811
1189
+ rmn_Cyrl,223,223,0,0,240018,1.0,1.0,1.0,1.0,0.0,1.0
1190
+ rmn_Grek,185,128,2,57,240054,0.984615,0.691892,0.812698,0.999992,8.331389,0.691892
1191
+ rmn_Latn,236,236,2,0,240003,0.991597,1.0,0.995781,0.999992,8.33316,1.0
1192
+ rmo_Latn,85,85,2,0,240154,0.977011,1.0,0.988372,0.999992,8.32792,1.0
1193
+ rmq_Latn,17,17,1,0,240223,0.944444,1.0,0.971429,0.999996,4.162781,1.0
1194
+ rmy_Cyrl,101,74,8,27,240132,0.902439,0.732673,0.808743,0.999967,33.3139,0.732673
1195
+ rmy_Latn,265,265,3,0,239973,0.988806,1.0,0.994371,0.999987,12.50125,1.0
1196
+ rnd_Latn,164,164,1,0,240076,0.993939,1.0,0.99696,0.999996,4.16533,1.0
1197
+ rng_Latn,209,209,6,0,240026,0.972093,1.0,0.985849,0.999975,24.996667,1.0
1198
+ roh_Latn,307,307,0,0,239934,1.0,1.0,1.0,1.0,0.0,1.0
1199
+ ron_Cyrl,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1200
+ ron_Latn,369,368,2,1,239870,0.994595,0.99729,0.99594,0.999992,8.33778,0.99729
1201
+ roo_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
1202
+ rop_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
1203
+ row_Latn,138,138,1,0,240102,0.992806,1.0,0.99639,0.999996,4.164879,1.0
1204
+ rro_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1205
+ rtm_Latn,174,174,0,0,240067,1.0,1.0,1.0,1.0,0.0,1.0
1206
+ rub_Latn,31,31,0,0,240210,1.0,1.0,1.0,1.0,0.0,1.0
1207
+ rue_Cyrl,301,301,13,0,239927,0.958599,1.0,0.978862,0.999946,54.180212,1.0
1208
+ ruf_Latn,173,173,1,0,240067,0.994253,1.0,0.997118,0.999996,4.165486,1.0
1209
+ rug_Latn,181,181,0,0,240060,1.0,1.0,1.0,1.0,0.0,1.0
1210
+ run_Latn,291,291,13,0,239937,0.957237,1.0,0.978151,0.999946,54.177954,1.0
1211
+ rup_Latn,166,166,1,0,240074,0.994012,1.0,0.996997,0.999996,4.165365,1.0
1212
+ rus_Cyrl,528,512,39,16,239674,0.92922,0.969697,0.949027,0.999837,162.694556,0.969697
1213
+ rwo_Latn,177,177,1,0,240063,0.994382,1.0,0.997183,0.999996,4.165556,1.0
1214
+ sab_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
1215
+ sag_Latn,237,237,0,0,240004,1.0,1.0,1.0,1.0,0.0,1.0
1216
+ sah_Cyrl,260,260,12,0,239969,0.955882,1.0,0.977444,0.99995,50.003959,1.0
1217
+ san_Deva,239,235,1,4,240001,0.995763,0.983264,0.989474,0.999996,4.166632,0.983264
1218
+ san_Latn,146,140,4,6,240091,0.972222,0.958904,0.965517,0.999983,16.660072,0.958904
1219
+ sas_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
1220
+ sat_Latn,239,239,3,0,239999,0.987603,1.0,0.993763,0.999988,12.499896,1.0
1221
+ sat_Olck,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1222
+ sbe_Latn,94,94,0,0,240147,1.0,1.0,1.0,1.0,0.0,1.0
1223
+ sbl_Latn,74,74,0,0,240167,1.0,1.0,1.0,1.0,0.0,1.0
1224
+ sby_Latn,100,81,0,19,240141,1.0,0.81,0.895028,1.0,0.0,0.81
1225
+ sck_Deva,15,10,4,5,240222,0.714286,0.666667,0.689655,0.999983,16.650987,0.666667
1226
+ scn_Latn,172,172,5,0,240064,0.971751,1.0,0.985673,0.999979,20.827345,1.0
1227
+ sco_Latn,210,210,19,0,240012,0.917031,1.0,0.95672,0.999921,79.156442,1.0
1228
+ sda_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1229
+ sdc_Latn,39,39,1,0,240201,0.975,1.0,0.987342,0.999996,4.163163,1.0
1230
+ sdh_Arab,400,399,38,1,239803,0.913043,0.9975,0.953405,0.999842,158.438299,0.9975
1231
+ seh_Latn,162,162,3,0,240076,0.981818,1.0,0.990826,0.999988,12.495887,1.0
1232
+ ses_Latn,130,130,0,0,240111,1.0,1.0,1.0,1.0,0.0,1.0
1233
+ sey_Latn,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
1234
+ sgb_Latn,115,115,5,0,240121,0.958333,1.0,0.978723,0.999979,20.822402,1.0
1235
+ sgc_Latn,184,184,0,0,240057,1.0,1.0,1.0,1.0,0.0,1.0
1236
+ sgh_Cyrl,9,7,5,2,240227,0.583333,0.777778,0.666667,0.999979,20.813214,0.777778
1237
+ sgs_Latn,218,218,0,0,240023,1.0,1.0,1.0,1.0,0.0,1.0
1238
+ sgw_Ethi,96,96,1,0,240144,0.989691,1.0,0.994819,0.999996,4.164151,1.0
1239
+ sgz_Latn,136,136,2,0,240103,0.985507,1.0,0.992701,0.999992,8.329689,1.0
1240
+ shi_Latn,133,121,0,12,240108,1.0,0.909774,0.952756,1.0,0.0,0.909774
1241
+ shn_Mymr,174,174,2,0,240065,0.988636,1.0,0.994286,0.999992,8.331008,1.0
1242
+ shp_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
1243
+ sid_Latn,193,193,0,0,240048,1.0,1.0,1.0,1.0,0.0,1.0
1244
+ sig_Latn,89,89,0,0,240152,1.0,1.0,1.0,1.0,0.0,1.0
1245
+ sil_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1246
+ sim_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
1247
+ sin_Sinh,232,232,0,0,240009,1.0,1.0,1.0,1.0,0.0,1.0
1248
+ sja_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
1249
+ skg_Latn,104,104,4,0,240133,0.962963,1.0,0.981132,0.999983,16.657158,1.0
1250
+ skr_Arab,116,95,0,21,240125,1.0,0.818966,0.900474,1.0,0.0,0.818966
1251
+ slk_Latn,374,374,1,0,239866,0.997333,1.0,0.998665,0.999996,4.168977,1.0
1252
+ sll_Latn,160,160,0,0,240081,1.0,1.0,1.0,1.0,0.0,1.0
1253
+ slv_Latn,338,338,11,0,239892,0.968481,1.0,0.983988,0.999954,45.851865,1.0
1254
+ sma_Latn,327,327,0,0,239914,1.0,1.0,1.0,1.0,0.0,1.0
1255
+ sme_Latn,246,246,3,0,239992,0.987952,1.0,0.993939,0.999987,12.50026,1.0
1256
+ smj_Latn,407,407,0,0,239834,1.0,1.0,1.0,1.0,0.0,1.0
1257
+ smk_Latn,172,172,2,0,240067,0.988506,1.0,0.99422,0.999992,8.330938,1.0
1258
+ sml_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1259
+ smn_Latn,293,293,0,0,239948,1.0,1.0,1.0,1.0,0.0,1.0
1260
+ smo_Latn,426,426,1,0,239814,0.997658,1.0,0.998828,0.999996,4.169881,1.0
1261
+ sms_Latn,178,178,1,0,240062,0.994413,1.0,0.997199,0.999996,4.165573,1.0
1262
+ sna_Latn,415,415,0,0,239826,1.0,1.0,1.0,1.0,0.0,1.0
1263
+ snc_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1264
+ snd_Arab,325,325,2,0,239914,0.993884,1.0,0.996933,0.999992,8.336251,1.0
1265
+ snd_Deva,267,267,1,0,239973,0.996269,1.0,0.998131,0.999996,4.167118,1.0
1266
+ snd_Latn,155,119,18,36,240068,0.868613,0.767742,0.815068,0.999925,74.973135,0.767742
1267
+ snf_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1268
+ snn_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
1269
+ snp_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
1270
+ snw_Latn,25,25,0,0,240216,1.0,1.0,1.0,1.0,0.0,1.0
1271
+ sny_Latn,163,163,0,0,240078,1.0,1.0,1.0,1.0,0.0,1.0
1272
+ som_Latn,439,435,1,4,239801,0.997706,0.990888,0.994286,0.999996,4.170107,0.990888
1273
+ sop_Latn,140,140,0,0,240101,1.0,1.0,1.0,1.0,0.0,1.0
1274
+ soq_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
1275
+ sot_Latn,491,475,6,16,239744,0.987526,0.967413,0.977366,0.999975,25.026069,0.967413
1276
+ soy_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
1277
+ spa_Latn,1136,1046,19,90,239086,0.98216,0.920775,0.950477,0.999921,79.462997,0.920775
1278
+ spl_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1279
+ spm_Latn,59,59,0,0,240182,1.0,1.0,1.0,1.0,0.0,1.0
1280
+ spp_Latn,155,155,0,0,240086,1.0,1.0,1.0,1.0,0.0,1.0
1281
+ sps_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
1282
+ spy_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
1283
+ srd_Latn,139,139,0,0,240102,1.0,1.0,1.0,1.0,0.0,1.0
1284
+ srm_Latn,125,125,0,0,240116,1.0,1.0,1.0,1.0,0.0,1.0
1285
+ srn_Latn,303,303,0,0,239938,1.0,1.0,1.0,1.0,0.0,1.0
1286
+ srp_Cyrl,269,269,6,0,239966,0.978182,1.0,0.988971,0.999975,25.002917,1.0
1287
+ srp_Latn,235,160,0,75,240006,1.0,0.680851,0.810127,1.0,0.0,0.680851
1288
+ srq_Latn,43,43,0,0,240198,1.0,1.0,1.0,1.0,0.0,1.0
1289
+ srr_Latn,49,49,1,0,240191,0.98,1.0,0.989899,0.999996,4.163336,1.0
1290
+ ssd_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1291
+ ssg_Latn,220,220,0,0,240021,1.0,1.0,1.0,1.0,0.0,1.0
1292
+ ssw_Latn,322,306,8,16,239911,0.974522,0.950311,0.962264,0.999967,33.344587,0.950311
1293
+ ssx_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1294
+ stp_Latn,62,62,0,0,240179,1.0,1.0,1.0,1.0,0.0,1.0
1295
+ stq_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1296
+ sua_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
1297
+ suc_Latn,29,29,0,0,240212,1.0,1.0,1.0,1.0,0.0,1.0
1298
+ sue_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
1299
+ suk_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
1300
+ sun_Latn,143,143,4,0,240094,0.972789,1.0,0.986207,0.999983,16.659864,1.0
1301
+ sur_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
1302
+ sus_Arab,116,116,1,0,240124,0.991453,1.0,0.995708,0.999996,4.164498,1.0
1303
+ sus_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
1304
+ suz_Deva,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1305
+ swc_Latn,273,188,28,85,239940,0.87037,0.688645,0.768916,0.999883,116.682224,0.688645
1306
+ swe_Latn,328,326,18,2,239895,0.947674,0.993902,0.970238,0.999925,75.027197,0.993902
1307
+ swg_Latn,134,109,0,25,240107,1.0,0.813433,0.897119,1.0,0.0,0.813433
1308
+ swh_Latn,592,545,51,47,239598,0.91443,0.920608,0.917508,0.999787,212.811236,0.920608
1309
+ swp_Latn,143,143,1,0,240097,0.993056,1.0,0.996516,0.999996,4.164966,1.0
1310
+ sxb_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
1311
+ sxn_Latn,137,137,1,0,240103,0.992754,1.0,0.996364,0.999996,4.164862,1.0
1312
+ syb_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
1313
+ syc_Syrc,193,193,13,0,240035,0.936893,1.0,0.967419,0.999946,54.155835,1.0
1314
+ syl_Beng,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
1315
+ syl_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1316
+ szl_Latn,320,320,2,0,239919,0.993789,1.0,0.996885,0.999992,8.336077,1.0
1317
+ szy_Latn,123,123,1,0,240117,0.991935,1.0,0.995951,0.999996,4.164619,1.0
1318
+ tab_Cyrl,196,196,0,0,240045,1.0,1.0,1.0,1.0,0.0,1.0
1319
+ tac_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1320
+ tah_Latn,242,242,1,0,239998,0.995885,1.0,0.997938,0.999996,4.166684,1.0
1321
+ taj_Deva,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
1322
+ tam_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
1323
+ tam_Taml,754,754,10,0,239477,0.986911,1.0,0.993412,0.999958,41.75592,1.0
1324
+ taq_Latn,106,106,6,0,240129,0.946429,1.0,0.972477,0.999975,24.985945,1.0
1325
+ taq_Tfng,104,70,21,34,240116,0.769231,0.673077,0.717949,0.999913,87.450081,0.673077
1326
+ tar_Latn,190,190,0,0,240051,1.0,1.0,1.0,1.0,0.0,1.0
1327
+ tat_Cyrl,201,201,4,0,240036,0.980488,1.0,0.990148,0.999983,16.663889,1.0
1328
+ tat_Latn,161,161,2,0,240078,0.98773,1.0,0.993827,0.999992,8.330556,1.0
1329
+ tav_Latn,36,36,0,0,240205,1.0,1.0,1.0,1.0,0.0,1.0
1330
+ taw_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
1331
+ tay_Latn,106,106,1,0,240134,0.990654,1.0,0.995305,0.999996,4.164324,1.0
1332
+ tbc_Latn,131,131,0,0,240110,1.0,1.0,1.0,1.0,0.0,1.0
1333
+ tbg_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
1334
+ tbo_Latn,202,202,0,0,240039,1.0,1.0,1.0,1.0,0.0,1.0
1335
+ tby_Latn,107,107,0,0,240134,1.0,1.0,1.0,1.0,0.0,1.0
1336
+ tbz_Latn,148,148,0,0,240093,1.0,1.0,1.0,1.0,0.0,1.0
1337
+ tca_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
1338
+ tcf_Latn,146,146,0,0,240095,1.0,1.0,1.0,1.0,0.0,1.0
1339
+ tcs_Latn,128,128,0,0,240113,1.0,1.0,1.0,1.0,0.0,1.0
1340
+ tcy_Knda,99,99,7,0,240135,0.933962,1.0,0.965854,0.999971,29.14942,1.0
1341
+ tcz_Latn,291,291,5,0,239945,0.983108,1.0,0.991482,0.999979,20.837675,1.0
1342
+ tdt_Latn,57,57,75,0,240109,0.431818,1.0,0.603175,0.999688,312.2606,1.0
1343
+ ted_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
1344
+ tee_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
1345
+ tel_Latn,199,178,3,21,240039,0.983425,0.894472,0.936842,0.999988,12.497813,0.894472
1346
+ tel_Telu,555,553,5,2,239681,0.991039,0.996396,0.993711,0.999979,20.860626,0.996396
1347
+ tem_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1348
+ teo_Latn,225,222,0,3,240016,1.0,0.986667,0.993289,1.0,0.0,0.986667
1349
+ ter_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1350
+ tet_Latn,395,313,0,82,239846,1.0,0.792405,0.884181,1.0,0.0,0.792405
1351
+ tew_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1352
+ tfr_Latn,99,99,1,0,240141,0.99,1.0,0.994975,0.999996,4.164203,1.0
1353
+ tgk_Cyrl,413,413,2,0,239826,0.995181,1.0,0.997585,0.999992,8.33931,1.0
1354
+ tgo_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1355
+ tgp_Latn,189,189,0,0,240052,1.0,1.0,1.0,1.0,0.0,1.0
1356
+ tha_Thai,431,414,0,17,239810,1.0,0.960557,0.979882,1.0,0.0,0.960557
1357
+ thk_Latn,126,126,0,0,240115,1.0,1.0,1.0,1.0,0.0,1.0
1358
+ thl_Deva,121,97,1,24,240119,0.989796,0.801653,0.885845,0.999996,4.164584,0.801653
1359
+ tif_Latn,161,161,1,0,240079,0.993827,1.0,0.996904,0.999996,4.165278,1.0
1360
+ tih_Latn,10,10,0,0,240231,1.0,1.0,1.0,1.0,0.0,1.0
1361
+ tim_Latn,143,143,0,0,240098,1.0,1.0,1.0,1.0,0.0,1.0
1362
+ tir_Ethi,339,331,0,8,239902,1.0,0.976401,0.98806,1.0,0.0,0.976401
1363
+ tiv_Latn,199,199,4,0,240038,0.980296,1.0,0.99005,0.999983,16.663751,1.0
1364
+ tiy_Latn,115,115,0,0,240126,1.0,1.0,1.0,1.0,0.0,1.0
1365
+ tkl_Latn,208,208,0,0,240033,1.0,1.0,1.0,1.0,0.0,1.0
1366
+ tkr_Cyrl,69,69,0,0,240172,1.0,1.0,1.0,1.0,0.0,1.0
1367
+ tku_Latn,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1368
+ tlf_Latn,68,68,0,0,240173,1.0,1.0,1.0,1.0,0.0,1.0
1369
+ tlh_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
1370
+ tll_Latn,186,186,0,0,240055,1.0,1.0,1.0,1.0,0.0,1.0
1371
+ tly_Latn,123,123,0,0,240118,1.0,1.0,1.0,1.0,0.0,1.0
1372
+ tmd_Latn,109,109,0,0,240132,1.0,1.0,1.0,1.0,0.0,1.0
1373
+ tna_Latn,49,49,0,0,240192,1.0,1.0,1.0,1.0,0.0,1.0
1374
+ tnk_Latn,117,117,0,0,240124,1.0,1.0,1.0,1.0,0.0,1.0
1375
+ tnn_Latn,140,140,1,0,240100,0.992908,1.0,0.996441,0.999996,4.164914,1.0
1376
+ tnp_Latn,169,169,0,0,240072,1.0,1.0,1.0,1.0,0.0,1.0
1377
+ tob_Latn,85,85,0,0,240156,1.0,1.0,1.0,1.0,0.0,1.0
1378
+ toc_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
1379
+ tod_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1380
+ tog_Latn,105,105,0,0,240136,1.0,1.0,1.0,1.0,0.0,1.0
1381
+ toh_Latn,88,88,4,0,240149,0.956522,1.0,0.977778,0.999983,16.656048,1.0
1382
+ toi_Latn,232,231,4,1,240005,0.982979,0.99569,0.989293,0.999983,16.666042,0.99569
1383
+ toj_Latn,137,137,0,0,240104,1.0,1.0,1.0,1.0,0.0,1.0
1384
+ tok_Latn,106,106,0,0,240135,1.0,1.0,1.0,1.0,0.0,1.0
1385
+ ton_Latn,298,298,0,0,239943,1.0,1.0,1.0,1.0,0.0,1.0
1386
+ too_Latn,102,102,0,0,240139,1.0,1.0,1.0,1.0,0.0,1.0
1387
+ top_Latn,259,259,0,0,239982,1.0,1.0,1.0,1.0,0.0,1.0
1388
+ tos_Latn,77,77,0,0,240164,1.0,1.0,1.0,1.0,0.0,1.0
1389
+ tpi_Latn,302,302,1,0,239938,0.9967,1.0,0.998347,0.999996,4.167726,1.0
1390
+ tpm_Latn,7,7,0,0,240234,1.0,1.0,1.0,1.0,0.0,1.0
1391
+ tpp_Latn,86,86,0,0,240155,1.0,1.0,1.0,1.0,0.0,1.0
1392
+ tpt_Latn,115,115,1,0,240125,0.991379,1.0,0.995671,0.999996,4.16448,1.0
1393
+ tpz_Latn,154,154,0,0,240087,1.0,1.0,1.0,1.0,0.0,1.0
1394
+ trc_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
1395
+ trn_Latn,57,57,0,0,240184,1.0,1.0,1.0,1.0,0.0,1.0
1396
+ trp_Latn,186,186,0,0,240055,1.0,1.0,1.0,1.0,0.0,1.0
1397
+ trq_Latn,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1398
+ trv_Latn,159,159,5,0,240077,0.969512,1.0,0.98452,0.999979,20.826218,1.0
1399
+ tsc_Latn,184,182,20,2,240037,0.90099,0.98913,0.943005,0.999917,83.313546,0.98913
1400
+ tsg_Latn,170,170,1,0,240070,0.994152,1.0,0.997067,0.999996,4.165434,1.0
1401
+ tsn_Latn,456,438,18,18,239767,0.960526,0.960526,0.960526,0.999925,75.067248,0.960526
1402
+ tso_Latn,581,532,0,49,239660,1.0,0.915663,0.955975,1.0,0.0,0.915663
1403
+ tsw_Latn,64,64,0,0,240177,1.0,1.0,1.0,1.0,0.0,1.0
1404
+ tsz_Latn,159,159,0,0,240082,1.0,1.0,1.0,1.0,0.0,1.0
1405
+ ttc_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
1406
+ tte_Latn,132,132,1,0,240108,0.992481,1.0,0.996226,0.999996,4.164775,1.0
1407
+ ttj_Latn,28,26,1,2,240212,0.962963,0.928571,0.945455,0.999996,4.162972,0.928571
1408
+ tuc_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1409
+ tue_Latn,78,78,0,0,240163,1.0,1.0,1.0,1.0,0.0,1.0
1410
+ tuf_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
1411
+ tui_Latn,4,2,0,2,240237,1.0,0.5,0.666667,1.0,0.0,0.5
1412
+ tuk_Arab,135,89,10,46,240096,0.89899,0.659259,0.760684,0.999958,41.648272,0.659259
1413
+ tuk_Cyrl,129,109,4,20,240108,0.964602,0.844961,0.900826,0.999983,16.658893,0.844961
1414
+ tuk_Latn,227,227,1,0,240013,0.995614,1.0,0.997802,0.999996,4.166424,1.0
1415
+ tum_Latn,265,264,1,1,239975,0.996226,0.996226,0.996226,0.999996,4.167083,0.996226
1416
+ tuo_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1417
+ tur_Latn,430,429,1,1,239810,0.997674,0.997674,0.997674,0.999996,4.169951,0.997674
1418
+ tuv_Latn,22,22,3,0,240216,0.88,1.0,0.93617,0.999988,12.488604,1.0
1419
+ tvk_Latn,170,170,0,0,240071,1.0,1.0,1.0,1.0,0.0,1.0
1420
+ tvl_Latn,158,158,0,0,240083,1.0,1.0,1.0,1.0,0.0,1.0
1421
+ twi_Latn,359,353,4,6,239878,0.988796,0.983287,0.986034,0.999983,16.674865,0.983287
1422
+ twu_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1423
+ txq_Latn,145,145,3,0,240093,0.97973,1.0,0.989761,0.999988,12.495002,1.0
1424
+ txu_Latn,166,166,0,0,240075,1.0,1.0,1.0,1.0,0.0,1.0
1425
+ tyv_Cyrl,273,273,5,0,239963,0.982014,1.0,0.990926,0.999979,20.836111,1.0
1426
+ tzh_Latn,347,347,0,0,239894,1.0,1.0,1.0,1.0,0.0,1.0
1427
+ tzj_Latn,190,190,0,0,240051,1.0,1.0,1.0,1.0,0.0,1.0
1428
+ tzm_Tfng,157,157,71,0,240013,0.688596,1.0,0.815584,0.999704,295.729828,1.0
1429
+ tzo_Latn,294,294,0,0,239947,1.0,1.0,1.0,1.0,0.0,1.0
1430
+ ubr_Latn,194,194,0,0,240047,1.0,1.0,1.0,1.0,0.0,1.0
1431
+ ubu_Latn,211,211,0,0,240030,1.0,1.0,1.0,1.0,0.0,1.0
1432
+ udm_Cyrl,159,159,3,0,240079,0.981481,1.0,0.990654,0.999988,12.495731,1.0
1433
+ udu_Latn,98,98,0,0,240143,1.0,1.0,1.0,1.0,0.0,1.0
1434
+ uig_Arab,334,334,0,0,239907,1.0,1.0,1.0,1.0,0.0,1.0
1435
+ uig_Cyrl,253,253,1,0,239987,0.996063,1.0,0.998028,0.999996,4.166875,1.0
1436
+ uig_Latn,197,197,8,0,240036,0.960976,1.0,0.9801,0.999967,33.327223,1.0
1437
+ ukr_Cyrl,322,322,2,0,239917,0.993827,1.0,0.996904,0.999992,8.336147,1.0
1438
+ umb_Latn,100,100,1,0,240140,0.990099,1.0,0.995025,0.999996,4.16422,1.0
1439
+ und_Bali,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1440
+ und_Bamu,18,18,0,0,240223,1.0,1.0,1.0,1.0,0.0,1.0
1441
+ und_Bopo,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
1442
+ und_Cans,83,77,0,6,240158,1.0,0.927711,0.9625,1.0,0.0,0.927711
1443
+ und_Cher,40,40,0,0,240201,1.0,1.0,1.0,1.0,0.0,1.0
1444
+ und_Cyrl,78,78,5,0,240158,0.939759,1.0,0.968944,0.999979,20.819194,1.0
1445
+ und_Deva,5,4,2,1,240234,0.666667,0.8,0.727273,0.999992,8.325147,0.8
1446
+ und_Egyp,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
1447
+ und_Ethi,14,14,0,0,240227,1.0,1.0,1.0,1.0,0.0,1.0
1448
+ und_Geor,32,17,0,15,240209,1.0,0.53125,0.693878,1.0,0.0,0.53125
1449
+ und_Goth,22,17,0,5,240219,1.0,0.772727,0.871795,1.0,0.0,0.772727
1450
+ und_Grek,108,108,3,0,240130,0.972973,1.0,0.986301,0.999988,12.493077,1.0
1451
+ und_Hebr,47,37,0,10,240194,1.0,0.787234,0.880952,1.0,0.0,0.787234
1452
+ und_Hluw,16,16,2,0,240223,0.888889,1.0,0.941176,0.999992,8.325528,1.0
1453
+ und_Hung,80,80,0,0,240161,1.0,1.0,1.0,1.0,0.0,1.0
1454
+ und_Kana,136,103,0,33,240105,1.0,0.757353,0.861925,1.0,0.0,0.757353
1455
+ und_Khmr,18,13,0,5,240223,1.0,0.722222,0.83871,1.0,0.0,0.722222
1456
+ und_Lana,40,40,0,0,240201,1.0,1.0,1.0,1.0,0.0,1.0
1457
+ und_Laoo,20,9,0,11,240221,1.0,0.45,0.62069,1.0,0.0,0.45
1458
+ und_Lina,22,22,1,0,240218,0.956522,1.0,0.977778,0.999996,4.162868,1.0
1459
+ und_Mlym,35,35,0,0,240206,1.0,1.0,1.0,1.0,0.0,1.0
1460
+ und_Mong,93,93,0,0,240148,1.0,1.0,1.0,1.0,0.0,1.0
1461
+ und_Mymr,27,18,0,9,240214,1.0,0.666667,0.8,1.0,0.0,0.666667
1462
+ und_Newa,153,153,0,0,240088,1.0,1.0,1.0,1.0,0.0,1.0
1463
+ und_Orya,25,17,1,8,240215,0.944444,0.68,0.790698,0.999996,4.16292,0.68
1464
+ und_Shaw,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1465
+ und_Sylo,95,95,0,0,240146,1.0,1.0,1.0,1.0,0.0,1.0
1466
+ und_Syrc,43,30,0,13,240198,1.0,0.697674,0.821918,1.0,0.0,0.697674
1467
+ und_Taml,52,42,0,10,240189,1.0,0.807692,0.893617,1.0,0.0,0.807692
1468
+ und_Tang,28,28,3,0,240210,0.903226,1.0,0.949153,0.999988,12.488916,1.0
1469
+ und_Telu,49,44,0,5,240192,1.0,0.897959,0.946237,1.0,0.0,0.897959
1470
+ und_Thaa,29,14,0,15,240212,1.0,0.482759,0.651163,1.0,0.0,0.482759
1471
+ und_Thai,23,23,0,0,240218,1.0,1.0,1.0,1.0,0.0,1.0
1472
+ und_Tibt,24,23,0,1,240217,1.0,0.958333,0.978723,1.0,0.0,0.958333
1473
+ und_Vaii,12,12,1,0,240228,0.923077,1.0,0.96,0.999996,4.162695,1.0
1474
+ und_Xsux,43,43,1,0,240197,0.977273,1.0,0.988506,0.999996,4.163232,1.0
1475
+ und_Yiii,38,38,9,0,240194,0.808511,1.0,0.894118,0.999963,37.468308,1.0
1476
+ upv_Latn,50,50,0,0,240191,1.0,1.0,1.0,1.0,0.0,1.0
1477
+ ura_Latn,75,75,0,0,240166,1.0,1.0,1.0,1.0,0.0,1.0
1478
+ urb_Latn,112,112,0,0,240129,1.0,1.0,1.0,1.0,0.0,1.0
1479
+ urd_Arab,257,257,38,0,239946,0.871186,1.0,0.931159,0.999842,158.34389,1.0
1480
+ urd_Latn,204,166,55,38,239982,0.751131,0.813725,0.781176,0.999771,229.131342,0.813725
1481
+ urh_Latn,159,159,1,0,240081,0.99375,1.0,0.996865,0.999996,4.165244,1.0
1482
+ urk_Thai,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
1483
+ urt_Latn,96,96,0,0,240145,1.0,1.0,1.0,1.0,0.0,1.0
1484
+ usa_Latn,157,157,0,0,240084,1.0,1.0,1.0,1.0,0.0,1.0
1485
+ usp_Latn,90,90,0,0,240151,1.0,1.0,1.0,1.0,0.0,1.0
1486
+ uth_Latn,19,19,0,0,240222,1.0,1.0,1.0,1.0,0.0,1.0
1487
+ uvh_Latn,100,100,0,0,240141,1.0,1.0,1.0,1.0,0.0,1.0
1488
+ uvl_Latn,164,164,0,0,240077,1.0,1.0,1.0,1.0,0.0,1.0
1489
+ uzn_Cyrl,213,213,0,0,240028,1.0,1.0,1.0,1.0,0.0,1.0
1490
+ uzn_Latn,436,436,5,0,239800,0.988662,1.0,0.994299,0.999979,20.850274,1.0
1491
+ uzs_Arab,283,283,15,0,239943,0.949664,1.0,0.974182,0.999937,62.510939,1.0
1492
+ vap_Latn,140,119,4,21,240097,0.96748,0.85,0.904943,0.999983,16.659656,0.85
1493
+ var_Latn,38,38,0,0,240203,1.0,1.0,1.0,1.0,0.0,1.0
1494
+ vec_Latn,49,37,0,12,240192,1.0,0.755102,0.860465,1.0,0.0,0.755102
1495
+ ven_Latn,387,381,4,6,239850,0.98961,0.984496,0.987047,0.999983,16.676812,0.984496
1496
+ vep_Latn,113,113,1,0,240127,0.991228,1.0,0.995595,0.999996,4.164446,1.0
1497
+ vid_Latn,104,104,0,0,240137,1.0,1.0,1.0,1.0,0.0,1.0
1498
+ vie_Latn,338,338,2,0,239901,0.994118,1.0,0.99705,0.999992,8.336703,1.0
1499
+ viv_Latn,166,166,0,0,240075,1.0,1.0,1.0,1.0,0.0,1.0
1500
+ vls_Latn,98,98,2,0,240141,0.98,1.0,0.989899,0.999992,8.328371,1.0
1501
+ vmw_Latn,386,386,1,0,239854,0.997416,1.0,0.998706,0.999996,4.169186,1.0
1502
+ vmy_Latn,120,120,0,0,240121,1.0,1.0,1.0,1.0,0.0,1.0
1503
+ vol_Latn,82,82,1,0,240158,0.987952,1.0,0.993939,0.999996,4.163908,1.0
1504
+ vro_Latn,448,448,9,0,239784,0.980306,1.0,0.990055,0.999962,37.532372,1.0
1505
+ vun_Latn,82,82,0,0,240159,1.0,1.0,1.0,1.0,0.0,1.0
1506
+ waj_Latn,128,128,0,0,240113,1.0,1.0,1.0,1.0,0.0,1.0
1507
+ wal_Latn,284,284,0,0,239957,1.0,1.0,1.0,1.0,0.0,1.0
1508
+ wap_Latn,20,20,0,0,240221,1.0,1.0,1.0,1.0,0.0,1.0
1509
+ war_Latn,193,193,2,0,240046,0.989744,1.0,0.994845,0.999992,8.331667,1.0
1510
+ way_Latn,27,27,0,0,240214,1.0,1.0,1.0,1.0,0.0,1.0
1511
+ wba_Latn,63,63,1,0,240177,0.984375,1.0,0.992126,0.999996,4.163579,1.0
1512
+ wbm_Latn,42,42,0,0,240199,1.0,1.0,1.0,1.0,0.0,1.0
1513
+ wbp_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1514
+ wed_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1515
+ wer_Latn,143,143,0,0,240098,1.0,1.0,1.0,1.0,0.0,1.0
1516
+ whk_Latn,13,13,1,0,240227,0.928571,1.0,0.962963,0.999996,4.162712,1.0
1517
+ wib_Latn,17,17,0,0,240224,1.0,1.0,1.0,1.0,0.0,1.0
1518
+ wim_Latn,110,110,0,0,240131,1.0,1.0,1.0,1.0,0.0,1.0
1519
+ wiu_Latn,132,132,0,0,240109,1.0,1.0,1.0,1.0,0.0,1.0
1520
+ wln_Latn,305,305,2,0,239934,0.993485,1.0,0.996732,0.999992,8.335556,1.0
1521
+ wls_Latn,68,65,0,3,240173,1.0,0.955882,0.977444,1.0,0.0,0.955882
1522
+ wlv_Latn,82,82,1,0,240158,0.987952,1.0,0.993939,0.999996,4.163908,1.0
1523
+ wmt_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
1524
+ wmw_Latn,39,39,3,0,240199,0.928571,1.0,0.962963,0.999988,12.489488,1.0
1525
+ wnc_Latn,197,197,0,0,240044,1.0,1.0,1.0,1.0,0.0,1.0
1526
+ wnu_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
1527
+ wol_Latn,214,214,3,0,240024,0.986175,1.0,0.993039,0.999988,12.498594,1.0
1528
+ wos_Latn,183,183,1,0,240057,0.994565,1.0,0.997275,0.999996,4.16566,1.0
1529
+ wrk_Latn,185,185,0,0,240056,1.0,1.0,1.0,1.0,0.0,1.0
1530
+ wrs_Latn,158,158,1,0,240082,0.993711,1.0,0.996845,0.999996,4.165226,1.0
1531
+ wsk_Latn,128,128,0,0,240113,1.0,1.0,1.0,1.0,0.0,1.0
1532
+ wuu_Hani,148,148,6,0,240087,0.961039,1.0,0.980132,0.999975,24.990316,1.0
1533
+ wuv_Latn,144,144,0,0,240097,1.0,1.0,1.0,1.0,0.0,1.0
1534
+ xal_Cyrl,295,295,1,0,239945,0.996622,1.0,0.998308,0.999996,4.167604,1.0
1535
+ xav_Latn,103,103,2,0,240136,0.980952,1.0,0.990385,0.999992,8.328544,1.0
1536
+ xbi_Latn,165,165,0,0,240076,1.0,1.0,1.0,1.0,0.0,1.0
1537
+ xbr_Latn,8,8,0,0,240233,1.0,1.0,1.0,1.0,0.0,1.0
1538
+ xed_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
1539
+ xho_Latn,367,338,10,29,239864,0.971264,0.920981,0.945455,0.999958,41.688553,0.920981
1540
+ xla_Latn,151,151,0,0,240090,1.0,1.0,1.0,1.0,0.0,1.0
1541
+ xmf_Geor,132,132,2,0,240107,0.985075,1.0,0.992481,0.999992,8.32955,1.0
1542
+ xmm_Latn,32,28,6,4,240203,0.823529,0.875,0.848485,0.999975,24.978248,0.875
1543
+ xmv_Latn,130,97,0,33,240111,1.0,0.746154,0.854626,1.0,0.0,0.746154
1544
+ xnn_Latn,77,77,1,0,240163,0.987179,1.0,0.993548,0.999996,4.163821,1.0
1545
+ xog_Latn,93,91,1,2,240147,0.98913,0.978495,0.983784,0.999996,4.164099,0.978495
1546
+ xon_Latn,118,118,0,0,240123,1.0,1.0,1.0,1.0,0.0,1.0
1547
+ xrb_Latn,91,91,1,0,240149,0.98913,1.0,0.994536,0.999996,4.164064,1.0
1548
+ xsi_Latn,154,154,1,0,240086,0.993548,1.0,0.996764,0.999996,4.165157,1.0
1549
+ xsm_Latn,159,159,1,0,240081,0.99375,1.0,0.996865,0.999996,4.165244,1.0
1550
+ xsr_Deva,167,167,0,0,240074,1.0,1.0,1.0,1.0,0.0,1.0
1551
+ xsu_Latn,3,3,0,0,240238,1.0,1.0,1.0,1.0,0.0,1.0
1552
+ xtd_Latn,73,73,0,0,240168,1.0,1.0,1.0,1.0,0.0,1.0
1553
+ xtm_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
1554
+ xtn_Latn,135,135,0,0,240106,1.0,1.0,1.0,1.0,0.0,1.0
1555
+ xuo_Latn,62,62,0,0,240179,1.0,1.0,1.0,1.0,0.0,1.0
1556
+ yaa_Latn,56,56,0,0,240185,1.0,1.0,1.0,1.0,0.0,1.0
1557
+ yad_Latn,46,46,0,0,240195,1.0,1.0,1.0,1.0,0.0,1.0
1558
+ yal_Latn,129,129,0,0,240112,1.0,1.0,1.0,1.0,0.0,1.0
1559
+ yan_Latn,14,14,0,0,240227,1.0,1.0,1.0,1.0,0.0,1.0
1560
+ yao_Latn,137,137,2,0,240102,0.985612,1.0,0.992754,0.999992,8.329724,1.0
1561
+ yap_Latn,210,210,1,0,240030,0.995261,1.0,0.997625,0.999996,4.166129,1.0
1562
+ yaq_Latn,60,60,0,0,240181,1.0,1.0,1.0,1.0,0.0,1.0
1563
+ ybb_Latn,20,5,1,15,240220,0.833333,0.25,0.384615,0.999996,4.162833,0.25
1564
+ yby_Latn,121,121,0,0,240120,1.0,1.0,1.0,1.0,0.0,1.0
1565
+ ycn_Latn,79,79,0,0,240162,1.0,1.0,1.0,1.0,0.0,1.0
1566
+ ydd_Hebr,430,430,1,0,239810,0.99768,1.0,0.998839,0.999996,4.169951,1.0
1567
+ yka_Latn,215,215,1,0,240025,0.99537,1.0,0.99768,0.999996,4.166215,1.0
1568
+ yle_Latn,119,119,0,0,240122,1.0,1.0,1.0,1.0,0.0,1.0
1569
+ yli_Latn,145,145,0,0,240096,1.0,1.0,1.0,1.0,0.0,1.0
1570
+ yml_Latn,173,173,0,0,240068,1.0,1.0,1.0,1.0,0.0,1.0
1571
+ yom_Latn,117,117,1,0,240123,0.991525,1.0,0.995745,0.999996,4.164515,1.0
1572
+ yon_Latn,127,127,0,0,240114,1.0,1.0,1.0,1.0,0.0,1.0
1573
+ yor_Latn,308,308,2,0,239931,0.993548,1.0,0.996764,0.999992,8.33566,1.0
1574
+ yrb_Latn,188,188,0,0,240053,1.0,1.0,1.0,1.0,0.0,1.0
1575
+ yre_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
1576
+ yrk_Cyrl,61,58,0,3,240180,1.0,0.95082,0.97479,1.0,0.0,0.95082
1577
+ yss_Latn,231,231,0,0,240010,1.0,1.0,1.0,1.0,0.0,1.0
1578
+ yua_Latn,326,324,1,2,239914,0.996923,0.993865,0.995392,0.999996,4.168143,0.993865
1579
+ yue_Hani,194,159,3,35,240044,0.981481,0.819588,0.893258,0.999988,12.497553,0.819588
1580
+ yuj_Latn,205,205,0,0,240036,1.0,1.0,1.0,1.0,0.0,1.0
1581
+ yut_Latn,262,262,0,0,239979,1.0,1.0,1.0,1.0,0.0,1.0
1582
+ yuw_Latn,136,136,0,0,240105,1.0,1.0,1.0,1.0,0.0,1.0
1583
+ yva_Latn,25,25,0,0,240216,1.0,1.0,1.0,1.0,0.0,1.0
1584
+ zaa_Latn,63,63,1,0,240177,0.984375,1.0,0.992126,0.999996,4.163579,1.0
1585
+ zab_Latn,116,116,0,0,240125,1.0,1.0,1.0,1.0,0.0,1.0
1586
+ zac_Latn,138,138,0,0,240103,1.0,1.0,1.0,1.0,0.0,1.0
1587
+ zad_Latn,12,12,0,0,240229,1.0,1.0,1.0,1.0,0.0,1.0
1588
+ zae_Latn,37,37,0,0,240204,1.0,1.0,1.0,1.0,0.0,1.0
1589
+ zai_Latn,80,80,1,0,240160,0.987654,1.0,0.993789,0.999996,4.163873,1.0
1590
+ zam_Latn,52,52,0,0,240189,1.0,1.0,1.0,1.0,0.0,1.0
1591
+ zao_Latn,77,77,0,0,240164,1.0,1.0,1.0,1.0,0.0,1.0
1592
+ zar_Latn,108,108,0,0,240133,1.0,1.0,1.0,1.0,0.0,1.0
1593
+ zas_Latn,58,58,0,0,240183,1.0,1.0,1.0,1.0,0.0,1.0
1594
+ zat_Latn,261,261,0,0,239980,1.0,1.0,1.0,1.0,0.0,1.0
1595
+ zav_Latn,78,78,0,0,240163,1.0,1.0,1.0,1.0,0.0,1.0
1596
+ zaw_Latn,99,99,0,0,240142,1.0,1.0,1.0,1.0,0.0,1.0
1597
+ zdj_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
1598
+ zea_Latn,192,192,3,0,240046,0.984615,1.0,0.992248,0.999988,12.497448,1.0
1599
+ zgh_Tfng,135,64,12,71,240094,0.842105,0.474074,0.606635,0.99995,49.977926,0.474074
1600
+ zia_Latn,76,76,0,0,240165,1.0,1.0,1.0,1.0,0.0,1.0
1601
+ ziw_Latn,142,142,1,0,240098,0.993007,1.0,0.996491,0.999996,4.164949,1.0
1602
+ zne_Latn,195,195,0,0,240046,1.0,1.0,1.0,1.0,0.0,1.0
1603
+ zom_Latn,260,205,9,55,239972,0.957944,0.788462,0.864979,0.999962,37.502969,0.788462
1604
+ zos_Latn,171,171,0,0,240070,1.0,1.0,1.0,1.0,0.0,1.0
1605
+ zpa_Latn,174,174,1,0,240066,0.994286,1.0,0.997135,0.999996,4.165504,1.0
1606
+ zpc_Latn,134,134,0,0,240107,1.0,1.0,1.0,1.0,0.0,1.0
1607
+ zpg_Latn,15,15,0,0,240226,1.0,1.0,1.0,1.0,0.0,1.0
1608
+ zpi_Latn,28,28,0,0,240213,1.0,1.0,1.0,1.0,0.0,1.0
1609
+ zpl_Latn,91,91,0,0,240150,1.0,1.0,1.0,1.0,0.0,1.0
1610
+ zpm_Latn,111,111,0,0,240130,1.0,1.0,1.0,1.0,0.0,1.0
1611
+ zpo_Latn,39,39,0,0,240202,1.0,1.0,1.0,1.0,0.0,1.0
1612
+ zpt_Latn,30,30,0,0,240211,1.0,1.0,1.0,1.0,0.0,1.0
1613
+ zpu_Latn,122,122,0,0,240119,1.0,1.0,1.0,1.0,0.0,1.0
1614
+ zpv_Latn,147,147,0,0,240094,1.0,1.0,1.0,1.0,0.0,1.0
1615
+ zpz_Latn,114,114,0,0,240127,1.0,1.0,1.0,1.0,0.0,1.0
1616
+ zsm_Latn,244,244,22,0,239975,0.917293,1.0,0.956863,0.999908,91.667813,1.0
1617
+ zsr_Latn,124,124,0,0,240117,1.0,1.0,1.0,1.0,0.0,1.0
1618
+ ztq_Latn,187,187,0,0,240054,1.0,1.0,1.0,1.0,0.0,1.0
1619
+ zty_Latn,177,177,0,0,240064,1.0,1.0,1.0,1.0,0.0,1.0
1620
+ zul_Latn,594,500,22,94,239625,0.957854,0.841751,0.896057,0.999908,91.801692,0.841751
1621
+ zyb_Latn,153,153,1,0,240087,0.993506,1.0,0.996743,0.999996,4.165139,1.0
1622
+ zyp_Latn,178,178,0,0,240063,1.0,1.0,1.0,1.0,0.0,1.0
reports/test/glotlid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.977614145795264,
3
+ "top3_accuracy": 0.9977189572137978,
4
+ "top5_accuracy": 0.9983766301339072,
5
+ "passages": 240241,
6
+ "languages": 1621,
7
+ "macro_precision": 0.9782517709855841,
8
+ "macro_recall": 0.9751782136320077,
9
+ "macro_f1": 0.9748179587217549,
10
+ "macro_specificity": 0.9999867952157099,
11
+ "weighted_f1": 0.9776092036050326,
12
+ "median_f1": 1.0,
13
+ "languages_f1_at_least_0_9": 1488,
14
+ "languages_f1_below_0_5": 6,
15
+ "mean_fp_per_million": 13.204784290051938,
16
+ "micro_f1": 0.977614145795264,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9910708837587715,
19
+ "sentence": 0.9852877542189529,
20
+ "short": 0.9663739311301133
21
+ }
22
+ }
reports/test/leaderboard.csv ADDED
The diff for this file is too large to render. See raw diff
 
reports/test/millid_per_language.csv ADDED
The diff for this file is too large to render. See raw diff
 
reports/test/millid_summary.json ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9587247805328816,
3
+ "top3_accuracy": 0.9890484971341278,
4
+ "top5_accuracy": 0.9932401213781161,
5
+ "passages": 240241,
6
+ "languages": 1621,
7
+ "macro_precision": 0.9549770065582561,
8
+ "macro_recall": 0.9588167712047285,
9
+ "macro_f1": 0.9553762683202616,
10
+ "macro_specificity": 0.9999745397211366,
11
+ "weighted_f1": 0.9589133936122667,
12
+ "median_f1": 0.9824561403508771,
13
+ "languages_f1_at_least_0_9": 1446,
14
+ "languages_f1_below_0_5": 8,
15
+ "mean_fp_per_million": 25.46027886332467,
16
+ "micro_f1": 0.9587247805328816,
17
+ "top1_by_size": {
18
+ "paragraph": 0.9832807891792942,
19
+ "sentence": 0.9797006643418943,
20
+ "short": 0.933343407228316
21
+ }
22
+ }
reports/udhr-all/fasttext@millid_per_language.csv ADDED
@@ -0,0 +1,430 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
3
+ abk_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
4
+ ace_Latn,61,60,129,1,27433,0.31746,0.983607,0.48,0.99532,4680.357013,0.983607
5
+ acu_Latn,180,0,0,180,27443,0.0,0.0,0.0,1.0,0.0,0.0
6
+ ada_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
7
+ ady_Cyrl,56,56,59,0,27508,0.486957,1.0,0.654971,0.99786,2140.240142,1.0
8
+ afr_Latn,60,59,6,1,27557,0.907692,0.983333,0.944,0.999782,217.683126,0.983333
9
+ agr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
10
+ aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
11
+ ajg_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
12
+ als_Latn,59,59,80,0,27484,0.42446,1.0,0.59596,0.997098,2902.336381,1.0
13
+ alt_Cyrl,51,51,45,0,27527,0.53125,1.0,0.693878,0.998368,1632.090527,1.0
14
+ amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
15
+ ame_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
16
+ amh_Ethi,51,37,0,14,27572,1.0,0.72549,0.840909,1.0,0.0,0.72549
17
+ ami_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
18
+ amr_Latn,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
19
+ arb_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
20
+ arl_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
21
+ arn_Latn,58,56,28,2,27537,0.666667,0.965517,0.788732,0.998984,1015.780882,0.965517
22
+ ast_Latn,58,58,41,0,27524,0.585859,1.0,0.738854,0.998513,1487.393434,1.0
23
+ auc_Latn,154,0,0,154,27469,0.0,0.0,0.0,1.0,0.0,0.0
24
+ ayr_Latn,59,58,46,1,27518,0.557692,0.983051,0.711656,0.998331,1668.843419,0.983051
25
+ azj_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
26
+ azj_Latn,58,58,81,0,27484,0.417266,1.0,0.588832,0.997061,2938.508979,1.0
27
+ bam_Latn,57,50,561,7,27005,0.081833,0.877193,0.149701,0.979649,20351.157223,0.877193
28
+ ban_Latn,60,60,103,0,27460,0.368098,1.0,0.538117,0.996263,3736.893662,1.0
29
+ bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
30
+ bba_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
31
+ bci_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
32
+ bcl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
33
+ bel_Cyrl,58,58,23,0,27542,0.716049,1.0,0.834532,0.999166,834.391438,1.0
34
+ bem_Latn,57,57,154,0,27412,0.270142,1.0,0.425373,0.994413,5586.592179,1.0
35
+ ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
36
+ bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
37
+ bho_Deva,56,42,7,14,27560,0.857143,0.75,0.8,0.999746,253.926797,0.75
38
+ bin_Latn,47,0,0,47,27576,0.0,0.0,0.0,1.0,0.0,0.0
39
+ bis_Latn,59,59,39,0,27525,0.602041,1.0,0.751592,0.998585,1414.888986,1.0
40
+ blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
41
+ boa_Latn,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
42
+ bod_Tibt,60,58,11,2,27552,0.84058,0.966667,0.899225,0.999601,399.085731,0.966667
43
+ bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
44
+ bos_Latn,59,28,200,31,27364,0.122807,0.474576,0.195122,0.992744,7255.840952,0.474576
45
+ bre_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
46
+ buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
47
+ bug_Latn,60,60,92,0,27471,0.394737,1.0,0.566038,0.996662,3337.807931,1.0
48
+ bul_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
49
+ bum_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
50
+ cab_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
51
+ cak_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
52
+ cat_Latn,58,58,87,0,27478,0.4,1.0,0.571429,0.996844,3156.176311,1.0
53
+ cbi_Latn,62,0,0,62,27561,0.0,0.0,0.0,1.0,0.0,0.0
54
+ cbr_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
55
+ cbs_Latn,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
56
+ cbt_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
57
+ cbu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
58
+ ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
59
+ ceb_Latn,59,59,75,0,27489,0.440299,1.0,0.611399,0.997279,2720.940357,1.0
60
+ ces_Latn,58,58,16,0,27549,0.783784,1.0,0.878788,0.99942,580.446218,1.0
61
+ cfm_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
62
+ cha_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
63
+ chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
64
+ chk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
65
+ chr_Cher,115,0,0,115,27508,0.0,0.0,0.0,1.0,0.0,0.0
66
+ chv_Cyrl,25,25,6,0,27592,0.806452,1.0,0.892857,0.999783,217.407058,1.0
67
+ cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
68
+ cjk_Latn,114,110,191,4,27318,0.365449,0.964912,0.53012,0.993057,6943.182231,0.964912
69
+ cjs_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
70
+ cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
71
+ cmn_Hani,319,119,139,200,27165,0.46124,0.373041,0.412478,0.994909,5090.829183,0.373041
72
+ cnh_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
73
+ cni_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
74
+ cnr_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
75
+ cof_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
76
+ cos_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
77
+ cot_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
78
+ cpu_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
79
+ crh_Latn,59,59,28,0,27536,0.678161,1.0,0.808219,0.998984,1015.817733,1.0
80
+ cri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
81
+ crs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
82
+ csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
83
+ csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
84
+ ctd_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
85
+ cym_Latn,60,60,30,0,27533,0.666667,1.0,0.8,0.998912,1088.41563,1.0
86
+ dag_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
87
+ dan_Latn,61,60,4,1,27558,0.9375,0.983607,0.96,0.999855,145.127349,0.983607
88
+ ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
89
+ deu_Latn,67,67,6,0,27550,0.917808,1.0,0.957143,0.999782,217.738424,1.0
90
+ dga_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
91
+ dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
92
+ div_Thaa,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
93
+ dje_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
94
+ duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
95
+ dyo_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
96
+ dyu_Latn,58,1,103,57,27462,0.009615,0.017241,0.012346,0.996263,3736.622529,0.017241
97
+ dzo_Tibt,59,48,5,11,27559,0.90566,0.813559,0.857143,0.999819,181.396024,0.813559
98
+ ekk_Latn,60,60,239,0,27324,0.200669,1.0,0.334262,0.991329,8671.044516,1.0
99
+ ell_Grek,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
100
+ emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
101
+ eng_Latn,58,58,80,0,27485,0.42029,1.0,0.591837,0.997098,2902.23109,1.0
102
+ epo_Latn,58,58,225,0,27340,0.204947,1.0,0.340176,0.991837,8162.524941,1.0
103
+ ese_Latn,35,0,0,35,27588,0.0,0.0,0.0,1.0,0.0,0.0
104
+ eus_Latn,59,58,15,1,27549,0.794521,0.983051,0.878788,0.999456,544.188071,0.983051
105
+ eve_Cyrl,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
106
+ evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
107
+ ewe_Latn,59,58,124,1,27440,0.318681,0.983051,0.481328,0.995501,4498.62139,0.983051
108
+ fao_Latn,57,34,2,23,27564,0.944444,0.596491,0.731183,0.999927,72.553145,0.596491
109
+ fas_Arab,114,114,26,0,27483,0.814286,1.0,0.897638,0.999055,945.145225,1.0
110
+ fat_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
111
+ fij_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
112
+ fil_Latn,60,60,97,0,27466,0.382166,1.0,0.552995,0.996481,3519.210536,1.0
113
+ fin_Latn,61,61,323,0,27239,0.158854,1.0,0.274157,0.988281,11719.033452,1.0
114
+ fkv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
115
+ fon_Latn,58,58,151,0,27414,0.277512,1.0,0.434457,0.994522,5477.961183,1.0
116
+ fra_Latn,58,58,11,0,27554,0.84058,1.0,0.913386,0.999601,399.056775,1.0
117
+ fry_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
118
+ fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
119
+ fuf_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
120
+ fur_Latn,59,59,77,0,27487,0.433824,1.0,0.605128,0.997207,2793.498767,1.0
121
+ fuv_Latn,108,108,387,0,27128,0.218182,1.0,0.358209,0.985935,14065.055424,1.0
122
+ fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
123
+ gaa_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
124
+ gag_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
125
+ gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
126
+ gaz_Latn,60,60,132,0,27431,0.3125,1.0,0.47619,0.995211,4789.02877,1.0
127
+ gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
128
+ gjn_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
129
+ gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
130
+ gla_Latn,62,58,2,4,27559,0.966667,0.935484,0.95082,0.999927,72.566307,0.935484
131
+ gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
132
+ gle_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
133
+ glg_Latn,58,58,31,0,27534,0.651685,1.0,0.789116,0.998875,1124.614547,1.0
134
+ glv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
135
+ gsw_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
136
+ guc_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
137
+ gug_Latn,49,49,323,0,27251,0.13172,1.0,0.232779,0.988286,11713.933416,1.0
138
+ guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
139
+ guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
140
+ guu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
141
+ gyr_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
142
+ hak_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
143
+ hat_Latn,117,116,99,1,27407,0.539535,0.991453,0.698795,0.996401,3599.214717,0.991453
144
+ hau_Latn,155,155,53,0,27415,0.745192,1.0,0.853994,0.99807,1929.517985,1.0
145
+ haw_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
146
+ hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
147
+ heb_Hebr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
148
+ hil_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
149
+ hin_Deva,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
150
+ hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
151
+ hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
152
+ hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
153
+ hnj_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
154
+ hns_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
155
+ hrv_Latn,58,54,123,4,27442,0.305085,0.931034,0.459574,0.995538,4462.180301,0.931034
156
+ hsb_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
157
+ hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
158
+ hun_Latn,59,59,287,0,27277,0.17052,1.0,0.291358,0.989588,10412.131766,1.0
159
+ hus_Latn,175,0,0,175,27448,0.0,0.0,0.0,1.0,0.0,0.0
160
+ huu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
161
+ hye_Armn,70,68,0,2,27553,1.0,0.971429,0.985507,1.0,0.0,0.971429
162
+ ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
163
+ ibo_Latn,58,58,59,0,27506,0.495726,1.0,0.662857,0.99786,2140.395429,1.0
164
+ ido_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
165
+ idu_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
166
+ iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
167
+ ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
168
+ ike_Cans,44,0,0,44,27579,0.0,0.0,0.0,1.0,0.0,0.0
169
+ ilo_Latn,58,58,21,0,27544,0.734177,1.0,0.846715,0.999238,761.835661,1.0
170
+ ina_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
171
+ ind_Latn,60,52,85,8,27478,0.379562,0.866667,0.527919,0.996916,3083.844284,0.866667
172
+ isl_Latn,58,58,24,0,27541,0.707317,1.0,0.828571,0.999129,870.669327,1.0
173
+ ita_Latn,58,58,98,0,27467,0.371795,1.0,0.542056,0.996445,3555.233085,1.0
174
+ jav_Java,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
175
+ jav_Latn,60,59,130,1,27433,0.312169,0.983333,0.473896,0.995284,4716.467728,0.983333
176
+ jiv_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
177
+ jpn_Jpan,140,134,23,6,27460,0.853503,0.957143,0.902357,0.999163,836.880981,0.957143
178
+ kaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
179
+ kab_Latn,58,58,9,0,27556,0.865672,1.0,0.928,0.999673,326.500998,1.0
180
+ kal_Latn,58,57,36,1,27529,0.612903,0.982759,0.754967,0.998694,1306.003991,0.982759
181
+ kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
182
+ kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
183
+ kaz_Cyrl,58,58,145,0,27420,0.285714,1.0,0.444444,0.99474,5260.293851,1.0
184
+ kbd_Cyrl,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
185
+ kbp_Latn,59,58,281,1,27283,0.171091,0.983051,0.291457,0.989806,10194.456538,0.983051
186
+ kbr_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
187
+ kde_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
188
+ kdh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
189
+ kea_Latn,58,12,141,46,27424,0.078431,0.206897,0.113744,0.994885,5115.182296,0.206897
190
+ kek_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
191
+ kha_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
192
+ khk_Cyrl,57,57,31,0,27535,0.647727,1.0,0.786207,0.998875,1124.57375,1.0
193
+ khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
194
+ kin_Latn,59,51,16,8,27548,0.761194,0.864407,0.809524,0.99942,580.467276,0.864407
195
+ kir_Cyrl,58,58,76,0,27489,0.432836,1.0,0.604167,0.997243,2757.119536,1.0
196
+ kjh_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
197
+ kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
198
+ kmb_Latn,116,111,31,5,27476,0.78169,0.956897,0.860465,0.998873,1126.985858,0.956897
199
+ kmr_Latn,58,58,49,0,27516,0.542056,1.0,0.70303,0.998222,1777.616543,1.0
200
+ knc_Latn,64,64,201,0,27358,0.241509,1.0,0.389058,0.992707,7293.443158,1.0
201
+ kng_Latn,115,72,132,43,27376,0.352941,0.626087,0.451411,0.995201,4798.604042,0.626087
202
+ koi_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
203
+ koo_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
204
+ kor_Hang,58,58,17,0,27548,0.773333,1.0,0.87218,0.999383,616.724107,1.0
205
+ kqn_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
206
+ kqs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
207
+ kri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
208
+ krl_Latn,183,0,0,183,27440,0.0,0.0,0.0,1.0,0.0,0.0
209
+ ktu_Latn,118,0,0,118,27505,0.0,0.0,0.0,1.0,0.0,0.0
210
+ kwi_Latn,145,0,0,145,27478,0.0,0.0,0.0,1.0,0.0,0.0
211
+ lad_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
212
+ lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
213
+ lat_Latn,118,0,0,118,27505,0.0,0.0,0.0,1.0,0.0,0.0
214
+ lia_Latn,45,0,0,45,27578,0.0,0.0,0.0,1.0,0.0,0.0
215
+ lij_Latn,58,57,151,1,27414,0.274038,0.982759,0.428571,0.994522,5477.961183,0.982759
216
+ lin_Latn,110,109,3,1,27510,0.973214,0.990909,0.981982,0.999891,109.039363,0.990909
217
+ lit_Latn,58,58,27,0,27538,0.682353,1.0,0.811189,0.99902,979.502993,1.0
218
+ lld_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
219
+ lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
220
+ lob_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
221
+ lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
222
+ loz_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
223
+ ltz_Latn,59,58,67,1,27497,0.464,0.983051,0.630435,0.997569,2430.706719,0.983051
224
+ lua_Latn,58,53,56,5,27509,0.486239,0.913793,0.634731,0.997968,2031.561763,0.913793
225
+ lue_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
226
+ lug_Latn,49,49,198,0,27376,0.198381,1.0,0.331081,0.992819,7180.67745,1.0
227
+ lun_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
228
+ lus_Latn,58,58,216,0,27349,0.211679,1.0,0.349398,0.992164,7836.023943,1.0
229
+ lvs_Latn,115,115,2,0,27506,0.982906,1.0,0.991379,0.999927,72.706122,1.0
230
+ mad_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
231
+ mag_Deva,53,49,61,4,27509,0.445455,0.924528,0.601227,0.997787,2212.549873,0.924528
232
+ mah_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
233
+ mai_Deva,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
234
+ mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
235
+ mam_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
236
+ mar_Deva,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
237
+ maz_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
238
+ mcd_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
239
+ mcf_Latn,62,0,0,62,27561,0.0,0.0,0.0,1.0,0.0,0.0
240
+ men_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
241
+ mfq_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
242
+ mic_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
243
+ min_Latn,59,4,0,55,27564,1.0,0.067797,0.126984,1.0,0.0,0.067797
244
+ miq_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
245
+ mkd_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
246
+ mlt_Latn,59,59,18,0,27546,0.766234,1.0,0.867647,0.999347,653.025686,1.0
247
+ mnw_Mymr,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
248
+ mor_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
249
+ mos_Latn,56,56,23,0,27544,0.708861,1.0,0.82963,0.999166,834.330903,1.0
250
+ mri_Latn,57,57,202,0,27364,0.220077,1.0,0.360759,0.992672,7327.867663,1.0
251
+ mto_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
252
+ mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
253
+ mxv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
254
+ mya_Mymr,56,56,55,0,27512,0.504505,1.0,0.670659,0.998005,1995.139116,1.0
255
+ mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
256
+ nan_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
257
+ nav_Latn,59,59,97,0,27467,0.378205,1.0,0.548837,0.996481,3519.082862,1.0
258
+ nba_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
259
+ nbl_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
260
+ ndo_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
261
+ nds_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
262
+ nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
263
+ nio_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
264
+ niu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
265
+ niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
266
+ njo_Latn,64,0,0,64,27559,0.0,0.0,0.0,1.0,0.0,0.0
267
+ nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
268
+ nld_Latn,58,58,49,0,27516,0.542056,1.0,0.70303,0.998222,1777.616543,1.0
269
+ nno_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
270
+ nob_Latn,62,62,2,0,27559,0.96875,1.0,0.984127,0.999927,72.566307,1.0
271
+ not_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
272
+ npi_Deva,55,55,5,0,27563,0.916667,1.0,0.956522,0.999819,181.369704,1.0
273
+ nso_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
274
+ nya_Latn,116,116,62,0,27445,0.651685,1.0,0.789116,0.997746,2253.971716,1.0
275
+ nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
276
+ nyn_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
277
+ nzi_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
278
+ oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
279
+ oci_Latn,398,152,161,246,27064,0.485623,0.38191,0.427567,0.994086,5913.682277,0.38191
280
+ ojb_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
281
+ oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
282
+ orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
283
+ oss_Cyrl,44,44,4,0,27575,0.916667,1.0,0.956522,0.999855,145.037891,1.0
284
+ ote_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
285
+ pam_Latn,66,0,0,66,27557,0.0,0.0,0.0,1.0,0.0,0.0
286
+ pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
287
+ pap_Latn,58,58,53,0,27512,0.522523,1.0,0.686391,0.998077,1922.728097,1.0
288
+ pau_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
289
+ pbb_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
290
+ pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
291
+ pcd_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
292
+ pcm_Latn,56,53,2,3,27565,0.963636,0.946429,0.954955,0.999927,72.550513,0.946429
293
+ pis_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
294
+ piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
295
+ plt_Latn,53,53,9,0,27561,0.854839,1.0,0.921739,0.999674,326.441785,1.0
296
+ pnb_Arab,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
297
+ pol_Latn,59,58,50,1,27514,0.537037,0.983051,0.694611,0.998186,1813.960238,0.983051
298
+ pon_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
299
+ por_Latn,115,115,65,0,27443,0.638889,1.0,0.779661,0.997637,2362.94896,1.0
300
+ pov_Latn,115,0,0,115,27508,0.0,0.0,0.0,1.0,0.0,0.0
301
+ ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
302
+ quc_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
303
+ que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
304
+ qug_Latn,182,0,0,182,27441,0.0,0.0,0.0,1.0,0.0,0.0
305
+ quh_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
306
+ quy_Latn,60,59,1179,1,26384,0.047658,0.983333,0.090909,0.957225,42774.734245,0.983333
307
+ quz_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
308
+ qva_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
309
+ qvc_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
310
+ qvh_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
311
+ qvm_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
312
+ qvn_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
313
+ qwh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
314
+ qxn_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
315
+ qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
316
+ rar_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
317
+ rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
318
+ rmn_Latn,116,0,0,116,27507,0.0,0.0,0.0,1.0,0.0,0.0
319
+ roh_Latn,399,399,50,0,27174,0.888641,1.0,0.941038,0.998163,1836.614752,1.0
320
+ ron_Latn,97,96,27,1,27499,0.780488,0.989691,0.872727,0.999019,980.890794,0.989691
321
+ run_Latn,58,58,45,0,27520,0.563107,1.0,0.720497,0.998367,1632.504988,1.0
322
+ rup_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
323
+ rus_Cyrl,58,58,70,0,27495,0.453125,1.0,0.623656,0.997461,2539.452204,1.0
324
+ sag_Latn,59,7,12,52,27552,0.368421,0.118644,0.179487,0.999565,435.350457,0.118644
325
+ sah_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
326
+ san_Deva,55,54,4,1,27564,0.931034,0.981818,0.955752,0.999855,145.095763,0.981818
327
+ san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
328
+ sco_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
329
+ sey_Latn,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
330
+ shk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
331
+ shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
332
+ shp_Latn,62,0,0,62,27561,0.0,0.0,0.0,1.0,0.0,0.0
333
+ sid_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
334
+ sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
335
+ skr_Arab,63,0,0,63,27560,0.0,0.0,0.0,1.0,0.0,0.0
336
+ slk_Latn,56,56,10,0,27557,0.848485,1.0,0.918033,0.999637,362.752566,1.0
337
+ slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
338
+ slv_Latn,59,59,36,0,27528,0.621053,1.0,0.766234,0.998694,1306.051371,1.0
339
+ sme_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
340
+ smo_Latn,63,61,31,2,27529,0.663043,0.968254,0.787097,0.998875,1124.818578,0.968254
341
+ sna_Latn,60,57,92,3,27471,0.38255,0.95,0.545455,0.996662,3337.807931,0.95
342
+ snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
343
+ snn_Latn,136,0,0,136,27487,0.0,0.0,0.0,1.0,0.0,0.0
344
+ som_Latn,57,57,82,0,27484,0.410072,1.0,0.581633,0.997025,2974.678952,1.0
345
+ sot_Latn,57,46,20,11,27546,0.69697,0.807018,0.747967,0.999274,725.531452,0.807018
346
+ spa_Latn,78,78,128,0,27417,0.378641,1.0,0.549296,0.995353,4646.941369,1.0
347
+ src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
348
+ srp_Cyrl,59,58,58,1,27506,0.5,0.983051,0.662857,0.997896,2104.193876,0.983051
349
+ srp_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
350
+ srr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
351
+ ssw_Latn,59,59,25,0,27539,0.702381,1.0,0.825175,0.999093,906.980119,1.0
352
+ suk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
353
+ sun_Latn,66,65,48,1,27509,0.575221,0.984848,0.726257,0.998258,1741.844178,0.984848
354
+ sus_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
355
+ swb_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
356
+ swe_Latn,61,61,2,0,27560,0.968254,1.0,0.983871,0.999927,72.563675,1.0
357
+ swh_Latn,58,58,239,0,27326,0.195286,1.0,0.326761,0.99133,8670.415382,1.0
358
+ tah_Latn,57,57,4,0,27562,0.934426,1.0,0.966102,0.999855,145.10629,1.0
359
+ taj_Deva,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
360
+ tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
361
+ tat_Cyrl,57,57,124,0,27442,0.314917,1.0,0.478992,0.995502,4498.295001,1.0
362
+ tbz_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
363
+ tca_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
364
+ tdt_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
365
+ tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
366
+ tem_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
367
+ tet_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
368
+ tgk_Cyrl,57,57,142,0,27424,0.286432,1.0,0.445312,0.994849,5151.273308,1.0
369
+ tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
370
+ tha_Thai,114,114,1,0,27508,0.991304,1.0,0.995633,0.999964,36.351739,1.0
371
+ tir_Ethi,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
372
+ tiv_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
373
+ tly_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
374
+ tob_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
375
+ toi_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
376
+ toj_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
377
+ ton_Latn,60,0,32,60,27531,0.0,0.0,0.0,0.998839,1160.976672,0.0
378
+ top_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
379
+ tpi_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
380
+ tsn_Latn,58,58,16,0,27549,0.783784,1.0,0.878788,0.99942,580.446218,1.0
381
+ tso_Latn,114,114,118,0,27391,0.491379,1.0,0.65896,0.99571,4289.505253,1.0
382
+ tsz_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
383
+ tuk_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
384
+ tuk_Latn,59,59,4,0,27560,0.936508,1.0,0.967213,0.999855,145.116819,1.0
385
+ tur_Latn,59,59,128,0,27436,0.315508,1.0,0.479675,0.995356,4643.738209,1.0
386
+ twi_Latn,116,116,401,0,27106,0.224371,1.0,0.366509,0.985422,14578.107391,1.0
387
+ tyv_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
388
+ tzh_Latn,25,0,0,25,27598,0.0,0.0,0.0,1.0,0.0,0.0
389
+ tzm_Tfng,1,1,59,0,27563,0.016667,1.0,0.032787,0.997864,2135.978568,1.0
390
+ tzo_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
391
+ udu_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
392
+ uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
393
+ uig_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
394
+ ukr_Cyrl,58,58,5,0,27560,0.920635,1.0,0.958678,0.999819,181.389443,1.0
395
+ umb_Latn,107,104,20,3,27496,0.83871,0.971963,0.900433,0.999273,726.849833,0.971963
396
+ ura_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
397
+ urd_Arab,108,108,124,0,27391,0.465517,1.0,0.635294,0.995493,4506.632746,1.0
398
+ uzn_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
399
+ uzn_Latn,58,58,217,0,27348,0.210909,1.0,0.348348,0.992128,7872.301832,1.0
400
+ vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
401
+ vec_Latn,58,58,29,0,27536,0.666667,1.0,0.8,0.998948,1052.05877,1.0
402
+ ven_Latn,89,0,0,89,27534,0.0,0.0,0.0,1.0,0.0,0.0
403
+ vep_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
404
+ vie_Latn,60,60,9,0,27554,0.869565,1.0,0.930233,0.999673,326.524689,1.0
405
+ vmw_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
406
+ war_Latn,60,59,7,1,27556,0.893939,0.983333,0.936508,0.999746,253.963647,0.983333
407
+ wln_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
408
+ wol_Latn,60,60,457,0,27106,0.116054,1.0,0.207972,0.98342,16580.198092,1.0
409
+ wuu_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
410
+ wwa_Latn,39,0,0,39,27584,0.0,0.0,0.0,1.0,0.0,0.0
411
+ xho_Latn,58,58,49,0,27516,0.542056,1.0,0.70303,0.998222,1777.616543,1.0
412
+ xsm_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
413
+ yad_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
414
+ yao_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
415
+ yap_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
416
+ ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
417
+ ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
418
+ yor_Latn,57,57,84,0,27482,0.404255,1.0,0.575758,0.996953,3047.232098,1.0
419
+ yrk_Cyrl,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
420
+ yua_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
421
+ yue_Hani,49,45,1216,4,26358,0.035686,0.918367,0.068702,0.9559,44099.514035,0.918367
422
+ zam_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
423
+ zdj_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
424
+ zgh_Tfng,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
425
+ zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
426
+ zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
427
+ zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
428
+ ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
429
+ zul_Latn,58,58,77,0,27488,0.42963,1.0,0.601036,0.997207,2793.397424,1.0
430
+ zyb_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
reports/udhr-all/fasttext@millid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.39644499149259677,
3
+ "top3_accuracy": 0.4159577163957572,
4
+ "top5_accuracy": 0.42004851029938817,
5
+ "passages": 27623,
6
+ "languages": 429,
7
+ "macro_precision": 0.2478791005299098,
8
+ "macro_recall": 0.3741155533322177,
9
+ "macro_f1": 0.27967804305179117,
10
+ "macro_specificity": 0.998819804723614,
11
+ "weighted_f1": 0.3054055953686982,
12
+ "median_f1": 0.0,
13
+ "languages_f1_at_least_0_9": 55,
14
+ "languages_f1_below_0_5": 299,
15
+ "mean_fp_per_million": 1180.1952763859204,
16
+ "micro_f1": 0.39644499149259677
17
+ }
reports/udhr-all/fasttext_per_language.csv ADDED
@@ -0,0 +1,430 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
3
+ abk_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
4
+ ace_Latn,61,60,129,1,27433,0.31746,0.983607,0.48,0.99532,4680.357013,0.983607
5
+ acu_Latn,180,0,0,180,27443,0.0,0.0,0.0,1.0,0.0,0.0
6
+ ada_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
7
+ ady_Cyrl,56,56,59,0,27508,0.486957,1.0,0.654971,0.99786,2140.240142,1.0
8
+ afr_Latn,60,59,6,1,27557,0.907692,0.983333,0.944,0.999782,217.683126,0.983333
9
+ agr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
10
+ aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
11
+ ajg_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
12
+ als_Latn,59,59,80,0,27484,0.42446,1.0,0.59596,0.997098,2902.336381,1.0
13
+ alt_Cyrl,51,51,45,0,27527,0.53125,1.0,0.693878,0.998368,1632.090527,1.0
14
+ amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
15
+ ame_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
16
+ amh_Ethi,51,37,0,14,27572,1.0,0.72549,0.840909,1.0,0.0,0.72549
17
+ ami_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
18
+ amr_Latn,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
19
+ arb_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
20
+ arl_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
21
+ arn_Latn,58,56,28,2,27537,0.666667,0.965517,0.788732,0.998984,1015.780882,0.965517
22
+ ast_Latn,58,58,41,0,27524,0.585859,1.0,0.738854,0.998513,1487.393434,1.0
23
+ auc_Latn,154,0,0,154,27469,0.0,0.0,0.0,1.0,0.0,0.0
24
+ ayr_Latn,59,58,46,1,27518,0.557692,0.983051,0.711656,0.998331,1668.843419,0.983051
25
+ azj_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
26
+ azj_Latn,58,58,81,0,27484,0.417266,1.0,0.588832,0.997061,2938.508979,1.0
27
+ bam_Latn,57,50,555,7,27011,0.082645,0.877193,0.151057,0.979867,20133.497787,0.877193
28
+ ban_Latn,60,60,103,0,27460,0.368098,1.0,0.538117,0.996263,3736.893662,1.0
29
+ bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
30
+ bba_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
31
+ bci_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
32
+ bcl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
33
+ bel_Cyrl,58,58,23,0,27542,0.716049,1.0,0.834532,0.999166,834.391438,1.0
34
+ bem_Latn,57,57,154,0,27412,0.270142,1.0,0.425373,0.994413,5586.592179,1.0
35
+ ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
36
+ bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
37
+ bho_Deva,56,42,7,14,27560,0.857143,0.75,0.8,0.999746,253.926797,0.75
38
+ bin_Latn,47,0,0,47,27576,0.0,0.0,0.0,1.0,0.0,0.0
39
+ bis_Latn,59,59,39,0,27525,0.602041,1.0,0.751592,0.998585,1414.888986,1.0
40
+ blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
41
+ boa_Latn,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
42
+ bod_Tibt,60,58,11,2,27552,0.84058,0.966667,0.899225,0.999601,399.085731,0.966667
43
+ bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
44
+ bos_Latn,59,28,200,31,27364,0.122807,0.474576,0.195122,0.992744,7255.840952,0.474576
45
+ bre_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
46
+ buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
47
+ bug_Latn,60,60,92,0,27471,0.394737,1.0,0.566038,0.996662,3337.807931,1.0
48
+ bul_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
49
+ bum_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
50
+ cab_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
51
+ cak_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
52
+ cat_Latn,58,58,87,0,27478,0.4,1.0,0.571429,0.996844,3156.176311,1.0
53
+ cbi_Latn,62,0,0,62,27561,0.0,0.0,0.0,1.0,0.0,0.0
54
+ cbr_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
55
+ cbs_Latn,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
56
+ cbt_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
57
+ cbu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
58
+ ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
59
+ ceb_Latn,59,59,75,0,27489,0.440299,1.0,0.611399,0.997279,2720.940357,1.0
60
+ ces_Latn,58,58,16,0,27549,0.783784,1.0,0.878788,0.99942,580.446218,1.0
61
+ cfm_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
62
+ cha_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
63
+ chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
64
+ chk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
65
+ chr_Cher,115,0,0,115,27508,0.0,0.0,0.0,1.0,0.0,0.0
66
+ chv_Cyrl,25,25,6,0,27592,0.806452,1.0,0.892857,0.999783,217.407058,1.0
67
+ cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
68
+ cjk_Latn,114,110,191,4,27318,0.365449,0.964912,0.53012,0.993057,6943.182231,0.964912
69
+ cjs_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
70
+ cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
71
+ cmn_Hani,319,119,139,200,27165,0.46124,0.373041,0.412478,0.994909,5090.829183,0.373041
72
+ cnh_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
73
+ cni_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
74
+ cnr_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
75
+ cof_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
76
+ cos_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
77
+ cot_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
78
+ cpu_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
79
+ crh_Latn,59,59,28,0,27536,0.678161,1.0,0.808219,0.998984,1015.817733,1.0
80
+ cri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
81
+ crs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
82
+ csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
83
+ csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
84
+ ctd_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
85
+ cym_Latn,60,60,30,0,27533,0.666667,1.0,0.8,0.998912,1088.41563,1.0
86
+ dag_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
87
+ dan_Latn,61,60,4,1,27558,0.9375,0.983607,0.96,0.999855,145.127349,0.983607
88
+ ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
89
+ deu_Latn,67,67,6,0,27550,0.917808,1.0,0.957143,0.999782,217.738424,1.0
90
+ dga_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
91
+ dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
92
+ div_Thaa,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
93
+ dje_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
94
+ duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
95
+ dyo_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
96
+ dyu_Latn,58,1,103,57,27462,0.009615,0.017241,0.012346,0.996263,3736.622529,0.017241
97
+ dzo_Tibt,59,48,5,11,27559,0.90566,0.813559,0.857143,0.999819,181.396024,0.813559
98
+ ekk_Latn,60,60,239,0,27324,0.200669,1.0,0.334262,0.991329,8671.044516,1.0
99
+ ell_Grek,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
100
+ emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
101
+ eng_Latn,58,58,80,0,27485,0.42029,1.0,0.591837,0.997098,2902.23109,1.0
102
+ epo_Latn,58,58,225,0,27340,0.204947,1.0,0.340176,0.991837,8162.524941,1.0
103
+ ese_Latn,35,0,0,35,27588,0.0,0.0,0.0,1.0,0.0,0.0
104
+ eus_Latn,59,58,15,1,27549,0.794521,0.983051,0.878788,0.999456,544.188071,0.983051
105
+ eve_Cyrl,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
106
+ evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
107
+ ewe_Latn,59,58,124,1,27440,0.318681,0.983051,0.481328,0.995501,4498.62139,0.983051
108
+ fao_Latn,57,34,2,23,27564,0.944444,0.596491,0.731183,0.999927,72.553145,0.596491
109
+ fas_Arab,114,114,26,0,27483,0.814286,1.0,0.897638,0.999055,945.145225,1.0
110
+ fat_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
111
+ fij_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
112
+ fil_Latn,60,60,97,0,27466,0.382166,1.0,0.552995,0.996481,3519.210536,1.0
113
+ fin_Latn,61,61,323,0,27239,0.158854,1.0,0.274157,0.988281,11719.033452,1.0
114
+ fkv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
115
+ fon_Latn,58,58,151,0,27414,0.277512,1.0,0.434457,0.994522,5477.961183,1.0
116
+ fra_Latn,58,58,11,0,27554,0.84058,1.0,0.913386,0.999601,399.056775,1.0
117
+ fry_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
118
+ fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
119
+ fuf_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
120
+ fur_Latn,59,59,76,0,27488,0.437037,1.0,0.608247,0.997243,2757.219562,1.0
121
+ fuv_Latn,108,108,387,0,27128,0.218182,1.0,0.358209,0.985935,14065.055424,1.0
122
+ fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
123
+ gaa_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
124
+ gag_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
125
+ gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
126
+ gaz_Latn,60,60,132,0,27431,0.3125,1.0,0.47619,0.995211,4789.02877,1.0
127
+ gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
128
+ gjn_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
129
+ gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
130
+ gla_Latn,62,58,2,4,27559,0.966667,0.935484,0.95082,0.999927,72.566307,0.935484
131
+ gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
132
+ gle_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
133
+ glg_Latn,58,58,31,0,27534,0.651685,1.0,0.789116,0.998875,1124.614547,1.0
134
+ glv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
135
+ gsw_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
136
+ guc_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
137
+ gug_Latn,49,49,323,0,27251,0.13172,1.0,0.232779,0.988286,11713.933416,1.0
138
+ guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
139
+ guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
140
+ guu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
141
+ gyr_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
142
+ hak_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
143
+ hat_Latn,117,116,99,1,27407,0.539535,0.991453,0.698795,0.996401,3599.214717,0.991453
144
+ hau_Latn,155,155,53,0,27415,0.745192,1.0,0.853994,0.99807,1929.517985,1.0
145
+ haw_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
146
+ hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
147
+ heb_Hebr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
148
+ hil_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
149
+ hin_Deva,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
150
+ hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
151
+ hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
152
+ hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
153
+ hnj_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
154
+ hns_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
155
+ hrv_Latn,58,54,123,4,27442,0.305085,0.931034,0.459574,0.995538,4462.180301,0.931034
156
+ hsb_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
157
+ hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
158
+ hun_Latn,59,59,287,0,27277,0.17052,1.0,0.291358,0.989588,10412.131766,1.0
159
+ hus_Latn,175,0,0,175,27448,0.0,0.0,0.0,1.0,0.0,0.0
160
+ huu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
161
+ hye_Armn,70,68,0,2,27553,1.0,0.971429,0.985507,1.0,0.0,0.971429
162
+ ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
163
+ ibo_Latn,58,58,59,0,27506,0.495726,1.0,0.662857,0.99786,2140.395429,1.0
164
+ ido_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
165
+ idu_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
166
+ iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
167
+ ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
168
+ ike_Cans,44,0,0,44,27579,0.0,0.0,0.0,1.0,0.0,0.0
169
+ ilo_Latn,58,58,21,0,27544,0.734177,1.0,0.846715,0.999238,761.835661,1.0
170
+ ina_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
171
+ ind_Latn,60,52,85,8,27478,0.379562,0.866667,0.527919,0.996916,3083.844284,0.866667
172
+ isl_Latn,58,58,24,0,27541,0.707317,1.0,0.828571,0.999129,870.669327,1.0
173
+ ita_Latn,58,58,98,0,27467,0.371795,1.0,0.542056,0.996445,3555.233085,1.0
174
+ jav_Java,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
175
+ jav_Latn,60,59,130,1,27433,0.312169,0.983333,0.473896,0.995284,4716.467728,0.983333
176
+ jiv_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
177
+ jpn_Jpan,140,134,23,6,27460,0.853503,0.957143,0.902357,0.999163,836.880981,0.957143
178
+ kaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
179
+ kab_Latn,58,58,8,0,27557,0.878788,1.0,0.935484,0.99971,290.223109,1.0
180
+ kal_Latn,58,57,36,1,27529,0.612903,0.982759,0.754967,0.998694,1306.003991,0.982759
181
+ kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
182
+ kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
183
+ kaz_Cyrl,58,58,145,0,27420,0.285714,1.0,0.444444,0.99474,5260.293851,1.0
184
+ kbd_Cyrl,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
185
+ kbp_Latn,59,58,281,1,27283,0.171091,0.983051,0.291457,0.989806,10194.456538,0.983051
186
+ kbr_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
187
+ kde_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
188
+ kdh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
189
+ kea_Latn,58,12,140,46,27425,0.078947,0.206897,0.114286,0.994921,5078.904408,0.206897
190
+ kek_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
191
+ kha_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
192
+ khk_Cyrl,57,57,31,0,27535,0.647727,1.0,0.786207,0.998875,1124.57375,1.0
193
+ khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
194
+ kin_Latn,59,51,16,8,27548,0.761194,0.864407,0.809524,0.99942,580.467276,0.864407
195
+ kir_Cyrl,58,58,76,0,27489,0.432836,1.0,0.604167,0.997243,2757.119536,1.0
196
+ kjh_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
197
+ kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
198
+ kmb_Latn,116,111,31,5,27476,0.78169,0.956897,0.860465,0.998873,1126.985858,0.956897
199
+ kmr_Latn,58,58,49,0,27516,0.542056,1.0,0.70303,0.998222,1777.616543,1.0
200
+ knc_Latn,64,64,201,0,27358,0.241509,1.0,0.389058,0.992707,7293.443158,1.0
201
+ kng_Latn,115,72,132,43,27376,0.352941,0.626087,0.451411,0.995201,4798.604042,0.626087
202
+ koi_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
203
+ koo_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
204
+ kor_Hang,58,58,17,0,27548,0.773333,1.0,0.87218,0.999383,616.724107,1.0
205
+ kqn_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
206
+ kqs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
207
+ kri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
208
+ krl_Latn,183,0,0,183,27440,0.0,0.0,0.0,1.0,0.0,0.0
209
+ ktu_Latn,118,0,0,118,27505,0.0,0.0,0.0,1.0,0.0,0.0
210
+ kwi_Latn,145,0,0,145,27478,0.0,0.0,0.0,1.0,0.0,0.0
211
+ lad_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
212
+ lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
213
+ lat_Latn,118,0,0,118,27505,0.0,0.0,0.0,1.0,0.0,0.0
214
+ lia_Latn,45,0,0,45,27578,0.0,0.0,0.0,1.0,0.0,0.0
215
+ lij_Latn,58,57,151,1,27414,0.274038,0.982759,0.428571,0.994522,5477.961183,0.982759
216
+ lin_Latn,110,109,3,1,27510,0.973214,0.990909,0.981982,0.999891,109.039363,0.990909
217
+ lit_Latn,58,58,27,0,27538,0.682353,1.0,0.811189,0.99902,979.502993,1.0
218
+ lld_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
219
+ lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
220
+ lob_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
221
+ lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
222
+ loz_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
223
+ ltz_Latn,59,58,67,1,27497,0.464,0.983051,0.630435,0.997569,2430.706719,0.983051
224
+ lua_Latn,58,53,56,5,27509,0.486239,0.913793,0.634731,0.997968,2031.561763,0.913793
225
+ lue_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
226
+ lug_Latn,49,49,198,0,27376,0.198381,1.0,0.331081,0.992819,7180.67745,1.0
227
+ lun_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
228
+ lus_Latn,58,58,216,0,27349,0.211679,1.0,0.349398,0.992164,7836.023943,1.0
229
+ lvs_Latn,115,115,2,0,27506,0.982906,1.0,0.991379,0.999927,72.706122,1.0
230
+ mad_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
231
+ mag_Deva,53,49,61,4,27509,0.445455,0.924528,0.601227,0.997787,2212.549873,0.924528
232
+ mah_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
233
+ mai_Deva,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
234
+ mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
235
+ mam_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
236
+ mar_Deva,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
237
+ maz_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
238
+ mcd_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
239
+ mcf_Latn,62,0,0,62,27561,0.0,0.0,0.0,1.0,0.0,0.0
240
+ men_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
241
+ mfq_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
242
+ mic_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
243
+ min_Latn,59,4,0,55,27564,1.0,0.067797,0.126984,1.0,0.0,0.067797
244
+ miq_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
245
+ mkd_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
246
+ mlt_Latn,59,59,18,0,27546,0.766234,1.0,0.867647,0.999347,653.025686,1.0
247
+ mnw_Mymr,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
248
+ mor_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
249
+ mos_Latn,56,56,23,0,27544,0.708861,1.0,0.82963,0.999166,834.330903,1.0
250
+ mri_Latn,57,57,201,0,27365,0.22093,1.0,0.361905,0.992708,7291.59109,1.0
251
+ mto_Latn,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
252
+ mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
253
+ mxv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
254
+ mya_Mymr,56,56,55,0,27512,0.504505,1.0,0.670659,0.998005,1995.139116,1.0
255
+ mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
256
+ nan_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
257
+ nav_Latn,59,59,97,0,27467,0.378205,1.0,0.548837,0.996481,3519.082862,1.0
258
+ nba_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
259
+ nbl_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
260
+ ndo_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
261
+ nds_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
262
+ nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
263
+ nio_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
264
+ niu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
265
+ niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
266
+ njo_Latn,64,0,0,64,27559,0.0,0.0,0.0,1.0,0.0,0.0
267
+ nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
268
+ nld_Latn,58,58,49,0,27516,0.542056,1.0,0.70303,0.998222,1777.616543,1.0
269
+ nno_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
270
+ nob_Latn,62,62,2,0,27559,0.96875,1.0,0.984127,0.999927,72.566307,1.0
271
+ not_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
272
+ npi_Deva,55,55,5,0,27563,0.916667,1.0,0.956522,0.999819,181.369704,1.0
273
+ nso_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
274
+ nya_Latn,116,116,62,0,27445,0.651685,1.0,0.789116,0.997746,2253.971716,1.0
275
+ nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
276
+ nyn_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
277
+ nzi_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
278
+ oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
279
+ oci_Latn,398,152,161,246,27064,0.485623,0.38191,0.427567,0.994086,5913.682277,0.38191
280
+ ojb_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
281
+ oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
282
+ orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
283
+ oss_Cyrl,44,44,4,0,27575,0.916667,1.0,0.956522,0.999855,145.037891,1.0
284
+ ote_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
285
+ pam_Latn,66,0,0,66,27557,0.0,0.0,0.0,1.0,0.0,0.0
286
+ pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
287
+ pap_Latn,58,58,53,0,27512,0.522523,1.0,0.686391,0.998077,1922.728097,1.0
288
+ pau_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
289
+ pbb_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
290
+ pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
291
+ pcd_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
292
+ pcm_Latn,56,44,2,12,27565,0.956522,0.785714,0.862745,0.999927,72.550513,0.785714
293
+ pis_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
294
+ piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
295
+ plt_Latn,53,53,9,0,27561,0.854839,1.0,0.921739,0.999674,326.441785,1.0
296
+ pnb_Arab,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
297
+ pol_Latn,59,58,50,1,27514,0.537037,0.983051,0.694611,0.998186,1813.960238,0.983051
298
+ pon_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
299
+ por_Latn,115,115,65,0,27443,0.638889,1.0,0.779661,0.997637,2362.94896,1.0
300
+ pov_Latn,115,0,0,115,27508,0.0,0.0,0.0,1.0,0.0,0.0
301
+ ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
302
+ quc_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
303
+ que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
304
+ qug_Latn,182,0,0,182,27441,0.0,0.0,0.0,1.0,0.0,0.0
305
+ quh_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
306
+ quy_Latn,60,59,1179,1,26384,0.047658,0.983333,0.090909,0.957225,42774.734245,0.983333
307
+ quz_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
308
+ qva_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
309
+ qvc_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
310
+ qvh_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
311
+ qvm_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
312
+ qvn_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
313
+ qwh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
314
+ qxn_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
315
+ qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
316
+ rar_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
317
+ rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
318
+ rmn_Latn,116,0,0,116,27507,0.0,0.0,0.0,1.0,0.0,0.0
319
+ roh_Latn,399,399,50,0,27174,0.888641,1.0,0.941038,0.998163,1836.614752,1.0
320
+ ron_Latn,97,96,27,1,27499,0.780488,0.989691,0.872727,0.999019,980.890794,0.989691
321
+ run_Latn,58,58,45,0,27520,0.563107,1.0,0.720497,0.998367,1632.504988,1.0
322
+ rup_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
323
+ rus_Cyrl,58,58,70,0,27495,0.453125,1.0,0.623656,0.997461,2539.452204,1.0
324
+ sag_Latn,59,7,12,52,27552,0.368421,0.118644,0.179487,0.999565,435.350457,0.118644
325
+ sah_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
326
+ san_Deva,55,54,4,1,27564,0.931034,0.981818,0.955752,0.999855,145.095763,0.981818
327
+ san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
328
+ sco_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
329
+ sey_Latn,61,0,0,61,27562,0.0,0.0,0.0,1.0,0.0,0.0
330
+ shk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
331
+ shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
332
+ shp_Latn,62,0,0,62,27561,0.0,0.0,0.0,1.0,0.0,0.0
333
+ sid_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
334
+ sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
335
+ skr_Arab,63,0,0,63,27560,0.0,0.0,0.0,1.0,0.0,0.0
336
+ slk_Latn,56,56,10,0,27557,0.848485,1.0,0.918033,0.999637,362.752566,1.0
337
+ slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
338
+ slv_Latn,59,59,36,0,27528,0.621053,1.0,0.766234,0.998694,1306.051371,1.0
339
+ sme_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
340
+ smo_Latn,63,61,31,2,27529,0.663043,0.968254,0.787097,0.998875,1124.818578,0.968254
341
+ sna_Latn,60,57,92,3,27471,0.38255,0.95,0.545455,0.996662,3337.807931,0.95
342
+ snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
343
+ snn_Latn,136,0,0,136,27487,0.0,0.0,0.0,1.0,0.0,0.0
344
+ som_Latn,57,57,82,0,27484,0.410072,1.0,0.581633,0.997025,2974.678952,1.0
345
+ sot_Latn,57,46,20,11,27546,0.69697,0.807018,0.747967,0.999274,725.531452,0.807018
346
+ spa_Latn,78,78,128,0,27417,0.378641,1.0,0.549296,0.995353,4646.941369,1.0
347
+ src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
348
+ srp_Cyrl,59,58,58,1,27506,0.5,0.983051,0.662857,0.997896,2104.193876,0.983051
349
+ srp_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
350
+ srr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
351
+ ssw_Latn,59,59,25,0,27539,0.702381,1.0,0.825175,0.999093,906.980119,1.0
352
+ suk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
353
+ sun_Latn,66,65,48,1,27509,0.575221,0.984848,0.726257,0.998258,1741.844178,0.984848
354
+ sus_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
355
+ swb_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
356
+ swe_Latn,61,61,2,0,27560,0.968254,1.0,0.983871,0.999927,72.563675,1.0
357
+ swh_Latn,58,58,239,0,27326,0.195286,1.0,0.326761,0.99133,8670.415382,1.0
358
+ tah_Latn,57,57,4,0,27562,0.934426,1.0,0.966102,0.999855,145.10629,1.0
359
+ taj_Deva,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
360
+ tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
361
+ tat_Cyrl,57,57,124,0,27442,0.314917,1.0,0.478992,0.995502,4498.295001,1.0
362
+ tbz_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
363
+ tca_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
364
+ tdt_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
365
+ tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
366
+ tem_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
367
+ tet_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
368
+ tgk_Cyrl,57,57,142,0,27424,0.286432,1.0,0.445312,0.994849,5151.273308,1.0
369
+ tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
370
+ tha_Thai,114,114,1,0,27508,0.991304,1.0,0.995633,0.999964,36.351739,1.0
371
+ tir_Ethi,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
372
+ tiv_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
373
+ tly_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
374
+ tob_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
375
+ toi_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
376
+ toj_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
377
+ ton_Latn,60,0,32,60,27531,0.0,0.0,0.0,0.998839,1160.976672,0.0
378
+ top_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
379
+ tpi_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
380
+ tsn_Latn,58,58,16,0,27549,0.783784,1.0,0.878788,0.99942,580.446218,1.0
381
+ tso_Latn,114,114,118,0,27391,0.491379,1.0,0.65896,0.99571,4289.505253,1.0
382
+ tsz_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
383
+ tuk_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
384
+ tuk_Latn,59,59,4,0,27560,0.936508,1.0,0.967213,0.999855,145.116819,1.0
385
+ tur_Latn,59,59,128,0,27436,0.315508,1.0,0.479675,0.995356,4643.738209,1.0
386
+ twi_Latn,116,116,396,0,27111,0.226562,1.0,0.369427,0.985604,14396.335478,1.0
387
+ tyv_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
388
+ tzh_Latn,25,0,0,25,27598,0.0,0.0,0.0,1.0,0.0,0.0
389
+ tzm_Tfng,1,1,59,0,27563,0.016667,1.0,0.032787,0.997864,2135.978568,1.0
390
+ tzo_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
391
+ udu_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
392
+ uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
393
+ uig_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
394
+ ukr_Cyrl,58,58,5,0,27560,0.920635,1.0,0.958678,0.999819,181.389443,1.0
395
+ umb_Latn,107,104,20,3,27496,0.83871,0.971963,0.900433,0.999273,726.849833,0.971963
396
+ ura_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
397
+ urd_Arab,108,108,124,0,27391,0.465517,1.0,0.635294,0.995493,4506.632746,1.0
398
+ uzn_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
399
+ uzn_Latn,58,58,217,0,27348,0.210909,1.0,0.348348,0.992128,7872.301832,1.0
400
+ vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
401
+ vec_Latn,58,58,29,0,27536,0.666667,1.0,0.8,0.998948,1052.05877,1.0
402
+ ven_Latn,89,0,0,89,27534,0.0,0.0,0.0,1.0,0.0,0.0
403
+ vep_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
404
+ vie_Latn,60,60,9,0,27554,0.869565,1.0,0.930233,0.999673,326.524689,1.0
405
+ vmw_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
406
+ war_Latn,60,59,7,1,27556,0.893939,0.983333,0.936508,0.999746,253.963647,0.983333
407
+ wln_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
408
+ wol_Latn,60,60,457,0,27106,0.116054,1.0,0.207972,0.98342,16580.198092,1.0
409
+ wuu_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
410
+ wwa_Latn,39,0,0,39,27584,0.0,0.0,0.0,1.0,0.0,0.0
411
+ xho_Latn,58,58,49,0,27516,0.542056,1.0,0.70303,0.998222,1777.616543,1.0
412
+ xsm_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
413
+ yad_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
414
+ yao_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
415
+ yap_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
416
+ ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
417
+ ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
418
+ yor_Latn,57,57,84,0,27482,0.404255,1.0,0.575758,0.996953,3047.232098,1.0
419
+ yrk_Cyrl,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
420
+ yua_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
421
+ yue_Hani,49,45,1216,4,26358,0.035686,0.918367,0.068702,0.9559,44099.514035,0.918367
422
+ zam_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
423
+ zdj_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
424
+ zgh_Tfng,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
425
+ zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
426
+ zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
427
+ zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
428
+ ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
429
+ zul_Latn,58,58,77,0,27488,0.42963,1.0,0.601036,0.997207,2793.397424,1.0
430
+ zyb_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
reports/udhr-all/fasttext_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.3961191760489447,
3
+ "top3_accuracy": 0.4159577163957572,
4
+ "top5_accuracy": 0.4199761068674655,
5
+ "passages": 27623,
6
+ "languages": 429,
7
+ "macro_precision": 0.24791077144530446,
8
+ "macro_recall": 0.3737409279575923,
9
+ "macro_f1": 0.279501714390051,
10
+ "macro_specificity": 0.9988210740543896,
11
+ "weighted_f1": 0.30525958931365826,
12
+ "median_f1": 0.0,
13
+ "languages_f1_at_least_0_9": 54,
14
+ "languages_f1_below_0_5": 299,
15
+ "mean_fp_per_million": 1178.9259456102943,
16
+ "micro_f1": 0.3961191760489447
17
+ }
reports/udhr-all/glotlid@millid_per_language.csv ADDED
@@ -0,0 +1,430 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
3
+ abk_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
4
+ ace_Latn,61,60,0,1,27562,1.0,0.983607,0.991736,1.0,0.0,0.983607
5
+ acu_Latn,180,134,0,46,27443,1.0,0.744444,0.853503,1.0,0.0,0.744444
6
+ ada_Latn,59,59,8,0,27556,0.880597,1.0,0.936508,0.99971,290.233638,1.0
7
+ ady_Cyrl,56,54,0,2,27567,1.0,0.964286,0.981818,1.0,0.0,0.964286
8
+ afr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
9
+ agr_Latn,57,56,2,1,27564,0.965517,0.982456,0.973913,0.999927,72.553145,0.982456
10
+ aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
11
+ ajg_Latn,59,59,60,0,27504,0.495798,1.0,0.662921,0.997823,2176.752286,1.0
12
+ als_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
13
+ alt_Cyrl,51,51,4,0,27568,0.927273,1.0,0.962264,0.999855,145.074713,1.0
14
+ amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
15
+ ame_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
16
+ amh_Ethi,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
17
+ ami_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
18
+ amr_Latn,61,61,3,0,27559,0.953125,1.0,0.976,0.999891,108.845512,1.0
19
+ arb_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
20
+ arl_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
21
+ arn_Latn,58,48,0,10,27565,1.0,0.827586,0.90566,1.0,0.0,0.827586
22
+ ast_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
23
+ auc_Latn,154,0,0,154,27469,0.0,0.0,0.0,1.0,0.0,0.0
24
+ ayr_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
25
+ azj_Cyrl,56,56,1,0,27566,0.982456,1.0,0.99115,0.999964,36.275257,1.0
26
+ azj_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
27
+ bam_Latn,57,50,50,7,27516,0.5,0.877193,0.636943,0.998186,1813.828629,0.877193
28
+ ban_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
29
+ bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
30
+ bba_Latn,58,58,10,0,27555,0.852941,1.0,0.920635,0.999637,362.778886,1.0
31
+ bci_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
32
+ bcl_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
33
+ bel_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
34
+ bem_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
35
+ ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
36
+ bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
37
+ bho_Deva,56,49,0,7,27567,1.0,0.875,0.933333,1.0,0.0,0.875
38
+ bin_Latn,47,41,0,6,27576,1.0,0.87234,0.931818,1.0,0.0,0.87234
39
+ bis_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
40
+ blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
41
+ boa_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
42
+ bod_Tibt,60,50,1,10,27562,0.980392,0.833333,0.900901,0.999964,36.280521,0.833333
43
+ bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
44
+ bos_Latn,59,27,87,32,27477,0.236842,0.457627,0.312139,0.996844,3156.290814,0.457627
45
+ bre_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
46
+ buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
47
+ bug_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
48
+ bul_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
49
+ bum_Latn,58,3,6,55,27559,0.333333,0.051724,0.089552,0.999782,217.667332,0.051724
50
+ cab_Latn,60,58,0,2,27563,1.0,0.966667,0.983051,1.0,0.0,0.966667
51
+ cak_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
52
+ cat_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
53
+ cbi_Latn,62,61,2,1,27559,0.968254,0.983871,0.976,0.999927,72.566307,0.983871
54
+ cbr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
55
+ cbs_Latn,43,41,10,2,27570,0.803922,0.953488,0.87234,0.999637,362.581581,0.953488
56
+ cbt_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
57
+ cbu_Latn,57,45,1,12,27565,0.978261,0.789474,0.873786,0.999964,36.276573,0.789474
58
+ ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
59
+ ceb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
60
+ ces_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
61
+ cfm_Latn,57,55,1,2,27565,0.982143,0.964912,0.973451,0.999964,36.276573,0.964912
62
+ cha_Latn,57,49,1,8,27565,0.98,0.859649,0.915888,0.999964,36.276573,0.859649
63
+ chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
64
+ chk_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
65
+ chr_Cher,115,57,0,58,27508,1.0,0.495652,0.662791,1.0,0.0,0.495652
66
+ chv_Cyrl,25,25,4,0,27594,0.862069,1.0,0.925926,0.999855,144.938039,1.0
67
+ cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
68
+ cjk_Latn,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
69
+ cjs_Cyrl,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
70
+ cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
71
+ cmn_Hani,319,293,175,26,27129,0.626068,0.918495,0.7446,0.993591,6409.317316,0.918495
72
+ cnh_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
73
+ cni_Latn,52,52,4,0,27567,0.928571,1.0,0.962963,0.999855,145.079975,1.0
74
+ cnr_Latn,59,1,6,58,27558,0.142857,0.016949,0.030303,0.999782,217.675229,0.016949
75
+ cof_Latn,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
76
+ cos_Latn,59,58,1,1,27563,0.983051,0.983051,0.983051,0.999964,36.279205,0.983051
77
+ cot_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
78
+ cpu_Latn,60,57,0,3,27563,1.0,0.95,0.974359,1.0,0.0,0.95
79
+ crh_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
80
+ cri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
81
+ crs_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
82
+ csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
83
+ csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
84
+ ctd_Latn,60,34,0,26,27563,1.0,0.566667,0.723404,1.0,0.0,0.566667
85
+ cym_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
86
+ dag_Latn,57,56,29,1,27537,0.658824,0.982456,0.788732,0.998948,1052.020605,0.982456
87
+ dan_Latn,61,59,0,2,27562,1.0,0.967213,0.983333,1.0,0.0,0.967213
88
+ ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
89
+ deu_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
90
+ dga_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
91
+ dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
92
+ div_Thaa,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
93
+ dje_Latn,54,49,13,5,27556,0.790323,0.907407,0.844828,0.999528,471.544126,0.907407
94
+ duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
95
+ dyo_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
96
+ dyu_Latn,58,18,43,40,27522,0.295082,0.310345,0.302521,0.99844,1559.949211,0.310345
97
+ dzo_Tibt,59,58,10,1,27554,0.852941,0.983051,0.913386,0.999637,362.792048,0.983051
98
+ ekk_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
99
+ ell_Grek,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
100
+ emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
101
+ eng_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
102
+ epo_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
103
+ ese_Latn,35,34,0,1,27588,1.0,0.971429,0.985507,1.0,0.0,0.971429
104
+ eus_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
105
+ eve_Cyrl,49,39,112,10,27462,0.258278,0.795918,0.39,0.995938,4061.797345,0.795918
106
+ evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
107
+ ewe_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
108
+ fao_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
109
+ fas_Arab,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
110
+ fat_Latn,57,57,4,0,27562,0.934426,1.0,0.966102,0.999855,145.10629,1.0
111
+ fij_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
112
+ fil_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
113
+ fin_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
114
+ fkv_Latn,58,29,0,29,27565,1.0,0.5,0.666667,1.0,0.0,0.5
115
+ fon_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
116
+ fra_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
117
+ fry_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
118
+ fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
119
+ fuf_Latn,58,21,8,37,27557,0.724138,0.362069,0.482759,0.99971,290.223109,0.362069
120
+ fur_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
121
+ fuv_Latn,108,63,13,45,27502,0.828947,0.583333,0.684783,0.999528,472.469562,0.583333
122
+ fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
123
+ gaa_Latn,59,59,4,0,27560,0.936508,1.0,0.967213,0.999855,145.116819,1.0
124
+ gag_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
125
+ gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
126
+ gaz_Latn,60,59,2,1,27561,0.967213,0.983333,0.975207,0.999927,72.561042,0.983333
127
+ gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
128
+ gjn_Latn,60,58,7,2,27556,0.892308,0.966667,0.928,0.999746,253.963647,0.966667
129
+ gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
130
+ gla_Latn,62,60,0,2,27561,1.0,0.967742,0.983607,1.0,0.0,0.967742
131
+ gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
132
+ gle_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
133
+ glg_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
134
+ glv_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
135
+ gsw_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
136
+ guc_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
137
+ gug_Latn,49,49,1,0,27573,0.98,1.0,0.989899,0.999964,36.266048,1.0
138
+ guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
139
+ guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
140
+ guu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
141
+ gyr_Latn,49,48,0,1,27574,1.0,0.979592,0.989691,1.0,0.0,0.979592
142
+ hak_Hani,48,1,1,47,27574,0.5,0.020833,0.04,0.999964,36.264733,0.020833
143
+ hat_Latn,117,114,2,3,27504,0.982759,0.974359,0.978541,0.999927,72.711408,0.974359
144
+ hau_Latn,155,155,1,0,27467,0.99359,1.0,0.996785,0.999964,36.406,1.0
145
+ haw_Latn,58,55,0,3,27565,1.0,0.948276,0.973451,1.0,0.0,0.948276
146
+ hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
147
+ heb_Hebr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
148
+ hil_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
149
+ hin_Deva,59,56,2,3,27562,0.965517,0.949153,0.957265,0.999927,72.55841,0.949153
150
+ hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
151
+ hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
152
+ hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
153
+ hnj_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
154
+ hns_Latn,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
155
+ hrv_Latn,58,56,40,2,27525,0.583333,0.965517,0.727273,0.998549,1451.115545,0.965517
156
+ hsb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
157
+ hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
158
+ hun_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
159
+ hus_Latn,175,170,0,5,27448,1.0,0.971429,0.985507,1.0,0.0,0.971429
160
+ huu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
161
+ hye_Armn,70,70,0,0,27553,1.0,1.0,1.0,1.0,0.0,1.0
162
+ ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
163
+ ibo_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
164
+ ido_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
165
+ idu_Latn,51,45,0,6,27572,1.0,0.882353,0.9375,1.0,0.0,0.882353
166
+ iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
167
+ ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
168
+ ike_Cans,44,44,2,0,27577,0.956522,1.0,0.977778,0.999927,72.518946,1.0
169
+ ilo_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
170
+ ina_Latn,58,58,19,0,27546,0.753247,1.0,0.859259,0.999311,689.279884,1.0
171
+ ind_Latn,60,51,3,9,27560,0.944444,0.85,0.894737,0.999891,108.841563,0.85
172
+ isl_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
173
+ ita_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
174
+ jav_Java,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
175
+ jav_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
176
+ jiv_Latn,60,59,29,1,27534,0.670455,0.983333,0.797297,0.998948,1052.135109,0.983333
177
+ jpn_Jpan,140,140,4,0,27479,0.972222,1.0,0.985915,0.999854,145.544518,1.0
178
+ kaa_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
179
+ kab_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
180
+ kal_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
181
+ kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
182
+ kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
183
+ kaz_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
184
+ kbd_Cyrl,55,55,3,0,27565,0.948276,1.0,0.973451,0.999891,108.821822,1.0
185
+ kbp_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
186
+ kbr_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
187
+ kde_Latn,51,49,1,2,27571,0.98,0.960784,0.970297,0.999964,36.268678,0.960784
188
+ kdh_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
189
+ kea_Latn,58,58,62,0,27503,0.483333,1.0,0.651685,0.997751,2249.229095,1.0
190
+ kek_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
191
+ kha_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
192
+ khk_Cyrl,57,56,3,1,27563,0.949153,0.982456,0.965517,0.999891,108.829718,0.982456
193
+ khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
194
+ kin_Latn,59,47,0,12,27564,1.0,0.79661,0.886792,1.0,0.0,0.79661
195
+ kir_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
196
+ kjh_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
197
+ kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
198
+ kmb_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
199
+ kmr_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
200
+ knc_Latn,64,64,0,0,27559,1.0,1.0,1.0,1.0,0.0,1.0
201
+ kng_Latn,115,16,35,99,27473,0.313725,0.13913,0.192771,0.998728,1272.357132,0.13913
202
+ koi_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
203
+ koo_Latn,54,50,0,4,27569,1.0,0.925926,0.961538,1.0,0.0,0.925926
204
+ kor_Hang,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
205
+ kqn_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
206
+ kqs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
207
+ kri_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
208
+ krl_Latn,183,1,0,182,27440,1.0,0.005464,0.01087,1.0,0.0,0.005464
209
+ ktu_Latn,118,83,43,35,27462,0.65873,0.70339,0.680328,0.998437,1563.352118,0.70339
210
+ kwi_Latn,145,114,1,31,27477,0.991304,0.786207,0.876923,0.999964,36.392751,0.786207
211
+ lad_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
212
+ lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
213
+ lat_Latn,118,116,1,2,27504,0.991453,0.983051,0.987234,0.999964,36.357026,0.983051
214
+ lia_Latn,45,45,1,0,27577,0.978261,1.0,0.989011,0.999964,36.260788,1.0
215
+ lij_Latn,58,58,22,0,27543,0.725,1.0,0.84058,0.999202,798.11355,1.0
216
+ lin_Latn,110,110,0,0,27513,1.0,1.0,1.0,1.0,0.0,1.0
217
+ lit_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
218
+ lld_Latn,59,34,1,25,27563,0.971429,0.576271,0.723404,0.999964,36.279205,0.576271
219
+ lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
220
+ lob_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
221
+ lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
222
+ loz_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
223
+ ltz_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
224
+ lua_Latn,58,34,0,24,27565,1.0,0.586207,0.73913,1.0,0.0,0.586207
225
+ lue_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
226
+ lug_Latn,49,49,0,0,27574,1.0,1.0,1.0,1.0,0.0,1.0
227
+ lun_Latn,56,55,0,1,27567,1.0,0.982143,0.990991,1.0,0.0,0.982143
228
+ lus_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
229
+ lvs_Latn,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
230
+ mad_Latn,60,58,6,2,27557,0.90625,0.966667,0.935484,0.999782,217.683126,0.966667
231
+ mag_Deva,53,51,5,2,27565,0.910714,0.962264,0.93578,0.999819,181.356547,0.962264
232
+ mah_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
233
+ mai_Deva,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
234
+ mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
235
+ mam_Latn,58,52,1,6,27564,0.981132,0.896552,0.936937,0.999964,36.277889,0.896552
236
+ mar_Deva,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
237
+ maz_Latn,59,54,6,5,27558,0.9,0.915254,0.907563,0.999782,217.675229,0.915254
238
+ mcd_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
239
+ mcf_Latn,62,62,1,0,27560,0.984127,1.0,0.992,0.999964,36.283154,1.0
240
+ men_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
241
+ mfq_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
242
+ mic_Latn,59,16,0,43,27564,1.0,0.271186,0.426667,1.0,0.0,0.271186
243
+ min_Latn,59,59,6,0,27558,0.907692,1.0,0.951613,0.999782,217.675229,1.0
244
+ miq_Latn,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
245
+ mkd_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
246
+ mlt_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
247
+ mnw_Mymr,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
248
+ mor_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
249
+ mos_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
250
+ mri_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
251
+ mto_Latn,51,0,5,51,27567,0.0,0.0,0.0,0.999819,181.343392,0.0
252
+ mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
253
+ mxv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
254
+ mya_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
255
+ mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
256
+ nan_Hani,48,0,19,48,27556,0.0,0.0,0.0,0.999311,689.029918,0.0
257
+ nav_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
258
+ nba_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
259
+ nbl_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
260
+ ndo_Latn,58,57,4,1,27561,0.934426,0.982759,0.957983,0.999855,145.111555,0.982759
261
+ nds_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
262
+ nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
263
+ nio_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
264
+ niu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
265
+ niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
266
+ njo_Latn,64,63,1,1,27558,0.984375,0.984375,0.984375,0.999964,36.285787,0.984375
267
+ nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
268
+ nld_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
269
+ nno_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
270
+ nob_Latn,62,62,3,0,27558,0.953846,1.0,0.976378,0.999891,108.849461,1.0
271
+ not_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
272
+ npi_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
273
+ nso_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
274
+ nya_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
275
+ nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
276
+ nyn_Latn,50,48,0,2,27573,1.0,0.96,0.979592,1.0,0.0,0.96
277
+ nzi_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
278
+ oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
279
+ oci_Latn,398,92,0,306,27225,1.0,0.231156,0.37551,1.0,0.0,0.231156
280
+ ojb_Cans,43,40,0,3,27580,1.0,0.930233,0.963855,1.0,0.0,0.930233
281
+ oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
282
+ orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
283
+ oss_Cyrl,44,44,1,0,27578,0.977778,1.0,0.988764,0.999964,36.259473,1.0
284
+ ote_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
285
+ pam_Latn,66,66,0,0,27557,1.0,1.0,1.0,1.0,0.0,1.0
286
+ pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
287
+ pap_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
288
+ pau_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
289
+ pbb_Latn,56,31,9,25,27558,0.775,0.553571,0.645833,0.999674,326.47731,0.553571
290
+ pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
291
+ pcd_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
292
+ pcm_Latn,56,56,9,0,27558,0.861538,1.0,0.92562,0.999674,326.47731,1.0
293
+ pis_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
294
+ piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
295
+ plt_Latn,53,53,1,0,27569,0.981481,1.0,0.990654,0.999964,36.271309,1.0
296
+ pnb_Arab,61,61,43,0,27519,0.586538,1.0,0.739394,0.99844,1560.119004,1.0
297
+ pol_Latn,59,59,98,0,27466,0.375796,1.0,0.546296,0.996445,3555.362066,1.0
298
+ pon_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
299
+ por_Latn,115,115,19,0,27489,0.858209,1.0,0.923695,0.999309,690.708158,1.0
300
+ pov_Latn,115,82,0,33,27508,1.0,0.713043,0.832487,1.0,0.0,0.713043
301
+ ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
302
+ quc_Latn,58,50,1,8,27564,0.980392,0.862069,0.917431,0.999964,36.277889,0.862069
303
+ que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
304
+ qug_Latn,182,0,0,182,27441,0.0,0.0,0.0,1.0,0.0,0.0
305
+ quh_Latn,57,55,2,2,27564,0.964912,0.964912,0.964912,0.999927,72.553145,0.964912
306
+ quy_Latn,60,59,34,1,27529,0.634409,0.983333,0.771242,0.998766,1233.537714,0.983333
307
+ quz_Latn,57,53,37,4,27529,0.588889,0.929825,0.721088,0.998658,1342.233186,0.929825
308
+ qva_Latn,59,1,2,58,27562,0.333333,0.016949,0.032258,0.999927,72.55841,0.016949
309
+ qvc_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
310
+ qvh_Latn,58,5,3,53,27562,0.625,0.086207,0.151515,0.999891,108.833666,0.086207
311
+ qvm_Latn,60,20,0,40,27563,1.0,0.333333,0.5,1.0,0.0,0.333333
312
+ qvn_Latn,57,17,0,40,27566,1.0,0.298246,0.459459,1.0,0.0,0.298246
313
+ qwh_Latn,59,36,15,23,27549,0.705882,0.610169,0.654545,0.999456,544.188071,0.610169
314
+ qxn_Latn,57,1,0,56,27566,1.0,0.017544,0.034483,1.0,0.0,0.017544
315
+ qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
316
+ rar_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
317
+ rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
318
+ rmn_Latn,116,87,0,29,27507,1.0,0.75,0.857143,1.0,0.0,0.75
319
+ roh_Latn,399,399,1,0,27223,0.9975,1.0,0.998748,0.999963,36.732295,1.0
320
+ ron_Latn,97,97,0,0,27526,1.0,1.0,1.0,1.0,0.0,1.0
321
+ run_Latn,58,58,14,0,27551,0.805556,1.0,0.892308,0.999492,507.890441,1.0
322
+ rup_Latn,57,57,4,0,27562,0.934426,1.0,0.966102,0.999855,145.10629,1.0
323
+ rus_Cyrl,58,58,29,0,27536,0.666667,1.0,0.8,0.998948,1052.05877,1.0
324
+ sag_Latn,59,24,0,35,27564,1.0,0.40678,0.578313,1.0,0.0,0.40678
325
+ sah_Cyrl,57,57,63,0,27503,0.475,1.0,0.644068,0.997715,2285.424073,1.0
326
+ san_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
327
+ san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
328
+ sco_Latn,58,55,2,3,27563,0.964912,0.948276,0.956522,0.999927,72.555777,0.948276
329
+ sey_Latn,61,58,102,3,27460,0.3625,0.95082,0.524887,0.996299,3700.747406,0.95082
330
+ shk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
331
+ shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
332
+ shp_Latn,62,52,0,10,27561,1.0,0.83871,0.912281,1.0,0.0,0.83871
333
+ sid_Latn,57,57,11,0,27555,0.838235,1.0,0.912,0.999601,399.042298,1.0
334
+ sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
335
+ skr_Arab,63,21,0,42,27560,1.0,0.333333,0.5,1.0,0.0,0.333333
336
+ slk_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
337
+ slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
338
+ slv_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
339
+ sme_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
340
+ smo_Latn,63,63,0,0,27560,1.0,1.0,1.0,1.0,0.0,1.0
341
+ sna_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
342
+ snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
343
+ snn_Latn,136,47,0,89,27487,1.0,0.345588,0.513661,1.0,0.0,0.345588
344
+ som_Latn,57,57,8,0,27558,0.876923,1.0,0.934426,0.99971,290.212581,1.0
345
+ sot_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
346
+ spa_Latn,78,77,5,1,27540,0.939024,0.987179,0.9625,0.999818,181.521147,0.987179
347
+ src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
348
+ srp_Cyrl,59,58,58,1,27506,0.5,0.983051,0.662857,0.997896,2104.193876,0.983051
349
+ srp_Latn,59,18,3,41,27561,0.857143,0.305085,0.45,0.999891,108.837614,0.305085
350
+ srr_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
351
+ ssw_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
352
+ suk_Latn,58,57,42,1,27523,0.575758,0.982759,0.726115,0.998476,1523.671322,0.982759
353
+ sun_Latn,66,65,0,1,27557,1.0,0.984848,0.992366,1.0,0.0,0.984848
354
+ sus_Latn,58,58,9,0,27556,0.865672,1.0,0.928,0.999673,326.500998,1.0
355
+ swb_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
356
+ swe_Latn,61,61,1,0,27561,0.983871,1.0,0.99187,0.999964,36.281837,1.0
357
+ swh_Latn,58,56,5,2,27560,0.918033,0.965517,0.941176,0.999819,181.389443,0.965517
358
+ tah_Latn,57,39,0,18,27566,1.0,0.684211,0.8125,1.0,0.0,0.684211
359
+ taj_Deva,1,1,0,0,27622,1.0,1.0,1.0,1.0,0.0,1.0
360
+ tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
361
+ tat_Cyrl,57,57,17,0,27549,0.77027,1.0,0.870229,0.999383,616.701734,1.0
362
+ tbz_Latn,60,14,0,46,27563,1.0,0.233333,0.378378,1.0,0.0,0.233333
363
+ tca_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
364
+ tdt_Latn,57,48,52,9,27514,0.48,0.842105,0.611465,0.998114,1886.381775,0.842105
365
+ tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
366
+ tem_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
367
+ tet_Latn,58,6,9,52,27556,0.4,0.103448,0.164384,0.999673,326.500998,0.103448
368
+ tgk_Cyrl,57,57,7,0,27559,0.890625,1.0,0.942149,0.999746,253.936008,1.0
369
+ tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
370
+ tha_Thai,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
371
+ tir_Ethi,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
372
+ tiv_Latn,67,67,2,0,27554,0.971014,1.0,0.985294,0.999927,72.579475,1.0
373
+ tly_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
374
+ tob_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
375
+ toi_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
376
+ toj_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
377
+ ton_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
378
+ top_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
379
+ tpi_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
380
+ tsn_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
381
+ tso_Latn,114,73,0,41,27509,1.0,0.640351,0.780749,1.0,0.0,0.640351
382
+ tsz_Latn,59,57,11,2,27553,0.838235,0.966102,0.897638,0.999601,399.071252,0.966102
383
+ tuk_Cyrl,57,57,6,0,27560,0.904762,1.0,0.95,0.999782,217.659436,1.0
384
+ tuk_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
385
+ tur_Latn,59,59,36,0,27528,0.621053,1.0,0.766234,0.998694,1306.051371,1.0
386
+ twi_Latn,116,116,1,0,27506,0.991453,1.0,0.995708,0.999964,36.354383,1.0
387
+ tyv_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
388
+ tzh_Latn,25,25,1,0,27597,0.961538,1.0,0.980392,0.999964,36.23451,1.0
389
+ tzm_Tfng,1,1,30,0,27592,0.032258,1.0,0.0625,0.998914,1086.090797,1.0
390
+ tzo_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
391
+ udu_Latn,60,60,9,0,27554,0.869565,1.0,0.930233,0.999673,326.524689,1.0
392
+ uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
393
+ uig_Latn,59,59,31,0,27533,0.655556,1.0,0.791946,0.998875,1124.655348,1.0
394
+ ukr_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
395
+ umb_Latn,107,105,0,2,27516,1.0,0.981308,0.990566,1.0,0.0,0.981308
396
+ ura_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
397
+ urd_Arab,108,106,1,2,27514,0.990654,0.981481,0.986047,0.999964,36.343812,0.981481
398
+ uzn_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
399
+ uzn_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
400
+ vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
401
+ vec_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
402
+ ven_Latn,89,89,0,0,27534,1.0,1.0,1.0,1.0,0.0,1.0
403
+ vep_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
404
+ vie_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
405
+ vmw_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
406
+ war_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
407
+ wln_Latn,59,56,56,3,27508,0.5,0.949153,0.654971,0.997968,2031.635467,0.949153
408
+ wol_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
409
+ wuu_Hani,48,47,125,1,27450,0.273256,0.979167,0.427273,0.995467,4533.091568,0.979167
410
+ wwa_Latn,39,0,0,39,27584,0.0,0.0,0.0,1.0,0.0,0.0
411
+ xho_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
412
+ xsm_Latn,59,58,45,1,27519,0.563107,0.983051,0.716049,0.998367,1632.564214,0.983051
413
+ yad_Latn,55,53,0,2,27568,1.0,0.963636,0.981481,1.0,0.0,0.963636
414
+ yao_Latn,52,51,0,1,27571,1.0,0.980769,0.990291,1.0,0.0,0.980769
415
+ yap_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
416
+ ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
417
+ ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
418
+ yor_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
419
+ yrk_Cyrl,55,52,3,3,27565,0.945455,0.945455,0.945455,0.999891,108.821822,0.945455
420
+ yua_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
421
+ yue_Hani,49,20,0,29,27574,1.0,0.408163,0.57971,1.0,0.0,0.408163
422
+ zam_Latn,60,0,5,60,27558,0.0,0.0,0.0,0.999819,181.402605,0.0
423
+ zdj_Latn,50,49,44,1,27529,0.526882,0.98,0.685315,0.998404,1595.763972,0.98
424
+ zgh_Tfng,60,18,0,42,27563,1.0,0.3,0.461538,1.0,0.0,0.3
425
+ zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
426
+ zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
427
+ zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
428
+ ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
429
+ zul_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
430
+ zyb_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
reports/udhr-all/glotlid@millid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.7378271730080006,
3
+ "top3_accuracy": 0.7960395322738297,
4
+ "top5_accuracy": 0.8079498968251095,
5
+ "passages": 27623,
6
+ "languages": 429,
7
+ "macro_precision": 0.7425329775774382,
8
+ "macro_recall": 0.7380568437901042,
9
+ "macro_f1": 0.724506747472521,
10
+ "macro_specificity": 0.999809579502659,
11
+ "weighted_f1": 0.7305913692421664,
12
+ "median_f1": 0.9747899159663865,
13
+ "languages_f1_at_least_0_9": 272,
14
+ "languages_f1_below_0_5": 105,
15
+ "mean_fp_per_million": 190.42049734090864,
16
+ "micro_f1": 0.7378271730080006
17
+ }
reports/udhr-all/glotlid_per_language.csv ADDED
@@ -0,0 +1,430 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
3
+ abk_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
4
+ ace_Latn,61,60,0,1,27562,1.0,0.983607,0.991736,1.0,0.0,0.983607
5
+ acu_Latn,180,134,0,46,27443,1.0,0.744444,0.853503,1.0,0.0,0.744444
6
+ ada_Latn,59,59,8,0,27556,0.880597,1.0,0.936508,0.99971,290.233638,1.0
7
+ ady_Cyrl,56,54,0,2,27567,1.0,0.964286,0.981818,1.0,0.0,0.964286
8
+ afr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
9
+ agr_Latn,57,56,2,1,27564,0.965517,0.982456,0.973913,0.999927,72.553145,0.982456
10
+ aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
11
+ ajg_Latn,59,59,59,0,27505,0.5,1.0,0.666667,0.99786,2140.473081,1.0
12
+ als_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
13
+ alt_Cyrl,51,51,4,0,27568,0.927273,1.0,0.962264,0.999855,145.074713,1.0
14
+ amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
15
+ ame_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
16
+ amh_Ethi,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
17
+ ami_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
18
+ amr_Latn,61,61,3,0,27559,0.953125,1.0,0.976,0.999891,108.845512,1.0
19
+ arb_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
20
+ arl_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
21
+ arn_Latn,58,47,0,11,27565,1.0,0.810345,0.895238,1.0,0.0,0.810345
22
+ ast_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
23
+ auc_Latn,154,0,0,154,27469,0.0,0.0,0.0,1.0,0.0,0.0
24
+ ayr_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
25
+ azj_Cyrl,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
26
+ azj_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
27
+ bam_Latn,57,50,34,7,27532,0.595238,0.877193,0.70922,0.998767,1233.403468,0.877193
28
+ ban_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
29
+ bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
30
+ bba_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
31
+ bci_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
32
+ bcl_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
33
+ bel_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
34
+ bem_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
35
+ ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
36
+ bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
37
+ bho_Deva,56,49,0,7,27567,1.0,0.875,0.933333,1.0,0.0,0.875
38
+ bin_Latn,47,41,0,6,27576,1.0,0.87234,0.931818,1.0,0.0,0.87234
39
+ bis_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
40
+ blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
41
+ boa_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
42
+ bod_Tibt,60,50,1,10,27562,0.980392,0.833333,0.900901,0.999964,36.280521,0.833333
43
+ bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
44
+ bos_Latn,59,27,87,32,27477,0.236842,0.457627,0.312139,0.996844,3156.290814,0.457627
45
+ bre_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
46
+ buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
47
+ bug_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
48
+ bul_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
49
+ bum_Latn,58,3,1,55,27564,0.75,0.051724,0.096774,0.999964,36.277889,0.051724
50
+ cab_Latn,60,58,0,2,27563,1.0,0.966667,0.983051,1.0,0.0,0.966667
51
+ cak_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
52
+ cat_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
53
+ cbi_Latn,62,61,1,1,27560,0.983871,0.983871,0.983871,0.999964,36.283154,0.983871
54
+ cbr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
55
+ cbs_Latn,43,41,10,2,27570,0.803922,0.953488,0.87234,0.999637,362.581581,0.953488
56
+ cbt_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
57
+ cbu_Latn,57,45,0,12,27566,1.0,0.789474,0.882353,1.0,0.0,0.789474
58
+ ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
59
+ ceb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
60
+ ces_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
61
+ cfm_Latn,57,55,1,2,27565,0.982143,0.964912,0.973451,0.999964,36.276573,0.964912
62
+ cha_Latn,57,49,1,8,27565,0.98,0.859649,0.915888,0.999964,36.276573,0.859649
63
+ chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
64
+ chk_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
65
+ chr_Cher,115,57,0,58,27508,1.0,0.495652,0.662791,1.0,0.0,0.495652
66
+ chv_Cyrl,25,25,4,0,27594,0.862069,1.0,0.925926,0.999855,144.938039,1.0
67
+ cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
68
+ cjk_Latn,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
69
+ cjs_Cyrl,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
70
+ cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
71
+ cmn_Hani,319,293,175,26,27129,0.626068,0.918495,0.7446,0.993591,6409.317316,0.918495
72
+ cnh_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
73
+ cni_Latn,52,52,4,0,27567,0.928571,1.0,0.962963,0.999855,145.079975,1.0
74
+ cnr_Latn,59,1,6,58,27558,0.142857,0.016949,0.030303,0.999782,217.675229,0.016949
75
+ cof_Latn,59,51,0,8,27564,1.0,0.864407,0.927273,1.0,0.0,0.864407
76
+ cos_Latn,59,58,1,1,27563,0.983051,0.983051,0.983051,0.999964,36.279205,0.983051
77
+ cot_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
78
+ cpu_Latn,60,57,0,3,27563,1.0,0.95,0.974359,1.0,0.0,0.95
79
+ crh_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
80
+ cri_Latn,58,36,0,22,27565,1.0,0.62069,0.765957,1.0,0.0,0.62069
81
+ crs_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
82
+ csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
83
+ csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
84
+ ctd_Latn,60,32,0,28,27563,1.0,0.533333,0.695652,1.0,0.0,0.533333
85
+ cym_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
86
+ dag_Latn,57,56,24,1,27542,0.7,0.982456,0.817518,0.999129,870.637742,0.982456
87
+ dan_Latn,61,59,0,2,27562,1.0,0.967213,0.983333,1.0,0.0,0.967213
88
+ ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
89
+ deu_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
90
+ dga_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
91
+ dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
92
+ div_Thaa,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
93
+ dje_Latn,54,48,10,6,27559,0.827586,0.888889,0.857143,0.999637,362.72625,0.888889
94
+ duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
95
+ dyo_Latn,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
96
+ dyu_Latn,58,18,10,40,27555,0.642857,0.310345,0.418605,0.999637,362.778886,0.310345
97
+ dzo_Tibt,59,58,10,1,27554,0.852941,0.983051,0.913386,0.999637,362.792048,0.983051
98
+ ekk_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
99
+ ell_Grek,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
100
+ emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
101
+ eng_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
102
+ epo_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
103
+ ese_Latn,35,34,0,1,27588,1.0,0.971429,0.985507,1.0,0.0,0.971429
104
+ eus_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
105
+ eve_Cyrl,49,39,111,10,27463,0.26,0.795918,0.39196,0.995974,4025.531298,0.795918
106
+ evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
107
+ ewe_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
108
+ fao_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
109
+ fas_Arab,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
110
+ fat_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
111
+ fij_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
112
+ fil_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
113
+ fin_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
114
+ fkv_Latn,58,29,0,29,27565,1.0,0.5,0.666667,1.0,0.0,0.5
115
+ fon_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
116
+ fra_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
117
+ fry_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
118
+ fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
119
+ fuf_Latn,58,21,8,37,27557,0.724138,0.362069,0.482759,0.99971,290.223109,0.362069
120
+ fur_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
121
+ fuv_Latn,108,62,12,46,27503,0.837838,0.574074,0.681319,0.999564,436.12575,0.574074
122
+ fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
123
+ gaa_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
124
+ gag_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
125
+ gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
126
+ gaz_Latn,60,59,2,1,27561,0.967213,0.983333,0.975207,0.999927,72.561042,0.983333
127
+ gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
128
+ gjn_Latn,60,58,7,2,27556,0.892308,0.966667,0.928,0.999746,253.963647,0.966667
129
+ gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
130
+ gla_Latn,62,60,0,2,27561,1.0,0.967742,0.983607,1.0,0.0,0.967742
131
+ gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
132
+ gle_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
133
+ glg_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
134
+ glv_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
135
+ gsw_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
136
+ guc_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
137
+ gug_Latn,49,49,1,0,27573,0.98,1.0,0.989899,0.999964,36.266048,1.0
138
+ guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
139
+ guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
140
+ guu_Latn,58,0,4,58,27561,0.0,0.0,0.0,0.999855,145.111555,0.0
141
+ gyr_Latn,49,48,0,1,27574,1.0,0.979592,0.989691,1.0,0.0,0.979592
142
+ hak_Hani,48,1,1,47,27574,0.5,0.020833,0.04,0.999964,36.264733,0.020833
143
+ hat_Latn,117,114,2,3,27504,0.982759,0.974359,0.978541,0.999927,72.711408,0.974359
144
+ hau_Latn,155,155,1,0,27467,0.99359,1.0,0.996785,0.999964,36.406,1.0
145
+ haw_Latn,58,55,0,3,27565,1.0,0.948276,0.973451,1.0,0.0,0.948276
146
+ hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
147
+ heb_Hebr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
148
+ hil_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
149
+ hin_Deva,59,56,2,3,27562,0.965517,0.949153,0.957265,0.999927,72.55841,0.949153
150
+ hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
151
+ hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
152
+ hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
153
+ hnj_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
154
+ hns_Latn,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
155
+ hrv_Latn,58,56,40,2,27525,0.583333,0.965517,0.727273,0.998549,1451.115545,0.965517
156
+ hsb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
157
+ hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
158
+ hun_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
159
+ hus_Latn,175,170,0,5,27448,1.0,0.971429,0.985507,1.0,0.0,0.971429
160
+ huu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
161
+ hye_Armn,70,70,0,0,27553,1.0,1.0,1.0,1.0,0.0,1.0
162
+ ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
163
+ ibo_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
164
+ ido_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
165
+ idu_Latn,51,40,0,11,27572,1.0,0.784314,0.879121,1.0,0.0,0.784314
166
+ iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
167
+ ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
168
+ ike_Cans,44,44,2,0,27577,0.956522,1.0,0.977778,0.999927,72.518946,1.0
169
+ ilo_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
170
+ ina_Latn,58,58,19,0,27546,0.753247,1.0,0.859259,0.999311,689.279884,1.0
171
+ ind_Latn,60,51,3,9,27560,0.944444,0.85,0.894737,0.999891,108.841563,0.85
172
+ isl_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
173
+ ita_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
174
+ jav_Java,60,57,0,3,27563,1.0,0.95,0.974359,1.0,0.0,0.95
175
+ jav_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
176
+ jiv_Latn,60,59,29,1,27534,0.670455,0.983333,0.797297,0.998948,1052.135109,0.983333
177
+ jpn_Jpan,140,140,3,0,27480,0.979021,1.0,0.989399,0.999891,109.158389,1.0
178
+ kaa_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
179
+ kab_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
180
+ kal_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
181
+ kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
182
+ kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
183
+ kaz_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
184
+ kbd_Cyrl,55,55,3,0,27565,0.948276,1.0,0.973451,0.999891,108.821822,1.0
185
+ kbp_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
186
+ kbr_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
187
+ kde_Latn,51,49,1,2,27571,0.98,0.960784,0.970297,0.999964,36.268678,0.960784
188
+ kdh_Latn,59,45,0,14,27564,1.0,0.762712,0.865385,1.0,0.0,0.762712
189
+ kea_Latn,58,58,28,0,27537,0.674419,1.0,0.805556,0.998984,1015.780882,1.0
190
+ kek_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
191
+ kha_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
192
+ khk_Cyrl,57,56,3,1,27563,0.949153,0.982456,0.965517,0.999891,108.829718,0.982456
193
+ khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
194
+ kin_Latn,59,47,0,12,27564,1.0,0.79661,0.886792,1.0,0.0,0.79661
195
+ kir_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
196
+ kjh_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
197
+ kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
198
+ kmb_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
199
+ kmr_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
200
+ knc_Latn,64,64,0,0,27559,1.0,1.0,1.0,1.0,0.0,1.0
201
+ kng_Latn,115,16,35,99,27473,0.313725,0.13913,0.192771,0.998728,1272.357132,0.13913
202
+ koi_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
203
+ koo_Latn,54,50,0,4,27569,1.0,0.925926,0.961538,1.0,0.0,0.925926
204
+ kor_Hang,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
205
+ kqn_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
206
+ kqs_Latn,58,39,0,19,27565,1.0,0.672414,0.804124,1.0,0.0,0.672414
207
+ kri_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
208
+ krl_Latn,183,1,0,182,27440,1.0,0.005464,0.01087,1.0,0.0,0.005464
209
+ ktu_Latn,118,83,43,35,27462,0.65873,0.70339,0.680328,0.998437,1563.352118,0.70339
210
+ kwi_Latn,145,114,1,31,27477,0.991304,0.786207,0.876923,0.999964,36.392751,0.786207
211
+ lad_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
212
+ lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
213
+ lat_Latn,118,116,1,2,27504,0.991453,0.983051,0.987234,0.999964,36.357026,0.983051
214
+ lia_Latn,45,45,1,0,27577,0.978261,1.0,0.989011,0.999964,36.260788,1.0
215
+ lij_Latn,58,58,22,0,27543,0.725,1.0,0.84058,0.999202,798.11355,1.0
216
+ lin_Latn,110,110,0,0,27513,1.0,1.0,1.0,1.0,0.0,1.0
217
+ lit_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
218
+ lld_Latn,59,34,0,25,27564,1.0,0.576271,0.731183,1.0,0.0,0.576271
219
+ lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
220
+ lob_Latn,58,55,13,3,27552,0.808824,0.948276,0.873016,0.999528,471.612552,0.948276
221
+ lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
222
+ loz_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
223
+ ltz_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
224
+ lua_Latn,58,34,0,24,27565,1.0,0.586207,0.73913,1.0,0.0,0.586207
225
+ lue_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
226
+ lug_Latn,49,49,0,0,27574,1.0,1.0,1.0,1.0,0.0,1.0
227
+ lun_Latn,56,55,0,1,27567,1.0,0.982143,0.990991,1.0,0.0,0.982143
228
+ lus_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
229
+ lvs_Latn,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
230
+ mad_Latn,60,58,4,2,27559,0.935484,0.966667,0.95082,0.999855,145.122084,0.966667
231
+ mag_Deva,53,51,5,2,27565,0.910714,0.962264,0.93578,0.999819,181.356547,0.962264
232
+ mah_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
233
+ mai_Deva,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
234
+ mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
235
+ mam_Latn,58,52,1,6,27564,0.981132,0.896552,0.936937,0.999964,36.277889,0.896552
236
+ mar_Deva,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
237
+ maz_Latn,59,54,5,5,27559,0.915254,0.915254,0.915254,0.999819,181.396024,0.915254
238
+ mcd_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
239
+ mcf_Latn,62,62,1,0,27560,0.984127,1.0,0.992,0.999964,36.283154,1.0
240
+ men_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
241
+ mfq_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
242
+ mic_Latn,59,16,0,43,27564,1.0,0.271186,0.426667,1.0,0.0,0.271186
243
+ min_Latn,59,59,6,0,27558,0.907692,1.0,0.951613,0.999782,217.675229,1.0
244
+ miq_Latn,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
245
+ mkd_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
246
+ mlt_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
247
+ mnw_Mymr,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
248
+ mor_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
249
+ mos_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
250
+ mri_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
251
+ mto_Latn,51,0,5,51,27567,0.0,0.0,0.0,0.999819,181.343392,0.0
252
+ mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
253
+ mxv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
254
+ mya_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
255
+ mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
256
+ nan_Hani,48,0,4,48,27571,0.0,0.0,0.0,0.999855,145.05893,0.0
257
+ nav_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
258
+ nba_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
259
+ nbl_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
260
+ ndo_Latn,58,57,4,1,27561,0.934426,0.982759,0.957983,0.999855,145.111555,0.982759
261
+ nds_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
262
+ nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
263
+ nio_Cyrl,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
264
+ niu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
265
+ niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
266
+ njo_Latn,64,63,1,1,27558,0.984375,0.984375,0.984375,0.999964,36.285787,0.984375
267
+ nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
268
+ nld_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
269
+ nno_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
270
+ nob_Latn,62,62,3,0,27558,0.953846,1.0,0.976378,0.999891,108.849461,1.0
271
+ not_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
272
+ npi_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
273
+ nso_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
274
+ nya_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
275
+ nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
276
+ nyn_Latn,50,48,0,2,27573,1.0,0.96,0.979592,1.0,0.0,0.96
277
+ nzi_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
278
+ oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
279
+ oci_Latn,398,92,0,306,27225,1.0,0.231156,0.37551,1.0,0.0,0.231156
280
+ ojb_Cans,43,40,0,3,27580,1.0,0.930233,0.963855,1.0,0.0,0.930233
281
+ oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
282
+ orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
283
+ oss_Cyrl,44,44,1,0,27578,0.977778,1.0,0.988764,0.999964,36.259473,1.0
284
+ ote_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
285
+ pam_Latn,66,66,0,0,27557,1.0,1.0,1.0,1.0,0.0,1.0
286
+ pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
287
+ pap_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
288
+ pau_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
289
+ pbb_Latn,56,31,9,25,27558,0.775,0.553571,0.645833,0.999674,326.47731,0.553571
290
+ pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
291
+ pcd_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
292
+ pcm_Latn,56,55,8,1,27559,0.873016,0.982143,0.92437,0.99971,290.202053,0.982143
293
+ pis_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
294
+ piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
295
+ plt_Latn,53,53,0,0,27570,1.0,1.0,1.0,1.0,0.0,1.0
296
+ pnb_Arab,61,61,43,0,27519,0.586538,1.0,0.739394,0.99844,1560.119004,1.0
297
+ pol_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
298
+ pon_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
299
+ por_Latn,115,115,3,0,27505,0.974576,1.0,0.987124,0.999891,109.059183,1.0
300
+ pov_Latn,115,82,0,33,27508,1.0,0.713043,0.832487,1.0,0.0,0.713043
301
+ ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
302
+ quc_Latn,58,50,1,8,27564,0.980392,0.862069,0.917431,0.999964,36.277889,0.862069
303
+ que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
304
+ qug_Latn,182,0,0,182,27441,0.0,0.0,0.0,1.0,0.0,0.0
305
+ quh_Latn,57,52,2,5,27564,0.962963,0.912281,0.936937,0.999927,72.553145,0.912281
306
+ quy_Latn,60,59,34,1,27529,0.634409,0.983333,0.771242,0.998766,1233.537714,0.983333
307
+ quz_Latn,57,51,36,6,27530,0.586207,0.894737,0.708333,0.998694,1305.956613,0.894737
308
+ qva_Latn,59,1,2,58,27562,0.333333,0.016949,0.032258,0.999927,72.55841,0.016949
309
+ qvc_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
310
+ qvh_Latn,58,5,3,53,27562,0.625,0.086207,0.151515,0.999891,108.833666,0.086207
311
+ qvm_Latn,60,20,0,40,27563,1.0,0.333333,0.5,1.0,0.0,0.333333
312
+ qvn_Latn,57,17,0,40,27566,1.0,0.298246,0.459459,1.0,0.0,0.298246
313
+ qwh_Latn,59,36,15,23,27549,0.705882,0.610169,0.654545,0.999456,544.188071,0.610169
314
+ qxn_Latn,57,1,0,56,27566,1.0,0.017544,0.034483,1.0,0.0,0.017544
315
+ qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
316
+ rar_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
317
+ rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
318
+ rmn_Latn,116,87,0,29,27507,1.0,0.75,0.857143,1.0,0.0,0.75
319
+ roh_Latn,399,399,1,0,27223,0.9975,1.0,0.998748,0.999963,36.732295,1.0
320
+ ron_Latn,97,97,0,0,27526,1.0,1.0,1.0,1.0,0.0,1.0
321
+ run_Latn,58,58,14,0,27551,0.805556,1.0,0.892308,0.999492,507.890441,1.0
322
+ rup_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
323
+ rus_Cyrl,58,58,29,0,27536,0.666667,1.0,0.8,0.998948,1052.05877,1.0
324
+ sag_Latn,59,24,0,35,27564,1.0,0.40678,0.578313,1.0,0.0,0.40678
325
+ sah_Cyrl,57,57,63,0,27503,0.475,1.0,0.644068,0.997715,2285.424073,1.0
326
+ san_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
327
+ san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
328
+ sco_Latn,58,55,2,3,27563,0.964912,0.948276,0.956522,0.999927,72.555777,0.948276
329
+ sey_Latn,61,56,101,5,27461,0.356688,0.918033,0.513761,0.996336,3664.465569,0.918033
330
+ shk_Latn,55,47,0,8,27568,1.0,0.854545,0.921569,1.0,0.0,0.854545
331
+ shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
332
+ shp_Latn,62,52,0,10,27561,1.0,0.83871,0.912281,1.0,0.0,0.83871
333
+ sid_Latn,57,57,11,0,27555,0.838235,1.0,0.912,0.999601,399.042298,1.0
334
+ sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
335
+ skr_Arab,63,21,0,42,27560,1.0,0.333333,0.5,1.0,0.0,0.333333
336
+ slk_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
337
+ slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
338
+ slv_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
339
+ sme_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
340
+ smo_Latn,63,63,0,0,27560,1.0,1.0,1.0,1.0,0.0,1.0
341
+ sna_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
342
+ snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
343
+ snn_Latn,136,47,0,89,27487,1.0,0.345588,0.513661,1.0,0.0,0.345588
344
+ som_Latn,57,57,8,0,27558,0.876923,1.0,0.934426,0.99971,290.212581,1.0
345
+ sot_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
346
+ spa_Latn,78,77,2,1,27543,0.974684,0.987179,0.980892,0.999927,72.608459,0.987179
347
+ src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
348
+ srp_Cyrl,59,58,58,1,27506,0.5,0.983051,0.662857,0.997896,2104.193876,0.983051
349
+ srp_Latn,59,18,3,41,27561,0.857143,0.305085,0.45,0.999891,108.837614,0.305085
350
+ srr_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
351
+ ssw_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
352
+ suk_Latn,58,57,42,1,27523,0.575758,0.982759,0.726115,0.998476,1523.671322,0.982759
353
+ sun_Latn,66,65,0,1,27557,1.0,0.984848,0.992366,1.0,0.0,0.984848
354
+ sus_Latn,58,58,9,0,27556,0.865672,1.0,0.928,0.999673,326.500998,1.0
355
+ swb_Latn,58,57,13,1,27552,0.814286,0.982759,0.890625,0.999528,471.612552,0.982759
356
+ swe_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
357
+ swh_Latn,58,56,3,2,27562,0.949153,0.965517,0.957265,0.999891,108.833666,0.965517
358
+ tah_Latn,57,39,0,18,27566,1.0,0.684211,0.8125,1.0,0.0,0.684211
359
+ taj_Deva,1,1,0,0,27622,1.0,1.0,1.0,1.0,0.0,1.0
360
+ tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
361
+ tat_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
362
+ tbz_Latn,60,14,0,46,27563,1.0,0.233333,0.378378,1.0,0.0,0.233333
363
+ tca_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
364
+ tdt_Latn,57,48,52,9,27514,0.48,0.842105,0.611465,0.998114,1886.381775,0.842105
365
+ tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
366
+ tem_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
367
+ tet_Latn,58,6,8,52,27557,0.428571,0.103448,0.166667,0.99971,290.223109,0.103448
368
+ tgk_Cyrl,57,57,7,0,27559,0.890625,1.0,0.942149,0.999746,253.936008,1.0
369
+ tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
370
+ tha_Thai,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
371
+ tir_Ethi,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
372
+ tiv_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
373
+ tly_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
374
+ tob_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
375
+ toi_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
376
+ toj_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
377
+ ton_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
378
+ top_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
379
+ tpi_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
380
+ tsn_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
381
+ tso_Latn,114,73,0,41,27509,1.0,0.640351,0.780749,1.0,0.0,0.640351
382
+ tsz_Latn,59,56,11,3,27553,0.835821,0.949153,0.888889,0.999601,399.071252,0.949153
383
+ tuk_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
384
+ tuk_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
385
+ tur_Latn,59,59,35,0,27529,0.62766,1.0,0.771242,0.99873,1269.772167,1.0
386
+ twi_Latn,116,116,1,0,27506,0.991453,1.0,0.995708,0.999964,36.354383,1.0
387
+ tyv_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
388
+ tzh_Latn,25,25,1,0,27597,0.961538,1.0,0.980392,0.999964,36.23451,1.0
389
+ tzm_Tfng,1,1,30,0,27592,0.032258,1.0,0.0625,0.998914,1086.090797,1.0
390
+ tzo_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
391
+ udu_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
392
+ uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
393
+ uig_Latn,59,59,26,0,27538,0.694118,1.0,0.819444,0.999057,943.259324,1.0
394
+ ukr_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
395
+ umb_Latn,107,105,0,2,27516,1.0,0.981308,0.990566,1.0,0.0,0.981308
396
+ ura_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
397
+ urd_Arab,108,106,1,2,27514,0.990654,0.981481,0.986047,0.999964,36.343812,0.981481
398
+ uzn_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
399
+ uzn_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
400
+ vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
401
+ vec_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
402
+ ven_Latn,89,89,0,0,27534,1.0,1.0,1.0,1.0,0.0,1.0
403
+ vep_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
404
+ vie_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
405
+ vmw_Latn,58,56,1,2,27564,0.982456,0.965517,0.973913,0.999964,36.277889,0.965517
406
+ war_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
407
+ wln_Latn,59,56,56,3,27508,0.5,0.949153,0.654971,0.997968,2031.635467,0.949153
408
+ wol_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
409
+ wuu_Hani,48,47,123,1,27452,0.276471,0.979167,0.431193,0.995539,4460.562103,0.979167
410
+ wwa_Latn,39,39,2,0,27582,0.95122,1.0,0.975,0.999927,72.5058,1.0
411
+ xho_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
412
+ xsm_Latn,59,58,7,1,27557,0.892308,0.983051,0.935484,0.999746,253.954433,0.983051
413
+ yad_Latn,55,53,0,2,27568,1.0,0.963636,0.981481,1.0,0.0,0.963636
414
+ yao_Latn,52,51,0,1,27571,1.0,0.980769,0.990291,1.0,0.0,0.980769
415
+ yap_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
416
+ ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
417
+ ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
418
+ yor_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
419
+ yrk_Cyrl,55,52,1,3,27567,0.981132,0.945455,0.962963,0.999964,36.273941,0.945455
420
+ yua_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
421
+ yue_Hani,49,20,0,29,27574,1.0,0.408163,0.57971,1.0,0.0,0.408163
422
+ zam_Latn,60,0,5,60,27558,0.0,0.0,0.0,0.999819,181.402605,0.0
423
+ zdj_Latn,50,48,1,2,27572,0.979592,0.96,0.969697,0.999964,36.267363,0.96
424
+ zgh_Tfng,60,18,0,42,27563,1.0,0.3,0.461538,1.0,0.0,0.3
425
+ zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
426
+ zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
427
+ zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
428
+ ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
429
+ zul_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
430
+ zyb_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
reports/udhr-all/glotlid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.750244361582739,
3
+ "top3_accuracy": 0.8144662056981501,
4
+ "top5_accuracy": 0.8281866560474966,
5
+ "passages": 27623,
6
+ "languages": 429,
7
+ "macro_precision": 0.7694575973118034,
8
+ "macro_recall": 0.7529055089081532,
9
+ "macro_f1": 0.7454327849166208,
10
+ "macro_specificity": 0.9998410395298513,
11
+ "weighted_f1": 0.7485822543592835,
12
+ "median_f1": 0.9795918367346939,
13
+ "languages_f1_at_least_0_9": 277,
14
+ "languages_f1_below_0_5": 97,
15
+ "mean_fp_per_million": 158.96047014874904,
16
+ "micro_f1": 0.750244361582739
17
+ }
reports/udhr-all/leaderboard.csv ADDED
@@ -0,0 +1,430 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,language,support,millid_f1,millid_precision,millid_recall,glotlid_f1,glotlid_precision,glotlid_recall,glotlid@millid_f1,glotlid@millid_precision,glotlid@millid_recall,fasttext_f1,fasttext_precision,fasttext_recall,fasttext@millid_f1,fasttext@millid_precision,fasttext@millid_recall,delta,winner,delta_fasttext,winner_fasttext
2
+ roh_Latn,Romansh,399,0.9925,0.995,0.99,0.9987,0.9975,1.0,0.9987,0.9975,1.0,0.941,0.8886,1.0,0.941,0.8886,1.0,-0.0063,tie,0.0514,MillID
3
+ oci_Latn,Occitan,398,0.2747,0.9412,0.1608,0.3755,1.0,0.2312,0.3755,1.0,0.2312,0.4276,0.4856,0.3819,0.4276,0.4856,0.3819,-0.1008,GlotLID,-0.1529,fastText
4
+ cmn_Hani,Chinese (Mandarin),319,0.7876,0.6681,0.9592,0.7446,0.6261,0.9185,0.7446,0.6261,0.9185,0.4125,0.4612,0.373,0.4125,0.4612,0.373,0.043,MillID,0.3752,MillID
5
+ krl_Latn,Karelian,183,0.0,0.0,0.0,0.0109,1.0,0.0055,0.0109,1.0,0.0055,0.0,0.0,0.0,0.0,0.0,0.0,-0.0109,GlotLID,0.0,tie
6
+ qug_Latn,Chimborazo Highland Quichua,182,0.0109,1.0,0.0055,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0109,MillID,0.0109,MillID
7
+ acu_Latn,Achuar-Shiwiar,180,0.8254,0.963,0.7222,0.8535,1.0,0.7444,0.8535,1.0,0.7444,0.0,0.0,0.0,0.0,0.0,0.0,-0.0281,GlotLID,0.8254,MillID
8
+ hus_Latn,Huastec,175,0.9766,1.0,0.9543,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0,0.0,0.0,0.0,0.0,0.0,-0.0089,tie,0.9766,MillID
9
+ hau_Latn,Hausa,155,0.984,0.9747,0.9935,0.9968,0.9936,1.0,0.9968,0.9936,1.0,0.854,0.7452,1.0,0.854,0.7452,1.0,-0.0128,GlotLID,0.13,MillID
10
+ auc_Latn,Waorani,154,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
11
+ kwi_Latn,Awa-Cuaiquer,145,0.8803,1.0,0.7862,0.8769,0.9913,0.7862,0.8769,0.9913,0.7862,0.0,0.0,0.0,0.0,0.0,0.0,0.0034,tie,0.8803,MillID
12
+ lot_Latn,lot_Latn,140,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
13
+ jpn_Jpan,Japanese,140,1.0,1.0,1.0,0.9894,0.979,1.0,0.9859,0.9722,1.0,0.9024,0.8535,0.9571,0.9024,0.8535,0.9571,0.0141,MillID,0.0976,MillID
14
+ snn_Latn,Siona,136,0.6305,0.9552,0.4706,0.5137,1.0,0.3456,0.5137,1.0,0.3456,0.0,0.0,0.0,0.0,0.0,0.0,0.1169,MillID,0.6305,MillID
15
+ lat_Latn,Latin,118,0.9915,0.9915,0.9915,0.9872,0.9915,0.9831,0.9872,0.9915,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,0.0043,tie,0.9915,MillID
16
+ ktu_Latn,Kituba (Democratic Republic of Congo),118,0.7653,0.6667,0.8983,0.6803,0.6587,0.7034,0.6803,0.6587,0.7034,0.0,0.0,0.0,0.0,0.0,0.0,0.085,MillID,0.7653,MillID
17
+ hat_Latn,Haitian Creole,117,0.9915,0.9915,0.9915,0.9785,0.9828,0.9744,0.9785,0.9828,0.9744,0.6988,0.5395,0.9915,0.6988,0.5395,0.9915,0.0129,MillID,0.2927,MillID
18
+ nya_Latn,Nyanja,116,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.7891,0.6517,1.0,0.7891,0.6517,1.0,-0.0087,tie,0.2022,MillID
19
+ twi_Latn,Twi,116,0.9748,0.9508,1.0,0.9957,0.9915,1.0,0.9957,0.9915,1.0,0.3694,0.2266,1.0,0.3665,0.2244,1.0,-0.0209,GlotLID,0.6083,MillID
20
+ kmb_Latn,Kimbundu,116,0.9702,0.958,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.8605,0.7817,0.9569,0.8605,0.7817,0.9569,-0.0298,GlotLID,0.1097,MillID
21
+ rmn_Latn,Balkan Romani,116,0.678,0.9836,0.5172,0.8571,1.0,0.75,0.8571,1.0,0.75,0.0,0.0,0.0,0.0,0.0,0.0,-0.1792,GlotLID,0.678,MillID
22
+ kng_Latn,Koongo,115,0.0758,0.2941,0.0435,0.1928,0.3137,0.1391,0.1928,0.3137,0.1391,0.4514,0.3529,0.6261,0.4514,0.3529,0.6261,-0.117,GlotLID,-0.3757,fastText
23
+ pov_Latn,Upper Guinea Crioulo,115,0.8205,1.0,0.6957,0.8325,1.0,0.713,0.8325,1.0,0.713,0.0,0.0,0.0,0.0,0.0,0.0,-0.012,GlotLID,0.8205,MillID
24
+ chr_Cher,Cherokee,115,0.6705,1.0,0.5043,0.6628,1.0,0.4957,0.6628,1.0,0.4957,0.0,0.0,0.0,0.0,0.0,0.0,0.0077,tie,0.6705,MillID
25
+ lvs_Latn,Standard Latvian,115,0.9868,1.0,0.9739,1.0,1.0,1.0,1.0,1.0,1.0,0.9914,0.9829,1.0,0.9914,0.9829,1.0,-0.0132,GlotLID,-0.0046,tie
26
+ ell_Grek,Greek,115,0.6705,1.0,0.5043,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.3295,GlotLID,-0.3295,fastText
27
+ por_Latn,Portuguese,115,0.9554,0.9817,0.9304,0.9871,0.9746,1.0,0.9237,0.8582,1.0,0.7797,0.6389,1.0,0.7797,0.6389,1.0,0.0317,MillID,0.1757,MillID
28
+ fas_Arab,Persian,114,0.9912,1.0,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,0.8976,0.8143,1.0,0.8976,0.8143,1.0,-0.0088,tie,0.0935,MillID
29
+ tso_Latn,Tsonga,114,0.8557,0.9885,0.7544,0.7807,1.0,0.6404,0.7807,1.0,0.6404,0.659,0.4914,1.0,0.659,0.4914,1.0,0.075,MillID,0.1968,MillID
30
+ tha_Thai,Thai,114,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9956,0.9913,1.0,0.9956,0.9913,1.0,0.0,tie,0.0044,tie
31
+ cjk_Latn,Chokwe,114,0.867,0.9888,0.7719,1.0,1.0,1.0,1.0,1.0,1.0,0.5301,0.3654,0.9649,0.5301,0.3654,0.9649,-0.133,GlotLID,0.3369,MillID
32
+ lin_Latn,Lingala,110,0.991,0.9821,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.982,0.9732,0.9909,0.982,0.9732,0.9909,-0.009,tie,0.009,tie
33
+ urd_Arab,Urdu,108,0.9907,1.0,0.9815,0.986,0.9907,0.9815,0.986,0.9907,0.9815,0.6353,0.4655,1.0,0.6353,0.4655,1.0,0.0046,tie,0.3554,MillID
34
+ fuv_Latn,Nigerian Fulfulde,108,0.6364,0.8235,0.5185,0.6813,0.8378,0.5741,0.6848,0.8289,0.5833,0.3582,0.2182,1.0,0.3582,0.2182,1.0,-0.0484,GlotLID,0.2782,MillID
35
+ umb_Latn,Umbundu,107,0.9662,1.0,0.9346,0.9906,1.0,0.9813,0.9906,1.0,0.9813,0.9004,0.8387,0.972,0.9004,0.8387,0.972,-0.0244,GlotLID,0.0658,MillID
36
+ mal_Mlym,Malayalam,100,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
37
+ ron_Latn,Romanian,97,0.9949,0.9898,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8727,0.7805,0.9897,0.8727,0.7805,0.9897,-0.0051,tie,0.1221,MillID
38
+ ven_Latn,Venda,89,0.9944,0.9889,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0056,tie,0.9944,MillID
39
+ spa_Latn,Spanish,78,0.9677,0.974,0.9615,0.9809,0.9747,0.9872,0.9625,0.939,0.9872,0.5493,0.3786,1.0,0.5493,0.3786,1.0,0.0052,tie,0.4184,MillID
40
+ hye_Armn,Armenian,70,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0,tie,0.0145,MillID
41
+ tam_Taml,Tamil,68,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
42
+ tiv_Latn,Tiv,67,1.0,1.0,1.0,1.0,1.0,1.0,0.9853,0.971,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0147,MillID,1.0,MillID
43
+ deu_Latn,German,67,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9571,0.9178,1.0,0.9571,0.9178,1.0,0.0,tie,0.0429,MillID
44
+ ibb_Latn,ibb_Latn,67,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
45
+ sun_Latn,Sundanese,66,0.9924,1.0,0.9848,0.9924,1.0,0.9848,0.9924,1.0,0.9848,0.7263,0.5752,0.9848,0.7263,0.5752,0.9848,0.0,tie,0.2661,MillID
46
+ pam_Latn,Pampanga,66,0.9778,0.9565,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0222,GlotLID,0.9778,MillID
47
+ njo_Latn,Ao Naga,64,1.0,1.0,1.0,0.9844,0.9844,0.9844,0.9844,0.9844,0.9844,0.0,0.0,0.0,0.0,0.0,0.0,0.0156,MillID,1.0,MillID
48
+ knc_Latn,Central Kanuri,64,0.9697,0.9412,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.3891,0.2415,1.0,0.3891,0.2415,1.0,-0.0303,GlotLID,0.5806,MillID
49
+ skr_Arab,Saraiki,63,0.8673,0.98,0.7778,0.5,1.0,0.3333,0.5,1.0,0.3333,0.0,0.0,0.0,0.0,0.0,0.0,0.3673,MillID,0.8673,MillID
50
+ smo_Latn,Samoan,63,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.7871,0.663,0.9683,0.7871,0.663,0.9683,0.0,tie,0.2129,MillID
51
+ mcf_Latn,Matsés,62,1.0,1.0,1.0,0.992,0.9841,1.0,0.992,0.9841,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.008,tie,1.0,MillID
52
+ shp_Latn,Shipibo-Conibo,62,0.4691,1.0,0.3065,0.9123,1.0,0.8387,0.9123,1.0,0.8387,0.0,0.0,0.0,0.0,0.0,0.0,-0.4431,GlotLID,0.4691,MillID
53
+ cbi_Latn,Chachi,62,0.9688,0.9394,1.0,0.9839,0.9839,0.9839,0.976,0.9683,0.9839,0.0,0.0,0.0,0.0,0.0,0.0,-0.0072,tie,0.9688,MillID
54
+ nob_Latn,Norwegian Bokmål,62,0.9134,0.8923,0.9355,0.9764,0.9538,1.0,0.9764,0.9538,1.0,0.9841,0.9688,1.0,0.9841,0.9688,1.0,-0.063,GlotLID,-0.0707,fastText
55
+ gla_Latn,Scottish Gaelic,62,0.9919,1.0,0.9839,0.9836,1.0,0.9677,0.9836,1.0,0.9677,0.9508,0.9667,0.9355,0.9508,0.9667,0.9355,0.0083,tie,0.0411,MillID
56
+ swe_Latn,Swedish,61,0.9917,1.0,0.9836,1.0,1.0,1.0,0.9919,0.9839,1.0,0.9839,0.9683,1.0,0.9839,0.9683,1.0,-0.0001,tie,0.0079,tie
57
+ sey_Latn,Secoya,61,0.5799,0.4537,0.8033,0.5138,0.3567,0.918,0.5249,0.3625,0.9508,0.0,0.0,0.0,0.0,0.0,0.0,0.055,MillID,0.5799,MillID
58
+ fin_Latn,Finnish,61,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.2742,0.1589,1.0,0.2742,0.1589,1.0,0.0,tie,0.7258,MillID
59
+ pnb_Arab,Western Panjabi,61,0.8824,0.8,0.9836,0.7394,0.5865,1.0,0.7394,0.5865,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.143,MillID,0.8824,MillID
60
+ amr_Latn,Amarakaeri,61,0.976,0.9531,1.0,0.976,0.9531,1.0,0.976,0.9531,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.976,MillID
61
+ ace_Latn,Acehnese,61,1.0,1.0,1.0,0.9917,1.0,0.9836,0.9917,1.0,0.9836,0.48,0.3175,0.9836,0.48,0.3175,0.9836,0.0083,tie,0.52,MillID
62
+ dan_Latn,Danish,61,0.9431,0.9355,0.9508,0.9833,1.0,0.9672,0.9833,1.0,0.9672,0.96,0.9375,0.9836,0.96,0.9375,0.9836,-0.0402,GlotLID,-0.0169,fastText
63
+ boa_Latn,Bora,61,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
64
+ vai_Vaii,vai_Vaii,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
65
+ wol_Latn,Wolof,60,0.8511,0.7407,1.0,0.9836,0.9677,1.0,0.9836,0.9677,1.0,0.208,0.1161,1.0,0.208,0.1161,1.0,-0.1325,GlotLID,0.6431,MillID
66
+ fil_Latn,Filipino,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.553,0.3822,1.0,0.553,0.3822,1.0,0.0,tie,0.447,MillID
67
+ mad_Latn,Madurese,60,0.6556,0.4917,0.9833,0.9508,0.9355,0.9667,0.9355,0.9062,0.9667,0.0,0.0,0.0,0.0,0.0,0.0,-0.2799,GlotLID,0.6556,MillID
68
+ war_Latn,Waray,60,0.9836,0.9677,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.9365,0.8939,0.9833,0.9365,0.8939,0.9833,-0.0081,tie,0.0471,MillID
69
+ ban_Latn,Balinese,60,0.9661,0.9828,0.95,1.0,1.0,1.0,1.0,1.0,1.0,0.5381,0.3681,1.0,0.5381,0.3681,1.0,-0.0339,GlotLID,0.428,MillID
70
+ tca_Latn,Ticuna,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
71
+ ton_Latn,Tongan,60,1.0,1.0,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0083,tie,1.0,MillID
72
+ zam_Latn,Miahuatlán Zapotec,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
73
+ zgh_Tfng,Standard Moroccan Tamazight,60,0.75,1.0,0.6,0.4615,1.0,0.3,0.4615,1.0,0.3,0.0,0.0,0.0,0.0,0.0,0.0,0.2885,MillID,0.75,MillID
74
+ tbz_Latn,Ditammari,60,0.0,0.0,0.0,0.3784,1.0,0.2333,0.3784,1.0,0.2333,0.0,0.0,0.0,0.0,0.0,0.0,-0.3784,GlotLID,0.0,tie
75
+ cab_Latn,Garifuna,60,1.0,1.0,1.0,0.9831,1.0,0.9667,0.9831,1.0,0.9667,0.0,0.0,0.0,0.0,0.0,0.0,0.0169,MillID,1.0,MillID
76
+ cic_Latn,cic_Latn,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
77
+ cbr_Latn,Cashibo-Cacataibo,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
78
+ bod_Tibt,Tibetan,60,0.9748,0.9831,0.9667,0.9009,0.9804,0.8333,0.9009,0.9804,0.8333,0.8992,0.8406,0.9667,0.8992,0.8406,0.9667,0.0739,MillID,0.0756,MillID
79
+ bug_Latn,Buginese,60,0.9298,0.9815,0.8833,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.566,0.3947,1.0,0.566,0.3947,1.0,-0.0619,GlotLID,0.3638,MillID
80
+ sna_Latn,Shona,60,0.9756,0.9524,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.5455,0.3826,0.95,0.5455,0.3826,0.95,-0.0161,GlotLID,0.4302,MillID
81
+ jav_Java,jav_Java,60,0.0,0.0,0.0,0.9744,1.0,0.95,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
82
+ afr_Latn,Afrikaans,60,0.9916,1.0,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,0.944,0.9077,0.9833,0.944,0.9077,0.9833,-0.0084,tie,0.0476,MillID
83
+ arl_Latn,Arabela,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
84
+ udu_Latn,Uduk,60,0.9836,0.9677,1.0,0.9836,0.9677,1.0,0.9302,0.8696,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0534,MillID,0.9836,MillID
85
+ vie_Latn,Vietnamese,60,0.9917,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9302,0.8696,1.0,0.9302,0.8696,1.0,-0.0083,tie,0.0615,MillID
86
+ mcd_Latn,Sharanahua,60,1.0,1.0,1.0,0.9836,0.9677,1.0,0.9836,0.9677,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0164,MillID,1.0,MillID
87
+ jav_Latn,Javanese,60,0.9833,0.9833,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.4739,0.3122,0.9833,0.4739,0.3122,0.9833,-0.0083,tie,0.5094,MillID
88
+ jiv_Latn,Shuar,60,0.8,0.6824,0.9667,0.7973,0.6705,0.9833,0.7973,0.6705,0.9833,0.0,0.0,0.0,0.0,0.0,0.0,0.0027,tie,0.8,MillID
89
+ gjn_Latn,Gonja,60,0.9833,0.9833,0.9833,0.928,0.8923,0.9667,0.928,0.8923,0.9667,0.0,0.0,0.0,0.0,0.0,0.0,0.0553,MillID,0.9833,MillID
90
+ gaz_Latn,Oromo (West Central),60,0.912,0.8769,0.95,0.9752,0.9672,0.9833,0.9752,0.9672,0.9833,0.4762,0.3125,1.0,0.4762,0.3125,1.0,-0.0632,GlotLID,0.4358,MillID
91
+ quy_Latn,Ayacucho Quechua,60,0.6554,0.4957,0.9667,0.7712,0.6344,0.9833,0.7712,0.6344,0.9833,0.0909,0.0477,0.9833,0.0909,0.0477,0.9833,-0.1159,GlotLID,0.5645,MillID
92
+ qvm_Latn,Margos-Yarowilca-Lauricocha Quechua,60,0.3562,1.0,0.2167,0.5,1.0,0.3333,0.5,1.0,0.3333,0.0,0.0,0.0,0.0,0.0,0.0,-0.1438,GlotLID,0.3562,MillID
93
+ ctd_Latn,Tedim Chin,60,0.6047,1.0,0.4333,0.6957,1.0,0.5333,0.7234,1.0,0.5667,0.0,0.0,0.0,0.0,0.0,0.0,-0.1188,GlotLID,0.6047,MillID
94
+ cot_Latn,Caquinte,60,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.9916,MillID
95
+ cym_Latn,Welsh,60,0.9917,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8,0.6667,1.0,0.8,0.6667,1.0,-0.0083,tie,0.1917,MillID
96
+ cpu_Latn,Pichis Ashéninka,60,0.7292,0.9722,0.5833,0.9744,1.0,0.95,0.9744,1.0,0.95,0.0,0.0,0.0,0.0,0.0,0.0,-0.2452,GlotLID,0.7292,MillID
97
+ ekk_Latn,Estonian,60,0.9917,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.3343,0.2007,1.0,0.3343,0.2007,1.0,-0.0083,tie,0.6575,MillID
98
+ ind_Latn,Indonesian,60,0.7308,0.8636,0.6333,0.8947,0.9444,0.85,0.8947,0.9444,0.85,0.5279,0.3796,0.8667,0.5279,0.3796,0.8667,-0.164,GlotLID,0.2029,MillID
99
+ tuk_Latn,Turkmen,59,0.9828,1.0,0.9661,1.0,1.0,1.0,0.9916,0.9833,1.0,0.9672,0.9365,1.0,0.9672,0.9365,1.0,-0.0088,tie,0.0155,MillID
100
+ tsz_Latn,Purepecha,59,0.8175,0.7179,0.9492,0.8889,0.8358,0.9492,0.8976,0.8382,0.9661,0.0,0.0,0.0,0.0,0.0,0.0,-0.0801,GlotLID,0.8175,MillID
101
+ yua_Latn,Yucateco,59,0.9833,0.9672,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0167,GlotLID,0.9833,MillID
102
+ tur_Latn,Turkish,59,0.9516,0.9077,1.0,0.7712,0.6277,1.0,0.7662,0.6211,1.0,0.4797,0.3155,1.0,0.4797,0.3155,1.0,0.1854,MillID,0.4719,MillID
103
+ ssw_Latn,Swati,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8252,0.7024,1.0,0.8252,0.7024,1.0,0.0,tie,0.1748,MillID
104
+ srp_Latn,Serbian,59,0.3486,0.38,0.322,0.45,0.8571,0.3051,0.45,0.8571,0.3051,0.0,0.0,0.0,0.0,0.0,0.0,-0.1014,GlotLID,0.3486,MillID
105
+ bos_Cyrl,bos_Cyrl,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
106
+ ceb_Latn,Cebuano,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.6114,0.4403,1.0,0.6114,0.4403,1.0,-0.0084,tie,0.3802,MillID
107
+ bre_Latn,Breton,59,0.9831,0.9831,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,-0.0084,tie,0.9831,MillID
108
+ ccp_Cakm,ccp_Cakm,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
109
+ chj_Latn,chj_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
110
+ bis_Latn,Bislama,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.7516,0.602,1.0,0.7516,0.602,1.0,0.0,tie,0.2484,MillID
111
+ top_Latn,Papantla Totonac,59,0.958,0.95,0.9661,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0336,GlotLID,0.958,MillID
112
+ tly_Latn,Talysh,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.9915,MillID
113
+ tob_Latn,Toba,59,0.9833,0.9672,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0167,GlotLID,0.9833,MillID
114
+ slv_Latn,Slovenian,59,0.9661,0.9661,0.9661,0.9752,0.9516,1.0,0.9752,0.9516,1.0,0.7662,0.6211,1.0,0.7662,0.6211,1.0,-0.0091,tie,0.1999,MillID
115
+ src_Latn,src_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
116
+ srp_Cyrl,Serbian,59,0.6629,0.5,0.9831,0.6629,0.5,0.9831,0.6629,0.5,0.9831,0.6629,0.5,0.9831,0.6629,0.5,0.9831,0.0,tie,0.0,tie
117
+ sin_Sinh,Sinhala,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
118
+ bos_Latn,Bosnian,59,0.2,0.1831,0.2203,0.3121,0.2368,0.4576,0.3121,0.2368,0.4576,0.1951,0.1228,0.4746,0.1951,0.1228,0.4746,-0.1121,GlotLID,0.0049,tie
119
+ hun_Latn,Hungarian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.2914,0.1705,1.0,0.2914,0.1705,1.0,0.0,tie,0.7086,MillID
120
+ oki_Latn,oki_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
121
+ orh_Latn,orh_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
122
+ ote_Latn,Mezquital Otomi,59,0.1408,0.4167,0.0847,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1408,MillID,0.1408,MillID
123
+ gaa_Latn,Ga,59,0.9672,0.9365,1.0,0.9752,0.9516,1.0,0.9672,0.9365,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.9672,MillID
124
+ gld_Cyrl,gld_Cyrl,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
125
+ fij_Latn,Fijian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9752,0.9516,1.0,0.9752,0.9516,1.0,0.0,tie,0.0248,MillID
126
+ eus_Latn,Basque,59,0.9147,0.8429,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.8788,0.7945,0.9831,0.8788,0.7945,0.9831,-0.0769,GlotLID,0.0359,MillID
127
+ ewe_Latn,Ewe,59,0.9291,0.8676,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.4813,0.3187,0.9831,0.4813,0.3187,0.9831,-0.0709,GlotLID,0.4478,MillID
128
+ pbu_Arab,pbu_Arab,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
129
+ not_Latn,Nomatsiguenga,59,0.9831,0.9831,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,-0.0084,tie,0.9831,MillID
130
+ fur_Latn,Friulian,59,0.9667,0.9508,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,0.6082,0.437,1.0,0.6051,0.4338,1.0,-0.0333,GlotLID,0.3615,MillID
131
+ gag_Latn,Gagauz,59,0.9744,0.9828,0.9661,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,-0.0171,GlotLID,0.9744,MillID
132
+ qwh_Latn,Huaylas Ancash Quechua,59,0.494,0.3832,0.6949,0.6545,0.7059,0.6102,0.6545,0.7059,0.6102,0.0,0.0,0.0,0.0,0.0,0.0,-0.1606,GlotLID,0.494,MillID
133
+ cnr_Latn,Serbian (Montenegro),59,0.0,0.0,0.0,0.0303,0.1429,0.0169,0.0303,0.1429,0.0169,0.0,0.0,0.0,0.0,0.0,0.0,-0.0303,GlotLID,0.0,tie
134
+ crh_Latn,Crimean Tatar,59,0.9833,0.9672,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8082,0.6782,1.0,0.8082,0.6782,1.0,-0.0167,GlotLID,0.1751,MillID
135
+ dga_Latn,Southern Dagaare,59,0.9833,0.9672,1.0,0.9915,1.0,0.9831,0.9916,0.9833,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0083,tie,0.9833,MillID
136
+ dzo_Tibt,Dzongkha,59,0.9748,0.9667,0.9831,0.9134,0.8529,0.9831,0.9134,0.8529,0.9831,0.8571,0.9057,0.8136,0.8571,0.9057,0.8136,0.0614,MillID,0.1176,MillID
137
+ cjs_Cyrl,Shor,59,0.9474,0.9818,0.9153,0.9369,1.0,0.8814,0.9369,1.0,0.8814,0.0,0.0,0.0,0.0,0.0,0.0,0.0104,MillID,0.9474,MillID
138
+ cos_Latn,Corsican,59,0.9916,0.9833,1.0,0.9831,0.9831,0.9831,0.9831,0.9831,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,0.0085,tie,0.9916,MillID
139
+ cof_Latn,Colorado,59,1.0,1.0,1.0,0.9273,1.0,0.8644,0.9369,1.0,0.8814,0.0,0.0,0.0,0.0,0.0,0.0,0.0631,MillID,1.0,MillID
140
+ qva_Latn,Ambo-Pasco Quechua,59,0.0,0.0,0.0,0.0323,0.3333,0.0169,0.0323,0.3333,0.0169,0.0,0.0,0.0,0.0,0.0,0.0,-0.0323,GlotLID,0.0,tie
141
+ sag_Latn,Sango,59,0.9831,0.9831,0.9831,0.5783,1.0,0.4068,0.5783,1.0,0.4068,0.1795,0.3684,0.1186,0.1795,0.3684,0.1186,0.4047,MillID,0.8036,MillID
142
+ ppl_Latn,ppl_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
143
+ rar_Latn,Rarotongan,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
144
+ pol_Latn,Polish,59,0.9833,0.9672,1.0,1.0,1.0,1.0,0.5463,0.3758,1.0,0.6946,0.537,0.9831,0.6946,0.537,0.9831,0.437,MillID,0.2887,MillID
145
+ nzi_Latn,Nzima,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
146
+ hsb_Latn,Upper Sorbian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
147
+ hns_Latn,Caribbean Hindustani,59,0.9273,1.0,0.8644,0.9369,1.0,0.8814,0.9369,1.0,0.8814,0.0,0.0,0.0,0.0,0.0,0.0,-0.0097,tie,0.9273,MillID
148
+ hms_Latn,hms_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
149
+ hin_Deva,Hindi,59,0.7234,0.9714,0.5763,0.9573,0.9655,0.9492,0.9573,0.9655,0.9492,0.9752,0.9516,1.0,0.9752,0.9516,1.0,-0.2339,GlotLID,-0.2518,fastText
150
+ ltz_Latn,Luxembourgish,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.6304,0.464,0.9831,0.6304,0.464,0.9831,0.0,tie,0.361,MillID
151
+ mar_Deva,Marathi,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
152
+ lld_Latn,Ladin,59,0.9009,0.9615,0.8475,0.7312,1.0,0.5763,0.7234,0.9714,0.5763,0.0,0.0,0.0,0.0,0.0,0.0,0.1775,MillID,0.9009,MillID
153
+ gsw_Latn,Swiss German,59,0.8462,0.9778,0.7458,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,-0.1453,GlotLID,0.8462,MillID
154
+ maz_Latn,Central Mazahua,59,0.7389,0.5918,0.9831,0.9153,0.9153,0.9153,0.9076,0.9,0.9153,0.0,0.0,0.0,0.0,0.0,0.0,-0.1687,GlotLID,0.7389,MillID
155
+ mor_Latn,Moro,59,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,0.0085,tie,1.0,MillID
156
+ mlt_Latn,Maltese,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8676,0.7662,1.0,0.8676,0.7662,1.0,-0.0084,tie,0.1239,MillID
157
+ nba_Latn,Nyemba,59,0.0328,0.5,0.0169,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0328,MillID,0.0328,MillID
158
+ nav_Latn,Navajo,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.5488,0.3782,1.0,0.5488,0.3782,1.0,-0.0084,tie,0.4428,MillID
159
+ men_Latn,Mende,59,0.9593,0.9219,1.0,0.9916,0.9833,1.0,0.9833,0.9672,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.024,GlotLID,0.9593,MillID
160
+ mic_Latn,Mi'kmaw,59,0.9748,0.9667,0.9831,0.4267,1.0,0.2712,0.4267,1.0,0.2712,0.0,0.0,0.0,0.0,0.0,0.0,0.5481,MillID,0.9748,MillID
161
+ min_Latn,Minangkabau,59,0.9916,0.9833,1.0,0.9516,0.9077,1.0,0.9516,0.9077,1.0,0.127,1.0,0.0678,0.127,1.0,0.0678,0.04,MillID,0.8646,MillID
162
+ kbp_Latn,Kabiyè,59,0.6821,0.5175,1.0,1.0,1.0,1.0,0.9916,0.9833,1.0,0.2915,0.1711,0.9831,0.2915,0.1711,0.9831,-0.3095,GlotLID,0.3906,MillID
163
+ kin_Latn,Kinyarwanda,59,0.7961,0.9318,0.6949,0.8868,1.0,0.7966,0.8868,1.0,0.7966,0.8095,0.7612,0.8644,0.8095,0.7612,0.8644,-0.0907,GlotLID,-0.0134,fastText
164
+ khm_Khmr,Khmer,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
165
+ kqn_Latn,Kaonde,59,0.9748,0.9667,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0252,GlotLID,0.9748,MillID
166
+ kdh_Latn,Tem,59,0.9916,0.9833,1.0,0.8654,1.0,0.7627,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,0.0001,tie,0.9916,MillID
167
+ wln_Latn,Walloon,59,0.6118,0.4685,0.8814,0.655,0.5,0.9492,0.655,0.5,0.9492,0.0,0.0,0.0,0.0,0.0,0.0,-0.0432,GlotLID,0.6118,MillID
168
+ kbr_Latn,Kafa,59,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,0.0085,tie,1.0,MillID
169
+ ydd_Hebr,Eastern Yiddish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
170
+ xsm_Latn,Kasem,59,0.816,0.7727,0.8644,0.9355,0.8923,0.9831,0.716,0.5631,0.9831,0.0,0.0,0.0,0.0,0.0,0.0,0.1,MillID,0.816,MillID
171
+ ayr_Latn,Central Aymara,59,0.9833,0.9672,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.7117,0.5577,0.9831,0.7117,0.5577,0.9831,-0.0167,GlotLID,0.2717,MillID
172
+ uig_Latn,Uyghur,59,0.7152,0.5566,1.0,0.8194,0.6941,1.0,0.7919,0.6556,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0768,GlotLID,0.7152,MillID
173
+ bcl_Latn,Central Bikol,59,0.9915,1.0,0.9831,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0001,tie,0.9915,MillID
174
+ ame_Latn,Yanesha',59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
175
+ ada_Latn,Adangme,59,0.9752,0.9516,1.0,0.9365,0.8806,1.0,0.9365,0.8806,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0387,MillID,0.9752,MillID
176
+ ajg_Latn,Aja (Benin),59,0.6519,0.4836,1.0,0.6667,0.5,1.0,0.6629,0.4958,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.011,GlotLID,0.6519,MillID
177
+ als_Latn,Albanian (Tosk),59,0.9915,1.0,0.9831,0.9833,0.9672,1.0,0.9833,0.9672,1.0,0.596,0.4245,1.0,0.596,0.4245,1.0,0.0081,tie,0.3955,MillID
178
+ azj_Latn,North Azerbaijani,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.5888,0.4173,1.0,0.5888,0.4173,1.0,0.0,tie,0.4026,MillID
179
+ ast_Latn,Asturian,58,0.9649,0.9821,0.9483,1.0,1.0,1.0,1.0,1.0,1.0,0.7389,0.5859,1.0,0.7389,0.5859,1.0,-0.0351,GlotLID,0.2261,MillID
180
+ arn_Latn,Mapuche,58,0.9655,0.9655,0.9655,0.8952,1.0,0.8103,0.9057,1.0,0.8276,0.7887,0.6667,0.9655,0.7887,0.6667,0.9655,0.0599,MillID,0.1768,MillID
181
+ arb_Arab,Arabic (Modern Standard),58,0.8846,1.0,0.7931,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.1154,GlotLID,-0.1154,fastText
182
+ ami_Latn,Amis,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
183
+ tzo_Latn,Tzotzil,58,0.9643,1.0,0.931,0.9828,0.9828,0.9828,0.9828,0.9828,0.9828,0.0,0.0,0.0,0.0,0.0,0.0,-0.0185,GlotLID,0.9643,MillID
184
+ uig_Arab,Uyghur,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
185
+ ukr_Cyrl,Ukrainian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9587,0.9206,1.0,0.9587,0.9206,1.0,0.0,tie,0.0413,MillID
186
+ ben_Beng,Bangla,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
187
+ bel_Cyrl,Belarusian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8345,0.716,1.0,0.8345,0.716,1.0,0.0,tie,0.1655,MillID
188
+ bci_Latn,Baoulé,58,0.9915,0.9831,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.9915,MillID
189
+ bba_Latn,Baatonum,58,0.7451,0.6,0.9828,0.9744,0.9661,0.9828,0.9206,0.8529,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.1755,GlotLID,0.7451,MillID
190
+ bax_Latn,bax_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
191
+ vec_Latn,Venetian,58,0.9667,0.9355,1.0,0.9831,0.9667,1.0,0.9831,0.9667,1.0,0.8,0.6667,1.0,0.8,0.6667,1.0,-0.0164,GlotLID,0.1667,MillID
192
+ uzn_Latn,Northern Uzbek,58,0.9355,0.8788,1.0,0.9667,0.9355,1.0,0.9667,0.9355,1.0,0.3483,0.2109,1.0,0.3483,0.2109,1.0,-0.0312,GlotLID,0.5871,MillID
193
+ vep_Latn,Veps,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0175,GlotLID,0.9825,MillID
194
+ uzn_Cyrl,Northern Uzbek,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0087,tie,0.9913,MillID
195
+ kal_Latn,Kalaallisut,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.755,0.6129,0.9828,0.755,0.6129,0.9828,0.0,tie,0.245,MillID
196
+ kan_Knda,Kannada,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
197
+ kat_Geor,Georgian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
198
+ kaz_Cyrl,Kazakh,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.4444,0.2857,1.0,0.4444,0.2857,1.0,0.0,tie,0.5556,MillID
199
+ kea_Latn,Kabuverdianu,58,0.5729,0.4043,0.9828,0.8056,0.6744,1.0,0.6517,0.4833,1.0,0.1143,0.0789,0.2069,0.1137,0.0784,0.2069,-0.0788,GlotLID,0.4591,MillID
200
+ kha_Latn,Khasi,58,0.9508,0.9062,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0406,GlotLID,0.9508,MillID
201
+ kir_Cyrl,Kyrgyz,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.6042,0.4328,1.0,0.6042,0.4328,1.0,-0.0085,tie,0.3873,MillID
202
+ ina_Latn,Interlingua,58,0.8382,0.7308,0.9828,0.8593,0.7532,1.0,0.8593,0.7532,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.021,GlotLID,0.8382,MillID
203
+ ilo_Latn,Iloko,58,0.9831,0.9667,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.8467,0.7342,1.0,0.8467,0.7342,1.0,-0.0083,tie,0.1363,MillID
204
+ yap_Latn,Yapese,58,0.9913,1.0,0.9828,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0001,tie,0.9913,MillID
205
+ xho_Latn,Xhosa,58,0.9402,0.9322,0.9483,1.0,1.0,1.0,1.0,1.0,1.0,0.703,0.5421,1.0,0.703,0.5421,1.0,-0.0598,GlotLID,0.2371,MillID
206
+ vmw_Latn,Makhuwa,58,0.9825,1.0,0.9655,0.9739,0.9825,0.9655,0.9828,0.9828,0.9828,0.0,0.0,0.0,0.0,0.0,0.0,-0.0003,tie,0.9825,MillID
207
+ kab_Latn,Kabyle,58,0.9259,1.0,0.8621,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.9355,0.8788,1.0,0.928,0.8657,1.0,-0.0654,GlotLID,-0.0021,tie
208
+ kaa_Cyrl,Kara-Kalpak,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
209
+ ita_Latn,Italian,58,0.8571,0.76,0.9828,0.9062,0.8286,1.0,0.9062,0.8286,1.0,0.5421,0.3718,1.0,0.5421,0.3718,1.0,-0.0491,GlotLID,0.3151,MillID
210
+ isl_Latn,Icelandic,58,0.8738,1.0,0.7759,1.0,1.0,1.0,1.0,1.0,1.0,0.8286,0.7073,1.0,0.8286,0.7073,1.0,-0.1262,GlotLID,0.0452,MillID
211
+ glg_Latn,Galician,58,0.9828,0.9828,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.7891,0.6517,1.0,0.7891,0.6517,1.0,-0.0172,GlotLID,0.1936,MillID
212
+ glv_Latn,Manx,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
213
+ guj_Gujr,Gujarati,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
214
+ guc_Latn,Wayuu,58,0.928,0.8657,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.072,GlotLID,0.928,MillID
215
+ haw_Latn,Hawaiian,58,1.0,1.0,1.0,0.9735,1.0,0.9483,0.9735,1.0,0.9483,0.0,0.0,0.0,0.0,0.0,0.0,0.0265,MillID,1.0,MillID
216
+ guu_Latn,guu_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
217
+ nds_Latn,Low German,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
218
+ hrv_Latn,Croatian,58,0.5,0.3772,0.7414,0.7273,0.5833,0.9655,0.7273,0.5833,0.9655,0.4596,0.3051,0.931,0.4596,0.3051,0.931,-0.2273,GlotLID,0.0404,MillID
219
+ hnj_Latn,Hmong Njua,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
220
+ hil_Latn,Hiligaynon,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0087,tie,0.9913,MillID
221
+ mfq_Latn,Moba,58,1.0,1.0,1.0,0.9748,0.9508,1.0,0.9748,0.9508,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0252,MillID,1.0,MillID
222
+ mkd_Cyrl,Macedonian,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie,-0.0085,tie
223
+ lue_Latn,Luvale,58,0.9667,0.9355,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.0,0.0,0.0,0.0,0.0,0.0,-0.0246,GlotLID,0.9667,MillID
224
+ lus_Latn,Mizo,58,0.9913,1.0,0.9828,1.0,1.0,1.0,0.9748,0.9508,1.0,0.3494,0.2117,1.0,0.3494,0.2117,1.0,0.0165,MillID,0.6419,MillID
225
+ mai_Deva,Maithili,58,0.9355,0.8788,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0645,GlotLID,-0.056,fastText
226
+ mah_Latn,Marshallese,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
227
+ mam_Latn,Mam,58,0.8846,1.0,0.7931,0.9369,0.9811,0.8966,0.9369,0.9811,0.8966,0.0,0.0,0.0,0.0,0.0,0.0,-0.0523,GlotLID,0.8846,MillID
228
+ mxi_Latn,mxi_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
229
+ lob_Latn,lob_Latn,58,0.0,0.0,0.0,0.873,0.8088,0.9483,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
230
+ lua_Latn,Luba-Lulua,58,0.7097,0.9429,0.569,0.7391,1.0,0.5862,0.7391,1.0,0.5862,0.6347,0.4862,0.9138,0.6347,0.4862,0.9138,-0.0295,GlotLID,0.0749,MillID
231
+ lit_Latn,Lithuanian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8112,0.6824,1.0,0.8112,0.6824,1.0,0.0,tie,0.1888,MillID
232
+ lij_Latn,Ligurian,58,0.9748,0.9508,1.0,0.8406,0.725,1.0,0.8406,0.725,1.0,0.4286,0.274,0.9828,0.4286,0.274,0.9828,0.1342,MillID,0.5462,MillID
233
+ loz_Latn,Lozi,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0085,tie,0.9915,MillID
234
+ lad_Latn,Ladino,58,0.9643,1.0,0.931,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0357,GlotLID,0.9643,MillID
235
+ kor_Hang,Korean,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8722,0.7733,1.0,0.8722,0.7733,1.0,0.0,tie,0.1278,MillID
236
+ kqs_Latn,kqs_Latn,58,0.0,0.0,0.0,0.8041,1.0,0.6724,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
237
+ kri_Latn,Krio,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0085,tie,0.9915,MillID
238
+ kmr_Latn,Northern Kurdish,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.703,0.5421,1.0,0.703,0.5421,1.0,0.0,tie,0.297,MillID
239
+ niu_Latn,Niuean,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
240
+ nhn_Latn,nhn_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
241
+ ibo_Latn,Igbo,58,0.9748,0.9508,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.6629,0.4957,1.0,0.6629,0.4957,1.0,-0.0167,GlotLID,0.3119,MillID
242
+ huu_Latn,Murui Huitoto,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
243
+ heb_Hebr,Hebrew,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID,-0.0175,fastText
244
+ hea_Latn,hea_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
245
+ mzi_Latn,mzi_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
246
+ mxv_Latn,Metlatónoc Mixtec,58,0.129,1.0,0.069,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.129,MillID,0.129,MillID
247
+ nbl_Latn,South Ndebele,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
248
+ ndo_Latn,Ndonga,58,0.95,0.9194,0.9828,0.958,0.9344,0.9828,0.958,0.9344,0.9828,0.0,0.0,0.0,0.0,0.0,0.0,-0.008,tie,0.95,MillID
249
+ ddn_Latn,ddn_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
250
+ qvh_Latn,Huamalíes-Dos de Mayo Huánuco Quechua,58,0.4675,0.9474,0.3103,0.1515,0.625,0.0862,0.1515,0.625,0.0862,0.0,0.0,0.0,0.0,0.0,0.0,0.316,MillID,0.4675,MillID
251
+ bul_Cyrl,Bulgarian,58,0.9744,0.9661,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0256,GlotLID,-0.0171,fastText
252
+ snk_Latn,snk_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
253
+ suk_Latn,Sukuma,58,0.6994,0.5429,0.9828,0.7261,0.5758,0.9828,0.7261,0.5758,0.9828,0.0,0.0,0.0,0.0,0.0,0.0,-0.0267,GlotLID,0.6994,MillID
254
+ srr_Latn,Serer,58,0.9508,0.9062,1.0,0.9508,0.9062,1.0,0.9508,0.9062,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.9508,MillID
255
+ tpi_Latn,Tok Pisin,58,0.9831,0.9667,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9748,0.9508,1.0,0.9748,0.9508,1.0,-0.0169,GlotLID,0.0083,tie
256
+ tsn_Latn,Tswana,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.8788,0.7838,1.0,0.8788,0.7838,1.0,0.0,tie,0.1127,MillID
257
+ tyv_Cyrl,Tuvinian,58,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0085,tie,1.0,MillID
258
+ tir_Ethi,Tigrinya,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0085,tie,0.0,tie
259
+ tel_Telu,Telugu,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
260
+ zul_Latn,Zulu,58,0.9027,0.9273,0.8793,0.9744,0.9661,0.9828,0.9744,0.9661,0.9828,0.601,0.4296,1.0,0.601,0.4296,1.0,-0.0717,GlotLID,0.3016,MillID
261
+ ztu_Latn,ztu_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
262
+ zlm_Latn,zlm_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
263
+ tet_Latn,Tetum,58,0.6377,0.55,0.7586,0.1667,0.4286,0.1034,0.1644,0.4,0.1034,0.0,0.0,0.0,0.0,0.0,0.0,0.4733,MillID,0.6377,MillID
264
+ bum_Latn,Bulu,58,0.2059,0.7,0.1207,0.0968,0.75,0.0517,0.0896,0.3333,0.0517,0.0,0.0,0.0,0.0,0.0,0.0,0.1163,MillID,0.2059,MillID
265
+ cat_Latn,Catalan,58,0.9748,0.9508,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.5714,0.4,1.0,0.5714,0.4,1.0,-0.0252,GlotLID,0.4034,MillID
266
+ ces_Latn,Czech,58,0.9739,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,0.8788,0.7838,1.0,0.8788,0.7838,1.0,-0.0261,GlotLID,0.0951,MillID
267
+ swb_Latn,swb_Latn,58,0.0,0.0,0.0,0.8906,0.8143,0.9828,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
268
+ sus_Latn,Susu,58,0.9298,0.9464,0.9138,0.928,0.8657,1.0,0.928,0.8657,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0018,tie,0.9298,MillID
269
+ swh_Latn,Swahili,58,0.8522,0.8596,0.8448,0.9573,0.9492,0.9655,0.9412,0.918,0.9655,0.3268,0.1953,1.0,0.3268,0.1953,1.0,-0.089,GlotLID,0.5254,MillID
270
+ chk_Latn,Chuukese,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0085,tie,0.9915,MillID
271
+ dyu_Latn,Dyula,58,0.0,0.0,0.0,0.4186,0.6429,0.3103,0.3025,0.2951,0.3103,0.0123,0.0096,0.0172,0.0123,0.0096,0.0172,-0.3025,GlotLID,-0.0123,fastText
272
+ emk_Latn,emk_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
273
+ sco_Latn,Scots,58,0.9739,0.9825,0.9655,0.9565,0.9649,0.9483,0.9565,0.9649,0.9483,0.0,0.0,0.0,0.0,0.0,0.0,0.0174,MillID,0.9739,MillID
274
+ slr_Latn,slr_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
275
+ sme_Latn,Northern Sami,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
276
+ quc_Latn,Kʼicheʼ,58,1.0,1.0,1.0,0.9174,0.9804,0.8621,0.9174,0.9804,0.8621,0.0,0.0,0.0,0.0,0.0,0.0,0.0826,MillID,1.0,MillID
277
+ qvc_Latn,Cajamarca Quechua,58,0.648,0.4793,1.0,0.9062,0.8286,1.0,0.9062,0.8286,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.2582,GlotLID,0.648,MillID
278
+ que_Latn,que_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
279
+ cnh_Latn,Hakha Chin,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.9915,MillID
280
+ crs_Latn,Seselwa Creole French,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0085,tie,0.9915,MillID
281
+ pcd_Latn,Picard,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
282
+ pan_Guru,Punjabi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
283
+ rgn_Latn,rgn_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
284
+ cri_Latn,cri_Latn,58,0.0,0.0,0.0,0.766,1.0,0.6207,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
285
+ rus_Cyrl,Russian,58,0.9431,0.8923,1.0,0.8,0.6667,1.0,0.8,0.6667,1.0,0.6237,0.4531,1.0,0.6237,0.4531,1.0,0.1431,MillID,0.3194,MillID
286
+ run_Latn,Rundi,58,0.8444,0.7403,0.9828,0.8923,0.8056,1.0,0.8923,0.8056,1.0,0.7205,0.5631,1.0,0.7205,0.5631,1.0,-0.0479,GlotLID,0.1239,MillID
287
+ eng_Latn,English,58,0.9748,0.9508,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.5918,0.4203,1.0,0.5918,0.4203,1.0,-0.0252,GlotLID,0.383,MillID
288
+ epo_Latn,Esperanto,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.3402,0.2049,1.0,0.3402,0.2049,1.0,-0.0087,tie,0.6511,MillID
289
+ fkv_Latn,Kven Finnish,58,0.6279,0.9643,0.4655,0.6667,1.0,0.5,0.6667,1.0,0.5,0.0,0.0,0.0,0.0,0.0,0.0,-0.0388,GlotLID,0.6279,MillID
290
+ fuf_Latn,Pular,58,0.8807,0.9412,0.8276,0.4828,0.7241,0.3621,0.4828,0.7241,0.3621,0.0,0.0,0.0,0.0,0.0,0.0,0.398,MillID,0.8807,MillID
291
+ fuf_Adlm,fuf_Adlm,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
292
+ fry_Latn,Western Frisian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
293
+ fra_Latn,French,58,0.8544,0.9778,0.7586,0.9915,0.9831,1.0,0.9748,0.9508,1.0,0.9134,0.8406,1.0,0.9134,0.8406,1.0,-0.1204,GlotLID,-0.059,fastText
294
+ fon_Latn,Fon,58,0.9333,0.9032,0.9655,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.4345,0.2775,1.0,0.4345,0.2775,1.0,-0.058,GlotLID,0.4989,MillID
295
+ gej_Latn,gej_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
296
+ pap_Latn,Papiamento,58,1.0,1.0,1.0,0.9831,0.9667,1.0,0.9831,0.9667,1.0,0.6864,0.5225,1.0,0.6864,0.5225,1.0,0.0169,MillID,0.3136,MillID
297
+ nno_Latn,Norwegian Nynorsk,58,0.9558,0.9818,0.931,0.9915,0.9831,1.0,0.9831,0.9667,1.0,0.9667,0.9355,1.0,0.9667,0.9355,1.0,-0.0273,GlotLID,-0.0109,fastText
298
+ nld_Latn,Dutch,58,0.9915,0.9831,1.0,1.0,1.0,1.0,0.9062,0.8286,1.0,0.703,0.5421,1.0,0.703,0.5421,1.0,0.0852,MillID,0.2884,MillID
299
+ nso_Latn,Northern Sotho,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9508,0.9062,1.0,0.9508,0.9062,1.0,0.0,tie,0.0492,MillID
300
+ oaa_Cyrl,oaa_Cyrl,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
301
+ lns_Latn,lns_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
302
+ khk_Cyrl,Halh Mongolian,57,1.0,1.0,1.0,0.9655,0.9492,0.9825,0.9655,0.9492,0.9825,0.7862,0.6477,1.0,0.7862,0.6477,1.0,0.0345,MillID,0.2138,MillID
303
+ zyb_Latn,Yongbei Zhuang,57,0.6064,0.4351,1.0,0.9828,0.9661,1.0,0.9744,0.95,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.368,GlotLID,0.6064,MillID
304
+ aar_Latn,aar_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
305
+ abk_Cyrl,Abkhazian,57,0.9744,0.95,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,-0.0256,GlotLID,-0.0169,fastText
306
+ toj_Latn,Tojolabal,57,0.9825,0.9825,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0175,GlotLID,0.9825,MillID
307
+ tdt_Latn,Tetun Dili,57,0.4565,0.6,0.3684,0.6115,0.48,0.8421,0.6115,0.48,0.8421,0.0,0.0,0.0,0.0,0.0,0.0,-0.1549,GlotLID,0.4565,MillID
308
+ tah_Latn,Tahitian,57,0.973,1.0,0.9474,0.8125,1.0,0.6842,0.8125,1.0,0.6842,0.9661,0.9344,1.0,0.9661,0.9344,1.0,0.1605,MillID,0.0069,tie
309
+ tuk_Cyrl,Turkmen,57,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.95,0.9048,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0413,MillID,0.9913,MillID
310
+ cfm_Latn,Falam Chin,57,0.9912,1.0,0.9825,0.9735,0.9821,0.9649,0.9735,0.9821,0.9649,0.0,0.0,0.0,0.0,0.0,0.0,0.0177,MillID,0.9912,MillID
311
+ toi_Latn,Tonga (Zambia),57,0.9825,0.9825,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0175,GlotLID,0.9825,MillID
312
+ tat_Cyrl,Tatar,57,0.9268,0.8636,1.0,1.0,1.0,1.0,0.8702,0.7703,1.0,0.479,0.3149,1.0,0.479,0.3149,1.0,0.0566,MillID,0.4478,MillID
313
+ som_Latn,Somali,57,0.8906,0.8028,1.0,0.9344,0.8769,1.0,0.9344,0.8769,1.0,0.5816,0.4101,1.0,0.5816,0.4101,1.0,-0.0438,GlotLID,0.309,MillID
314
+ tgk_Cyrl,Tajik,57,0.9421,0.8906,1.0,0.9421,0.8906,1.0,0.9421,0.8906,1.0,0.4453,0.2864,1.0,0.4453,0.2864,1.0,0.0,tie,0.4968,MillID
315
+ cha_Latn,Chamorro,57,0.9828,0.9661,1.0,0.9159,0.98,0.8596,0.9159,0.98,0.8596,0.0,0.0,0.0,0.0,0.0,0.0,0.0669,MillID,0.9828,MillID
316
+ cbt_Latn,Chayahuita,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0087,tie,1.0,MillID
317
+ sid_Latn,Sidamo,57,0.9655,0.9492,0.9825,0.912,0.8382,1.0,0.912,0.8382,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0535,MillID,0.9655,MillID
318
+ sah_Cyrl,Yakut,57,0.8028,0.6706,1.0,0.6441,0.475,1.0,0.6441,0.475,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.1587,MillID,0.8028,MillID
319
+ rup_Latn,Aromanian,57,0.9828,0.9661,1.0,0.9744,0.95,1.0,0.9661,0.9344,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0167,MillID,0.9828,MillID
320
+ cak_Latn,Kaqchikel,57,0.9912,1.0,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0088,tie,0.9912,MillID
321
+ cbu_Latn,Candoshi-Shapra,57,0.5,1.0,0.3333,0.8824,1.0,0.7895,0.8738,0.9783,0.7895,0.0,0.0,0.0,0.0,0.0,0.0,-0.3738,GlotLID,0.5,MillID
322
+ pis_Latn,Pijin,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0087,tie,1.0,MillID
323
+ qvn_Latn,North Junín Quechua,57,0.2188,1.0,0.1228,0.4595,1.0,0.2982,0.4595,1.0,0.2982,0.0,0.0,0.0,0.0,0.0,0.0,-0.2407,GlotLID,0.2188,MillID
324
+ piu_Latn,piu_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
325
+ pon_Latn,Pohnpeian,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
326
+ quh_Latn,South Bolivian Quechua,57,0.9655,0.9492,0.9825,0.9369,0.963,0.9123,0.9649,0.9649,0.9649,0.0,0.0,0.0,0.0,0.0,0.0,0.0006,tie,0.9655,MillID
327
+ sot_Latn,Southern Sotho,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.748,0.697,0.807,0.748,0.697,0.807,0.0087,tie,0.252,MillID
328
+ buc_Latn,buc_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
329
+ dag_Latn,Dagbani,57,0.8485,0.7467,0.9825,0.8175,0.7,0.9825,0.7887,0.6588,0.9825,0.0,0.0,0.0,0.0,0.0,0.0,0.0598,MillID,0.8485,MillID
330
+ pau_Latn,Palauan,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
331
+ fvr_Latn,fvr_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
332
+ evn_Cyrl,evn_Cyrl,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
333
+ fat_Latn,Fanti,57,1.0,1.0,1.0,0.9744,0.95,1.0,0.9661,0.9344,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0339,MillID,1.0,MillID
334
+ fao_Latn,Faroese,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.7312,0.9444,0.5965,0.7312,0.9444,0.5965,0.0,tie,0.2688,MillID
335
+ mri_Latn,Māori,57,0.9194,0.8507,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.3619,0.2209,1.0,0.3608,0.2201,1.0,-0.0806,GlotLID,0.5586,MillID
336
+ hni_Latn,hni_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
337
+ lao_Laoo,Lao,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
338
+ koi_Cyrl,Komi-Permyak,57,0.8367,1.0,0.7193,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.1633,GlotLID,0.8367,MillID
339
+ quz_Latn,Cusco Quechua,57,0.6571,0.5542,0.807,0.7083,0.5862,0.8947,0.7211,0.5889,0.9298,0.0,0.0,0.0,0.0,0.0,0.0,-0.0639,GlotLID,0.6571,MillID
340
+ qxn_Latn,Northern Conchucos Ancash Quechua,57,0.127,0.6667,0.0702,0.0345,1.0,0.0175,0.0345,1.0,0.0175,0.0,0.0,0.0,0.0,0.0,0.0,0.0925,MillID,0.127,MillID
341
+ csa_Latn,csa_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
342
+ dip_Latn,dip_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
343
+ duu_Latn,duu_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
344
+ bam_Latn,Bambara,57,0.6316,0.4737,0.9474,0.7092,0.5952,0.8772,0.6369,0.5,0.8772,0.1511,0.0826,0.8772,0.1497,0.0818,0.8772,-0.0054,tie,0.4819,MillID
345
+ aii_Syrc,Assyrian Neo-Aramaic,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
346
+ bem_Latn,Bemba,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.4254,0.2701,1.0,0.4254,0.2701,1.0,-0.0087,tie,0.5659,MillID
347
+ agr_Latn,Aguaruna,57,0.9483,0.9322,0.9649,0.9739,0.9655,0.9825,0.9739,0.9655,0.9825,0.0,0.0,0.0,0.0,0.0,0.0,-0.0256,GlotLID,0.9483,MillID
348
+ kjh_Cyrl,Khakas,57,0.9744,0.95,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0169,GlotLID,0.9744,MillID
349
+ yor_Latn,Yoruba,57,0.8906,0.8028,1.0,0.9828,0.9661,1.0,0.9828,0.9661,1.0,0.5758,0.4043,1.0,0.5758,0.4043,1.0,-0.0921,GlotLID,0.3149,MillID
350
+ kek_Latn,Kekchí,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0087,tie,1.0,MillID
351
+ div_Thaa,Divehi,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
352
+ zro_Latn,zro_Latn,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
353
+ mya_Mymr,Burmese,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.6707,0.5045,1.0,0.6707,0.5045,1.0,0.0,tie,0.3293,MillID
354
+ mos_Latn,Mossi,56,0.9739,0.9492,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8296,0.7089,1.0,0.8296,0.7089,1.0,-0.0261,GlotLID,0.1443,MillID
355
+ lun_Latn,Lunda,56,0.991,1.0,0.9821,0.991,1.0,0.9821,0.991,1.0,0.9821,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.991,MillID
356
+ amc_Latn,amc_Latn,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
357
+ ura_Latn,Urarina,56,1.0,1.0,1.0,0.9825,0.9655,1.0,0.9825,0.9655,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0175,MillID,1.0,MillID
358
+ ady_Cyrl,Adyghe,56,0.963,1.0,0.9286,0.9818,1.0,0.9643,0.9818,1.0,0.9643,0.655,0.487,1.0,0.655,0.487,1.0,-0.0189,GlotLID,0.308,MillID
359
+ azj_Cyrl,North Azerbaijani,56,0.9739,0.9492,1.0,1.0,1.0,1.0,0.9912,0.9825,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0172,GlotLID,0.9739,MillID
360
+ niv_Cyrl,niv_Cyrl,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
361
+ gkp_Latn,gkp_Latn,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
362
+ pbb_Latn,Páez,56,0.5941,0.6667,0.5357,0.6458,0.775,0.5536,0.6458,0.775,0.5536,0.0,0.0,0.0,0.0,0.0,0.0,-0.0518,GlotLID,0.5941,MillID
363
+ pcm_Latn,Nigerian Pidgin,56,0.9825,0.9655,1.0,0.9244,0.873,0.9821,0.9256,0.8615,1.0,0.8627,0.9565,0.7857,0.955,0.9636,0.9464,0.0568,MillID,0.0275,MillID
364
+ shn_Mymr,Shan,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
365
+ slk_Latn,Slovak,56,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.918,0.8485,1.0,0.918,0.8485,1.0,-0.0175,GlotLID,0.0644,MillID
366
+ gle_Latn,Irish,56,1.0,1.0,1.0,0.9825,0.9655,1.0,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0175,MillID,0.0,tie
367
+ bho_Deva,Bhojpuri,56,0.8515,0.9556,0.7679,0.9333,1.0,0.875,0.9333,1.0,0.875,0.8,0.8571,0.75,0.8,0.8571,0.75,-0.0818,GlotLID,0.0515,MillID
368
+ yad_Latn,Yagua,55,0.963,0.9811,0.9455,0.9815,1.0,0.9636,0.9815,1.0,0.9636,0.0,0.0,0.0,0.0,0.0,0.0,-0.0185,GlotLID,0.963,MillID
369
+ dyo_Latn,Jola-Fonyi,55,0.9908,1.0,0.9818,0.9908,1.0,0.9818,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0092,tie,0.9908,MillID
370
+ tem_Latn,Timne,55,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
371
+ san_Deva,Sanskrit,55,0.9815,1.0,0.9636,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.9558,0.931,0.9818,0.9558,0.931,0.9818,-0.0093,tie,0.0257,MillID
372
+ shk_Latn,shk_Latn,55,0.0,0.0,0.0,0.9216,1.0,0.8545,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
373
+ npi_Deva,Nepali,55,1.0,1.0,1.0,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.9565,0.9167,1.0,0.9565,0.9167,1.0,0.0092,tie,0.0435,MillID
374
+ ido_Latn,Ido,55,0.955,0.9464,0.9636,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.045,GlotLID,0.955,MillID
375
+ mnw_Mymr,Mon,55,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
376
+ guk_Latn,guk_Latn,55,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
377
+ kbd_Cyrl,Kabardian,55,0.9649,0.9322,1.0,0.9735,0.9483,1.0,0.9735,0.9483,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0085,tie,0.9649,MillID
378
+ yrk_Cyrl,Nenets,55,0.9725,0.9815,0.9636,0.963,0.9811,0.9455,0.9455,0.9455,0.9455,0.0,0.0,0.0,0.0,0.0,0.0,0.027,MillID,0.9725,MillID
379
+ hlt_Latn,hlt_Latn,55,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
380
+ dje_Latn,Zarma,54,0.8381,0.8627,0.8148,0.8571,0.8276,0.8889,0.8448,0.7903,0.9074,0.0,0.0,0.0,0.0,0.0,0.0,-0.0067,tie,0.8381,MillID
381
+ qxu_Latn,qxu_Latn,54,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
382
+ blt_Tavt,blt_Tavt,54,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
383
+ koo_Latn,Konzo,54,0.9714,1.0,0.9444,0.9615,1.0,0.9259,0.9615,1.0,0.9259,0.0,0.0,0.0,0.0,0.0,0.0,0.0099,tie,0.9714,MillID
384
+ mag_Deva,Magahi,53,0.8679,0.8679,0.8679,0.9358,0.9107,0.9623,0.9358,0.9107,0.9623,0.6012,0.4455,0.9245,0.6012,0.4455,0.9245,-0.0679,GlotLID,0.2667,MillID
385
+ plt_Latn,Malagasy (Plateau),53,0.9907,0.9815,1.0,1.0,1.0,1.0,0.9907,0.9815,1.0,0.9217,0.8548,1.0,0.9217,0.8548,1.0,0.0,tie,0.0689,MillID
386
+ iii_Yiii,iii_Yiii,53,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
387
+ nku_Latn,nku_Latn,52,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
388
+ cni_Latn,Asháninka,52,0.7727,0.6375,0.9808,0.963,0.9286,1.0,0.963,0.9286,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.1902,GlotLID,0.7727,MillID
389
+ yao_Latn,Yao,52,0.9811,0.963,1.0,0.9903,1.0,0.9808,0.9903,1.0,0.9808,0.0,0.0,0.0,0.0,0.0,0.0,-0.0092,tie,0.9811,MillID
390
+ ykg_Cyrl,ykg_Cyrl,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
391
+ idu_Latn,Idoma,51,0.6027,1.0,0.4314,0.8791,1.0,0.7843,0.9375,1.0,0.8824,0.0,0.0,0.0,0.0,0.0,0.0,-0.3348,GlotLID,0.6027,MillID
392
+ kde_Latn,Makonde,51,0.9278,0.9783,0.8824,0.9703,0.98,0.9608,0.9703,0.98,0.9608,0.0,0.0,0.0,0.0,0.0,0.0,-0.0425,GlotLID,0.9278,MillID
393
+ kkh_Lana,kkh_Lana,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
394
+ amh_Ethi,Amharic,51,0.9901,1.0,0.9804,1.0,1.0,1.0,1.0,1.0,1.0,0.8409,1.0,0.7255,0.8409,1.0,0.7255,-0.0099,tie,0.1492,MillID
395
+ alt_Cyrl,Southern Altai,51,0.9808,0.9623,1.0,0.9623,0.9273,1.0,0.9623,0.9273,1.0,0.6939,0.5312,1.0,0.6939,0.5312,1.0,0.0185,MillID,0.2869,MillID
396
+ miq_Latn,Mískito,51,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
397
+ mto_Latn,Totontepec Mixe,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
398
+ nio_Cyrl,nio_Cyrl,51,0.0,0.0,0.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
399
+ san_Gran,san_Gran,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
400
+ ijs_Latn,ijs_Latn,50,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
401
+ nyn_Latn,Nyankole,50,0.9804,0.9615,1.0,0.9796,1.0,0.96,0.9796,1.0,0.96,0.0,0.0,0.0,0.0,0.0,0.0,0.0008,tie,0.9804,MillID
402
+ zdj_Latn,Ngazidja Comorian,50,0.6536,0.4854,1.0,0.9697,0.9796,0.96,0.6853,0.5269,0.98,0.0,0.0,0.0,0.0,0.0,0.0,-0.0317,GlotLID,0.6536,MillID
403
+ yue_Hani,Cantonese,49,0.7073,0.8788,0.5918,0.5797,1.0,0.4082,0.5797,1.0,0.4082,0.0687,0.0357,0.9184,0.0687,0.0357,0.9184,0.1276,MillID,0.6386,MillID
404
+ gan_Hani,gan_Hani,49,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
405
+ nym_Latn,nym_Latn,49,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
406
+ eve_Cyrl,Even,49,0.4118,0.2593,1.0,0.392,0.26,0.7959,0.39,0.2583,0.7959,0.0,0.0,0.0,0.0,0.0,0.0,0.0218,MillID,0.4118,MillID
407
+ lug_Latn,Ganda,49,0.9703,0.9423,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.3311,0.1984,1.0,0.3311,0.1984,1.0,-0.0297,GlotLID,0.6392,MillID
408
+ gyr_Latn,Guarayu,49,0.5373,1.0,0.3673,0.9897,1.0,0.9796,0.9897,1.0,0.9796,0.0,0.0,0.0,0.0,0.0,0.0,-0.4524,GlotLID,0.5373,MillID
409
+ gug_Latn,Paraguayan Guaraní,49,0.9515,0.9074,1.0,0.9899,0.98,1.0,0.9899,0.98,1.0,0.2328,0.1317,1.0,0.2328,0.1317,1.0,-0.0384,GlotLID,0.7187,MillID
410
+ wuu_Hani,Wu Chinese,48,0.4653,0.3052,0.9792,0.4312,0.2765,0.9792,0.4273,0.2733,0.9792,0.0,0.0,0.0,0.0,0.0,0.0,0.0381,MillID,0.4653,MillID
411
+ cjy_Hani,cjy_Hani,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
412
+ hsn_Hani,hsn_Hani,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
413
+ nan_Hani,Min Nan Chinese,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
414
+ hak_Hani,Hakka Chinese,48,0.0392,0.3333,0.0208,0.04,0.5,0.0208,0.04,0.5,0.0208,0.0,0.0,0.0,0.0,0.0,0.0,-0.0008,tie,0.0392,MillID
415
+ bin_Latn,Bini,47,0.9892,1.0,0.9787,0.9318,1.0,0.8723,0.9318,1.0,0.8723,0.0,0.0,0.0,0.0,0.0,0.0,0.0574,MillID,0.9892,MillID
416
+ lia_Latn,West-Central Limba,45,1.0,1.0,1.0,0.989,0.9783,1.0,0.989,0.9783,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.011,MillID,1.0,MillID
417
+ oss_Cyrl,Ossetic,44,1.0,1.0,1.0,0.9888,0.9778,1.0,0.9888,0.9778,1.0,0.9565,0.9167,1.0,0.9565,0.9167,1.0,0.0112,MillID,0.0435,MillID
418
+ ike_Cans,Eastern Canadian Inuktitut,44,1.0,1.0,1.0,0.9778,0.9565,1.0,0.9778,0.9565,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0222,MillID,1.0,MillID
419
+ cbs_Latn,Cashinahua,43,0.8485,0.75,0.9767,0.8723,0.8039,0.9535,0.8723,0.8039,0.9535,0.0,0.0,0.0,0.0,0.0,0.0,-0.0239,GlotLID,0.8485,MillID
420
+ csw_Cans,csw_Cans,43,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
421
+ ojb_Cans,Northwestern Ojibwa,43,1.0,1.0,1.0,0.9639,1.0,0.9302,0.9639,1.0,0.9302,0.0,0.0,0.0,0.0,0.0,0.0,0.0361,MillID,1.0,MillID
422
+ bfa_Latn,bfa_Latn,42,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
423
+ wwa_Latn,wwa_Latn,39,0.0,0.0,0.0,0.975,0.9512,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
424
+ ese_Latn,Ese Ejja,35,1.0,1.0,1.0,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0,0.0,0.0,0.0,0.0,0.0,0.0145,MillID,1.0,MillID
425
+ tzh_Latn,Tzeltal,25,0.9259,0.8621,1.0,0.9804,0.9615,1.0,0.9804,0.9615,1.0,0.0,0.0,0.0,0.0,0.0,0.0,-0.0545,GlotLID,0.9259,MillID
426
+ chv_Cyrl,Chuvash,25,1.0,1.0,1.0,0.9259,0.8621,1.0,0.9259,0.8621,1.0,0.8929,0.8065,1.0,0.8929,0.8065,1.0,0.0741,MillID,0.1071,MillID
427
+ zlm_Arab,zlm_Arab,24,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
428
+ tzm_Tfng,Central Atlas Tamazight,1,0.1667,0.0909,1.0,0.0625,0.0323,1.0,0.0625,0.0323,1.0,0.0328,0.0167,1.0,0.0328,0.0167,1.0,0.1042,MillID,0.1339,MillID
429
+ tgl_Tglg,tgl_Tglg,1,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,0.0,tie
430
+ taj_Deva,Eastern Tamang,1,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
reports/udhr-all/millid_per_language.csv ADDED
@@ -0,0 +1,430 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
3
+ abk_Cyrl,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
4
+ ace_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
5
+ acu_Latn,180,130,5,50,27438,0.962963,0.722222,0.825397,0.999818,182.195824,0.722222
6
+ ada_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
7
+ ady_Cyrl,56,52,0,4,27567,1.0,0.928571,0.962963,1.0,0.0,0.928571
8
+ afr_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
9
+ agr_Latn,57,55,4,2,27562,0.932203,0.964912,0.948276,0.999855,145.10629,0.964912
10
+ aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
11
+ ajg_Latn,59,59,63,0,27501,0.483607,1.0,0.651934,0.997714,2285.5899,1.0
12
+ als_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
13
+ alt_Cyrl,51,51,2,0,27570,0.962264,1.0,0.980769,0.999927,72.537357,1.0
14
+ amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
15
+ ame_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
16
+ amh_Ethi,51,50,0,1,27572,1.0,0.980392,0.990099,1.0,0.0,0.980392
17
+ ami_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
18
+ amr_Latn,61,61,3,0,27559,0.953125,1.0,0.976,0.999891,108.845512,1.0
19
+ arb_Arab,58,46,0,12,27565,1.0,0.793103,0.884615,1.0,0.0,0.793103
20
+ arl_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
21
+ arn_Latn,58,56,2,2,27563,0.965517,0.965517,0.965517,0.999927,72.555777,0.965517
22
+ ast_Latn,58,55,1,3,27564,0.982143,0.948276,0.964912,0.999964,36.277889,0.948276
23
+ auc_Latn,154,0,0,154,27469,0.0,0.0,0.0,1.0,0.0,0.0
24
+ ayr_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
25
+ azj_Cyrl,56,56,3,0,27564,0.949153,1.0,0.973913,0.999891,108.82577,1.0
26
+ azj_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
27
+ bam_Latn,57,54,60,3,27506,0.473684,0.947368,0.631579,0.997823,2176.594355,0.947368
28
+ ban_Latn,60,57,1,3,27562,0.982759,0.95,0.966102,0.999964,36.280521,0.95
29
+ bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
30
+ bba_Latn,58,57,38,1,27527,0.6,0.982759,0.745098,0.998621,1378.559768,0.982759
31
+ bci_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
32
+ bcl_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
33
+ bel_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
34
+ bem_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
35
+ ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
36
+ bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
37
+ bho_Deva,56,43,2,13,27565,0.955556,0.767857,0.851485,0.999927,72.550513,0.767857
38
+ bin_Latn,47,46,0,1,27576,1.0,0.978723,0.989247,1.0,0.0,0.978723
39
+ bis_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
40
+ blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
41
+ boa_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
42
+ bod_Tibt,60,58,1,2,27562,0.983051,0.966667,0.97479,0.999964,36.280521,0.966667
43
+ bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
44
+ bos_Latn,59,13,58,46,27506,0.183099,0.220339,0.2,0.997896,2104.193876,0.220339
45
+ bre_Latn,59,58,1,1,27563,0.983051,0.983051,0.983051,0.999964,36.279205,0.983051
46
+ buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
47
+ bug_Latn,60,53,1,7,27562,0.981481,0.883333,0.929825,0.999964,36.280521,0.883333
48
+ bul_Cyrl,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
49
+ bum_Latn,58,7,3,51,27562,0.7,0.12069,0.205882,0.999891,108.833666,0.12069
50
+ cab_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
51
+ cak_Latn,57,56,0,1,27566,1.0,0.982456,0.99115,1.0,0.0,0.982456
52
+ cat_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
53
+ cbi_Latn,62,62,4,0,27557,0.939394,1.0,0.96875,0.999855,145.132615,1.0
54
+ cbr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
55
+ cbs_Latn,43,42,14,1,27566,0.75,0.976744,0.848485,0.999492,507.614213,0.976744
56
+ cbt_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
57
+ cbu_Latn,57,19,0,38,27566,1.0,0.333333,0.5,1.0,0.0,0.333333
58
+ ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
59
+ ceb_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
60
+ ces_Latn,58,56,1,2,27564,0.982456,0.965517,0.973913,0.999964,36.277889,0.965517
61
+ cfm_Latn,57,56,0,1,27566,1.0,0.982456,0.99115,1.0,0.0,0.982456
62
+ cha_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
63
+ chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
64
+ chk_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
65
+ chr_Cher,115,58,0,57,27508,1.0,0.504348,0.67052,1.0,0.0,0.504348
66
+ chv_Cyrl,25,25,0,0,27598,1.0,1.0,1.0,1.0,0.0,1.0
67
+ cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
68
+ cjk_Latn,114,88,1,26,27508,0.988764,0.77193,0.866995,0.999964,36.351739,0.77193
69
+ cjs_Cyrl,59,54,1,5,27563,0.981818,0.915254,0.947368,0.999964,36.279205,0.915254
70
+ cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
71
+ cmn_Hani,319,306,152,13,27152,0.668122,0.959248,0.787645,0.994433,5566.949897,0.959248
72
+ cnh_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
73
+ cni_Latn,52,51,29,1,27542,0.6375,0.980769,0.772727,0.998948,1051.829821,0.980769
74
+ cnr_Latn,59,0,4,59,27560,0.0,0.0,0.0,0.999855,145.116819,0.0
75
+ cof_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
76
+ cos_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
77
+ cot_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
78
+ cpu_Latn,60,35,1,25,27562,0.972222,0.583333,0.729167,0.999964,36.280521,0.583333
79
+ crh_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
80
+ cri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
81
+ crs_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
82
+ csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
83
+ csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
84
+ ctd_Latn,60,26,0,34,27563,1.0,0.433333,0.604651,1.0,0.0,0.433333
85
+ cym_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
86
+ dag_Latn,57,56,19,1,27547,0.746667,0.982456,0.848485,0.999311,689.254879,0.982456
87
+ dan_Latn,61,58,4,3,27558,0.935484,0.95082,0.943089,0.999855,145.127349,0.95082
88
+ ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
89
+ deu_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
90
+ dga_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
91
+ dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
92
+ div_Thaa,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
93
+ dje_Latn,54,44,7,10,27562,0.862745,0.814815,0.838095,0.999746,253.908375,0.814815
94
+ duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
95
+ dyo_Latn,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
96
+ dyu_Latn,58,0,24,58,27541,0.0,0.0,0.0,0.999129,870.669327,0.0
97
+ dzo_Tibt,59,58,2,1,27562,0.966667,0.983051,0.97479,0.999927,72.55841,0.983051
98
+ ekk_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
99
+ ell_Grek,115,58,0,57,27508,1.0,0.504348,0.67052,1.0,0.0,0.504348
100
+ emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
101
+ eng_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
102
+ epo_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
103
+ ese_Latn,35,35,0,0,27588,1.0,1.0,1.0,1.0,0.0,1.0
104
+ eus_Latn,59,59,11,0,27553,0.842857,1.0,0.914729,0.999601,399.071252,1.0
105
+ eve_Cyrl,49,49,140,0,27434,0.259259,1.0,0.411765,0.994923,5077.246682,1.0
106
+ evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
107
+ ewe_Latn,59,59,9,0,27555,0.867647,1.0,0.929134,0.999673,326.512843,1.0
108
+ fao_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
109
+ fas_Arab,114,112,0,2,27509,1.0,0.982456,0.99115,1.0,0.0,0.982456
110
+ fat_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
111
+ fij_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
112
+ fil_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
113
+ fin_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
114
+ fkv_Latn,58,27,1,31,27564,0.964286,0.465517,0.627907,0.999964,36.277889,0.465517
115
+ fon_Latn,58,56,6,2,27559,0.903226,0.965517,0.933333,0.999782,217.667332,0.965517
116
+ fra_Latn,58,44,1,14,27564,0.977778,0.758621,0.854369,0.999964,36.277889,0.758621
117
+ fry_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
118
+ fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
119
+ fuf_Latn,58,48,3,10,27562,0.941176,0.827586,0.880734,0.999891,108.833666,0.827586
120
+ fur_Latn,59,58,3,1,27561,0.95082,0.983051,0.966667,0.999891,108.837614,0.983051
121
+ fuv_Latn,108,56,12,52,27503,0.823529,0.518519,0.636364,0.999564,436.12575,0.518519
122
+ fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
123
+ gaa_Latn,59,59,4,0,27560,0.936508,1.0,0.967213,0.999855,145.116819,1.0
124
+ gag_Latn,59,57,1,2,27563,0.982759,0.966102,0.974359,0.999964,36.279205,0.966102
125
+ gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
126
+ gaz_Latn,60,57,8,3,27555,0.876923,0.95,0.912,0.99971,290.244168,0.95
127
+ gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
128
+ gjn_Latn,60,59,1,1,27562,0.983333,0.983333,0.983333,0.999964,36.280521,0.983333
129
+ gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
130
+ gla_Latn,62,61,0,1,27561,1.0,0.983871,0.99187,1.0,0.0,0.983871
131
+ gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
132
+ gle_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
133
+ glg_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
134
+ glv_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
135
+ gsw_Latn,59,44,1,15,27563,0.977778,0.745763,0.846154,0.999964,36.279205,0.745763
136
+ guc_Latn,58,58,9,0,27556,0.865672,1.0,0.928,0.999673,326.500998,1.0
137
+ gug_Latn,49,49,5,0,27569,0.907407,1.0,0.951456,0.999819,181.330239,1.0
138
+ guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
139
+ guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
140
+ guu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
141
+ gyr_Latn,49,18,0,31,27574,1.0,0.367347,0.537313,1.0,0.0,0.367347
142
+ hak_Hani,48,1,2,47,27573,0.333333,0.020833,0.039216,0.999927,72.529465,0.020833
143
+ hat_Latn,117,116,1,1,27505,0.991453,0.991453,0.991453,0.999964,36.355704,0.991453
144
+ hau_Latn,155,154,4,1,27464,0.974684,0.993548,0.984026,0.999854,145.623999,0.993548
145
+ haw_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
146
+ hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
147
+ heb_Hebr,58,56,0,2,27565,1.0,0.965517,0.982456,1.0,0.0,0.965517
148
+ hil_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
149
+ hin_Deva,59,34,1,25,27563,0.971429,0.576271,0.723404,0.999964,36.279205,0.576271
150
+ hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
151
+ hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
152
+ hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
153
+ hnj_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
154
+ hns_Latn,59,51,0,8,27564,1.0,0.864407,0.927273,1.0,0.0,0.864407
155
+ hrv_Latn,58,43,71,15,27494,0.377193,0.741379,0.5,0.997424,2575.730093,0.741379
156
+ hsb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
157
+ hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
158
+ hun_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
159
+ hus_Latn,175,167,0,8,27448,1.0,0.954286,0.976608,1.0,0.0,0.954286
160
+ huu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
161
+ hye_Armn,70,70,0,0,27553,1.0,1.0,1.0,1.0,0.0,1.0
162
+ ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
163
+ ibo_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
164
+ ido_Latn,55,53,3,2,27565,0.946429,0.963636,0.954955,0.999891,108.821822,0.963636
165
+ idu_Latn,51,22,0,29,27572,1.0,0.431373,0.60274,1.0,0.0,0.431373
166
+ iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
167
+ ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
168
+ ike_Cans,44,44,0,0,27579,1.0,1.0,1.0,1.0,0.0,1.0
169
+ ilo_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
170
+ ina_Latn,58,57,21,1,27544,0.730769,0.982759,0.838235,0.999238,761.835661,0.982759
171
+ ind_Latn,60,38,6,22,27557,0.863636,0.633333,0.730769,0.999782,217.683126,0.633333
172
+ isl_Latn,58,45,0,13,27565,1.0,0.775862,0.873786,1.0,0.0,0.775862
173
+ ita_Latn,58,57,18,1,27547,0.76,0.982759,0.857143,0.999347,653.001995,0.982759
174
+ jav_Java,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
175
+ jav_Latn,60,59,1,1,27562,0.983333,0.983333,0.983333,0.999964,36.280521,0.983333
176
+ jiv_Latn,60,58,27,2,27536,0.682353,0.966667,0.8,0.99902,979.574067,0.966667
177
+ jpn_Jpan,140,140,0,0,27483,1.0,1.0,1.0,1.0,0.0,1.0
178
+ kaa_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
179
+ kab_Latn,58,50,0,8,27565,1.0,0.862069,0.925926,1.0,0.0,0.862069
180
+ kal_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
181
+ kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
182
+ kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
183
+ kaz_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
184
+ kbd_Cyrl,55,55,4,0,27564,0.932203,1.0,0.964912,0.999855,145.095763,1.0
185
+ kbp_Latn,59,59,55,0,27509,0.517544,1.0,0.682081,0.998005,1995.356262,1.0
186
+ kbr_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
187
+ kde_Latn,51,45,1,6,27571,0.978261,0.882353,0.927835,0.999964,36.268678,0.882353
188
+ kdh_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
189
+ kea_Latn,58,57,84,1,27481,0.404255,0.982759,0.572864,0.996953,3047.342645,0.982759
190
+ kek_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
191
+ kha_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
192
+ khk_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
193
+ khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
194
+ kin_Latn,59,41,3,18,27561,0.931818,0.694915,0.796117,0.999891,108.837614,0.694915
195
+ kir_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
196
+ kjh_Cyrl,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
197
+ kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
198
+ kmb_Latn,116,114,5,2,27502,0.957983,0.982759,0.970213,0.999818,181.771913,0.982759
199
+ kmr_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
200
+ knc_Latn,64,64,4,0,27555,0.941176,1.0,0.969697,0.999855,145.143147,1.0
201
+ kng_Latn,115,5,12,110,27496,0.294118,0.043478,0.075758,0.999564,436.236731,0.043478
202
+ koi_Cyrl,57,41,0,16,27566,1.0,0.719298,0.836735,1.0,0.0,0.719298
203
+ koo_Latn,54,51,0,3,27569,1.0,0.944444,0.971429,1.0,0.0,0.944444
204
+ kor_Hang,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
205
+ kqn_Latn,59,58,2,1,27562,0.966667,0.983051,0.97479,0.999927,72.55841,0.983051
206
+ kqs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
207
+ kri_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
208
+ krl_Latn,183,0,1,183,27439,0.0,0.0,0.0,0.999964,36.443149,0.0
209
+ ktu_Latn,118,106,53,12,27452,0.666667,0.898305,0.765343,0.998073,1926.922378,0.898305
210
+ kwi_Latn,145,114,0,31,27478,1.0,0.786207,0.880309,1.0,0.0,0.786207
211
+ lad_Latn,58,54,0,4,27565,1.0,0.931034,0.964286,1.0,0.0,0.931034
212
+ lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
213
+ lat_Latn,118,117,1,1,27504,0.991525,0.991525,0.991525,0.999964,36.357026,0.991525
214
+ lia_Latn,45,45,0,0,27578,1.0,1.0,1.0,1.0,0.0,1.0
215
+ lij_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
216
+ lin_Latn,110,110,2,0,27511,0.982143,1.0,0.990991,0.999927,72.692909,1.0
217
+ lit_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
218
+ lld_Latn,59,50,2,9,27562,0.961538,0.847458,0.900901,0.999927,72.55841,0.847458
219
+ lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
220
+ lob_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
221
+ lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
222
+ loz_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
223
+ ltz_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
224
+ lua_Latn,58,33,2,25,27563,0.942857,0.568966,0.709677,0.999927,72.555777,0.568966
225
+ lue_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
226
+ lug_Latn,49,49,3,0,27571,0.942308,1.0,0.970297,0.999891,108.798143,1.0
227
+ lun_Latn,56,55,0,1,27567,1.0,0.982143,0.990991,1.0,0.0,0.982143
228
+ lus_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
229
+ lvs_Latn,115,112,0,3,27508,1.0,0.973913,0.986784,1.0,0.0,0.973913
230
+ mad_Latn,60,59,61,1,27502,0.491667,0.983333,0.655556,0.997787,2213.11178,0.983333
231
+ mag_Deva,53,46,7,7,27563,0.867925,0.867925,0.867925,0.999746,253.899166,0.867925
232
+ mah_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
233
+ mai_Deva,58,58,8,0,27557,0.878788,1.0,0.935484,0.99971,290.223109,1.0
234
+ mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
235
+ mam_Latn,58,46,0,12,27565,1.0,0.793103,0.884615,1.0,0.0,0.793103
236
+ mar_Deva,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
237
+ maz_Latn,59,58,40,1,27524,0.591837,0.983051,0.738854,0.998549,1451.16819,0.983051
238
+ mcd_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
239
+ mcf_Latn,62,62,0,0,27561,1.0,1.0,1.0,1.0,0.0,1.0
240
+ men_Latn,59,59,5,0,27559,0.921875,1.0,0.95935,0.999819,181.396024,1.0
241
+ mfq_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
242
+ mic_Latn,59,58,2,1,27562,0.966667,0.983051,0.97479,0.999927,72.55841,0.983051
243
+ min_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
244
+ miq_Latn,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
245
+ mkd_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
246
+ mlt_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
247
+ mnw_Mymr,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
248
+ mor_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
249
+ mos_Latn,56,56,3,0,27564,0.949153,1.0,0.973913,0.999891,108.82577,1.0
250
+ mri_Latn,57,57,10,0,27556,0.850746,1.0,0.919355,0.999637,362.765726,1.0
251
+ mto_Latn,51,0,1,51,27571,0.0,0.0,0.0,0.999964,36.268678,0.0
252
+ mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
253
+ mxv_Latn,58,4,0,54,27565,1.0,0.068966,0.129032,1.0,0.0,0.068966
254
+ mya_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
255
+ mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
256
+ nan_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
257
+ nav_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
258
+ nba_Latn,59,1,1,58,27563,0.5,0.016949,0.032787,0.999964,36.279205,0.016949
259
+ nbl_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
260
+ ndo_Latn,58,57,5,1,27560,0.919355,0.982759,0.95,0.999819,181.389443,0.982759
261
+ nds_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
262
+ nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
263
+ nio_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
264
+ niu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
265
+ niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
266
+ njo_Latn,64,64,0,0,27559,1.0,1.0,1.0,1.0,0.0,1.0
267
+ nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
268
+ nld_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
269
+ nno_Latn,58,54,1,4,27564,0.981818,0.931034,0.955752,0.999964,36.277889,0.931034
270
+ nob_Latn,62,58,7,4,27554,0.892308,0.935484,0.913386,0.999746,253.982076,0.935484
271
+ not_Latn,59,58,1,1,27563,0.983051,0.983051,0.983051,0.999964,36.279205,0.983051
272
+ npi_Deva,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
273
+ nso_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
274
+ nya_Latn,116,114,0,2,27507,1.0,0.982759,0.991304,1.0,0.0,0.982759
275
+ nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
276
+ nyn_Latn,50,50,2,0,27571,0.961538,1.0,0.980392,0.999927,72.534726,1.0
277
+ nzi_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
278
+ oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
279
+ oci_Latn,398,64,4,334,27221,0.941176,0.160804,0.274678,0.999853,146.923783,0.160804
280
+ ojb_Cans,43,43,0,0,27580,1.0,1.0,1.0,1.0,0.0,1.0
281
+ oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
282
+ orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
283
+ oss_Cyrl,44,44,0,0,27579,1.0,1.0,1.0,1.0,0.0,1.0
284
+ ote_Latn,59,5,7,54,27557,0.416667,0.084746,0.140845,0.999746,253.954433,0.084746
285
+ pam_Latn,66,66,3,0,27554,0.956522,1.0,0.977778,0.999891,108.865261,1.0
286
+ pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
287
+ pap_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
288
+ pau_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
289
+ pbb_Latn,56,30,15,26,27552,0.666667,0.535714,0.594059,0.999456,544.12885,0.535714
290
+ pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
291
+ pcd_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
292
+ pcm_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
293
+ pis_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
294
+ piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
295
+ plt_Latn,53,53,1,0,27569,0.981481,1.0,0.990654,0.999964,36.271309,1.0
296
+ pnb_Arab,61,60,15,1,27547,0.8,0.983607,0.882353,0.999456,544.22756,0.983607
297
+ pol_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
298
+ pon_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
299
+ por_Latn,115,107,2,8,27506,0.981651,0.930435,0.955357,0.999927,72.706122,0.930435
300
+ pov_Latn,115,80,0,35,27508,1.0,0.695652,0.820513,1.0,0.0,0.695652
301
+ ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
302
+ quc_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
303
+ que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
304
+ qug_Latn,182,1,0,181,27441,1.0,0.005495,0.010929,1.0,0.0,0.005495
305
+ quh_Latn,57,56,3,1,27563,0.949153,0.982456,0.965517,0.999891,108.829718,0.982456
306
+ quy_Latn,60,58,59,2,27504,0.495726,0.966667,0.655367,0.997859,2140.550738,0.966667
307
+ quz_Latn,57,46,37,11,27529,0.554217,0.807018,0.657143,0.998658,1342.233186,0.807018
308
+ qva_Latn,59,0,1,59,27563,0.0,0.0,0.0,0.999964,36.279205,0.0
309
+ qvc_Latn,58,58,63,0,27502,0.479339,1.0,0.648045,0.997714,2285.506983,1.0
310
+ qvh_Latn,58,18,1,40,27564,0.947368,0.310345,0.467532,0.999964,36.277889,0.310345
311
+ qvm_Latn,60,13,0,47,27563,1.0,0.216667,0.356164,1.0,0.0,0.216667
312
+ qvn_Latn,57,7,0,50,27566,1.0,0.122807,0.21875,1.0,0.0,0.122807
313
+ qwh_Latn,59,41,66,18,27498,0.383178,0.694915,0.493976,0.997606,2394.427514,0.694915
314
+ qxn_Latn,57,4,2,53,27564,0.666667,0.070175,0.126984,0.999927,72.553145,0.070175
315
+ qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
316
+ rar_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
317
+ rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
318
+ rmn_Latn,116,60,1,56,27506,0.983607,0.517241,0.677966,0.999964,36.354383,0.517241
319
+ roh_Latn,399,395,2,4,27222,0.994962,0.989975,0.992462,0.999927,73.46459,0.989975
320
+ ron_Latn,97,97,1,0,27525,0.989796,1.0,0.994872,0.999964,36.329289,1.0
321
+ run_Latn,58,57,20,1,27545,0.74026,0.982759,0.844444,0.999274,725.557773,0.982759
322
+ rup_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
323
+ rus_Cyrl,58,58,7,0,27558,0.892308,1.0,0.943089,0.999746,253.94522,1.0
324
+ sag_Latn,59,58,1,1,27563,0.983051,0.983051,0.983051,0.999964,36.279205,0.983051
325
+ sah_Cyrl,57,57,28,0,27538,0.670588,1.0,0.802817,0.998984,1015.744033,1.0
326
+ san_Deva,55,53,0,2,27568,1.0,0.963636,0.981481,1.0,0.0,0.963636
327
+ san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
328
+ sco_Latn,58,56,1,2,27564,0.982456,0.965517,0.973913,0.999964,36.277889,0.965517
329
+ sey_Latn,61,49,59,12,27503,0.453704,0.803279,0.579882,0.997859,2140.628401,0.803279
330
+ shk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
331
+ shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
332
+ shp_Latn,62,19,0,43,27561,1.0,0.306452,0.469136,1.0,0.0,0.306452
333
+ sid_Latn,57,56,3,1,27563,0.949153,0.982456,0.965517,0.999891,108.829718,0.982456
334
+ sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
335
+ skr_Arab,63,49,1,14,27559,0.98,0.777778,0.867257,0.999964,36.28447,0.777778
336
+ slk_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
337
+ slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
338
+ slv_Latn,59,57,2,2,27562,0.966102,0.966102,0.966102,0.999927,72.55841,0.966102
339
+ sme_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
340
+ smo_Latn,63,63,0,0,27560,1.0,1.0,1.0,1.0,0.0,1.0
341
+ sna_Latn,60,60,3,0,27560,0.952381,1.0,0.97561,0.999891,108.841563,1.0
342
+ snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
343
+ snn_Latn,136,64,3,72,27484,0.955224,0.470588,0.630542,0.999891,109.142504,0.470588
344
+ som_Latn,57,57,14,0,27552,0.802817,1.0,0.890625,0.999492,507.872016,1.0
345
+ sot_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
346
+ spa_Latn,78,75,2,3,27543,0.974026,0.961538,0.967742,0.999927,72.608459,0.961538
347
+ src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
348
+ srp_Cyrl,59,58,58,1,27506,0.5,0.983051,0.662857,0.997896,2104.193876,0.983051
349
+ srp_Latn,59,19,31,40,27533,0.38,0.322034,0.348624,0.998875,1124.655348,0.322034
350
+ srr_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
351
+ ssw_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
352
+ suk_Latn,58,57,48,1,27517,0.542857,0.982759,0.699387,0.998259,1741.338654,0.982759
353
+ sun_Latn,66,65,0,1,27557,1.0,0.984848,0.992366,1.0,0.0,0.984848
354
+ sus_Latn,58,53,3,5,27562,0.946429,0.913793,0.929825,0.999891,108.833666,0.913793
355
+ swb_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
356
+ swe_Latn,61,60,0,1,27562,1.0,0.983607,0.991736,1.0,0.0,0.983607
357
+ swh_Latn,58,49,8,9,27557,0.859649,0.844828,0.852174,0.99971,290.223109,0.844828
358
+ tah_Latn,57,54,0,3,27566,1.0,0.947368,0.972973,1.0,0.0,0.947368
359
+ taj_Deva,1,1,0,0,27622,1.0,1.0,1.0,1.0,0.0,1.0
360
+ tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
361
+ tat_Cyrl,57,57,9,0,27557,0.863636,1.0,0.926829,0.999674,326.489153,1.0
362
+ tbz_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
363
+ tca_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
364
+ tdt_Latn,57,21,14,36,27552,0.6,0.368421,0.456522,0.999492,507.872016,0.368421
365
+ tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
366
+ tem_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
367
+ tet_Latn,58,44,36,14,27529,0.55,0.758621,0.637681,0.998694,1306.003991,0.758621
368
+ tgk_Cyrl,57,57,7,0,27559,0.890625,1.0,0.942149,0.999746,253.936008,1.0
369
+ tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
370
+ tha_Thai,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
371
+ tir_Ethi,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
372
+ tiv_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
373
+ tly_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
374
+ tob_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
375
+ toi_Latn,57,56,1,1,27565,0.982456,0.982456,0.982456,0.999964,36.276573,0.982456
376
+ toj_Latn,57,56,1,1,27565,0.982456,0.982456,0.982456,0.999964,36.276573,0.982456
377
+ ton_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
378
+ top_Latn,59,57,3,2,27561,0.95,0.966102,0.957983,0.999891,108.837614,0.966102
379
+ tpi_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
380
+ tsn_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
381
+ tso_Latn,114,86,1,28,27508,0.988506,0.754386,0.855721,0.999964,36.351739,0.754386
382
+ tsz_Latn,59,56,22,3,27542,0.717949,0.949153,0.817518,0.999202,798.142505,0.949153
383
+ tuk_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
384
+ tuk_Latn,59,57,0,2,27564,1.0,0.966102,0.982759,1.0,0.0,0.966102
385
+ tur_Latn,59,59,6,0,27558,0.907692,1.0,0.951613,0.999782,217.675229,1.0
386
+ twi_Latn,116,116,6,0,27501,0.95082,1.0,0.97479,0.999782,218.126295,1.0
387
+ tyv_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
388
+ tzh_Latn,25,25,4,0,27594,0.862069,1.0,0.925926,0.999855,144.938039,1.0
389
+ tzm_Tfng,1,1,10,0,27612,0.090909,1.0,0.166667,0.999638,362.030266,1.0
390
+ tzo_Latn,58,54,0,4,27565,1.0,0.931034,0.964286,1.0,0.0,0.931034
391
+ udu_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
392
+ uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
393
+ uig_Latn,59,59,47,0,27517,0.556604,1.0,0.715152,0.998295,1705.122624,1.0
394
+ ukr_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
395
+ umb_Latn,107,100,0,7,27516,1.0,0.934579,0.966184,1.0,0.0,0.934579
396
+ ura_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
397
+ urd_Arab,108,106,0,2,27515,1.0,0.981481,0.990654,1.0,0.0,0.981481
398
+ uzn_Cyrl,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
399
+ uzn_Latn,58,58,8,0,27557,0.878788,1.0,0.935484,0.99971,290.223109,1.0
400
+ vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
401
+ vec_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
402
+ ven_Latn,89,89,1,0,27533,0.988889,1.0,0.994413,0.999964,36.318733,1.0
403
+ vep_Latn,58,56,0,2,27565,1.0,0.965517,0.982456,1.0,0.0,0.965517
404
+ vie_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
405
+ vmw_Latn,58,56,0,2,27565,1.0,0.965517,0.982456,1.0,0.0,0.965517
406
+ war_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
407
+ wln_Latn,59,52,59,7,27505,0.468468,0.881356,0.611765,0.99786,2140.473081,0.881356
408
+ wol_Latn,60,60,21,0,27542,0.740741,1.0,0.851064,0.999238,761.890941,1.0
409
+ wuu_Hani,48,47,107,1,27468,0.305195,0.979167,0.465347,0.99612,3880.326383,0.979167
410
+ wwa_Latn,39,0,0,39,27584,0.0,0.0,0.0,1.0,0.0,0.0
411
+ xho_Latn,58,55,4,3,27561,0.932203,0.948276,0.940171,0.999855,145.111555,0.948276
412
+ xsm_Latn,59,51,15,8,27549,0.772727,0.864407,0.816,0.999456,544.188071,0.864407
413
+ yad_Latn,55,52,1,3,27567,0.981132,0.945455,0.962963,0.999964,36.273941,0.945455
414
+ yao_Latn,52,52,2,0,27569,0.962963,1.0,0.981132,0.999927,72.539988,1.0
415
+ yap_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
416
+ ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
417
+ ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
418
+ yor_Latn,57,57,14,0,27552,0.802817,1.0,0.890625,0.999492,507.872016,1.0
419
+ yrk_Cyrl,55,53,1,2,27567,0.981481,0.963636,0.972477,0.999964,36.273941,0.963636
420
+ yua_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
421
+ yue_Hani,49,29,4,20,27570,0.878788,0.591837,0.707317,0.999855,145.064191,0.591837
422
+ zam_Latn,60,0,4,60,27559,0.0,0.0,0.0,0.999855,145.122084,0.0
423
+ zdj_Latn,50,50,53,0,27520,0.485437,1.0,0.653595,0.998078,1922.170239,1.0
424
+ zgh_Tfng,60,36,0,24,27563,1.0,0.6,0.75,1.0,0.0,0.6
425
+ zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
426
+ zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
427
+ zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
428
+ ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
429
+ zul_Latn,58,51,4,7,27561,0.927273,0.87931,0.902655,0.999855,145.111555,0.87931
430
+ zyb_Latn,57,57,74,0,27492,0.435115,1.0,0.606383,0.997316,2684.466372,1.0
reports/udhr-all/millid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.7273648770951743,
3
+ "top3_accuracy": 0.7808710132860297,
4
+ "top5_accuracy": 0.7928175795532708,
5
+ "passages": 27623,
6
+ "languages": 429,
7
+ "macro_precision": 0.7340309394117082,
8
+ "macro_recall": 0.7290411714617072,
9
+ "macro_f1": 0.7148579318843858,
10
+ "macro_specificity": 0.9997903094250377,
11
+ "weighted_f1": 0.7196404590366388,
12
+ "median_f1": 0.9649122807017544,
13
+ "languages_f1_at_least_0_9": 254,
14
+ "languages_f1_below_0_5": 105,
15
+ "mean_fp_per_million": 209.69057496245543,
16
+ "micro_f1": 0.7273648770951743
17
+ }
reports/udhr-common/fasttext@millid_per_language.csv ADDED
@@ -0,0 +1,171 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,61,60,12,1,11837,0.833333,0.983607,0.902256,0.998987,1012.743691,0.983607
4
+ ady_Cyrl,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
5
+ afr_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
6
+ als_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
7
+ alt_Cyrl,51,51,0,0,11859,1.0,1.0,1.0,1.0,0.0,1.0
8
+ amh_Ethi,51,37,0,14,11859,1.0,0.72549,0.840909,1.0,0.0,0.72549
9
+ arb_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
10
+ arn_Latn,58,56,0,2,11852,1.0,0.965517,0.982456,1.0,0.0,0.965517
11
+ ast_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
12
+ ayr_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
13
+ azj_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
14
+ bam_Latn,57,50,42,7,11811,0.543478,0.877193,0.671141,0.996457,3543.406732,0.877193
15
+ ban_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
16
+ bel_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
17
+ bem_Latn,57,57,3,0,11850,0.95,1.0,0.974359,0.999747,253.100481,1.0
18
+ ben_Beng,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
19
+ bho_Deva,56,42,2,14,11852,0.954545,0.75,0.84,0.999831,168.71942,0.75
20
+ bis_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
21
+ bod_Tibt,60,58,11,2,11839,0.84058,0.966667,0.899225,0.999072,928.270042,0.966667
22
+ bos_Latn,59,28,4,31,11847,0.875,0.474576,0.615385,0.999662,337.52426,0.474576
23
+ bug_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
24
+ bul_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
25
+ cat_Latn,58,58,2,0,11850,0.966667,1.0,0.983051,0.999831,168.747891,1.0
26
+ ceb_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
27
+ ces_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
28
+ chv_Cyrl,25,25,1,0,11884,0.961538,1.0,0.980392,0.999916,84.139672,1.0
29
+ cjk_Latn,114,110,0,4,11796,1.0,0.964912,0.982143,1.0,0.0,0.964912
30
+ cmn_Hani,319,119,15,200,11576,0.88806,0.373041,0.525386,0.998706,1294.107497,0.373041
31
+ crh_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
32
+ cym_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
33
+ dan_Latn,61,60,0,1,11849,1.0,0.983607,0.991736,1.0,0.0,0.983607
34
+ deu_Latn,67,67,0,0,11843,1.0,1.0,1.0,1.0,0.0,1.0
35
+ dyu_Latn,58,1,7,57,11845,0.125,0.017241,0.030303,0.999409,590.617617,0.017241
36
+ dzo_Tibt,59,48,2,11,11849,0.96,0.813559,0.880734,0.999831,168.76213,0.813559
37
+ ekk_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
38
+ ell_Grek,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
39
+ eng_Latn,58,58,3,0,11849,0.95082,1.0,0.97479,0.999747,253.121836,1.0
40
+ epo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
41
+ eus_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
42
+ ewe_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
43
+ fao_Latn,57,34,0,23,11853,1.0,0.596491,0.747253,1.0,0.0,0.596491
44
+ fas_Arab,114,114,2,0,11794,0.982759,1.0,0.991304,0.99983,169.549,1.0
45
+ fij_Latn,59,59,1,0,11850,0.983333,1.0,0.991597,0.999916,84.381065,1.0
46
+ fil_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
47
+ fin_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
48
+ fon_Latn,58,58,11,0,11841,0.84058,1.0,0.913386,0.999072,928.113399,1.0
49
+ fra_Latn,58,58,6,0,11846,0.90625,1.0,0.95082,0.999494,506.243672,1.0
50
+ fur_Latn,59,59,30,0,11821,0.662921,1.0,0.797297,0.997469,2531.431947,1.0
51
+ fuv_Latn,108,108,12,0,11790,0.9,1.0,0.947368,0.998983,1016.776817,1.0
52
+ gaz_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
53
+ gla_Latn,62,58,0,4,11848,1.0,0.935484,0.966667,1.0,0.0,0.935484
54
+ gle_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
55
+ glg_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
56
+ gug_Latn,49,49,3,0,11858,0.942308,1.0,0.970297,0.999747,252.92977,1.0
57
+ guj_Gujr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
58
+ hat_Latn,117,116,32,1,11761,0.783784,0.991453,0.875472,0.997287,2713.474095,0.991453
59
+ hau_Latn,155,155,0,0,11755,1.0,1.0,1.0,1.0,0.0,1.0
60
+ heb_Hebr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
61
+ hin_Deva,59,59,3,0,11848,0.951613,1.0,0.975207,0.999747,253.143195,1.0
62
+ hrv_Latn,58,54,30,4,11822,0.642857,0.931034,0.760563,0.997469,2531.21836,0.931034
63
+ hun_Latn,59,59,2,0,11849,0.967213,1.0,0.983333,0.999831,168.76213,1.0
64
+ hye_Armn,70,68,0,2,11840,1.0,0.971429,0.985507,1.0,0.0,0.971429
65
+ ibo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
66
+ ilo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
67
+ ind_Latn,60,52,4,8,11846,0.928571,0.866667,0.896552,0.999662,337.552743,0.866667
68
+ isl_Latn,58,58,22,0,11830,0.725,1.0,0.84058,0.998144,1856.226797,1.0
69
+ ita_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
70
+ jav_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
71
+ jpn_Jpan,140,134,2,6,11768,0.985294,0.957143,0.971014,0.99983,169.923534,0.957143
72
+ kab_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
73
+ kal_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
74
+ kan_Knda,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
75
+ kat_Geor,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
76
+ kaz_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
77
+ kbp_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
78
+ kea_Latn,58,12,0,46,11852,1.0,0.206897,0.342857,1.0,0.0,0.206897
79
+ khk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
80
+ khm_Khmr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
81
+ kin_Latn,59,51,1,8,11850,0.980769,0.864407,0.918919,0.999916,84.381065,0.864407
82
+ kir_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
83
+ kmb_Latn,116,111,8,5,11786,0.932773,0.956897,0.944681,0.999322,678.311006,0.956897
84
+ kmr_Latn,58,58,25,0,11827,0.698795,1.0,0.822695,0.997891,2109.348633,1.0
85
+ knc_Latn,64,64,0,0,11846,1.0,1.0,1.0,1.0,0.0,1.0
86
+ kng_Latn,115,72,0,43,11795,1.0,0.626087,0.770053,1.0,0.0,0.626087
87
+ kor_Hang,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
88
+ lao_Laoo,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
89
+ lij_Latn,58,57,90,1,11762,0.387755,0.982759,0.556098,0.992406,7593.655079,0.982759
90
+ lin_Latn,110,109,0,1,11800,1.0,0.990909,0.995434,1.0,0.0,0.990909
91
+ lit_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
92
+ ltz_Latn,59,58,6,1,11845,0.90625,0.983051,0.943089,0.999494,506.286389,0.983051
93
+ lua_Latn,58,53,29,5,11823,0.646341,0.913793,0.757143,0.997553,2446.844414,0.913793
94
+ lug_Latn,49,49,3,0,11858,0.942308,1.0,0.970297,0.999747,252.92977,1.0
95
+ lus_Latn,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
96
+ lvs_Latn,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
97
+ mag_Deva,53,49,12,4,11845,0.803279,0.924528,0.859649,0.998988,1012.060386,0.924528
98
+ mai_Deva,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
99
+ mal_Mlym,100,100,0,0,11810,1.0,1.0,1.0,1.0,0.0,1.0
100
+ mar_Deva,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
101
+ min_Latn,59,4,0,55,11851,1.0,0.067797,0.126984,1.0,0.0,0.067797
102
+ mkd_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
103
+ mlt_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
104
+ mos_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
105
+ mri_Latn,57,57,31,0,11822,0.647727,1.0,0.786207,0.997385,2615.371636,1.0
106
+ mya_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
107
+ nav_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
108
+ nld_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
109
+ nno_Latn,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
110
+ nob_Latn,62,62,1,0,11847,0.984127,1.0,0.992,0.999916,84.402431,1.0
111
+ npi_Deva,55,55,0,0,11855,1.0,1.0,1.0,1.0,0.0,1.0
112
+ nso_Latn,58,58,3,0,11849,0.95082,1.0,0.97479,0.999747,253.121836,1.0
113
+ nya_Latn,116,116,2,0,11792,0.983051,1.0,0.991453,0.99983,169.577751,1.0
114
+ oci_Latn,398,152,0,246,11512,1.0,0.38191,0.552727,1.0,0.0,0.38191
115
+ oss_Cyrl,44,44,0,0,11866,1.0,1.0,1.0,1.0,0.0,1.0
116
+ pan_Guru,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
117
+ pap_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
118
+ pcm_Latn,56,53,0,3,11854,1.0,0.946429,0.972477,1.0,0.0,0.946429
119
+ plt_Latn,53,53,0,0,11857,1.0,1.0,1.0,1.0,0.0,1.0
120
+ pol_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
121
+ por_Latn,115,115,32,0,11763,0.782313,1.0,0.877863,0.997287,2713.013989,1.0
122
+ quy_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
123
+ roh_Latn,399,399,3,0,11508,0.992537,1.0,0.996255,0.999739,260.620276,1.0
124
+ ron_Latn,97,96,0,1,11813,1.0,0.989691,0.994819,1.0,0.0,0.989691
125
+ run_Latn,58,58,8,0,11844,0.878788,1.0,0.935484,0.999325,674.991563,1.0
126
+ rus_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
127
+ sag_Latn,59,7,0,52,11851,1.0,0.118644,0.212121,1.0,0.0,0.118644
128
+ san_Deva,55,54,0,1,11855,1.0,0.981818,0.990826,1.0,0.0,0.981818
129
+ shn_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
130
+ sin_Sinh,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
131
+ slk_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
132
+ slv_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
133
+ smo_Latn,63,61,11,2,11836,0.847222,0.968254,0.903704,0.999071,928.505107,0.968254
134
+ sna_Latn,60,57,0,3,11850,1.0,0.95,0.974359,1.0,0.0,0.95
135
+ som_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
136
+ sot_Latn,57,46,3,11,11850,0.938776,0.807018,0.867925,0.999747,253.100481,0.807018
137
+ spa_Latn,78,78,0,0,11832,1.0,1.0,1.0,1.0,0.0,1.0
138
+ srp_Cyrl,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
139
+ ssw_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
140
+ sun_Latn,66,65,2,1,11842,0.970149,0.984848,0.977444,0.999831,168.861871,0.984848
141
+ swe_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
142
+ swh_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
143
+ tah_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
144
+ tam_Taml,68,68,0,0,11842,1.0,1.0,1.0,1.0,0.0,1.0
145
+ tat_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
146
+ tel_Telu,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
147
+ tgk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
148
+ tha_Thai,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
149
+ tir_Ethi,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
150
+ ton_Latn,60,0,4,60,11846,0.0,0.0,0.0,0.999662,337.552743,0.0
151
+ tpi_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
152
+ tsn_Latn,58,58,8,0,11844,0.878788,1.0,0.935484,0.999325,674.991563,1.0
153
+ tso_Latn,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
154
+ tuk_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
155
+ tur_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
156
+ twi_Latn,116,116,3,0,11791,0.97479,1.0,0.987234,0.999746,254.366627,1.0
157
+ tzm_Tfng,1,1,0,0,11909,1.0,1.0,1.0,1.0,0.0,1.0
158
+ uig_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
159
+ ukr_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
160
+ umb_Latn,107,104,0,3,11803,1.0,0.971963,0.985782,1.0,0.0,0.971963
161
+ urd_Arab,108,108,0,0,11802,1.0,1.0,1.0,1.0,0.0,1.0
162
+ uzn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
163
+ vec_Latn,58,58,8,0,11844,0.878788,1.0,0.935484,0.999325,674.991563,1.0
164
+ vie_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
165
+ war_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
166
+ wol_Latn,60,60,1,0,11849,0.983607,1.0,0.991736,0.999916,84.388186,1.0
167
+ xho_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
168
+ ydd_Hebr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
169
+ yor_Latn,57,57,6,0,11847,0.904762,1.0,0.95,0.999494,506.200962,1.0
170
+ yue_Hani,49,45,237,4,11624,0.159574,0.918367,0.271903,0.980019,19981.451817,0.918367
171
+ zul_Latn,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
reports/udhr-common/fasttext@millid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9194794290512175,
3
+ "top3_accuracy": 0.964735516372796,
4
+ "top5_accuracy": 0.974223341729639,
5
+ "passages": 11910,
6
+ "languages": 170,
7
+ "macro_precision": 0.9473808585265043,
8
+ "macro_recall": 0.9440916022324787,
9
+ "macro_f1": 0.9328542536140149,
10
+ "macro_specificity": 0.9996006150778249,
11
+ "weighted_f1": 0.9181958923496206,
12
+ "median_f1": 1.0,
13
+ "languages_f1_at_least_0_9": 142,
14
+ "languages_f1_below_0_5": 6,
15
+ "mean_fp_per_million": 399.3849221751375,
16
+ "micro_f1": 0.9194794290512175
17
+ }
reports/udhr-common/fasttext_per_language.csv ADDED
@@ -0,0 +1,171 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,61,60,12,1,11837,0.833333,0.983607,0.902256,0.998987,1012.743691,0.983607
4
+ ady_Cyrl,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
5
+ afr_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
6
+ als_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
7
+ alt_Cyrl,51,51,0,0,11859,1.0,1.0,1.0,1.0,0.0,1.0
8
+ amh_Ethi,51,37,0,14,11859,1.0,0.72549,0.840909,1.0,0.0,0.72549
9
+ arb_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
10
+ arn_Latn,58,56,0,2,11852,1.0,0.965517,0.982456,1.0,0.0,0.965517
11
+ ast_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
12
+ ayr_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
13
+ azj_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
14
+ bam_Latn,57,50,42,7,11811,0.543478,0.877193,0.671141,0.996457,3543.406732,0.877193
15
+ ban_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
16
+ bel_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
17
+ bem_Latn,57,57,3,0,11850,0.95,1.0,0.974359,0.999747,253.100481,1.0
18
+ ben_Beng,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
19
+ bho_Deva,56,42,2,14,11852,0.954545,0.75,0.84,0.999831,168.71942,0.75
20
+ bis_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
21
+ bod_Tibt,60,58,11,2,11839,0.84058,0.966667,0.899225,0.999072,928.270042,0.966667
22
+ bos_Latn,59,28,4,31,11847,0.875,0.474576,0.615385,0.999662,337.52426,0.474576
23
+ bug_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
24
+ bul_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
25
+ cat_Latn,58,58,2,0,11850,0.966667,1.0,0.983051,0.999831,168.747891,1.0
26
+ ceb_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
27
+ ces_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
28
+ chv_Cyrl,25,25,1,0,11884,0.961538,1.0,0.980392,0.999916,84.139672,1.0
29
+ cjk_Latn,114,110,0,4,11796,1.0,0.964912,0.982143,1.0,0.0,0.964912
30
+ cmn_Hani,319,119,15,200,11576,0.88806,0.373041,0.525386,0.998706,1294.107497,0.373041
31
+ crh_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
32
+ cym_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
33
+ dan_Latn,61,60,0,1,11849,1.0,0.983607,0.991736,1.0,0.0,0.983607
34
+ deu_Latn,67,67,0,0,11843,1.0,1.0,1.0,1.0,0.0,1.0
35
+ dyu_Latn,58,1,7,57,11845,0.125,0.017241,0.030303,0.999409,590.617617,0.017241
36
+ dzo_Tibt,59,48,2,11,11849,0.96,0.813559,0.880734,0.999831,168.76213,0.813559
37
+ ekk_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
38
+ ell_Grek,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
39
+ eng_Latn,58,58,3,0,11849,0.95082,1.0,0.97479,0.999747,253.121836,1.0
40
+ epo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
41
+ eus_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
42
+ ewe_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
43
+ fao_Latn,57,34,0,23,11853,1.0,0.596491,0.747253,1.0,0.0,0.596491
44
+ fas_Arab,114,114,2,0,11794,0.982759,1.0,0.991304,0.99983,169.549,1.0
45
+ fij_Latn,59,59,1,0,11850,0.983333,1.0,0.991597,0.999916,84.381065,1.0
46
+ fil_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
47
+ fin_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
48
+ fon_Latn,58,58,11,0,11841,0.84058,1.0,0.913386,0.999072,928.113399,1.0
49
+ fra_Latn,58,58,6,0,11846,0.90625,1.0,0.95082,0.999494,506.243672,1.0
50
+ fur_Latn,59,59,30,0,11821,0.662921,1.0,0.797297,0.997469,2531.431947,1.0
51
+ fuv_Latn,108,108,12,0,11790,0.9,1.0,0.947368,0.998983,1016.776817,1.0
52
+ gaz_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
53
+ gla_Latn,62,58,0,4,11848,1.0,0.935484,0.966667,1.0,0.0,0.935484
54
+ gle_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
55
+ glg_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
56
+ gug_Latn,49,49,3,0,11858,0.942308,1.0,0.970297,0.999747,252.92977,1.0
57
+ guj_Gujr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
58
+ hat_Latn,117,116,32,1,11761,0.783784,0.991453,0.875472,0.997287,2713.474095,0.991453
59
+ hau_Latn,155,155,0,0,11755,1.0,1.0,1.0,1.0,0.0,1.0
60
+ heb_Hebr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
61
+ hin_Deva,59,59,3,0,11848,0.951613,1.0,0.975207,0.999747,253.143195,1.0
62
+ hrv_Latn,58,54,30,4,11822,0.642857,0.931034,0.760563,0.997469,2531.21836,0.931034
63
+ hun_Latn,59,59,2,0,11849,0.967213,1.0,0.983333,0.999831,168.76213,1.0
64
+ hye_Armn,70,68,0,2,11840,1.0,0.971429,0.985507,1.0,0.0,0.971429
65
+ ibo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
66
+ ilo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
67
+ ind_Latn,60,52,4,8,11846,0.928571,0.866667,0.896552,0.999662,337.552743,0.866667
68
+ isl_Latn,58,58,22,0,11830,0.725,1.0,0.84058,0.998144,1856.226797,1.0
69
+ ita_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
70
+ jav_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
71
+ jpn_Jpan,140,134,2,6,11768,0.985294,0.957143,0.971014,0.99983,169.923534,0.957143
72
+ kab_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
73
+ kal_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
74
+ kan_Knda,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
75
+ kat_Geor,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
76
+ kaz_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
77
+ kbp_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
78
+ kea_Latn,58,12,0,46,11852,1.0,0.206897,0.342857,1.0,0.0,0.206897
79
+ khk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
80
+ khm_Khmr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
81
+ kin_Latn,59,51,1,8,11850,0.980769,0.864407,0.918919,0.999916,84.381065,0.864407
82
+ kir_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
83
+ kmb_Latn,116,111,8,5,11786,0.932773,0.956897,0.944681,0.999322,678.311006,0.956897
84
+ kmr_Latn,58,58,25,0,11827,0.698795,1.0,0.822695,0.997891,2109.348633,1.0
85
+ knc_Latn,64,64,0,0,11846,1.0,1.0,1.0,1.0,0.0,1.0
86
+ kng_Latn,115,72,0,43,11795,1.0,0.626087,0.770053,1.0,0.0,0.626087
87
+ kor_Hang,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
88
+ lao_Laoo,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
89
+ lij_Latn,58,57,90,1,11762,0.387755,0.982759,0.556098,0.992406,7593.655079,0.982759
90
+ lin_Latn,110,109,0,1,11800,1.0,0.990909,0.995434,1.0,0.0,0.990909
91
+ lit_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
92
+ ltz_Latn,59,58,6,1,11845,0.90625,0.983051,0.943089,0.999494,506.286389,0.983051
93
+ lua_Latn,58,53,29,5,11823,0.646341,0.913793,0.757143,0.997553,2446.844414,0.913793
94
+ lug_Latn,49,49,3,0,11858,0.942308,1.0,0.970297,0.999747,252.92977,1.0
95
+ lus_Latn,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
96
+ lvs_Latn,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
97
+ mag_Deva,53,49,12,4,11845,0.803279,0.924528,0.859649,0.998988,1012.060386,0.924528
98
+ mai_Deva,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
99
+ mal_Mlym,100,100,0,0,11810,1.0,1.0,1.0,1.0,0.0,1.0
100
+ mar_Deva,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
101
+ min_Latn,59,4,0,55,11851,1.0,0.067797,0.126984,1.0,0.0,0.067797
102
+ mkd_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
103
+ mlt_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
104
+ mos_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
105
+ mri_Latn,57,57,31,0,11822,0.647727,1.0,0.786207,0.997385,2615.371636,1.0
106
+ mya_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
107
+ nav_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
108
+ nld_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
109
+ nno_Latn,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
110
+ nob_Latn,62,62,1,0,11847,0.984127,1.0,0.992,0.999916,84.402431,1.0
111
+ npi_Deva,55,55,0,0,11855,1.0,1.0,1.0,1.0,0.0,1.0
112
+ nso_Latn,58,58,3,0,11849,0.95082,1.0,0.97479,0.999747,253.121836,1.0
113
+ nya_Latn,116,116,2,0,11792,0.983051,1.0,0.991453,0.99983,169.577751,1.0
114
+ oci_Latn,398,152,0,246,11512,1.0,0.38191,0.552727,1.0,0.0,0.38191
115
+ oss_Cyrl,44,44,0,0,11866,1.0,1.0,1.0,1.0,0.0,1.0
116
+ pan_Guru,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
117
+ pap_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
118
+ pcm_Latn,56,44,0,12,11854,1.0,0.785714,0.88,1.0,0.0,0.785714
119
+ plt_Latn,53,53,0,0,11857,1.0,1.0,1.0,1.0,0.0,1.0
120
+ pol_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
121
+ por_Latn,115,115,32,0,11763,0.782313,1.0,0.877863,0.997287,2713.013989,1.0
122
+ quy_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
123
+ roh_Latn,399,399,3,0,11508,0.992537,1.0,0.996255,0.999739,260.620276,1.0
124
+ ron_Latn,97,96,0,1,11813,1.0,0.989691,0.994819,1.0,0.0,0.989691
125
+ run_Latn,58,58,8,0,11844,0.878788,1.0,0.935484,0.999325,674.991563,1.0
126
+ rus_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
127
+ sag_Latn,59,7,0,52,11851,1.0,0.118644,0.212121,1.0,0.0,0.118644
128
+ san_Deva,55,54,0,1,11855,1.0,0.981818,0.990826,1.0,0.0,0.981818
129
+ shn_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
130
+ sin_Sinh,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
131
+ slk_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
132
+ slv_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
133
+ smo_Latn,63,61,11,2,11836,0.847222,0.968254,0.903704,0.999071,928.505107,0.968254
134
+ sna_Latn,60,57,0,3,11850,1.0,0.95,0.974359,1.0,0.0,0.95
135
+ som_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
136
+ sot_Latn,57,46,3,11,11850,0.938776,0.807018,0.867925,0.999747,253.100481,0.807018
137
+ spa_Latn,78,78,0,0,11832,1.0,1.0,1.0,1.0,0.0,1.0
138
+ srp_Cyrl,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
139
+ ssw_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
140
+ sun_Latn,66,65,2,1,11842,0.970149,0.984848,0.977444,0.999831,168.861871,0.984848
141
+ swe_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
142
+ swh_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
143
+ tah_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
144
+ tam_Taml,68,68,0,0,11842,1.0,1.0,1.0,1.0,0.0,1.0
145
+ tat_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
146
+ tel_Telu,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
147
+ tgk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
148
+ tha_Thai,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
149
+ tir_Ethi,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
150
+ ton_Latn,60,0,4,60,11846,0.0,0.0,0.0,0.999662,337.552743,0.0
151
+ tpi_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
152
+ tsn_Latn,58,58,8,0,11844,0.878788,1.0,0.935484,0.999325,674.991563,1.0
153
+ tso_Latn,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
154
+ tuk_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
155
+ tur_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
156
+ twi_Latn,116,116,3,0,11791,0.97479,1.0,0.987234,0.999746,254.366627,1.0
157
+ tzm_Tfng,1,1,0,0,11909,1.0,1.0,1.0,1.0,0.0,1.0
158
+ uig_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
159
+ ukr_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
160
+ umb_Latn,107,104,0,3,11803,1.0,0.971963,0.985782,1.0,0.0,0.971963
161
+ urd_Arab,108,108,0,0,11802,1.0,1.0,1.0,1.0,0.0,1.0
162
+ uzn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
163
+ vec_Latn,58,58,8,0,11844,0.878788,1.0,0.935484,0.999325,674.991563,1.0
164
+ vie_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
165
+ war_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
166
+ wol_Latn,60,60,1,0,11849,0.983607,1.0,0.991736,0.999916,84.388186,1.0
167
+ xho_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
168
+ ydd_Hebr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
169
+ yor_Latn,57,57,6,0,11847,0.904762,1.0,0.95,0.999494,506.200962,1.0
170
+ yue_Hani,49,45,237,4,11624,0.159574,0.918367,0.271903,0.980019,19981.451817,0.918367
171
+ zul_Latn,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
reports/udhr-common/fasttext_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9187237615449202,
3
+ "top3_accuracy": 0.964735516372796,
4
+ "top5_accuracy": 0.9740554156171285,
5
+ "passages": 11910,
6
+ "languages": 170,
7
+ "macro_precision": 0.9473808585265043,
8
+ "macro_recall": 0.9431462240812183,
9
+ "macro_f1": 0.9323102708833079,
10
+ "macro_specificity": 0.9996006150778249,
11
+ "weighted_f1": 0.917761071560676,
12
+ "median_f1": 1.0,
13
+ "languages_f1_at_least_0_9": 141,
14
+ "languages_f1_below_0_5": 6,
15
+ "mean_fp_per_million": 399.3849221751375,
16
+ "micro_f1": 0.9187237615449202
17
+ }
reports/udhr-common/glotlid@millid_per_language.csv ADDED
@@ -0,0 +1,171 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,61,60,0,1,11849,1.0,0.983607,0.991736,1.0,0.0,0.983607
4
+ ady_Cyrl,56,54,0,2,11854,1.0,0.964286,0.981818,1.0,0.0,0.964286
5
+ afr_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
6
+ als_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
7
+ alt_Cyrl,51,51,0,0,11859,1.0,1.0,1.0,1.0,0.0,1.0
8
+ amh_Ethi,51,51,0,0,11859,1.0,1.0,1.0,1.0,0.0,1.0
9
+ arb_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
10
+ arn_Latn,58,48,0,10,11852,1.0,0.827586,0.90566,1.0,0.0,0.827586
11
+ ast_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
12
+ ayr_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
13
+ azj_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
14
+ bam_Latn,57,50,26,7,11827,0.657895,0.877193,0.75188,0.997806,2193.537501,0.877193
15
+ ban_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
16
+ bel_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
17
+ bem_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
18
+ ben_Beng,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
19
+ bho_Deva,56,49,0,7,11854,1.0,0.875,0.933333,1.0,0.0,0.875
20
+ bis_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
21
+ bod_Tibt,60,50,1,10,11849,0.980392,0.833333,0.900901,0.999916,84.388186,0.833333
22
+ bos_Latn,59,27,2,32,11849,0.931034,0.457627,0.613636,0.999831,168.76213,0.457627
23
+ bug_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
24
+ bul_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
25
+ cat_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
26
+ ceb_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
27
+ ces_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
28
+ chv_Cyrl,25,25,0,0,11885,1.0,1.0,1.0,1.0,0.0,1.0
29
+ cjk_Latn,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
30
+ cmn_Hani,319,293,12,26,11579,0.960656,0.918495,0.939103,0.998965,1035.285998,0.918495
31
+ crh_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
32
+ cym_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
33
+ dan_Latn,61,59,0,2,11849,1.0,0.967213,0.983333,1.0,0.0,0.967213
34
+ deu_Latn,67,67,0,0,11843,1.0,1.0,1.0,1.0,0.0,1.0
35
+ dyu_Latn,58,18,7,40,11845,0.72,0.310345,0.433735,0.999409,590.617617,0.310345
36
+ dzo_Tibt,59,58,10,1,11841,0.852941,0.983051,0.913386,0.999156,843.810649,0.983051
37
+ ekk_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
38
+ ell_Grek,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
39
+ eng_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
40
+ epo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
41
+ eus_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
42
+ ewe_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
43
+ fao_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
44
+ fas_Arab,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
45
+ fij_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
46
+ fil_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
47
+ fin_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
48
+ fon_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
49
+ fra_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
50
+ fur_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
51
+ fuv_Latn,108,63,0,45,11802,1.0,0.583333,0.736842,1.0,0.0,0.583333
52
+ gaz_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
53
+ gla_Latn,62,60,0,2,11848,1.0,0.967742,0.983607,1.0,0.0,0.967742
54
+ gle_Latn,56,56,2,0,11852,0.965517,1.0,0.982456,0.999831,168.71942,1.0
55
+ glg_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
56
+ gug_Latn,49,49,0,0,11861,1.0,1.0,1.0,1.0,0.0,1.0
57
+ guj_Gujr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
58
+ hat_Latn,117,114,2,3,11791,0.982759,0.974359,0.978541,0.99983,169.592131,0.974359
59
+ hau_Latn,155,155,0,0,11755,1.0,1.0,1.0,1.0,0.0,1.0
60
+ heb_Hebr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
61
+ hin_Deva,59,56,2,3,11849,0.965517,0.949153,0.957265,0.999831,168.76213,0.949153
62
+ hrv_Latn,58,56,28,2,11824,0.666667,0.965517,0.788732,0.997638,2362.470469,0.965517
63
+ hun_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
64
+ hye_Armn,70,70,0,0,11840,1.0,1.0,1.0,1.0,0.0,1.0
65
+ ibo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
66
+ ilo_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
67
+ ind_Latn,60,51,1,9,11849,0.980769,0.85,0.910714,0.999916,84.388186,0.85
68
+ isl_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
69
+ ita_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
70
+ jav_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
71
+ jpn_Jpan,140,140,0,0,11770,1.0,1.0,1.0,1.0,0.0,1.0
72
+ kab_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
73
+ kal_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
74
+ kan_Knda,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
75
+ kat_Geor,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
76
+ kaz_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
77
+ kbp_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
78
+ kea_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
79
+ khk_Cyrl,57,56,0,1,11853,1.0,0.982456,0.99115,1.0,0.0,0.982456
80
+ khm_Khmr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
81
+ kin_Latn,59,47,0,12,11851,1.0,0.79661,0.886792,1.0,0.0,0.79661
82
+ kir_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
83
+ kmb_Latn,116,116,0,0,11794,1.0,1.0,1.0,1.0,0.0,1.0
84
+ kmr_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
85
+ knc_Latn,64,64,0,0,11846,1.0,1.0,1.0,1.0,0.0,1.0
86
+ kng_Latn,115,16,0,99,11795,1.0,0.13913,0.244275,1.0,0.0,0.13913
87
+ kor_Hang,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
88
+ lao_Laoo,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
89
+ lij_Latn,58,58,18,0,11834,0.763158,1.0,0.865672,0.998481,1518.731016,1.0
90
+ lin_Latn,110,110,0,0,11800,1.0,1.0,1.0,1.0,0.0,1.0
91
+ lit_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
92
+ ltz_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
93
+ lua_Latn,58,34,0,24,11852,1.0,0.586207,0.73913,1.0,0.0,0.586207
94
+ lug_Latn,49,49,0,0,11861,1.0,1.0,1.0,1.0,0.0,1.0
95
+ lus_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
96
+ lvs_Latn,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
97
+ mag_Deva,53,51,4,2,11853,0.927273,0.962264,0.944444,0.999663,337.353462,0.962264
98
+ mai_Deva,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
99
+ mal_Mlym,100,100,0,0,11810,1.0,1.0,1.0,1.0,0.0,1.0
100
+ mar_Deva,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
101
+ min_Latn,59,59,1,0,11850,0.983333,1.0,0.991597,0.999916,84.381065,1.0
102
+ mkd_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
103
+ mlt_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
104
+ mos_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
105
+ mri_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
106
+ mya_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
107
+ nav_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
108
+ nld_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
109
+ nno_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
110
+ nob_Latn,62,62,2,0,11846,0.96875,1.0,0.984127,0.999831,168.804862,1.0
111
+ npi_Deva,55,54,0,1,11855,1.0,0.981818,0.990826,1.0,0.0,0.981818
112
+ nso_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
113
+ nya_Latn,116,116,0,0,11794,1.0,1.0,1.0,1.0,0.0,1.0
114
+ oci_Latn,398,92,0,306,11512,1.0,0.231156,0.37551,1.0,0.0,0.231156
115
+ oss_Cyrl,44,44,0,0,11866,1.0,1.0,1.0,1.0,0.0,1.0
116
+ pan_Guru,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
117
+ pap_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
118
+ pcm_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
119
+ plt_Latn,53,53,0,0,11857,1.0,1.0,1.0,1.0,0.0,1.0
120
+ pol_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
121
+ por_Latn,115,115,1,0,11794,0.991379,1.0,0.995671,0.999915,84.781687,1.0
122
+ quy_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
123
+ roh_Latn,399,399,0,0,11511,1.0,1.0,1.0,1.0,0.0,1.0
124
+ ron_Latn,97,97,0,0,11813,1.0,1.0,1.0,1.0,0.0,1.0
125
+ run_Latn,58,58,12,0,11840,0.828571,1.0,0.90625,0.998988,1012.487344,1.0
126
+ rus_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
127
+ sag_Latn,59,24,0,35,11851,1.0,0.40678,0.578313,1.0,0.0,0.40678
128
+ san_Deva,55,54,0,1,11855,1.0,0.981818,0.990826,1.0,0.0,0.981818
129
+ shn_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
130
+ sin_Sinh,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
131
+ slk_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
132
+ slv_Latn,59,59,1,0,11850,0.983333,1.0,0.991597,0.999916,84.381065,1.0
133
+ smo_Latn,63,63,0,0,11847,1.0,1.0,1.0,1.0,0.0,1.0
134
+ sna_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
135
+ som_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
136
+ sot_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
137
+ spa_Latn,78,77,0,1,11832,1.0,0.987179,0.993548,1.0,0.0,0.987179
138
+ srp_Cyrl,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
139
+ ssw_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
140
+ sun_Latn,66,65,0,1,11844,1.0,0.984848,0.992366,1.0,0.0,0.984848
141
+ swe_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
142
+ swh_Latn,58,56,0,2,11852,1.0,0.965517,0.982456,1.0,0.0,0.965517
143
+ tah_Latn,57,39,0,18,11853,1.0,0.684211,0.8125,1.0,0.0,0.684211
144
+ tam_Taml,68,68,0,0,11842,1.0,1.0,1.0,1.0,0.0,1.0
145
+ tat_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
146
+ tel_Telu,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
147
+ tgk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
148
+ tha_Thai,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
149
+ tir_Ethi,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
150
+ ton_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
151
+ tpi_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
152
+ tsn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
153
+ tso_Latn,114,73,0,41,11796,1.0,0.640351,0.780749,1.0,0.0,0.640351
154
+ tuk_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
155
+ tur_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
156
+ twi_Latn,116,116,0,0,11794,1.0,1.0,1.0,1.0,0.0,1.0
157
+ tzm_Tfng,1,1,0,0,11909,1.0,1.0,1.0,1.0,0.0,1.0
158
+ uig_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
159
+ ukr_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
160
+ umb_Latn,107,105,0,2,11803,1.0,0.981308,0.990566,1.0,0.0,0.981308
161
+ urd_Arab,108,106,0,2,11802,1.0,0.981481,0.990654,1.0,0.0,0.981481
162
+ uzn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
163
+ vec_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
164
+ vie_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
165
+ war_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
166
+ wol_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
167
+ xho_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
168
+ ydd_Hebr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
169
+ yor_Latn,57,57,1,0,11852,0.982759,1.0,0.991304,0.999916,84.366827,1.0
170
+ yue_Hani,49,20,0,29,11861,1.0,0.408163,0.57971,1.0,0.0,0.408163
171
+ zul_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
reports/udhr-common/glotlid@millid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9338371116708648,
3
+ "top3_accuracy": 0.9682619647355164,
4
+ "top5_accuracy": 0.9735516372795969,
5
+ "passages": 11910,
6
+ "languages": 170,
7
+ "macro_precision": 0.9887806114106193,
8
+ "macro_recall": 0.9578604445634422,
9
+ "macro_f1": 0.9658801542070193,
10
+ "macro_specificity": 0.9999338492838657,
11
+ "weighted_f1": 0.9468741038422634,
12
+ "median_f1": 1.0,
13
+ "languages_f1_at_least_0_9": 156,
14
+ "languages_f1_below_0_5": 3,
15
+ "mean_fp_per_million": 66.15071613431165,
16
+ "micro_f1": 0.9338371116708648
17
+ }
reports/udhr-common/glotlid_per_language.csv ADDED
@@ -0,0 +1,171 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,61,60,0,1,11849,1.0,0.983607,0.991736,1.0,0.0,0.983607
4
+ ady_Cyrl,56,54,0,2,11854,1.0,0.964286,0.981818,1.0,0.0,0.964286
5
+ afr_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
6
+ als_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
7
+ alt_Cyrl,51,51,0,0,11859,1.0,1.0,1.0,1.0,0.0,1.0
8
+ amh_Ethi,51,51,0,0,11859,1.0,1.0,1.0,1.0,0.0,1.0
9
+ arb_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
10
+ arn_Latn,58,47,0,11,11852,1.0,0.810345,0.895238,1.0,0.0,0.810345
11
+ ast_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
12
+ ayr_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
13
+ azj_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
14
+ bam_Latn,57,50,26,7,11827,0.657895,0.877193,0.75188,0.997806,2193.537501,0.877193
15
+ ban_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
16
+ bel_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
17
+ bem_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
18
+ ben_Beng,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
19
+ bho_Deva,56,49,0,7,11854,1.0,0.875,0.933333,1.0,0.0,0.875
20
+ bis_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
21
+ bod_Tibt,60,50,1,10,11849,0.980392,0.833333,0.900901,0.999916,84.388186,0.833333
22
+ bos_Latn,59,27,2,32,11849,0.931034,0.457627,0.613636,0.999831,168.76213,0.457627
23
+ bug_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
24
+ bul_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
25
+ cat_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
26
+ ceb_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
27
+ ces_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
28
+ chv_Cyrl,25,25,0,0,11885,1.0,1.0,1.0,1.0,0.0,1.0
29
+ cjk_Latn,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
30
+ cmn_Hani,319,293,12,26,11579,0.960656,0.918495,0.939103,0.998965,1035.285998,0.918495
31
+ crh_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
32
+ cym_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
33
+ dan_Latn,61,59,0,2,11849,1.0,0.967213,0.983333,1.0,0.0,0.967213
34
+ deu_Latn,67,67,0,0,11843,1.0,1.0,1.0,1.0,0.0,1.0
35
+ dyu_Latn,58,18,7,40,11845,0.72,0.310345,0.433735,0.999409,590.617617,0.310345
36
+ dzo_Tibt,59,58,10,1,11841,0.852941,0.983051,0.913386,0.999156,843.810649,0.983051
37
+ ekk_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
38
+ ell_Grek,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
39
+ eng_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
40
+ epo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
41
+ eus_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
42
+ ewe_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
43
+ fao_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
44
+ fas_Arab,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
45
+ fij_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
46
+ fil_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
47
+ fin_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
48
+ fon_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
49
+ fra_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
50
+ fur_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
51
+ fuv_Latn,108,62,0,46,11802,1.0,0.574074,0.729412,1.0,0.0,0.574074
52
+ gaz_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
53
+ gla_Latn,62,60,0,2,11848,1.0,0.967742,0.983607,1.0,0.0,0.967742
54
+ gle_Latn,56,56,2,0,11852,0.965517,1.0,0.982456,0.999831,168.71942,1.0
55
+ glg_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
56
+ gug_Latn,49,49,0,0,11861,1.0,1.0,1.0,1.0,0.0,1.0
57
+ guj_Gujr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
58
+ hat_Latn,117,114,2,3,11791,0.982759,0.974359,0.978541,0.99983,169.592131,0.974359
59
+ hau_Latn,155,155,0,0,11755,1.0,1.0,1.0,1.0,0.0,1.0
60
+ heb_Hebr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
61
+ hin_Deva,59,56,2,3,11849,0.965517,0.949153,0.957265,0.999831,168.76213,0.949153
62
+ hrv_Latn,58,56,28,2,11824,0.666667,0.965517,0.788732,0.997638,2362.470469,0.965517
63
+ hun_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
64
+ hye_Armn,70,70,0,0,11840,1.0,1.0,1.0,1.0,0.0,1.0
65
+ ibo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
66
+ ilo_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
67
+ ind_Latn,60,51,1,9,11849,0.980769,0.85,0.910714,0.999916,84.388186,0.85
68
+ isl_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
69
+ ita_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
70
+ jav_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
71
+ jpn_Jpan,140,140,0,0,11770,1.0,1.0,1.0,1.0,0.0,1.0
72
+ kab_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
73
+ kal_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
74
+ kan_Knda,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
75
+ kat_Geor,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
76
+ kaz_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
77
+ kbp_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
78
+ kea_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
79
+ khk_Cyrl,57,56,0,1,11853,1.0,0.982456,0.99115,1.0,0.0,0.982456
80
+ khm_Khmr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
81
+ kin_Latn,59,47,0,12,11851,1.0,0.79661,0.886792,1.0,0.0,0.79661
82
+ kir_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
83
+ kmb_Latn,116,116,0,0,11794,1.0,1.0,1.0,1.0,0.0,1.0
84
+ kmr_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
85
+ knc_Latn,64,64,0,0,11846,1.0,1.0,1.0,1.0,0.0,1.0
86
+ kng_Latn,115,16,0,99,11795,1.0,0.13913,0.244275,1.0,0.0,0.13913
87
+ kor_Hang,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
88
+ lao_Laoo,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
89
+ lij_Latn,58,58,18,0,11834,0.763158,1.0,0.865672,0.998481,1518.731016,1.0
90
+ lin_Latn,110,110,0,0,11800,1.0,1.0,1.0,1.0,0.0,1.0
91
+ lit_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
92
+ ltz_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
93
+ lua_Latn,58,34,0,24,11852,1.0,0.586207,0.73913,1.0,0.0,0.586207
94
+ lug_Latn,49,49,0,0,11861,1.0,1.0,1.0,1.0,0.0,1.0
95
+ lus_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
96
+ lvs_Latn,115,115,0,0,11795,1.0,1.0,1.0,1.0,0.0,1.0
97
+ mag_Deva,53,51,4,2,11853,0.927273,0.962264,0.944444,0.999663,337.353462,0.962264
98
+ mai_Deva,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
99
+ mal_Mlym,100,100,0,0,11810,1.0,1.0,1.0,1.0,0.0,1.0
100
+ mar_Deva,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
101
+ min_Latn,59,59,1,0,11850,0.983333,1.0,0.991597,0.999916,84.381065,1.0
102
+ mkd_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
103
+ mlt_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
104
+ mos_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
105
+ mri_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
106
+ mya_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
107
+ nav_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
108
+ nld_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
109
+ nno_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
110
+ nob_Latn,62,62,2,0,11846,0.96875,1.0,0.984127,0.999831,168.804862,1.0
111
+ npi_Deva,55,54,0,1,11855,1.0,0.981818,0.990826,1.0,0.0,0.981818
112
+ nso_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
113
+ nya_Latn,116,116,0,0,11794,1.0,1.0,1.0,1.0,0.0,1.0
114
+ oci_Latn,398,92,0,306,11512,1.0,0.231156,0.37551,1.0,0.0,0.231156
115
+ oss_Cyrl,44,44,0,0,11866,1.0,1.0,1.0,1.0,0.0,1.0
116
+ pan_Guru,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
117
+ pap_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
118
+ pcm_Latn,56,55,0,1,11854,1.0,0.982143,0.990991,1.0,0.0,0.982143
119
+ plt_Latn,53,53,0,0,11857,1.0,1.0,1.0,1.0,0.0,1.0
120
+ pol_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
121
+ por_Latn,115,115,1,0,11794,0.991379,1.0,0.995671,0.999915,84.781687,1.0
122
+ quy_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
123
+ roh_Latn,399,399,0,0,11511,1.0,1.0,1.0,1.0,0.0,1.0
124
+ ron_Latn,97,97,0,0,11813,1.0,1.0,1.0,1.0,0.0,1.0
125
+ run_Latn,58,58,12,0,11840,0.828571,1.0,0.90625,0.998988,1012.487344,1.0
126
+ rus_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
127
+ sag_Latn,59,24,0,35,11851,1.0,0.40678,0.578313,1.0,0.0,0.40678
128
+ san_Deva,55,54,0,1,11855,1.0,0.981818,0.990826,1.0,0.0,0.981818
129
+ shn_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
130
+ sin_Sinh,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
131
+ slk_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
132
+ slv_Latn,59,59,1,0,11850,0.983333,1.0,0.991597,0.999916,84.381065,1.0
133
+ smo_Latn,63,63,0,0,11847,1.0,1.0,1.0,1.0,0.0,1.0
134
+ sna_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
135
+ som_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
136
+ sot_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
137
+ spa_Latn,78,77,0,1,11832,1.0,0.987179,0.993548,1.0,0.0,0.987179
138
+ srp_Cyrl,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
139
+ ssw_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
140
+ sun_Latn,66,65,0,1,11844,1.0,0.984848,0.992366,1.0,0.0,0.984848
141
+ swe_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
142
+ swh_Latn,58,56,0,2,11852,1.0,0.965517,0.982456,1.0,0.0,0.965517
143
+ tah_Latn,57,39,0,18,11853,1.0,0.684211,0.8125,1.0,0.0,0.684211
144
+ tam_Taml,68,68,0,0,11842,1.0,1.0,1.0,1.0,0.0,1.0
145
+ tat_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
146
+ tel_Telu,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
147
+ tgk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
148
+ tha_Thai,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
149
+ tir_Ethi,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
150
+ ton_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
151
+ tpi_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
152
+ tsn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
153
+ tso_Latn,114,73,0,41,11796,1.0,0.640351,0.780749,1.0,0.0,0.640351
154
+ tuk_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
155
+ tur_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
156
+ twi_Latn,116,116,0,0,11794,1.0,1.0,1.0,1.0,0.0,1.0
157
+ tzm_Tfng,1,1,0,0,11909,1.0,1.0,1.0,1.0,0.0,1.0
158
+ uig_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
159
+ ukr_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
160
+ umb_Latn,107,105,0,2,11803,1.0,0.981308,0.990566,1.0,0.0,0.981308
161
+ urd_Arab,108,106,0,2,11802,1.0,0.981481,0.990654,1.0,0.0,0.981481
162
+ uzn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
163
+ vec_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
164
+ vie_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
165
+ war_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
166
+ wol_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
167
+ xho_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
168
+ ydd_Hebr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
169
+ yor_Latn,57,57,1,0,11852,0.982759,1.0,0.991304,0.999916,84.366827,1.0
170
+ yue_Hani,49,20,0,29,11861,1.0,0.408163,0.57971,1.0,0.0,0.408163
171
+ zul_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
reports/udhr-common/glotlid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9335852225020991,
3
+ "top3_accuracy": 0.9677581863979848,
4
+ "top5_accuracy": 0.973215785054576,
5
+ "passages": 11910,
6
+ "languages": 170,
7
+ "macro_precision": 0.9887806114106193,
8
+ "macro_recall": 0.9575995164374027,
9
+ "macro_f1": 0.9657221446088623,
10
+ "macro_specificity": 0.9999338492838657,
11
+ "weighted_f1": 0.9467136106728533,
12
+ "median_f1": 1.0,
13
+ "languages_f1_at_least_0_9": 155,
14
+ "languages_f1_below_0_5": 3,
15
+ "mean_fp_per_million": 66.15071613431165,
16
+ "micro_f1": 0.9335852225020991
17
+ }
reports/udhr-common/leaderboard.csv ADDED
@@ -0,0 +1,171 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,language,support,millid_f1,millid_precision,millid_recall,glotlid_f1,glotlid_precision,glotlid_recall,glotlid@millid_f1,glotlid@millid_precision,glotlid@millid_recall,fasttext_f1,fasttext_precision,fasttext_recall,fasttext@millid_f1,fasttext@millid_precision,fasttext@millid_recall,delta,winner,delta_fasttext,winner_fasttext
2
+ roh_Latn,Romansh,399,0.995,1.0,0.99,1.0,1.0,1.0,1.0,1.0,1.0,0.9963,0.9925,1.0,0.9963,0.9925,1.0,-0.005,tie,-0.0013,tie
3
+ oci_Latn,Occitan,398,0.2771,1.0,0.1608,0.3755,1.0,0.2312,0.3755,1.0,0.2312,0.5527,1.0,0.3819,0.5527,1.0,0.3819,-0.0985,GlotLID,-0.2757,fastText
4
+ cmn_Hani,Chinese (Mandarin),319,0.9577,0.9562,0.9592,0.9391,0.9607,0.9185,0.9391,0.9607,0.9185,0.5254,0.8881,0.373,0.5254,0.8881,0.373,0.0186,MillID,0.4324,MillID
5
+ hau_Latn,Hausa,155,0.9968,1.0,0.9935,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0032,tie,-0.0032,tie
6
+ jpn_Jpan,Japanese,140,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.971,0.9853,0.9571,0.971,0.9853,0.9571,0.0,tie,0.029,MillID
7
+ hat_Latn,Haitian Creole,117,0.9915,0.9915,0.9915,0.9785,0.9828,0.9744,0.9785,0.9828,0.9744,0.8755,0.7838,0.9915,0.8755,0.7838,0.9915,0.0129,MillID,0.116,MillID
8
+ kmb_Latn,Kimbundu,116,0.9702,0.958,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.9447,0.9328,0.9569,0.9447,0.9328,0.9569,-0.0298,GlotLID,0.0255,MillID
9
+ twi_Latn,Twi,116,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9872,0.9748,1.0,0.9872,0.9748,1.0,0.0,tie,0.0128,MillID
10
+ nya_Latn,Nyanja,116,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0087,tie,-0.0001,tie
11
+ ell_Grek,Greek,115,0.6705,1.0,0.5043,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.3295,GlotLID,-0.3295,fastText
12
+ lvs_Latn,Standard Latvian,115,0.9868,1.0,0.9739,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0132,GlotLID,-0.0132,fastText
13
+ por_Latn,Portuguese,115,0.9554,0.9817,0.9304,0.9957,0.9914,1.0,0.9957,0.9914,1.0,0.8779,0.7823,1.0,0.8779,0.7823,1.0,-0.0403,GlotLID,0.0775,MillID
14
+ kng_Latn,Koongo,115,0.0833,1.0,0.0435,0.2443,1.0,0.1391,0.2443,1.0,0.1391,0.7701,1.0,0.6261,0.7701,1.0,0.6261,-0.1609,GlotLID,-0.6867,fastText
15
+ cjk_Latn,Chokwe,114,0.8713,1.0,0.7719,1.0,1.0,1.0,1.0,1.0,1.0,0.9821,1.0,0.9649,0.9821,1.0,0.9649,-0.1287,GlotLID,-0.1109,fastText
16
+ tso_Latn,Tsonga,114,0.86,1.0,0.7544,0.7807,1.0,0.6404,0.7807,1.0,0.6404,1.0,1.0,1.0,1.0,1.0,1.0,0.0793,MillID,-0.14,fastText
17
+ fas_Arab,Persian,114,0.9912,1.0,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,-0.0088,tie,-0.0002,tie
18
+ tha_Thai,Thai,114,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
19
+ lin_Latn,Lingala,110,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9954,1.0,0.9909,0.9954,1.0,0.9909,0.0,tie,0.0046,tie
20
+ fuv_Latn,Nigerian Fulfulde,108,0.6829,1.0,0.5185,0.7294,1.0,0.5741,0.7368,1.0,0.5833,0.9474,0.9,1.0,0.9474,0.9,1.0,-0.0539,GlotLID,-0.2644,fastText
21
+ urd_Arab,Urdu,108,0.9907,1.0,0.9815,0.9907,1.0,0.9815,0.9907,1.0,0.9815,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,-0.0093,tie
22
+ umb_Latn,Umbundu,107,0.9662,1.0,0.9346,0.9906,1.0,0.9813,0.9906,1.0,0.9813,0.9858,1.0,0.972,0.9858,1.0,0.972,-0.0244,GlotLID,-0.0196,fastText
23
+ mal_Mlym,Malayalam,100,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
24
+ ron_Latn,Romanian,97,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9948,1.0,0.9897,0.9948,1.0,0.9897,0.0,tie,0.0052,tie
25
+ spa_Latn,Spanish,78,0.9804,1.0,0.9615,0.9935,1.0,0.9872,0.9935,1.0,0.9872,1.0,1.0,1.0,1.0,1.0,1.0,-0.0132,GlotLID,-0.0196,fastText
26
+ hye_Armn,Armenian,70,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0,tie,0.0145,MillID
27
+ tam_Taml,Tamil,68,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
28
+ deu_Latn,German,67,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
29
+ sun_Latn,Sundanese,66,0.9924,1.0,0.9848,0.9924,1.0,0.9848,0.9924,1.0,0.9848,0.9774,0.9701,0.9848,0.9774,0.9701,0.9848,0.0,tie,0.0149,MillID
30
+ knc_Latn,Central Kanuri,64,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
31
+ smo_Latn,Samoan,63,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9037,0.8472,0.9683,0.9037,0.8472,0.9683,0.0,tie,0.0963,MillID
32
+ nob_Latn,Norwegian Bokmål,62,0.9134,0.8923,0.9355,0.9841,0.9688,1.0,0.9841,0.9688,1.0,0.992,0.9841,1.0,0.992,0.9841,1.0,-0.0707,GlotLID,-0.0786,fastText
33
+ gla_Latn,Scottish Gaelic,62,0.9919,1.0,0.9839,0.9836,1.0,0.9677,0.9836,1.0,0.9677,0.9667,1.0,0.9355,0.9667,1.0,0.9355,0.0083,tie,0.0252,MillID
34
+ fin_Latn,Finnish,61,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
35
+ swe_Latn,Swedish,61,0.9917,1.0,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0083,tie,-0.0083,tie
36
+ ace_Latn,Acehnese,61,1.0,1.0,1.0,0.9917,1.0,0.9836,0.9917,1.0,0.9836,0.9023,0.8333,0.9836,0.9023,0.8333,0.9836,0.0083,tie,0.0977,MillID
37
+ dan_Latn,Danish,61,0.9431,0.9355,0.9508,0.9833,1.0,0.9672,0.9833,1.0,0.9672,0.9917,1.0,0.9836,0.9917,1.0,0.9836,-0.0402,GlotLID,-0.0486,fastText
38
+ cym_Latn,Welsh,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
39
+ ekk_Latn,Estonian,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
40
+ bod_Tibt,Tibetan,60,0.9748,0.9831,0.9667,0.9009,0.9804,0.8333,0.9009,0.9804,0.8333,0.8992,0.8406,0.9667,0.8992,0.8406,0.9667,0.0739,MillID,0.0756,MillID
41
+ bug_Latn,Buginese,60,0.9381,1.0,0.8833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0619,GlotLID,-0.0619,fastText
42
+ ban_Latn,Balinese,60,0.9744,1.0,0.95,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0256,GlotLID,-0.0256,fastText
43
+ afr_Latn,Afrikaans,60,0.9916,1.0,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,0.9916,1.0,0.9833,0.9916,1.0,0.9833,-0.0084,tie,0.0,tie
44
+ gaz_Latn,Oromo (West Central),60,0.9744,1.0,0.95,0.9916,1.0,0.9833,0.9916,1.0,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID,-0.0256,fastText
45
+ fil_Latn,Filipino,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
46
+ wol_Latn,Wolof,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.0,tie,0.0083,tie
47
+ war_Latn,Waray,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.0,tie,0.0084,tie
48
+ vie_Latn,Vietnamese,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
49
+ ton_Latn,Tongan,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie,1.0,MillID
50
+ quy_Latn,Ayacucho Quechua,60,0.9831,1.0,0.9667,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,-0.0085,tie,-0.0085,tie
51
+ sna_Latn,Shona,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9744,1.0,0.95,0.9744,1.0,0.95,0.0,tie,0.0256,MillID
52
+ ind_Latn,Indonesian,60,0.7677,0.9744,0.6333,0.9107,0.9808,0.85,0.9107,0.9808,0.85,0.8966,0.9286,0.8667,0.8966,0.9286,0.8667,-0.143,GlotLID,-0.1289,fastText
53
+ jav_Latn,Javanese,60,0.9833,0.9833,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,-0.0083,tie,-0.0083,tie
54
+ tuk_Latn,Turkmen,59,0.9828,1.0,0.9661,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID,-0.0172,fastText
55
+ ydd_Hebr,Eastern Yiddish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
56
+ slv_Latn,Slovenian,59,0.9744,0.9828,0.9661,0.9916,0.9833,1.0,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID,-0.0256,fastText
57
+ sag_Latn,Sango,59,0.9915,1.0,0.9831,0.5783,1.0,0.4068,0.5783,1.0,0.4068,0.2121,1.0,0.1186,0.2121,1.0,0.1186,0.4131,MillID,0.7793,MillID
58
+ sin_Sinh,Sinhala,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
59
+ pol_Latn,Polish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie,0.0085,tie
60
+ fur_Latn,Friulian,59,0.9748,0.9667,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,0.7973,0.6629,1.0,0.7973,0.6629,1.0,-0.0252,GlotLID,0.1775,MillID
61
+ srp_Cyrl,Serbian,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie,0.0,tie
62
+ kbp_Latn,Kabiyè,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie,0.0085,tie
63
+ khm_Khmr,Khmer,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
64
+ nav_Latn,Navajo,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
65
+ ewe_Latn,Ewe,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie,0.0085,tie
66
+ eus_Latn,Basque,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie,0.0085,tie
67
+ dzo_Tibt,Dzongkha,59,0.9748,0.9667,0.9831,0.9134,0.8529,0.9831,0.9134,0.8529,0.9831,0.8807,0.96,0.8136,0.8807,0.96,0.8136,0.0614,MillID,0.0941,MillID
68
+ als_Latn,Albanian (Tosk),59,0.9915,1.0,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie,-0.0085,tie
69
+ ceb_Latn,Cebuano,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
70
+ bis_Latn,Bislama,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
71
+ bos_Latn,Bosnian,59,0.3291,0.65,0.2203,0.6136,0.931,0.4576,0.6136,0.931,0.4576,0.6154,0.875,0.4746,0.6154,0.875,0.4746,-0.2845,GlotLID,-0.2863,fastText
72
+ ayr_Latn,Central Aymara,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie,0.0085,tie
73
+ crh_Latn,Crimean Tatar,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
74
+ tur_Latn,Turkish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
75
+ ssw_Latn,Swati,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
76
+ hun_Latn,Hungarian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833,0.9672,1.0,0.9833,0.9672,1.0,0.0,tie,0.0167,MillID
77
+ fij_Latn,Fijian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.0,tie,0.0084,tie
78
+ ltz_Latn,Luxembourgish,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9431,0.9062,0.9831,0.9431,0.9062,0.9831,0.0,tie,0.0484,MillID
79
+ kin_Latn,Kinyarwanda,59,0.8039,0.9535,0.6949,0.8868,1.0,0.7966,0.8868,1.0,0.7966,0.9189,0.9808,0.8644,0.9189,0.9808,0.8644,-0.0829,GlotLID,-0.115,fastText
80
+ hin_Deva,Hindi,59,0.7234,0.9714,0.5763,0.9573,0.9655,0.9492,0.9573,0.9655,0.9492,0.9752,0.9516,1.0,0.9752,0.9516,1.0,-0.2339,GlotLID,-0.2518,fastText
81
+ mlt_Latn,Maltese,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
82
+ min_Latn,Minangkabau,59,1.0,1.0,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.127,1.0,0.0678,0.127,1.0,0.0678,0.0084,tie,0.873,MillID
83
+ mar_Deva,Marathi,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
84
+ xho_Latn,Xhosa,58,0.9565,0.9649,0.9483,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0435,GlotLID,-0.0435,fastText
85
+ vec_Latn,Venetian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9355,0.8788,1.0,0.9355,0.8788,1.0,0.0,tie,0.0645,MillID
86
+ ukr_Cyrl,Ukrainian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
87
+ tsn_Latn,Tswana,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9355,0.8788,1.0,0.9355,0.8788,1.0,0.0,tie,0.0645,MillID
88
+ tel_Telu,Telugu,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
89
+ dyu_Latn,Dyula,58,0.0,0.0,0.0,0.4337,0.72,0.3103,0.4337,0.72,0.3103,0.0303,0.125,0.0172,0.0303,0.125,0.0172,-0.4337,GlotLID,-0.0303,fastText
90
+ eng_Latn,English,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9748,0.9508,1.0,0.9748,0.9508,1.0,0.0,tie,0.0252,MillID
91
+ epo_Latn,Esperanto,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie,-0.0087,tie
92
+ ces_Latn,Czech,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID,-0.0175,fastText
93
+ ast_Latn,Asturian,58,0.9735,1.0,0.9483,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0265,GlotLID,-0.0265,fastText
94
+ arn_Latn,Mapuche,58,0.9825,1.0,0.9655,0.8952,1.0,0.8103,0.9057,1.0,0.8276,0.9825,1.0,0.9655,0.9825,1.0,0.9655,0.0768,MillID,0.0,tie
95
+ arb_Arab,Arabic (Modern Standard),58,0.8846,1.0,0.7931,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.1154,GlotLID,-0.1154,fastText
96
+ azj_Latn,North Azerbaijani,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
97
+ tpi_Latn,Tok Pisin,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
98
+ tir_Ethi,Tigrinya,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie,-0.0085,tie
99
+ uig_Arab,Uyghur,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
100
+ zul_Latn,Zulu,58,0.9189,0.9623,0.8793,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0724,GlotLID,-0.0725,fastText
101
+ bul_Cyrl,Bulgarian,58,0.9828,0.9828,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID,-0.0172,fastText
102
+ cat_Latn,Catalan,58,0.9748,0.9508,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9831,0.9667,1.0,0.9831,0.9667,1.0,-0.0252,GlotLID,-0.0083,tie
103
+ ben_Beng,Bangla,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
104
+ bel_Cyrl,Belarusian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
105
+ mkd_Cyrl,Macedonian,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie,-0.0085,tie
106
+ ilo_Latn,Iloko,58,1.0,1.0,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.0087,tie,0.0,tie
107
+ ibo_Latn,Igbo,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
108
+ uzn_Latn,Northern Uzbek,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
109
+ pan_Guru,Punjabi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
110
+ nno_Latn,Norwegian Nynorsk,58,0.9558,0.9818,0.931,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0442,GlotLID,-0.0357,fastText
111
+ nso_Latn,Northern Sotho,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9748,0.9508,1.0,0.9748,0.9508,1.0,0.0,tie,0.0252,MillID
112
+ pap_Latn,Papiamento,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
113
+ rus_Cyrl,Russian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
114
+ run_Latn,Rundi,58,0.8636,0.7703,0.9828,0.9062,0.8286,1.0,0.9062,0.8286,1.0,0.9355,0.8788,1.0,0.9355,0.8788,1.0,-0.0426,GlotLID,-0.0718,fastText
115
+ swh_Latn,Swahili,58,0.9159,1.0,0.8448,0.9825,1.0,0.9655,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0666,GlotLID,-0.0841,fastText
116
+ kab_Latn,Kabyle,58,0.9259,1.0,0.8621,0.9913,1.0,0.9828,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0654,GlotLID,-0.0741,fastText
117
+ kir_Cyrl,Kyrgyz,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
118
+ lua_Latn,Luba-Lulua,58,0.7174,0.9706,0.569,0.7391,1.0,0.5862,0.7391,1.0,0.5862,0.7571,0.6463,0.9138,0.7571,0.6463,0.9138,-0.0217,GlotLID,-0.0398,fastText
119
+ kmr_Latn,Northern Kurdish,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8227,0.6988,1.0,0.8227,0.6988,1.0,0.0,tie,0.1773,MillID
120
+ lit_Latn,Lithuanian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
121
+ lij_Latn,Ligurian,58,0.9831,0.9667,1.0,0.8657,0.7632,1.0,0.8657,0.7632,1.0,0.5561,0.3878,0.9828,0.5561,0.3878,0.9828,0.1174,MillID,0.427,MillID
122
+ kea_Latn,Kabuverdianu,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.3429,1.0,0.2069,0.3429,1.0,0.2069,-0.0087,tie,0.6484,MillID
123
+ lus_Latn,Mizo,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0087,tie,-0.0001,tie
124
+ kaz_Cyrl,Kazakh,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
125
+ kor_Hang,Korean,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
126
+ glg_Latn,Galician,58,0.9828,0.9828,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID,-0.0172,fastText
127
+ guj_Gujr,Gujarati,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
128
+ fra_Latn,French,58,0.8627,1.0,0.7586,1.0,1.0,1.0,1.0,1.0,1.0,0.9508,0.9062,1.0,0.9508,0.9062,1.0,-0.1373,GlotLID,-0.0881,fastText
129
+ fon_Latn,Fon,58,0.9573,0.9492,0.9655,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.9134,0.8406,1.0,0.9134,0.8406,1.0,-0.034,GlotLID,0.0439,MillID
130
+ hrv_Latn,Croatian,58,0.6277,0.5443,0.7414,0.7887,0.6667,0.9655,0.7887,0.6667,0.9655,0.7606,0.6429,0.931,0.7606,0.6429,0.931,-0.161,GlotLID,-0.1328,fastText
131
+ heb_Hebr,Hebrew,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID,-0.0175,fastText
132
+ kan_Knda,Kannada,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
133
+ kal_Latn,Kalaallisut,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.0,tie,0.0087,tie
134
+ ita_Latn,Italian,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie,-0.0087,tie
135
+ isl_Latn,Icelandic,58,0.8738,1.0,0.7759,1.0,1.0,1.0,1.0,1.0,1.0,0.8406,0.725,1.0,0.8406,0.725,1.0,-0.1262,GlotLID,0.0332,MillID
136
+ mai_Deva,Maithili,58,0.9355,0.8788,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0645,GlotLID,-0.0645,fastText
137
+ kat_Geor,Georgian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
138
+ nld_Latn,Dutch,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie,-0.0085,tie
139
+ abk_Cyrl,Abkhazian,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
140
+ sot_Latn,Southern Sotho,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.8679,0.9388,0.807,0.8679,0.9388,0.807,0.0,tie,0.1321,MillID
141
+ som_Latn,Somali,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
142
+ tgk_Cyrl,Tajik,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
143
+ tah_Latn,Tahitian,57,0.973,1.0,0.9474,0.8125,1.0,0.6842,0.8125,1.0,0.6842,1.0,1.0,1.0,1.0,1.0,1.0,0.1605,MillID,-0.027,fastText
144
+ tat_Cyrl,Tatar,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
145
+ bam_Latn,Bambara,57,0.8244,0.7297,0.9474,0.7519,0.6579,0.8772,0.7519,0.6579,0.8772,0.6711,0.5435,0.8772,0.6711,0.5435,0.8772,0.0725,MillID,0.1533,MillID
146
+ bem_Latn,Bemba,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9744,0.95,1.0,0.9744,0.95,1.0,-0.0087,tie,0.0169,MillID
147
+ fao_Latn,Faroese,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.7473,1.0,0.5965,0.7473,1.0,0.5965,0.0,tie,0.2527,MillID
148
+ khk_Cyrl,Halh Mongolian,57,1.0,1.0,1.0,0.9912,1.0,0.9825,0.9912,1.0,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,0.0088,tie,0.0,tie
149
+ yor_Latn,Yoruba,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.95,0.9048,1.0,0.95,0.9048,1.0,0.0087,tie,0.05,MillID
150
+ mri_Latn,Māori,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.7862,0.6477,1.0,0.7862,0.6477,1.0,0.0,tie,0.2138,MillID
151
+ lao_Laoo,Lao,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
152
+ ady_Cyrl,Adyghe,56,0.963,1.0,0.9286,0.9818,1.0,0.9643,0.9818,1.0,0.9643,1.0,1.0,1.0,1.0,1.0,1.0,-0.0189,GlotLID,-0.037,fastText
153
+ slk_Latn,Slovak,56,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID,-0.0175,fastText
154
+ pcm_Latn,Nigerian Pidgin,56,1.0,1.0,1.0,0.991,1.0,0.9821,1.0,1.0,1.0,0.88,1.0,0.7857,0.9725,1.0,0.9464,0.0,tie,0.0275,MillID
155
+ bho_Deva,Bhojpuri,56,0.8515,0.9556,0.7679,0.9333,1.0,0.875,0.9333,1.0,0.875,0.84,0.9545,0.75,0.84,0.9545,0.75,-0.0818,GlotLID,0.0115,MillID
156
+ gle_Latn,Irish,56,1.0,1.0,1.0,0.9825,0.9655,1.0,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0175,MillID,0.0,tie
157
+ mos_Latn,Mossi,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
158
+ shn_Mymr,Shan,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
159
+ mya_Mymr,Burmese,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
160
+ npi_Deva,Nepali,55,1.0,1.0,1.0,0.9908,1.0,0.9818,0.9908,1.0,0.9818,1.0,1.0,1.0,1.0,1.0,1.0,0.0092,tie,0.0,tie
161
+ san_Deva,Sanskrit,55,0.9815,1.0,0.9636,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.9908,1.0,0.9818,-0.0093,tie,-0.0093,tie
162
+ mag_Deva,Magahi,53,0.8679,0.8679,0.8679,0.9444,0.9273,0.9623,0.9444,0.9273,0.9623,0.8596,0.8033,0.9245,0.8596,0.8033,0.9245,-0.0765,GlotLID,0.0083,tie
163
+ plt_Latn,Malagasy (Plateau),53,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
164
+ alt_Cyrl,Southern Altai,51,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
165
+ amh_Ethi,Amharic,51,0.9901,1.0,0.9804,1.0,1.0,1.0,1.0,1.0,1.0,0.8409,1.0,0.7255,0.8409,1.0,0.7255,-0.0099,tie,0.1492,MillID
166
+ lug_Latn,Ganda,49,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9703,0.9423,1.0,0.9703,0.9423,1.0,0.0,tie,0.0297,MillID
167
+ gug_Latn,Paraguayan Guaraní,49,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9703,0.9423,1.0,0.9703,0.9423,1.0,0.0,tie,0.0297,MillID
168
+ yue_Hani,Cantonese,49,0.7436,1.0,0.5918,0.5797,1.0,0.4082,0.5797,1.0,0.4082,0.2719,0.1596,0.9184,0.2719,0.1596,0.9184,0.1639,MillID,0.4717,MillID
169
+ oss_Cyrl,Ossetic,44,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
170
+ chv_Cyrl,Chuvash,25,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9804,0.9615,1.0,0.9804,0.9615,1.0,0.0,tie,0.0196,MillID
171
+ tzm_Tfng,Central Atlas Tamazight,1,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie,0.0,tie
reports/udhr-common/millid_per_language.csv ADDED
@@ -0,0 +1,171 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
2
+ abk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
3
+ ace_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
4
+ ady_Cyrl,56,52,0,4,11854,1.0,0.928571,0.962963,1.0,0.0,0.928571
5
+ afr_Latn,60,59,0,1,11850,1.0,0.983333,0.991597,1.0,0.0,0.983333
6
+ als_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
7
+ alt_Cyrl,51,51,0,0,11859,1.0,1.0,1.0,1.0,0.0,1.0
8
+ amh_Ethi,51,50,0,1,11859,1.0,0.980392,0.990099,1.0,0.0,0.980392
9
+ arb_Arab,58,46,0,12,11852,1.0,0.793103,0.884615,1.0,0.0,0.793103
10
+ arn_Latn,58,56,0,2,11852,1.0,0.965517,0.982456,1.0,0.0,0.965517
11
+ ast_Latn,58,55,0,3,11852,1.0,0.948276,0.973451,1.0,0.0,0.948276
12
+ ayr_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
13
+ azj_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
14
+ bam_Latn,57,54,20,3,11833,0.72973,0.947368,0.824427,0.998313,1687.336539,0.947368
15
+ ban_Latn,60,57,0,3,11850,1.0,0.95,0.974359,1.0,0.0,0.95
16
+ bel_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
17
+ bem_Latn,57,57,1,0,11852,0.982759,1.0,0.991304,0.999916,84.366827,1.0
18
+ ben_Beng,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
19
+ bho_Deva,56,43,2,13,11852,0.955556,0.767857,0.851485,0.999831,168.71942,0.767857
20
+ bis_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
21
+ bod_Tibt,60,58,1,2,11849,0.983051,0.966667,0.97479,0.999916,84.388186,0.966667
22
+ bos_Latn,59,13,7,46,11844,0.65,0.220339,0.329114,0.999409,590.667454,0.220339
23
+ bug_Latn,60,53,0,7,11850,1.0,0.883333,0.938053,1.0,0.0,0.883333
24
+ bul_Cyrl,58,57,1,1,11851,0.982759,0.982759,0.982759,0.999916,84.373945,0.982759
25
+ cat_Latn,58,58,3,0,11849,0.95082,1.0,0.97479,0.999747,253.121836,1.0
26
+ ceb_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
27
+ ces_Latn,58,56,0,2,11852,1.0,0.965517,0.982456,1.0,0.0,0.965517
28
+ chv_Cyrl,25,25,0,0,11885,1.0,1.0,1.0,1.0,0.0,1.0
29
+ cjk_Latn,114,88,0,26,11796,1.0,0.77193,0.871287,1.0,0.0,0.77193
30
+ cmn_Hani,319,306,14,13,11577,0.95625,0.959248,0.957746,0.998792,1207.833664,0.959248
31
+ crh_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
32
+ cym_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
33
+ dan_Latn,61,58,4,3,11845,0.935484,0.95082,0.943089,0.999662,337.58123,0.95082
34
+ deu_Latn,67,67,0,0,11843,1.0,1.0,1.0,1.0,0.0,1.0
35
+ dyu_Latn,58,0,3,58,11849,0.0,0.0,0.0,0.999747,253.121836,0.0
36
+ dzo_Tibt,59,58,2,1,11849,0.966667,0.983051,0.97479,0.999831,168.76213,0.983051
37
+ ekk_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
38
+ ell_Grek,115,58,0,57,11795,1.0,0.504348,0.67052,1.0,0.0,0.504348
39
+ eng_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
40
+ epo_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
41
+ eus_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
42
+ ewe_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
43
+ fao_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
44
+ fas_Arab,114,112,0,2,11796,1.0,0.982456,0.99115,1.0,0.0,0.982456
45
+ fij_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
46
+ fil_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
47
+ fin_Latn,61,61,0,0,11849,1.0,1.0,1.0,1.0,0.0,1.0
48
+ fon_Latn,58,56,3,2,11849,0.949153,0.965517,0.957265,0.999747,253.121836,0.965517
49
+ fra_Latn,58,44,0,14,11852,1.0,0.758621,0.862745,1.0,0.0,0.758621
50
+ fur_Latn,59,58,2,1,11849,0.966667,0.983051,0.97479,0.999831,168.76213,0.983051
51
+ fuv_Latn,108,56,0,52,11802,1.0,0.518519,0.682927,1.0,0.0,0.518519
52
+ gaz_Latn,60,57,0,3,11850,1.0,0.95,0.974359,1.0,0.0,0.95
53
+ gla_Latn,62,61,0,1,11848,1.0,0.983871,0.99187,1.0,0.0,0.983871
54
+ gle_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
55
+ glg_Latn,58,57,1,1,11851,0.982759,0.982759,0.982759,0.999916,84.373945,0.982759
56
+ gug_Latn,49,49,0,0,11861,1.0,1.0,1.0,1.0,0.0,1.0
57
+ guj_Gujr,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
58
+ hat_Latn,117,116,1,1,11792,0.991453,0.991453,0.991453,0.999915,84.796065,0.991453
59
+ hau_Latn,155,154,0,1,11755,1.0,0.993548,0.996764,1.0,0.0,0.993548
60
+ heb_Hebr,58,56,0,2,11852,1.0,0.965517,0.982456,1.0,0.0,0.965517
61
+ hin_Deva,59,34,1,25,11850,0.971429,0.576271,0.723404,0.999916,84.381065,0.576271
62
+ hrv_Latn,58,43,36,15,11816,0.544304,0.741379,0.627737,0.996963,3037.462032,0.741379
63
+ hun_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
64
+ hye_Armn,70,70,0,0,11840,1.0,1.0,1.0,1.0,0.0,1.0
65
+ ibo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
66
+ ilo_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
67
+ ind_Latn,60,38,1,22,11849,0.974359,0.633333,0.767677,0.999916,84.388186,0.633333
68
+ isl_Latn,58,45,0,13,11852,1.0,0.775862,0.873786,1.0,0.0,0.775862
69
+ ita_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
70
+ jav_Latn,60,59,1,1,11849,0.983333,0.983333,0.983333,0.999916,84.388186,0.983333
71
+ jpn_Jpan,140,140,0,0,11770,1.0,1.0,1.0,1.0,0.0,1.0
72
+ kab_Latn,58,50,0,8,11852,1.0,0.862069,0.925926,1.0,0.0,0.862069
73
+ kal_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
74
+ kan_Knda,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
75
+ kat_Geor,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
76
+ kaz_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
77
+ kbp_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
78
+ kea_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
79
+ khk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
80
+ khm_Khmr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
81
+ kin_Latn,59,41,2,18,11849,0.953488,0.694915,0.803922,0.999831,168.76213,0.694915
82
+ kir_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
83
+ kmb_Latn,116,114,5,2,11789,0.957983,0.982759,0.970213,0.999576,423.944378,0.982759
84
+ kmr_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
85
+ knc_Latn,64,64,0,0,11846,1.0,1.0,1.0,1.0,0.0,1.0
86
+ kng_Latn,115,5,0,110,11795,1.0,0.043478,0.083333,1.0,0.0,0.043478
87
+ kor_Hang,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
88
+ lao_Laoo,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
89
+ lij_Latn,58,58,2,0,11850,0.966667,1.0,0.983051,0.999831,168.747891,1.0
90
+ lin_Latn,110,110,0,0,11800,1.0,1.0,1.0,1.0,0.0,1.0
91
+ lit_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
92
+ ltz_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
93
+ lua_Latn,58,33,1,25,11851,0.970588,0.568966,0.717391,0.999916,84.373945,0.568966
94
+ lug_Latn,49,49,0,0,11861,1.0,1.0,1.0,1.0,0.0,1.0
95
+ lus_Latn,58,57,0,1,11852,1.0,0.982759,0.991304,1.0,0.0,0.982759
96
+ lvs_Latn,115,112,0,3,11795,1.0,0.973913,0.986784,1.0,0.0,0.973913
97
+ mag_Deva,53,46,7,7,11850,0.867925,0.867925,0.867925,0.99941,590.368559,0.867925
98
+ mai_Deva,58,58,8,0,11844,0.878788,1.0,0.935484,0.999325,674.991563,1.0
99
+ mal_Mlym,100,100,0,0,11810,1.0,1.0,1.0,1.0,0.0,1.0
100
+ mar_Deva,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
101
+ min_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
102
+ mkd_Cyrl,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
103
+ mlt_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
104
+ mos_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
105
+ mri_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
106
+ mya_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
107
+ nav_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
108
+ nld_Latn,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
109
+ nno_Latn,58,54,1,4,11851,0.981818,0.931034,0.955752,0.999916,84.373945,0.931034
110
+ nob_Latn,62,58,7,4,11841,0.892308,0.935484,0.913386,0.999409,590.817016,0.935484
111
+ npi_Deva,55,55,0,0,11855,1.0,1.0,1.0,1.0,0.0,1.0
112
+ nso_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
113
+ nya_Latn,116,114,0,2,11794,1.0,0.982759,0.991304,1.0,0.0,0.982759
114
+ oci_Latn,398,64,0,334,11512,1.0,0.160804,0.277056,1.0,0.0,0.160804
115
+ oss_Cyrl,44,44,0,0,11866,1.0,1.0,1.0,1.0,0.0,1.0
116
+ pan_Guru,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
117
+ pap_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
118
+ pcm_Latn,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
119
+ plt_Latn,53,53,0,0,11857,1.0,1.0,1.0,1.0,0.0,1.0
120
+ pol_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
121
+ por_Latn,115,107,2,8,11793,0.981651,0.930435,0.955357,0.99983,169.563374,0.930435
122
+ quy_Latn,60,58,0,2,11850,1.0,0.966667,0.983051,1.0,0.0,0.966667
123
+ roh_Latn,399,395,0,4,11511,1.0,0.989975,0.994962,1.0,0.0,0.989975
124
+ ron_Latn,97,97,0,0,11813,1.0,1.0,1.0,1.0,0.0,1.0
125
+ run_Latn,58,57,17,1,11835,0.77027,0.982759,0.863636,0.998566,1434.357071,0.982759
126
+ rus_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
127
+ sag_Latn,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
128
+ san_Deva,55,53,0,2,11855,1.0,0.963636,0.981481,1.0,0.0,0.963636
129
+ shn_Mymr,56,56,0,0,11854,1.0,1.0,1.0,1.0,0.0,1.0
130
+ sin_Sinh,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
131
+ slk_Latn,56,56,2,0,11852,0.965517,1.0,0.982456,0.999831,168.71942,1.0
132
+ slv_Latn,59,57,1,2,11850,0.982759,0.966102,0.974359,0.999916,84.381065,0.966102
133
+ smo_Latn,63,63,0,0,11847,1.0,1.0,1.0,1.0,0.0,1.0
134
+ sna_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
135
+ som_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
136
+ sot_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
137
+ spa_Latn,78,75,0,3,11832,1.0,0.961538,0.980392,1.0,0.0,0.961538
138
+ srp_Cyrl,59,58,0,1,11851,1.0,0.983051,0.991453,1.0,0.0,0.983051
139
+ ssw_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
140
+ sun_Latn,66,65,0,1,11844,1.0,0.984848,0.992366,1.0,0.0,0.984848
141
+ swe_Latn,61,60,0,1,11849,1.0,0.983607,0.991736,1.0,0.0,0.983607
142
+ swh_Latn,58,49,0,9,11852,1.0,0.844828,0.915888,1.0,0.0,0.844828
143
+ tah_Latn,57,54,0,3,11853,1.0,0.947368,0.972973,1.0,0.0,0.947368
144
+ tam_Taml,68,68,0,0,11842,1.0,1.0,1.0,1.0,0.0,1.0
145
+ tat_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
146
+ tel_Telu,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
147
+ tgk_Cyrl,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
148
+ tha_Thai,114,114,0,0,11796,1.0,1.0,1.0,1.0,0.0,1.0
149
+ tir_Ethi,58,58,1,0,11851,0.983051,1.0,0.991453,0.999916,84.373945,1.0
150
+ ton_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
151
+ tpi_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
152
+ tsn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
153
+ tso_Latn,114,86,0,28,11796,1.0,0.754386,0.86,1.0,0.0,0.754386
154
+ tuk_Latn,59,57,0,2,11851,1.0,0.966102,0.982759,1.0,0.0,0.966102
155
+ tur_Latn,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
156
+ twi_Latn,116,116,0,0,11794,1.0,1.0,1.0,1.0,0.0,1.0
157
+ tzm_Tfng,1,1,0,0,11909,1.0,1.0,1.0,1.0,0.0,1.0
158
+ uig_Arab,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
159
+ ukr_Cyrl,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
160
+ umb_Latn,107,100,0,7,11803,1.0,0.934579,0.966184,1.0,0.0,0.934579
161
+ urd_Arab,108,106,0,2,11802,1.0,0.981481,0.990654,1.0,0.0,0.981481
162
+ uzn_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
163
+ vec_Latn,58,58,0,0,11852,1.0,1.0,1.0,1.0,0.0,1.0
164
+ vie_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
165
+ war_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
166
+ wol_Latn,60,60,0,0,11850,1.0,1.0,1.0,1.0,0.0,1.0
167
+ xho_Latn,58,55,2,3,11850,0.964912,0.948276,0.956522,0.999831,168.747891,0.948276
168
+ ydd_Hebr,59,59,0,0,11851,1.0,1.0,1.0,1.0,0.0,1.0
169
+ yor_Latn,57,57,0,0,11853,1.0,1.0,1.0,1.0,0.0,1.0
170
+ yue_Hani,49,29,0,20,11861,1.0,0.591837,0.74359,1.0,0.0,0.591837
171
+ zul_Latn,58,51,2,7,11850,0.962264,0.87931,0.918919,0.999831,168.747891,0.87931
reports/udhr-common/millid_summary.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "top1_accuracy": 0.9123425692695214,
3
+ "top3_accuracy": 0.9606213266162889,
4
+ "top5_accuracy": 0.9654911838790932,
5
+ "passages": 11910,
6
+ "languages": 170,
7
+ "macro_precision": 0.9794271783100589,
8
+ "macro_recall": 0.9393117513722192,
9
+ "macro_f1": 0.9512636942896991,
10
+ "macro_specificity": 0.9999174355030307,
11
+ "weighted_f1": 0.92868171659548,
12
+ "median_f1": 1.0,
13
+ "languages_f1_at_least_0_9": 149,
14
+ "languages_f1_below_0_5": 4,
15
+ "mean_fp_per_million": 82.56449696922371,
16
+ "micro_f1": 0.9123425692695214
17
+ }