MillID medium, step 56000

README.md

@@ -0,0 +1,209 @@
+---
+library_name: pytorch
+pipeline_tag: text-classification
+tags:
+- language-identification
+datasets:
+- baobabtech/millid-dataset
+---
+
+# MillID medium: MultiLingual Language IDentifier
+
+A byte-level, encoder-only transformer that names the language of a passage: **1641 language-script
+labels** (ISO 639-3 + script, e.g. `eng_Latn`, `amh_Ethi`). 115.0M parameters, trained from
+scratch on [baobabtech/millid-dataset](https://huggingface.co/datasets/baobabtech/millid-dataset).
+
+```python
+from millid import MillID   # millid.py, in this repository
+
+model = MillID.from_pretrained("baobabtech/millid-medium")
+model.predict(["Lave men ou ak savon anvan ou manje."], k=3)
+```
+
+## Architecture
+
+UTF-8 bytes (after Unicode NFKC), each embedded as byte + Unicode script + byte-in-character + hashed character
+2-, 3- and 4-grams (32,768 buckets) -> depthwise convolution stem (kernel 5) -> strided
+convolution, 2 bytes per token -> 12 pre-norm blocks (RMSNorm, attention with RoPE,
+12 heads, SwiGLU; d=768) -> masked mean pooling -> language head, each language's vector the sum of
+its own, its language's and its script's. Up to 256 bytes per passage. See `ARCHITECTURE.md`.
+
+## Evaluation against GlotLID
+
+`validation` chose the checkpoint; `test` is split by document from training; `udhr` is the Universal Declaration
+of Human Rights, labelled by its translators, over the languages MillID knows, and `udhr-all` over all of them.
+`glotlid` is [GlotLID](https://huggingface.co/cis-lmu/glotlid) as it is; `glotlid@millid` is GlotLID restricted to
+MillID's labels, the like-for-like comparison. GlotLID's own labels came from training on data that includes UDHR
+and labelled FinePDFs and FineWeb-2, so its scores on `udhr` and on those sources are optimistic.
+
+| Set | Model | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages |
+|---|---|---|---|---|---|---|---|---|---|
+| validation | millid | 0.9613 | 0.9909 | 0.9949 | 0.9573 | 0.9621 | 0.9583 | 0.9850 | 1626 |
+| test | millid | 0.9568 | 0.9861 | 0.9896 | 0.9545 | 0.9609 | 0.9559 | 0.9839 | 1621 |
+| test | glotlid | 0.9727 | 0.9928 | 0.9936 | 0.9780 | 0.9746 | 0.9743 | 1.0000 | 1621 |
+| test | glotlid@millid | 0.9734 | 0.9929 | 0.9936 | 0.9717 | 0.9759 | 0.9710 | 1.0000 | 1621 |
+| udhr | millid | 0.8524 | 0.9194 | 0.9341 | 0.9187 | 0.8770 | 0.8781 | 0.9910 | 358 |
+| udhr | glotlid | 0.8598 | 0.9280 | 0.9421 | 0.9261 | 0.8826 | 0.8865 | 0.9915 | 358 |
+| udhr | glotlid@millid | 0.8614 | 0.9294 | 0.9433 | 0.9258 | 0.8844 | 0.8873 | 0.9915 | 358 |
+| udhr-all | millid | 0.7301 | 0.7875 | 0.8001 | 0.7416 | 0.7318 | 0.7184 | 0.9672 | 429 |
+| udhr-all | glotlid | 0.7502 | 0.8145 | 0.8282 | 0.7695 | 0.7529 | 0.7454 | 0.9796 | 429 |
+| udhr-all | glotlid@millid | 0.7378 | 0.7960 | 0.8079 | 0.7425 | 0.7381 | 0.7245 | 0.9748 | 429 |
+
+Top-1 accuracy by passage length:
+
+| Set | Model | short | sentence | paragraph |
+|---|---|---|---|---|
+| validation | millid | 0.9363 | 0.9818 | 0.9858 |
+| test | millid | 0.9323 | 0.9781 | 0.9790 |
+| test | glotlid | 0.9603 | 0.9825 | 0.9855 |
+| test | glotlid@millid | 0.9614 | 0.9830 | 0.9856 |
+
+### Leaderboard: test
+
+MillID's F1 against GlotLID's, language by language. Against GlotLID restricted to MillID's labels, MillID is
+better on **122** languages, worse on **774**, and within 0.01 on 725. The full table, with precision and
+recall, is `reports/test/leaderboard.csv`.
+
+The 20 languages with the most passages:
+
+| Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted |
+|---|---|---|---|---|---|
+| `fra_Latn` | French | 1655 | 0.951 | 0.927 | 0.927 |
+| `rus_Cyrl` | Russian | 1538 | 0.459 | 0.490 | 0.490 |
+| `eng_Latn` | English | 1444 | 0.875 | 0.837 | 0.837 |
+| `spa_Latn` | Spanish | 1136 | 0.941 | 0.950 | 0.950 |
+| `tam_Taml` | Tamil | 754 | 0.997 | 0.993 | 0.993 |
+| `arb_Arab` | Arabic (Modern Standard) | 745 | 0.814 | 0.774 | 0.774 |
+| `por_Latn` | Portuguese | 657 | 0.955 | 0.947 | 0.946 |
+| `ekk_Latn` | Estonian | 615 | 0.784 | 0.807 | 0.807 |
+| `kan_Knda` | Kannada | 601 | 0.982 | 0.993 | 0.993 |
+| `zul_Latn` | Zulu | 594 | 0.833 | 0.896 | 0.896 |
+| `swh_Latn` | Swahili | 592 | 0.856 | 0.918 | 0.916 |
+| `mar_Deva` | Marathi | 589 | 0.981 | 0.989 | 0.990 |
+| `tso_Latn` | Tsonga | 581 | 0.970 | 0.956 | 0.956 |
+| `hun_Latn` | Hungarian | 576 | 0.990 | 0.998 | 0.998 |
+| `afr_Latn` | Afrikaans | 569 | 0.973 | 0.985 | 0.985 |
+| `tel_Telu` | Telugu | 555 | 0.994 | 0.994 | 0.992 |
+| `nbl_Latn` | South Ndebele | 528 | 0.895 | 0.948 | 0.949 |
+| `ory_Orya` | Odia (individual language) | 511 | 0.993 | 0.991 | 0.994 |
+| `sot_Latn` | Southern Sotho | 491 | 0.966 | 0.977 | 0.978 |
+| `nso_Latn` | Northern Sotho | 479 | 0.960 | 0.968 | 0.968 |
+
+Where MillID gains most:
+
+| Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted |
+|---|---|---|---|---|---|
+| `lbj_Tibt` | Ladakhi | 66 | 0.943 | 0.000 | 0.000 |
+| `und_Lina` | und | 22 | 1.000 | 0.978 | 0.216 |
+| `ain_Latn` | Ainu | 1 | 0.667 | 0.000 | 0.000 |
+| `und_Xsux` | und | 43 | 1.000 | 0.989 | 0.345 |
+| `und_Thaa` | und | 29 | 0.873 | 0.651 | 0.224 |
+| `und_Tang` | und | 28 | 0.982 | 0.949 | 0.471 |
+| `und_Geor` | und | 32 | 0.706 | 0.694 | 0.243 |
+| `und_Bamu` | und | 18 | 1.000 | 1.000 | 0.571 |
+| `und_Vaii` | und | 12 | 1.000 | 0.960 | 0.585 |
+| `und_Hluw` | und | 16 | 1.000 | 0.941 | 0.604 |
+| `und_Deva` | und | 5 | 0.667 | 0.727 | 0.286 |
+| `ajp_Arab` | South Levantine Arabic | 28 | 0.902 | 0.581 | 0.581 |
+| `und_Cyrl` | und | 78 | 0.932 | 0.969 | 0.622 |
+| `und_Egyp` | und | 37 | 1.000 | 1.000 | 0.705 |
+| `und_Yiii` | und | 38 | 1.000 | 0.894 | 0.752 |
+
+Where MillID loses most:
+
+| Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted |
+|---|---|---|---|---|---|
+| `dop_Latn` | Lukpa | 132 | 0.253 | 1.000 | 1.000 |
+| `ccp_Latn` | Chakma | 3 | 0.333 | 1.000 | 1.000 |
+| `ttj_Latn` | Tooro | 28 | 0.490 | 0.945 | 0.945 |
+| `hak_Hani` | Hakka Chinese | 29 | 0.415 | 0.824 | 0.824 |
+| `nnw_Latn` | Southern Nuni | 40 | 0.593 | 1.000 | 1.000 |
+| `mkl_Latn` | Mokole | 50 | 0.637 | 1.000 | 1.000 |
+| `mus_Latn` | Muscogee | 2 | 0.667 | 1.000 | 1.000 |
+| `biu_Latn` | Biete | 7 | 0.667 | 1.000 | 1.000 |
+| `knc_Arab` | Central Kanuri | 68 | 0.500 | 0.823 | 0.825 |
+| `bdq_Latn` | Bahnar | 9 | 0.500 | 0.800 | 0.800 |
+| `esi_Latn` | North Alaskan Inupiatun | 9 | 0.500 | 0.783 | 0.783 |
+| `hrv_Latn` | Croatian | 168 | 0.689 | 0.944 | 0.944 |
+| `dks_Latn` | Southeastern Dinka | 3 | 0.750 | 1.000 | 1.000 |
+| `tui_Latn` | Tupuri | 4 | 0.750 | 0.667 | 1.000 |
+| `nse_Latn` | Nsenga | 12 | 0.500 | 0.750 | 0.750 |
+
+### Leaderboard: udhr
+
+MillID's F1 against GlotLID's, language by language. Against GlotLID restricted to MillID's labels, MillID is
+better on **63** languages, worse on **95**, and within 0.01 on 200. The full table, with precision and
+recall, is `reports/udhr/leaderboard.csv`.
+
+The 20 languages with the most passages:
+
+| Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted |
+|---|---|---|---|---|---|
+| `roh_Latn` | Romansh | 399 | 0.991 | 0.999 | 0.999 |
+| `oci_Latn` | Occitan | 398 | 0.331 | 0.376 | 0.376 |
+| `cmn_Hani` | Chinese (Mandarin) | 319 | 0.886 | 0.868 | 0.868 |
+| `krl_Latn` | Karelian | 183 | 0.000 | 0.011 | 0.011 |
+| `qug_Latn` | Chimborazo Highland Quichua | 182 | 0.000 | 0.000 | 0.000 |
+| `acu_Latn` | Achuar-Shiwiar | 180 | 0.747 | 0.854 | 0.854 |
+| `hus_Latn` | Huastec | 175 | 0.991 | 0.986 | 0.986 |
+| `hau_Latn` | Hausa | 155 | 0.997 | 1.000 | 1.000 |
+| `auc_Latn` | Waorani | 154 | 0.050 | 0.000 | 0.000 |
+| `kwi_Latn` | Awa-Cuaiquer | 145 | 0.775 | 0.877 | 0.877 |
+| `jpn_Jpan` | Japanese | 140 | 1.000 | 1.000 | 1.000 |
+| `snn_Latn` | Siona | 136 | 0.773 | 0.514 | 0.514 |
+| `ktu_Latn` | Kituba (Democratic Republic of Congo) | 118 | 0.769 | 0.680 | 0.680 |
+| `lat_Latn` | Latin | 118 | 0.996 | 0.991 | 0.991 |
+| `hat_Latn` | Haitian Creole | 117 | 0.991 | 0.979 | 0.979 |
+| `nya_Latn` | Nyanja | 116 | 0.987 | 1.000 | 1.000 |
+| `kmb_Latn` | Kimbundu | 116 | 0.979 | 1.000 | 1.000 |
+| `rmn_Latn` | Balkan Romani | 116 | 0.667 | 0.857 | 0.857 |
+| `twi_Latn` | Twi | 116 | 0.987 | 0.996 | 0.996 |
+| `chr_Cher` | Cherokee | 115 | 0.715 | 0.663 | 0.663 |
+
+Where MillID gains most:
+
+| Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted |
+|---|---|---|---|---|---|
+| `mic_Latn` | Mi'kmaw | 59 | 1.000 | 0.427 | 0.427 |
+| `tet_Latn` | Tetum | 58 | 0.699 | 0.167 | 0.167 |
+| `skr_Arab` | Saraiki | 63 | 0.923 | 0.500 | 0.500 |
+| `sag_Latn` | Sango | 59 | 0.991 | 0.578 | 0.578 |
+| `zgh_Tfng` | Standard Moroccan Tamazight | 60 | 0.824 | 0.462 | 0.462 |
+| `fuf_Latn` | Pular | 58 | 0.816 | 0.483 | 0.483 |
+| `tzm_Tfng` | Central Atlas Tamazight | 1 | 0.333 | 0.065 | 0.065 |
+| `snn_Latn` | Siona | 136 | 0.773 | 0.514 | 0.514 |
+| `bum_Latn` | Bulu | 58 | 0.319 | 0.098 | 0.098 |
+| `mxv_Latn` | Metlatónoc Mixtec | 58 | 0.215 | 0.000 | 0.000 |
+| `pnb_Arab` | Western Panjabi | 61 | 0.931 | 0.739 | 0.739 |
+| `lld_Latn` | Ladin | 59 | 0.899 | 0.731 | 0.731 |
+| `tah_Latn` | Tahitian | 57 | 0.973 | 0.813 | 0.813 |
+| `pbb_Latn` | Páez | 56 | 0.848 | 0.713 | 0.713 |
+| `eve_Cyrl` | Even | 49 | 0.990 | 0.886 | 0.886 |
+
+Where MillID loses most:
+
+| Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted |
+|---|---|---|---|---|---|
+| `gyr_Latn` | Guarayu | 49 | 0.339 | 0.990 | 0.990 |
+| `cbu_Latn` | Candoshi-Shapra | 57 | 0.371 | 0.882 | 0.874 |
+| `shp_Latn` | Shipibo-Conibo | 62 | 0.410 | 0.912 | 0.912 |
+| `dyu_Latn` | Dyula | 58 | 0.000 | 0.434 | 0.434 |
+| `qvm_Latn` | Margos-Yarowilca-Lauricocha Quechua | 60 | 0.094 | 0.500 | 0.500 |
+| `cpu_Latn` | Pichis Ashéninka | 60 | 0.571 | 0.974 | 0.974 |
+| `hin_Deva` | Hindi | 59 | 0.607 | 0.957 | 0.957 |
+| `ell_Grek` | Greek | 115 | 0.655 | 1.000 | 1.000 |
+| `bho_Deva` | Bhojpuri | 56 | 0.643 | 0.933 | 0.933 |
+| `fuv_Latn` | Nigerian Fulfulde | 108 | 0.405 | 0.681 | 0.689 |
+| `cni_Latn` | Asháninka | 52 | 0.707 | 0.963 | 0.963 |
+| `qvn_Latn` | North Junín Quechua | 57 | 0.219 | 0.459 | 0.459 |
+| `ind_Latn` | Indonesian | 60 | 0.674 | 0.903 | 0.903 |
+| `maz_Latn` | Central Mazahua | 59 | 0.742 | 0.939 | 0.939 |
+| `rmn_Latn` | Balkan Romani | 116 | 0.667 | 0.857 | 0.857 |
+
+Per-language precision, recall (sensitivity), F1 and specificity for every model are in `reports/<set>/`.
+
+## Training
+
+1,944,095 passages, best validation macro F1 at step 56000, 3.4 hours.
+Languages sampled in proportion to n^0.3; 25% of passages cut to a 20 to 80 character
+snippet; batch 512, AdamW at 0.0003, cosine schedule, label smoothing 0.1.

config.json

@@ -0,0 +1,62 @@
+{
+  "model": {
+    "num_labels": 1641,
+    "max_len": 256,
+    "d_model": 768,
+    "n_layers": 12,
+    "n_heads": 12,
+    "dropout": 0.1,
+    "conv_kernel": 5,
+    "downsample": 2,
+    "ngram_buckets": 32768,
+    "script_buckets": 512,
+    "rope_theta": 10000.0,
+    "vocab_size": 259,
+    "modalities": [
+      "text"
+    ],
+    "model_type": "millid-byte-encoder"
+  },
+  "training": {
+    "dataset": "baobabtech/millid-dataset",
+    "preset": "medium",
+    "max_len": 256,
+    "steps": 60000,
+    "batch_size": 512,
+    "lr": 0.0003,
+    "warmup": 2000,
+    "weight_decay": 0.01,
+    "dropout": 0.1,
+    "label_smoothing": 0.1,
+    "alpha": 0.3,
+    "short_p": 0.25,
+    "eval_every": 2000,
+    "eval_per_label": 20,
+    "patience": 12000,
+    "commercial_only": false,
+    "extra": [],
+    "compare_glotlid": true,
+    "final_eval": "all",
+    "output_dir": "millid-out",
+    "push_to": "baobabtech/millid-medium",
+    "public": false,
+    "seed": 7,
+    "log_every": 100,
+    "threads": 0,
+    "workers": 12,
+    "compile": false,
+    "wandb_project": "millid",
+    "wandb_entity": "mscsr000324-must",
+    "wandb_run_name": "millid-medium",
+    "wandb_tags": [
+      "medium",
+      "v1"
+    ],
+    "no_wandb": false
+  },
+  "best_step": 56000,
+  "parameters": 114986601,
+  "train_passages": 1944095,
+  "trained_labels": 1641,
+  "seconds": 12300
+}

labels.json

@@ -0,0 +1,3320 @@
+{
+ "scheme": "ISO 639-3 language + '_' + ISO 15924 script, e.g. eng_Latn, amh_Ethi",
+ "text_encoding": "Unicode NFKC, whitespace collapsed, then UTF-8 bytes",
+ "labels": [
+  "aai_Latn",
+  "aak_Latn",
+  "aau_Latn",
+  "aaz_Latn",
+  "aba_Latn",
+  "abk_Cyrl",
+  "abn_Latn",
+  "abq_Cyrl",
+  "abs_Latn",
+  "abt_Latn",
+  "abx_Latn",
+  "aby_Latn",
+  "abz_Latn",
+  "aca_Latn",
+  "acd_Latn",
+  "ace_Latn",
+  "acf_Latn",
+  "ach_Latn",
+  "acm_Arab",
+  "acn_Latn",
+  "acr_Latn",
+  "acu_Latn",
+  "ada_Latn",
+  "ade_Latn",
+  "adh_Latn",
+  "adi_Latn",
+  "adj_Latn",
+  "ady_Cyrl",
+  "adz_Latn",
+  "aeb_Arab",
+  "aeb_Latn",
+  "aer_Latn",
+  "aeu_Latn",
+  "aey_Latn",
+  "afr_Latn",
+  "agd_Latn",
+  "agg_Latn",
+  "agm_Latn",
+  "agn_Latn",
+  "agr_Latn",
+  "agt_Latn",
+  "agu_Latn",
+  "agx_Cyrl",
+  "ahk_Latn",
+  "aia_Latn",
+  "aii_Syrc",
+  "ain_Latn",
+  "ajg_Latn",
+  "aji_Latn",
+  "ajp_Arab",
+  "akb_Latn",
+  "ake_Latn",
+  "akh_Latn",
+  "akp_Latn",
+  "aln_Latn",
+  "alp_Latn",
+  "alq_Latn",
+  "als_Latn",
+  "alt_Cyrl",
+  "aly_Latn",
+  "alz_Latn",
+  "ame_Latn",
+  "amf_Latn",
+  "amh_Ethi",
+  "ami_Latn",
+  "amk_Latn",
+  "amm_Latn",
+  "amn_Latn",
+  "amp_Latn",
+  "amr_Latn",
+  "amu_Latn",
+  "amx_Latn",
+  "ang_Latn",
+  "ann_Latn",
+  "anp_Deva",
+  "anv_Latn",
+  "any_Latn",
+  "aoi_Latn",
+  "aoj_Latn",
+  "aom_Latn",
+  "aoz_Latn",
+  "apb_Latn",
+  "apc_Arab",
+  "ape_Latn",
+  "apn_Latn",
+  "apr_Latn",
+  "apt_Latn",
+  "apu_Latn",
+  "apw_Latn",
+  "apy_Latn",
+  "apz_Latn",
+  "arb_Arab",
+  "arb_Latn",
+  "are_Latn",
+  "arg_Latn",
+  "arl_Latn",
+  "arn_Latn",
+  "arp_Latn",
+  "arq_Arab",
+  "ars_Arab",
+  "ary_Arab",
+  "arz_Arab",
+  "asm_Beng",
+  "asm_Latn",
+  "aso_Latn",
+  "ast_Latn",
+  "ata_Latn",
+  "atb_Latn",
+  "atd_Latn",
+  "atg_Latn",
+  "ati_Latn",
+  "atj_Latn",
+  "att_Latn",
+  "auc_Latn",
+  "aui_Latn",
+  "auy_Latn",
+  "ava_Cyrl",
+  "avk_Latn",
+  "avt_Latn",
+  "avu_Latn",
+  "awa_Deva",
+  "awb_Latn",
+  "awx_Latn",
+  "ayp_Arab",
+  "ayr_Latn",
+  "azb_Arab",
+  "azg_Latn",
+  "azj_Cyrl",
+  "azj_Latn",
+  "azz_Latn",
+  "bak_Cyrl",
+  "bam_Latn",
+  "ban_Latn",
+  "bao_Latn",
+  "bar_Latn",
+  "bas_Latn",
+  "bba_Latn",
+  "bbb_Latn",
+  "bbc_Latn",
+  "bbr_Latn",
+  "bcc_Arab",
+  "bch_Latn",
+  "bci_Latn",
+  "bcl_Latn",
+  "bco_Latn",
+  "bcw_Latn",
+  "bdd_Latn",
+  "bdh_Latn",
+  "bdq_Latn",
+  "bea_Latn",
+  "bef_Latn",
+  "bel_Cyrl",
+  "bem_Latn",
+  "ben_Beng",
+  "ben_Latn",
+  "beq_Latn",
+  "bew_Latn",
+  "bfd_Latn",
+  "bgr_Latn",
+  "bgs_Latn",
+  "bgt_Latn",
+  "bgz_Latn",
+  "bhg_Latn",
+  "bhl_Latn",
+  "bho_Deva",
+  "bhw_Latn",
+  "bib_Latn",
+  "big_Latn",
+  "bim_Latn",
+  "bin_Latn",
+  "bis_Latn",
+  "biu_Latn",
+  "biv_Latn",
+  "bjn_Arab",
+  "bjn_Latn",
+  "bjp_Latn",
+  "bjr_Latn",
+  "bjv_Latn",
+  "bkd_Latn",
+  "bkq_Latn",
+  "bku_Latn",
+  "bla_Latn",
+  "blh_Latn",
+  "blk_Mymr",
+  "blt_Latn",
+  "blw_Latn",
+  "blz_Latn",
+  "bmh_Latn",
+  "bmk_Latn",
+  "bmq_Latn",
+  "bmr_Latn",
+  "bmu_Latn",
+  "bno_Latn",
+  "bnp_Latn",
+  "boa_Latn",
+  "bod_Tibt",
+  "boj_Latn",
+  "bon_Latn",
+  "bos_Latn",
+  "box_Latn",
+  "bpr_Latn",
+  "bps_Latn",
+  "bpy_Beng",
+  "bqc_Latn",
+  "bqp_Latn",
+  "bre_Latn",
+  "brh_Arab",
+  "bru_Latn",
+  "brx_Deva",
+  "bsn_Latn",
+  "bsp_Latn",
+  "bsq_Latn",
+  "bss_Latn",
+  "btd_Latn",
+  "bth_Latn",
+  "bts_Latn",
+  "btx_Latn",
+  "bud_Latn",
+  "bug_Latn",
+  "buk_Latn",
+  "bul_Cyrl",
+  "bum_Latn",
+  "bus_Latn",
+  "bvd_Latn",
+  "bvr_Latn",
+  "bvz_Latn",
+  "bwd_Latn",
+  "bwu_Latn",
+  "bxh_Latn",
+  "bxr_Cyrl",
+  "byr_Latn",
+  "byx_Latn",
+  "bzd_Latn",
+  "bzh_Latn",
+  "bzi_Thai",
+  "bzj_Latn",
+  "caa_Latn",
+  "cab_Latn",
+  "cac_Latn",
+  "caf_Latn",
+  "cag_Latn",
+  "cak_Latn",
+  "cao_Latn",
+  "cap_Latn",
+  "caq_Latn",
+  "car_Latn",
+  "cas_Latn",
+  "cat_Latn",
+  "cav_Latn",
+  "cax_Latn",
+  "cbc_Latn",
+  "cbi_Latn",
+  "cbk_Latn",
+  "cbr_Latn",
+  "cbs_Latn",
+  "cbt_Latn",
+  "cbu_Latn",
+  "cbv_Latn",
+  "cce_Latn",
+  "cco_Latn",
+  "ccp_Latn",
+  "ceb_Latn",
+  "ceg_Latn",
+  "cek_Latn",
+  "ces_Latn",
+  "cfm_Latn",
+  "cgc_Latn",
+  "cha_Latn",
+  "chd_Latn",
+  "che_Cyrl",
+  "chf_Latn",
+  "chk_Latn",
+  "cho_Latn",
+  "chq_Latn",
+  "chr_Cher",
+  "chu_Cyrl",
+  "chv_Cyrl",
+  "chw_Latn",
+  "chz_Latn",
+  "cjk_Latn",
+  "cjp_Latn",
+  "cjs_Cyrl",
+  "cjv_Latn",
+  "ckb_Arab",
+  "ckm_Latn",
+  "cko_Latn",
+  "ckt_Cyrl",
+  "clu_Latn",
+  "cme_Latn",
+  "cmn_Hani",
+  "cmo_Latn",
+  "cnh_Latn",
+  "cni_Latn",
+  "cnk_Latn",
+  "cnr_Latn",
+  "cnw_Latn",
+  "coe_Latn",
+  "cof_Latn",
+  "cok_Latn",
+  "con_Latn",
+  "cop_Copt",
+  "cor_Latn",
+  "cos_Latn",
+  "cot_Latn",
+  "cpb_Latn",
+  "cpc_Latn",
+  "cpu_Latn",
+  "cpy_Latn",
+  "crh_Cyrl",
+  "crh_Latn",
+  "crj_Cans",
+  "crk_Cans",
+  "crk_Latn",
+  "crl_Cans",
+  "crm_Cans",
+  "crn_Latn",
+  "crs_Latn",
+  "crx_Latn",
+  "csb_Latn",
+  "csw_Latn",
+  "csy_Latn",
+  "cta_Latn",
+  "ctd_Latn",
+  "cto_Latn",
+  "ctp_Latn",
+  "ctu_Latn",
+  "cub_Latn",
+  "cui_Latn",
+  "cuk_Latn",
+  "cul_Latn",
+  "cut_Latn",
+  "cux_Latn",
+  "cwe_Latn",
+  "cwt_Latn",
+  "cya_Latn",
+  "cym_Latn",
+  "czt_Latn",
+  "daa_Latn",
+  "dad_Latn",
+  "daf_Latn",
+  "dag_Latn",
+  "dah_Latn",
+  "dak_Latn",
+  "dan_Latn",
+  "dar_Cyrl",
+  "ddg_Latn",
+  "ded_Latn",
+  "des_Latn",
+  "deu_Latn",
+  "dga_Latn",
+  "dgc_Latn",
+  "dgi_Latn",
+  "dgr_Latn",
+  "dgz_Latn",
+  "dhm_Latn",
+  "dhv_Latn",
+  "dig_Latn",
+  "dik_Latn",
+  "diq_Latn",
+  "diu_Latn",
+  "div_Thaa",
+  "dje_Latn",
+  "djk_Latn",
+  "djr_Latn",
+  "dks_Latn",
+  "dng_Cyrl",
+  "dnj_Latn",
+  "dnw_Latn",
+  "dob_Latn",
+  "doi_Deva",
+  "dop_Latn",
+  "dos_Latn",
+  "drg_Latn",
+  "dru_Latn",
+  "dsb_Latn",
+  "dtp_Latn",
+  "dts_Latn",
+  "dua_Latn",
+  "duo_Latn",
+  "dur_Latn",
+  "dwr_Latn",
+  "dww_Latn",
+  "dyi_Latn",
+  "dyo_Latn",
+  "dyu_Latn",
+  "dzo_Tibt",
+  "ebk_Latn",
+  "efi_Latn",
+  "ekk_Latn",
+  "eko_Latn",
+  "ell_Grek",
+  "emi_Latn",
+  "eml_Latn",
+  "emp_Latn",
+  "enb_Latn",
+  "eng_Latn",
+  "enl_Latn",
+  "enm_Latn",
+  "enq_Latn",
+  "epo_Latn",
+  "eri_Latn",
+  "ese_Latn",
+  "esi_Latn",
+  "esk_Latn",
+  "ess_Latn",
+  "esu_Latn",
+  "etr_Latn",
+  "eus_Latn",
+  "eve_Cyrl",
+  "ewe_Latn",
+  "ewo_Latn",
+  "ext_Latn",
+  "eza_Latn",
+  "faa_Latn",
+  "fai_Latn",
+  "fal_Latn",
+  "fan_Latn",
+  "fao_Latn",
+  "far_Latn",
+  "fas_Arab",
+  "fat_Latn",
+  "ffm_Latn",
+  "fij_Latn",
+  "fil_Latn",
+  "fin_Latn",
+  "fit_Latn",
+  "fkv_Latn",
+  "fon_Latn",
+  "for_Latn",
+  "fra_Latn",
+  "frd_Latn",
+  "fro_Latn",
+  "frp_Latn",
+  "frr_Latn",
+  "fry_Latn",
+  "fub_Latn",
+  "fue_Latn",
+  "fuf_Latn",
+  "fuh_Latn",
+  "fur_Latn",
+  "fuv_Arab",
+  "fuv_Latn",
+  "gaa_Latn",
+  "gag_Cyrl",
+  "gag_Latn",
+  "gah_Latn",
+  "gai_Latn",
+  "gam_Latn",
+  "gaw_Latn",
+  "gaz_Latn",
+  "gbi_Latn",
+  "gbo_Latn",
+  "gcf_Latn",
+  "gcr_Latn",
+  "gde_Latn",
+  "gdg_Latn",
+  "gdn_Latn",
+  "gdr_Latn",
+  "geb_Latn",
+  "gfk_Latn",
+  "ghs_Latn",
+  "gil_Latn",
+  "gjn_Latn",
+  "gkn_Latn",
+  "gla_Latn",
+  "gle_Latn",
+  "glg_Latn",
+  "glk_Arab",
+  "glv_Latn",
+  "gmh_Latn",
+  "gmv_Ethi",
+  "gmv_Latn",
+  "gnb_Latn",
+  "gnd_Latn",
+  "gng_Latn",
+  "gnn_Latn",
+  "gnw_Latn",
+  "gof_Ethi",
+  "gof_Latn",
+  "gog_Latn",
+  "goh_Latn",
+  "gom_Deva",
+  "gom_Latn",
+  "gor_Latn",
+  "gos_Latn",
+  "got_Goth",
+  "gqr_Latn",
+  "grc_Grek",
+  "grt_Beng",
+  "gso_Latn",
+  "gsw_Latn",
+  "gub_Latn",
+  "guc_Latn",
+  "gug_Latn",
+  "guh_Latn",
+  "gui_Latn",
+  "guj_Gujr",
+  "guj_Latn",
+  "guk_Ethi",
+  "gul_Latn",
+  "gum_Latn",
+  "gun_Latn",
+  "guo_Latn",
+  "guq_Latn",
+  "gur_Latn",
+  "guw_Latn",
+  "gux_Latn",
+  "guz_Latn",
+  "gvc_Latn",
+  "gvf_Latn",
+  "gvl_Latn",
+  "gvn_Latn",
+  "gwi_Latn",
+  "gym_Latn",
+  "gyr_Latn",
+  "hac_Arab",
+  "hae_Latn",
+  "hag_Latn",
+  "hak_Hani",
+  "hak_Latn",
+  "hat_Latn",
+  "hau_Latn",
+  "hav_Latn",
+  "haw_Latn",
+  "hay_Latn",
+  "hbo_Hebr",
+  "hch_Latn",
+  "heb_Hebr",
+  "heg_Latn",
+  "heh_Latn",
+  "her_Latn",
+  "hif_Latn",
+  "hig_Latn",
+  "hil_Latn",
+  "hin_Deva",
+  "hin_Latn",
+  "hix_Latn",
+  "hla_Latn",
+  "hmo_Latn",
+  "hmr_Latn",
+  "hne_Deva",
+  "hnj_Latn",
+  "hnn_Latn",
+  "hns_Latn",
+  "hop_Latn",
+  "hot_Latn",
+  "hra_Latn",
+  "hrv_Latn",
+  "hrx_Latn",
+  "hsb_Latn",
+  "hto_Latn",
+  "hub_Latn",
+  "hui_Latn",
+  "hun_Latn",
+  "hus_Latn",
+  "huu_Latn",
+  "huv_Latn",
+  "hvn_Latn",
+  "hwc_Latn",
+  "hye_Armn",
+  "hyw_Armn",
+  "ian_Latn",
+  "iba_Latn",
+  "ibg_Latn",
+  "ibo_Latn",
+  "icr_Latn",
+  "ido_Latn",
+  "idu_Latn",
+  "ifb_Latn",
+  "ife_Latn",
+  "ifk_Latn",
+  "ifu_Latn",
+  "ify_Latn",
+  "ige_Latn",
+  "ign_Latn",
+  "ike_Cans",
+  "ikk_Latn",
+  "ikt_Latn",
+  "ikw_Latn",
+  "ile_Latn",
+  "ilo_Latn",
+  "imo_Latn",
+  "ina_Latn",
+  "inb_Latn",
+  "ind_Latn",
+  "inh_Cyrl",
+  "ino_Latn",
+  "iou_Latn",
+  "ipi_Latn",
+  "irk_Latn",
+  "isd_Latn",
+  "ish_Latn",
+  "isl_Latn",
+  "iso_Latn",
+  "ita_Latn",
+  "itv_Latn",
+  "ium_Latn",
+  "ivv_Latn",
+  "iws_Latn",
+  "ixl_Latn",
+  "izr_Latn",
+  "izz_Latn",
+  "jac_Latn",
+  "jae_Latn",
+  "jam_Latn",
+  "jav_Latn",
+  "jbo_Latn",
+  "jbu_Latn",
+  "jic_Latn",
+  "jiv_Latn",
+  "jpn_Jpan",
+  "jra_Latn",
+  "jvn_Latn",
+  "kaa_Cyrl",
+  "kaa_Latn",
+  "kab_Latn",
+  "kac_Latn",
+  "kal_Latn",
+  "kam_Latn",
+  "kan_Knda",
+  "kan_Latn",
+  "kao_Latn",
+  "kaq_Latn",
+  "kas_Arab",
+  "kas_Deva",
+  "kat_Geor",
+  "kaz_Cyrl",
+  "kbc_Latn",
+  "kbd_Cyrl",
+  "kbh_Latn",
+  "kbm_Latn",
+  "kbp_Latn",
+  "kbq_Latn",
+  "kbr_Latn",
+  "kby_Latn",
+  "kca_Cyrl",
+  "kcg_Latn",
+  "kck_Latn",
+  "kdc_Latn",
+  "kde_Latn",
+  "kdh_Latn",
+  "kdi_Latn",
+  "kdl_Latn",
+  "kea_Latn",
+  "kek_Latn",
+  "ken_Latn",
+  "keo_Latn",
+  "kew_Latn",
+  "kez_Latn",
+  "kff_Telu",
+  "kgf_Latn",
+  "kgk_Latn",
+  "kgp_Latn",
+  "kha_Latn",
+  "khk_Cyrl",
+  "khm_Khmr",
+  "khs_Latn",
+  "khz_Latn",
+  "kij_Latn",
+  "kik_Latn",
+  "kin_Latn",
+  "kir_Cyrl",
+  "kiu_Latn",
+  "kix_Latn",
+  "kjb_Latn",
+  "kje_Latn",
+  "kjh_Cyrl",
+  "kjs_Latn",
+  "kkc_Latn",
+  "kki_Latn",
+  "kkj_Latn",
+  "kkl_Latn",
+  "klt_Latn",
+  "klv_Latn",
+  "kmb_Latn",
+  "kmg_Latn",
+  "kmh_Latn",
+  "kmk_Latn",
+  "kmm_Latn",
+  "kmo_Latn",
+  "kmr_Cyrl",
+  "kmr_Latn",
+  "kms_Latn",
+  "kmu_Latn",
+  "kmy_Latn",
+  "knc_Arab",
+  "knc_Latn",
+  "kne_Latn",
+  "knf_Latn",
+  "kng_Latn",
+  "knj_Latn",
+  "knk_Latn",
+  "knv_Latn",
+  "koi_Cyrl",
+  "koo_Latn",
+  "kor_Hang",
+  "kos_Latn",
+  "kpe_Latn",
+  "kpf_Latn",
+  "kpg_Latn",
+  "kpj_Latn",
+  "kpr_Latn",
+  "kpv_Cyrl",
+  "kpw_Latn",
+  "kpx_Latn",
+  "kpz_Latn",
+  "kqc_Latn",
+  "kqe_Latn",
+  "kqf_Latn",
+  "kqn_Latn",
+  "kqp_Latn",
+  "kqw_Latn",
+  "krc_Cyrl",
+  "kri_Latn",
+  "krj_Latn",
+  "krl_Latn",
+  "kru_Deva",
+  "ksc_Latn",
+  "ksd_Latn",
+  "ksh_Latn",
+  "ksp_Latn",
+  "ksr_Latn",
+  "kss_Latn",
+  "ksw_Mymr",
+  "ktj_Latn",
+  "kto_Latn",
+  "ktu_Latn",
+  "ktz_Latn",
+  "kua_Latn",
+  "kud_Latn",
+  "kue_Latn",
+  "kum_Cyrl",
+  "kup_Latn",
+  "kus_Latn",
+  "kvg_Latn",
+  "kvn_Latn",
+  "kwd_Latn",
+  "kwf_Latn",
+  "kwi_Latn",
+  "kwj_Latn",
+  "kwn_Latn",
+  "kwy_Latn",
+  "kxc_Ethi",
+  "kxw_Latn",
+  "kyc_Latn",
+  "kyf_Latn",
+  "kyg_Latn",
+  "kyq_Latn",
+  "kyu_Kali",
+  "kyz_Latn",
+  "kze_Latn",
+  "kzj_Latn",
+  "lac_Latn",
+  "lad_Hebr",
+  "lad_Latn",
+  "lai_Latn",
+  "laj_Latn",
+  "lam_Latn",
+  "lao_Laoo",
+  "lat_Latn",
+  "lbb_Latn",
+  "lbe_Cyrl",
+  "lbj_Tibt",
+  "lbk_Latn",
+  "lcm_Latn",
+  "lcp_Thai",
+  "ldi_Latn",
+  "lee_Latn",
+  "lef_Latn",
+  "leh_Latn",
+  "leu_Latn",
+  "lew_Latn",
+  "lex_Latn",
+  "lez_Cyrl",
+  "lfn_Cyrl",
+  "lfn_Latn",
+  "lgg_Latn",
+  "lgl_Latn",
+  "lhu_Latn",
+  "lia_Latn",
+  "lid_Latn",
+  "lif_Deva",
+  "lif_Limb",
+  "lij_Latn",
+  "lim_Latn",
+  "lin_Latn",
+  "lip_Latn",
+  "lis_Lisu",
+  "lit_Latn",
+  "liv_Latn",
+  "ljp_Latn",
+  "lki_Arab",
+  "lld_Latn",
+  "llg_Latn",
+  "lmk_Latn",
+  "lmo_Latn",
+  "lmp_Latn",
+  "lnd_Latn",
+  "log_Latn",
+  "loq_Latn",
+  "loz_Latn",
+  "lrc_Arab",
+  "lsi_Latn",
+  "lsm_Latn",
+  "ltg_Latn",
+  "ltz_Latn",
+  "lua_Latn",
+  "lub_Latn",
+  "luc_Latn",
+  "lue_Latn",
+  "lug_Latn",
+  "lun_Latn",
+  "luo_Latn",
+  "lus_Latn",
+  "lvs_Latn",
+  "lwg_Latn",
+  "lwo_Latn",
+  "lww_Latn",
+  "lzh_Hani",
+  "maa_Latn",
+  "mad_Latn",
+  "mag_Deva",
+  "mah_Latn",
+  "mai_Deva",
+  "maj_Latn",
+  "mak_Latn",
+  "mal_Latn",
+  "mal_Mlym",
+  "mam_Latn",
+  "maq_Latn",
+  "mar_Deva",
+  "mar_Latn",
+  "mas_Latn",
+  "mau_Latn",
+  "mav_Latn",
+  "maz_Latn",
+  "mbb_Latn",
+  "mbc_Latn",
+  "mbd_Latn",
+  "mbf_Latn",
+  "mbh_Latn",
+  "mbi_Latn",
+  "mbj_Latn",
+  "mbl_Latn",
+  "mbs_Latn",
+  "mbt_Latn",
+  "mca_Latn",
+  "mcb_Latn",
+  "mcd_Latn",
+  "mcf_Latn",
+  "mck_Latn",
+  "mco_Latn",
+  "mcp_Latn",
+  "mcq_Latn",
+  "mcu_Latn",
+  "mdf_Cyrl",
+  "mdy_Ethi",
+  "med_Latn",
+  "mee_Latn",
+  "mej_Latn",
+  "mek_Latn",
+  "men_Latn",
+  "meq_Latn",
+  "mer_Latn",
+  "meu_Latn",
+  "mfe_Latn",
+  "mfi_Latn",
+  "mfq_Latn",
+  "mfy_Latn",
+  "mfz_Latn",
+  "mgh_Latn",
+  "mgr_Latn",
+  "mhi_Latn",
+  "mhl_Latn",
+  "mhr_Cyrl",
+  "mhx_Latn",
+  "mib_Latn",
+  "mic_Latn",
+  "mie_Latn",
+  "mif_Latn",
+  "mig_Latn",
+  "mih_Latn",
+  "mil_Latn",
+  "mim_Latn",
+  "min_Latn",
+  "mio_Latn",
+  "mip_Latn",
+  "miq_Latn",
+  "mir_Latn",
+  "mit_Latn",
+  "miy_Latn",
+  "miz_Latn",
+  "mjc_Latn",
+  "mjw_Latn",
+  "mkd_Cyrl",
+  "mkl_Latn",
+  "mkn_Latn",
+  "mks_Latn",
+  "mlh_Latn",
+  "mlp_Latn",
+  "mlt_Latn",
+  "mlu_Latn",
+  "mmn_Latn",
+  "mmo_Latn",
+  "mmx_Latn",
+  "mna_Latn",
+  "mnb_Latn",
+  "mni_Beng",
+  "mni_Latn",
+  "mni_Mtei",
+  "mnk_Latn",
+  "mns_Cyrl",
+  "mnw_Mymr",
+  "mnx_Latn",
+  "mny_Latn",
+  "mog_Latn",
+  "moh_Latn",
+  "mop_Latn",
+  "mor_Latn",
+  "mos_Latn",
+  "mox_Latn",
+  "mph_Latn",
+  "mpm_Latn",
+  "mpp_Latn",
+  "mps_Latn",
+  "mpt_Latn",
+  "mpx_Latn",
+  "mqb_Latn",
+  "mqj_Latn",
+  "mqy_Latn",
+  "mri_Latn",
+  "mrj_Cyrl",
+  "mrq_Latn",
+  "mrw_Latn",
+  "msb_Latn",
+  "msk_Latn",
+  "msy_Latn",
+  "mta_Latn",
+  "mti_Latn",
+  "mto_Latn",
+  "mtp_Latn",
+  "muh_Latn",
+  "mui_Latn",
+  "mup_Deva",
+  "mur_Latn",
+  "mus_Latn",
+  "mux_Latn",
+  "muy_Latn",
+  "mva_Latn",
+  "mvn_Latn",
+  "mvp_Latn",
+  "mwc_Latn",
+  "mwl_Latn",
+  "mwn_Latn",
+  "mwp_Latn",
+  "mwq_Latn",
+  "mwv_Latn",
+  "mww_Latn",
+  "mxb_Latn",
+  "mxp_Latn",
+  "mxq_Latn",
+  "mxt_Latn",
+  "mxv_Latn",
+  "mya_Mymr",
+  "myk_Latn",
+  "myu_Latn",
+  "myv_Cyrl",
+  "myw_Latn",
+  "myx_Latn",
+  "myy_Latn",
+  "mza_Latn",
+  "mzh_Latn",
+  "mzk_Latn",
+  "mzn_Arab",
+  "mzw_Latn",
+  "mzz_Latn",
+  "naf_Latn",
+  "nah_Latn",
+  "nak_Latn",
+  "nan_Hani",
+  "nan_Latn",
+  "nap_Latn",
+  "naq_Latn",
+  "nas_Latn",
+  "nav_Latn",
+  "nba_Latn",
+  "nbe_Latn",
+  "nbl_Latn",
+  "nbq_Latn",
+  "nbu_Latn",
+  "nca_Latn",
+  "nch_Latn",
+  "ncj_Latn",
+  "ncl_Latn",
+  "ncq_Laoo",
+  "ncu_Latn",
+  "ncx_Latn",
+  "ndc_Latn",
+  "nde_Latn",
+  "ndh_Latn",
+  "ndo_Latn",
+  "nds_Latn",
+  "neb_Latn",
+  "new_Deva",
+  "nfa_Latn",
+  "nfr_Latn",
+  "ngl_Latn",
+  "ngp_Latn",
+  "ngu_Latn",
+  "nhe_Latn",
+  "nhg_Latn",
+  "nhi_Latn",
+  "nho_Latn",
+  "nhr_Latn",
+  "nhu_Latn",
+  "nhw_Latn",
+  "nhx_Latn",
+  "nhy_Latn",
+  "nia_Latn",
+  "nif_Latn",
+  "nii_Latn",
+  "nij_Latn",
+  "nim_Latn",
+  "nin_Latn",
+  "niu_Latn",
+  "niy_Latn",
+  "njb_Latn",
+  "njm_Latn",
+  "njn_Latn",
+  "njo_Latn",
+  "njz_Latn",
+  "nko_Latn",
+  "nld_Latn",
+  "nlg_Latn",
+  "nmf_Latn",
+  "nmo_Latn",
+  "nmz_Latn",
+  "nnb_Latn",
+  "nno_Latn",
+  "nnq_Latn",
+  "nnw_Latn",
+  "noa_Latn",
+  "nob_Latn",
+  "nod_Thai",
+  "nog_Cyrl",
+  "non_Latn",
+  "nop_Latn",
+  "not_Latn",
+  "nou_Latn",
+  "nov_Latn",
+  "nph_Latn",
+  "npi_Deva",
+  "npi_Latn",
+  "npl_Latn",
+  "npy_Latn",
+  "nqo_Nkoo",
+  "nre_Latn",
+  "nrf_Latn",
+  "nrm_Latn",
+  "nse_Latn",
+  "nsm_Latn",
+  "nsn_Latn",
+  "nso_Latn",
+  "nss_Latn",
+  "nsu_Latn",
+  "ntp_Latn",
+  "ntr_Latn",
+  "ntu_Latn",
+  "nuj_Latn",
+  "nus_Latn",
+  "nuy_Latn",
+  "nvm_Latn",
+  "nwi_Latn",
+  "nya_Latn",
+  "nyf_Latn",
+  "nyn_Latn",
+  "nyo_Latn",
+  "nyu_Latn",
+  "nyy_Latn",
+  "nzi_Latn",
+  "nzm_Latn",
+  "obo_Latn",
+  "oci_Latn",
+  "ogo_Latn",
+  "ojb_Cans",
+  "ojb_Latn",
+  "oke_Latn",
+  "okv_Latn",
+  "old_Latn",
+  "olo_Latn",
+  "omw_Latn",
+  "ong_Latn",
+  "ons_Latn",
+  "opm_Latn",
+  "orv_Cyrl",
+  "ory_Latn",
+  "ory_Orya",
+  "oss_Cyrl",
+  "ota_Arab",
+  "ote_Latn",
+  "otm_Latn",
+  "oto_Latn",
+  "otq_Latn",
+  "ots_Latn",
+  "otw_Latn",
+  "ozm_Latn",
+  "pab_Latn",
+  "pad_Latn",
+  "pag_Latn",
+  "pah_Latn",
+  "pam_Latn",
+  "pan_Guru",
+  "pan_Latn",
+  "pao_Latn",
+  "pap_Latn",
+  "pau_Latn",
+  "pbb_Latn",
+  "pbt_Arab",
+  "pcd_Latn",
+  "pck_Latn",
+  "pcm_Latn",
+  "pdc_Latn",
+  "pdt_Latn",
+  "pem_Latn",
+  "pfl_Latn",
+  "pib_Latn",
+  "pio_Latn",
+  "pir_Latn",
+  "pis_Latn",
+  "pjt_Latn",
+  "plg_Latn",
+  "pls_Latn",
+  "plt_Latn",
+  "plu_Latn",
+  "plw_Latn",
+  "pma_Latn",
+  "pmf_Latn",
+  "pmq_Latn",
+  "pms_Latn",
+  "pnb_Arab",
+  "pnt_Grek",
+  "poe_Latn",
+  "poh_Latn",
+  "poi_Latn",
+  "pol_Latn",
+  "pon_Latn",
+  "por_Latn",
+  "pot_Latn",
+  "pov_Latn",
+  "poy_Latn",
+  "ppk_Latn",
+  "ppo_Latn",
+  "prf_Latn",
+  "prg_Latn",
+  "pri_Latn",
+  "ptp_Latn",
+  "ptu_Latn",
+  "pwg_Latn",
+  "pwn_Latn",
+  "pxm_Latn",
+  "qub_Latn",
+  "quc_Latn",
+  "quf_Latn",
+  "qug_Latn",
+  "quh_Latn",
+  "qup_Latn",
+  "quw_Latn",
+  "quy_Latn",
+  "quz_Latn",
+  "qva_Latn",
+  "qvc_Latn",
+  "qve_Latn",
+  "qvh_Latn",
+  "qvi_Latn",
+  "qvm_Latn",
+  "qvn_Latn",
+  "qvs_Latn",
+  "qvw_Latn",
+  "qvz_Latn",
+  "qwh_Latn",
+  "qxh_Latn",
+  "qxl_Latn",
+  "qxn_Latn",
+  "qxo_Latn",
+  "qxr_Latn",
+  "rad_Latn",
+  "rai_Latn",
+  "rap_Latn",
+  "rar_Latn",
+  "rav_Deva",
+  "raw_Latn",
+  "rcf_Latn",
+  "rej_Latn",
+  "rgu_Latn",
+  "rhg_Latn",
+  "ria_Latn",
+  "rim_Latn",
+  "rkb_Latn",
+  "rki_Mymr",
+  "rmc_Latn",
+  "rml_Latn",
+  "rmn_Cyrl",
+  "rmn_Grek",
+  "rmn_Latn",
+  "rmo_Latn",
+  "rmq_Latn",
+  "rmy_Cyrl",
+  "rmy_Latn",
+  "rnd_Latn",
+  "rng_Latn",
+  "roh_Latn",
+  "ron_Cyrl",
+  "ron_Latn",
+  "roo_Latn",
+  "rop_Latn",
+  "row_Latn",
+  "rro_Latn",
+  "rtm_Latn",
+  "rub_Latn",
+  "rue_Cyrl",
+  "ruf_Latn",
+  "rug_Latn",
+  "run_Latn",
+  "rup_Latn",
+  "rus_Cyrl",
+  "rwo_Latn",
+  "sab_Latn",
+  "sag_Latn",
+  "sah_Cyrl",
+  "san_Deva",
+  "san_Latn",
+  "sas_Latn",
+  "sat_Latn",
+  "sat_Olck",
+  "sba_Latn",
+  "sbe_Latn",
+  "sbl_Latn",
+  "sby_Latn",
+  "sck_Deva",
+  "scn_Latn",
+  "sco_Latn",
+  "sda_Latn",
+  "sdc_Latn",
+  "sdh_Arab",
+  "seh_Latn",
+  "ses_Latn",
+  "sey_Latn",
+  "sfw_Latn",
+  "sgb_Latn",
+  "sgc_Latn",
+  "sgh_Cyrl",
+  "sgs_Latn",
+  "sgw_Ethi",
+  "sgz_Latn",
+  "shi_Latn",
+  "shn_Mymr",
+  "shp_Latn",
+  "sid_Latn",
+  "sig_Latn",
+  "sil_Latn",
+  "sim_Latn",
+  "sin_Sinh",
+  "sja_Latn",
+  "skg_Latn",
+  "skr_Arab",
+  "slk_Latn",
+  "sll_Latn",
+  "slv_Latn",
+  "sma_Latn",
+  "sme_Latn",
+  "smj_Latn",
+  "smk_Latn",
+  "sml_Latn",
+  "smn_Latn",
+  "smo_Latn",
+  "sms_Latn",
+  "sna_Latn",
+  "snc_Latn",
+  "snd_Arab",
+  "snd_Deva",
+  "snd_Latn",
+  "snf_Latn",
+  "snn_Latn",
+  "snp_Latn",
+  "snw_Latn",
+  "sny_Latn",
+  "som_Latn",
+  "sop_Latn",
+  "soq_Latn",
+  "sot_Latn",
+  "soy_Latn",
+  "spa_Latn",
+  "spl_Latn",
+  "spm_Latn",
+  "spp_Latn",
+  "sps_Latn",
+  "spy_Latn",
+  "srd_Latn",
+  "srm_Latn",
+  "srn_Latn",
+  "srp_Cyrl",
+  "srp_Latn",
+  "srq_Latn",
+  "srr_Latn",
+  "ssd_Latn",
+  "ssg_Latn",
+  "ssw_Latn",
+  "ssx_Latn",
+  "stp_Latn",
+  "stq_Latn",
+  "sua_Latn",
+  "suc_Latn",
+  "sue_Latn",
+  "suk_Latn",
+  "sun_Latn",
+  "sur_Latn",
+  "sus_Arab",
+  "sus_Latn",
+  "suz_Deva",
+  "swc_Latn",
+  "swe_Latn",
+  "swg_Latn",
+  "swh_Latn",
+  "swp_Latn",
+  "sxb_Latn",
+  "sxn_Latn",
+  "syb_Latn",
+  "syc_Syrc",
+  "syl_Beng",
+  "syl_Latn",
+  "szb_Latn",
+  "szl_Latn",
+  "szy_Latn",
+  "tab_Cyrl",
+  "tac_Latn",
+  "tah_Latn",
+  "taj_Deva",
+  "tam_Latn",
+  "tam_Taml",
+  "taq_Latn",
+  "taq_Tfng",
+  "tar_Latn",
+  "tat_Cyrl",
+  "tat_Latn",
+  "tav_Latn",
+  "taw_Latn",
+  "tay_Latn",
+  "tbc_Latn",
+  "tbg_Latn",
+  "tbo_Latn",
+  "tby_Latn",
+  "tbz_Latn",
+  "tca_Latn",
+  "tcf_Latn",
+  "tcs_Latn",
+  "tcy_Knda",
+  "tcz_Latn",
+  "tdt_Latn",
+  "ted_Latn",
+  "tee_Latn",
+  "tel_Latn",
+  "tel_Telu",
+  "tem_Latn",
+  "teo_Latn",
+  "ter_Latn",
+  "tet_Latn",
+  "tew_Latn",
+  "tfr_Latn",
+  "tgk_Cyrl",
+  "tgo_Latn",
+  "tgp_Latn",
+  "tha_Thai",
+  "thk_Latn",
+  "thl_Deva",
+  "tif_Latn",
+  "tih_Latn",
+  "tim_Latn",
+  "tir_Ethi",
+  "tiv_Latn",
+  "tiy_Latn",
+  "tkl_Latn",
+  "tkr_Cyrl",
+  "tku_Latn",
+  "tlf_Latn",
+  "tlh_Latn",
+  "tll_Latn",
+  "tly_Latn",
+  "tmd_Latn",
+  "tna_Latn",
+  "tnc_Latn",
+  "tnk_Latn",
+  "tnn_Latn",
+  "tnp_Latn",
+  "tob_Latn",
+  "toc_Latn",
+  "tod_Latn",
+  "tog_Latn",
+  "toh_Latn",
+  "toi_Latn",
+  "toj_Latn",
+  "tok_Latn",
+  "ton_Latn",
+  "too_Latn",
+  "top_Latn",
+  "tos_Latn",
+  "tpa_Latn",
+  "tpi_Latn",
+  "tpm_Latn",
+  "tpp_Latn",
+  "tpt_Latn",
+  "tpz_Latn",
+  "trc_Latn",
+  "trn_Latn",
+  "trp_Latn",
+  "trq_Latn",
+  "trv_Latn",
+  "tsc_Latn",
+  "tsg_Latn",
+  "tsn_Latn",
+  "tso_Latn",
+  "tsw_Latn",
+  "tsz_Latn",
+  "ttc_Latn",
+  "tte_Latn",
+  "ttj_Latn",
+  "tuc_Latn",
+  "tue_Latn",
+  "tuf_Latn",
+  "tui_Latn",
+  "tuk_Arab",
+  "tuk_Cyrl",
+  "tuk_Latn",
+  "tum_Latn",
+  "tuo_Latn",
+  "tur_Latn",
+  "tuv_Latn",
+  "tvk_Latn",
+  "tvl_Latn",
+  "twi_Latn",
+  "twu_Latn",
+  "txq_Latn",
+  "txu_Latn",
+  "tyv_Cyrl",
+  "tzh_Latn",
+  "tzj_Latn",
+  "tzm_Tfng",
+  "tzo_Latn",
+  "ubr_Latn",
+  "ubu_Latn",
+  "udm_Cyrl",
+  "udu_Latn",
+  "uig_Arab",
+  "uig_Cyrl",
+  "uig_Latn",
+  "ukr_Cyrl",
+  "umb_Latn",
+  "und_Bali",
+  "und_Bamu",
+  "und_Bopo",
+  "und_Cans",
+  "und_Cher",
+  "und_Cyrl",
+  "und_Deva",
+  "und_Egyp",
+  "und_Ethi",
+  "und_Geor",
+  "und_Goth",
+  "und_Grek",
+  "und_Hebr",
+  "und_Hluw",
+  "und_Hung",
+  "und_Kana",
+  "und_Khmr",
+  "und_Lana",
+  "und_Laoo",
+  "und_Lina",
+  "und_Mlym",
+  "und_Mong",
+  "und_Mymr",
+  "und_Newa",
+  "und_Orya",
+  "und_Shaw",
+  "und_Sylo",
+  "und_Syrc",
+  "und_Taml",
+  "und_Tang",
+  "und_Telu",
+  "und_Thaa",
+  "und_Thai",
+  "und_Tibt",
+  "und_Vaii",
+  "und_Xsux",
+  "und_Yiii",
+  "upv_Latn",
+  "ura_Latn",
+  "urb_Latn",
+  "urd_Arab",
+  "urd_Latn",
+  "urh_Latn",
+  "urk_Thai",
+  "urt_Latn",
+  "usa_Latn",
+  "usp_Latn",
+  "uth_Latn",
+  "uvh_Latn",
+  "uvl_Latn",
+  "uzn_Cyrl",
+  "uzn_Latn",
+  "uzs_Arab",
+  "vap_Latn",
+  "var_Latn",
+  "vec_Latn",
+  "ven_Latn",
+  "vep_Latn",
+  "vid_Latn",
+  "vie_Latn",
+  "viv_Latn",
+  "vls_Latn",
+  "vmw_Latn",
+  "vmy_Latn",
+  "vol_Latn",
+  "vro_Latn",
+  "vun_Latn",
+  "waj_Latn",
+  "wal_Latn",
+  "wap_Latn",
+  "war_Latn",
+  "way_Latn",
+  "wba_Latn",
+  "wbm_Latn",
+  "wbp_Latn",
+  "wed_Latn",
+  "wer_Latn",
+  "whk_Latn",
+  "wib_Latn",
+  "wim_Latn",
+  "wiu_Latn",
+  "wln_Latn",
+  "wls_Latn",
+  "wlv_Latn",
+  "wmt_Latn",
+  "wmw_Latn",
+  "wnc_Latn",
+  "wnu_Latn",
+  "wol_Latn",
+  "wos_Latn",
+  "wrk_Latn",
+  "wrs_Latn",
+  "wsk_Latn",
+  "wuu_Hani",
+  "wuv_Latn",
+  "xal_Cyrl",
+  "xav_Latn",
+  "xbi_Latn",
+  "xbr_Latn",
+  "xed_Latn",
+  "xho_Latn",
+  "xla_Latn",
+  "xmf_Geor",
+  "xmm_Latn",
+  "xmv_Latn",
+  "xnn_Latn",
+  "xog_Latn",
+  "xon_Latn",
+  "xrb_Latn",
+  "xsi_Latn",
+  "xsm_Latn",
+  "xsr_Deva",
+  "xsu_Latn",
+  "xtd_Latn",
+  "xtm_Latn",
+  "xtn_Latn",
+  "xuo_Latn",
+  "yaa_Latn",
+  "yad_Latn",
+  "yal_Latn",
+  "yan_Latn",
+  "yao_Latn",
+  "yap_Latn",
+  "yaq_Latn",
+  "ybb_Latn",
+  "yby_Latn",
+  "ycn_Latn",
+  "ydd_Hebr",
+  "yka_Latn",
+  "yle_Latn",
+  "yli_Latn",
+  "yml_Latn",
+  "yom_Latn",
+  "yon_Latn",
+  "yor_Latn",
+  "yrb_Latn",
+  "yre_Latn",
+  "yrk_Cyrl",
+  "yrl_Latn",
+  "yss_Latn",
+  "yua_Latn",
+  "yue_Hani",
+  "yuj_Latn",
+  "yut_Latn",
+  "yuw_Latn",
+  "yva_Latn",
+  "zaa_Latn",
+  "zab_Latn",
+  "zac_Latn",
+  "zad_Latn",
+  "zae_Latn",
+  "zai_Latn",
+  "zam_Latn",
+  "zao_Latn",
+  "zar_Latn",
+  "zas_Latn",
+  "zat_Latn",
+  "zav_Latn",
+  "zaw_Latn",
+  "zdj_Latn",
+  "zea_Latn",
+  "zgh_Tfng",
+  "zia_Latn",
+  "ziw_Latn",
+  "zne_Latn",
+  "zom_Latn",
+  "zos_Latn",
+  "zpa_Latn",
+  "zpc_Latn",
+  "zpg_Latn",
+  "zpi_Latn",
+  "zpl_Latn",
+  "zpm_Latn",
+  "zpo_Latn",
+  "zpt_Latn",
+  "zpu_Latn",
+  "zpv_Latn",
+  "zpz_Latn",
+  "zsm_Latn",
+  "zsr_Latn",
+  "ztq_Latn",
+  "zty_Latn",
+  "zul_Latn",
+  "zyb_Latn",
+  "zyp_Latn"
+ ],
+ "aliases": {
+  "ara_Arab": "arb_Arab",
+  "swa_Latn": "swh_Latn",
+  "sqi_Latn": "als_Latn",
+  "nep_Deva": "npi_Deva",
+  "orm_Latn": "gaz_Latn",
+  "ori_Orya": "ory_Orya",
+  "zho_Hani": "cmn_Hani",
+  "zho_Hans": "cmn_Hani",
+  "mlg_Latn": "plt_Latn",
+  "nor_Latn": "nob_Latn",
+  "pus_Arab": "pbt_Arab",
+  "prs_Arab": "fas_Arab",
+  "pes_Arab": "fas_Arab",
+  "tgl_Latn": "fil_Latn",
+  "kau_Latn": "knc_Latn",
+  "bal_Arab": "bcc_Arab",
+  "kok_Deva": "gom_Deva",
+  "kok_Latn": "gom_Latn",
+  "pan_Arab": "pnb_Arab",
+  "jpn_Hira": "jpn_Jpan",
+  "jpn_Kana": "jpn_Jpan",
+  "jpn_Hani": "jpn_Jpan"
+ },
+ "dropped": [
+  "din_Latn",
+  "ful_Latn",
+  "hbs_Latn",
+  "kln_Latn"
+ ],
+ "trained": [
+  "aai_Latn",
+  "aak_Latn",
+  "aau_Latn",
+  "aaz_Latn",
+  "aba_Latn",
+  "abk_Cyrl",
+  "abn_Latn",
+  "abq_Cyrl",
+  "abs_Latn",
+  "abt_Latn",
+  "abx_Latn",
+  "aby_Latn",
+  "abz_Latn",
+  "aca_Latn",
+  "acd_Latn",
+  "ace_Latn",
+  "acf_Latn",
+  "ach_Latn",
+  "acm_Arab",
+  "acn_Latn",
+  "acr_Latn",
+  "acu_Latn",
+  "ada_Latn",
+  "ade_Latn",
+  "adh_Latn",
+  "adi_Latn",
+  "adj_Latn",
+  "ady_Cyrl",
+  "adz_Latn",
+  "aeb_Arab",
+  "aeb_Latn",
+  "aer_Latn",
+  "aeu_Latn",
+  "aey_Latn",
+  "afr_Latn",
+  "agd_Latn",
+  "agg_Latn",
+  "agm_Latn",
+  "agn_Latn",
+  "agr_Latn",
+  "agt_Latn",
+  "agu_Latn",
+  "agx_Cyrl",
+  "ahk_Latn",
+  "aia_Latn",
+  "aii_Syrc",
+  "ain_Latn",
+  "ajg_Latn",
+  "aji_Latn",
+  "ajp_Arab",
+  "akb_Latn",
+  "ake_Latn",
+  "akh_Latn",
+  "akp_Latn",
+  "aln_Latn",
+  "alp_Latn",
+  "alq_Latn",
+  "als_Latn",
+  "alt_Cyrl",
+  "aly_Latn",
+  "alz_Latn",
+  "ame_Latn",
+  "amf_Latn",
+  "amh_Ethi",
+  "ami_Latn",
+  "amk_Latn",
+  "amm_Latn",
+  "amn_Latn",
+  "amp_Latn",
+  "amr_Latn",
+  "amu_Latn",
+  "amx_Latn",
+  "ang_Latn",
+  "ann_Latn",
+  "anp_Deva",
+  "anv_Latn",
+  "any_Latn",
+  "aoi_Latn",
+  "aoj_Latn",
+  "aom_Latn",
+  "aoz_Latn",
+  "apb_Latn",
+  "apc_Arab",
+  "ape_Latn",
+  "apn_Latn",
+  "apr_Latn",
+  "apt_Latn",
+  "apu_Latn",
+  "apw_Latn",
+  "apy_Latn",
+  "apz_Latn",
+  "arb_Arab",
+  "arb_Latn",
+  "are_Latn",
+  "arg_Latn",
+  "arl_Latn",
+  "arn_Latn",
+  "arp_Latn",
+  "arq_Arab",
+  "ars_Arab",
+  "ary_Arab",
+  "arz_Arab",
+  "asm_Beng",
+  "asm_Latn",
+  "aso_Latn",
+  "ast_Latn",
+  "ata_Latn",
+  "atb_Latn",
+  "atd_Latn",
+  "atg_Latn",
+  "ati_Latn",
+  "atj_Latn",
+  "att_Latn",
+  "auc_Latn",
+  "aui_Latn",
+  "auy_Latn",
+  "ava_Cyrl",
+  "avk_Latn",
+  "avt_Latn",
+  "avu_Latn",
+  "awa_Deva",
+  "awb_Latn",
+  "awx_Latn",
+  "ayp_Arab",
+  "ayr_Latn",
+  "azb_Arab",
+  "azg_Latn",
+  "azj_Cyrl",
+  "azj_Latn",
+  "azz_Latn",
+  "bak_Cyrl",
+  "bam_Latn",
+  "ban_Latn",
+  "bao_Latn",
+  "bar_Latn",
+  "bas_Latn",
+  "bba_Latn",
+  "bbb_Latn",
+  "bbc_Latn",
+  "bbr_Latn",
+  "bcc_Arab",
+  "bch_Latn",
+  "bci_Latn",
+  "bcl_Latn",
+  "bco_Latn",
+  "bcw_Latn",
+  "bdd_Latn",
+  "bdh_Latn",
+  "bdq_Latn",
+  "bea_Latn",
+  "bef_Latn",
+  "bel_Cyrl",
+  "bem_Latn",
+  "ben_Beng",
+  "ben_Latn",
+  "beq_Latn",
+  "bew_Latn",
+  "bfd_Latn",
+  "bgr_Latn",
+  "bgs_Latn",
+  "bgt_Latn",
+  "bgz_Latn",
+  "bhg_Latn",
+  "bhl_Latn",
+  "bho_Deva",
+  "bhw_Latn",
+  "bib_Latn",
+  "big_Latn",
+  "bim_Latn",
+  "bin_Latn",
+  "bis_Latn",
+  "biu_Latn",
+  "biv_Latn",
+  "bjn_Arab",
+  "bjn_Latn",
+  "bjp_Latn",
+  "bjr_Latn",
+  "bjv_Latn",
+  "bkd_Latn",
+  "bkq_Latn",
+  "bku_Latn",
+  "bla_Latn",
+  "blh_Latn",
+  "blk_Mymr",
+  "blt_Latn",
+  "blw_Latn",
+  "blz_Latn",
+  "bmh_Latn",
+  "bmk_Latn",
+  "bmq_Latn",
+  "bmr_Latn",
+  "bmu_Latn",
+  "bno_Latn",
+  "bnp_Latn",
+  "boa_Latn",
+  "bod_Tibt",
+  "boj_Latn",
+  "bon_Latn",
+  "bos_Latn",
+  "box_Latn",
+  "bpr_Latn",
+  "bps_Latn",
+  "bpy_Beng",
+  "bqc_Latn",
+  "bqp_Latn",
+  "bre_Latn",
+  "brh_Arab",
+  "bru_Latn",
+  "brx_Deva",
+  "bsn_Latn",
+  "bsp_Latn",
+  "bsq_Latn",
+  "bss_Latn",
+  "btd_Latn",
+  "bth_Latn",
+  "bts_Latn",
+  "btx_Latn",
+  "bud_Latn",
+  "bug_Latn",
+  "buk_Latn",
+  "bul_Cyrl",
+  "bum_Latn",
+  "bus_Latn",
+  "bvd_Latn",
+  "bvr_Latn",
+  "bvz_Latn",
+  "bwd_Latn",
+  "bwu_Latn",
+  "bxh_Latn",
+  "bxr_Cyrl",
+  "byr_Latn",
+  "byx_Latn",
+  "bzd_Latn",
+  "bzh_Latn",
+  "bzi_Thai",
+  "bzj_Latn",
+  "caa_Latn",
+  "cab_Latn",
+  "cac_Latn",
+  "caf_Latn",
+  "cag_Latn",
+  "cak_Latn",
+  "cao_Latn",
+  "cap_Latn",
+  "caq_Latn",
+  "car_Latn",
+  "cas_Latn",
+  "cat_Latn",
+  "cav_Latn",
+  "cax_Latn",
+  "cbc_Latn",
+  "cbi_Latn",
+  "cbk_Latn",
+  "cbr_Latn",
+  "cbs_Latn",
+  "cbt_Latn",
+  "cbu_Latn",
+  "cbv_Latn",
+  "cce_Latn",
+  "cco_Latn",
+  "ccp_Latn",
+  "ceb_Latn",
+  "ceg_Latn",
+  "cek_Latn",
+  "ces_Latn",
+  "cfm_Latn",
+  "cgc_Latn",
+  "cha_Latn",
+  "chd_Latn",
+  "che_Cyrl",
+  "chf_Latn",
+  "chk_Latn",
+  "cho_Latn",
+  "chq_Latn",
+  "chr_Cher",
+  "chu_Cyrl",
+  "chv_Cyrl",
+  "chw_Latn",
+  "chz_Latn",
+  "cjk_Latn",
+  "cjp_Latn",
+  "cjs_Cyrl",
+  "cjv_Latn",
+  "ckb_Arab",
+  "ckm_Latn",
+  "cko_Latn",
+  "ckt_Cyrl",
+  "clu_Latn",
+  "cme_Latn",
+  "cmn_Hani",
+  "cmo_Latn",
+  "cnh_Latn",
+  "cni_Latn",
+  "cnk_Latn",
+  "cnr_Latn",
+  "cnw_Latn",
+  "coe_Latn",
+  "cof_Latn",
+  "cok_Latn",
+  "con_Latn",
+  "cop_Copt",
+  "cor_Latn",
+  "cos_Latn",
+  "cot_Latn",
+  "cpb_Latn",
+  "cpc_Latn",
+  "cpu_Latn",
+  "cpy_Latn",
+  "crh_Cyrl",
+  "crh_Latn",
+  "crj_Cans",
+  "crk_Cans",
+  "crk_Latn",
+  "crl_Cans",
+  "crm_Cans",
+  "crn_Latn",
+  "crs_Latn",
+  "crx_Latn",
+  "csb_Latn",
+  "csw_Latn",
+  "csy_Latn",
+  "cta_Latn",
+  "ctd_Latn",
+  "cto_Latn",
+  "ctp_Latn",
+  "ctu_Latn",
+  "cub_Latn",
+  "cui_Latn",
+  "cuk_Latn",
+  "cul_Latn",
+  "cut_Latn",
+  "cux_Latn",
+  "cwe_Latn",
+  "cwt_Latn",
+  "cya_Latn",
+  "cym_Latn",
+  "czt_Latn",
+  "daa_Latn",
+  "dad_Latn",
+  "daf_Latn",
+  "dag_Latn",
+  "dah_Latn",
+  "dak_Latn",
+  "dan_Latn",
+  "dar_Cyrl",
+  "ddg_Latn",
+  "ded_Latn",
+  "des_Latn",
+  "deu_Latn",
+  "dga_Latn",
+  "dgc_Latn",
+  "dgi_Latn",
+  "dgr_Latn",
+  "dgz_Latn",
+  "dhm_Latn",
+  "dhv_Latn",
+  "dig_Latn",
+  "dik_Latn",
+  "diq_Latn",
+  "diu_Latn",
+  "div_Thaa",
+  "dje_Latn",
+  "djk_Latn",
+  "djr_Latn",
+  "dks_Latn",
+  "dng_Cyrl",
+  "dnj_Latn",
+  "dnw_Latn",
+  "dob_Latn",
+  "doi_Deva",
+  "dop_Latn",
+  "dos_Latn",
+  "drg_Latn",
+  "dru_Latn",
+  "dsb_Latn",
+  "dtp_Latn",
+  "dts_Latn",
+  "dua_Latn",
+  "duo_Latn",
+  "dur_Latn",
+  "dwr_Latn",
+  "dww_Latn",
+  "dyi_Latn",
+  "dyo_Latn",
+  "dyu_Latn",
+  "dzo_Tibt",
+  "ebk_Latn",
+  "efi_Latn",
+  "ekk_Latn",
+  "eko_Latn",
+  "ell_Grek",
+  "emi_Latn",
+  "eml_Latn",
+  "emp_Latn",
+  "enb_Latn",
+  "eng_Latn",
+  "enl_Latn",
+  "enm_Latn",
+  "enq_Latn",
+  "epo_Latn",
+  "eri_Latn",
+  "ese_Latn",
+  "esi_Latn",
+  "esk_Latn",
+  "ess_Latn",
+  "esu_Latn",
+  "etr_Latn",
+  "eus_Latn",
+  "eve_Cyrl",
+  "ewe_Latn",
+  "ewo_Latn",
+  "ext_Latn",
+  "eza_Latn",
+  "faa_Latn",
+  "fai_Latn",
+  "fal_Latn",
+  "fan_Latn",
+  "fao_Latn",
+  "far_Latn",
+  "fas_Arab",
+  "fat_Latn",
+  "ffm_Latn",
+  "fij_Latn",
+  "fil_Latn",
+  "fin_Latn",
+  "fit_Latn",
+  "fkv_Latn",
+  "fon_Latn",
+  "for_Latn",
+  "fra_Latn",
+  "frd_Latn",
+  "fro_Latn",
+  "frp_Latn",
+  "frr_Latn",
+  "fry_Latn",
+  "fub_Latn",
+  "fue_Latn",
+  "fuf_Latn",
+  "fuh_Latn",
+  "fur_Latn",
+  "fuv_Arab",
+  "fuv_Latn",
+  "gaa_Latn",
+  "gag_Cyrl",
+  "gag_Latn",
+  "gah_Latn",
+  "gai_Latn",
+  "gam_Latn",
+  "gaw_Latn",
+  "gaz_Latn",
+  "gbi_Latn",
+  "gbo_Latn",
+  "gcf_Latn",
+  "gcr_Latn",
+  "gde_Latn",
+  "gdg_Latn",
+  "gdn_Latn",
+  "gdr_Latn",
+  "geb_Latn",
+  "gfk_Latn",
+  "ghs_Latn",
+  "gil_Latn",
+  "gjn_Latn",
+  "gkn_Latn",
+  "gla_Latn",
+  "gle_Latn",
+  "glg_Latn",
+  "glk_Arab",
+  "glv_Latn",
+  "gmh_Latn",
+  "gmv_Ethi",
+  "gmv_Latn",
+  "gnb_Latn",
+  "gnd_Latn",
+  "gng_Latn",
+  "gnn_Latn",
+  "gnw_Latn",
+  "gof_Ethi",
+  "gof_Latn",
+  "gog_Latn",
+  "goh_Latn",
+  "gom_Deva",
+  "gom_Latn",
+  "gor_Latn",
+  "gos_Latn",
+  "got_Goth",
+  "gqr_Latn",
+  "grc_Grek",
+  "grt_Beng",
+  "gso_Latn",
+  "gsw_Latn",
+  "gub_Latn",
+  "guc_Latn",
+  "gug_Latn",
+  "guh_Latn",
+  "gui_Latn",
+  "guj_Gujr",
+  "guj_Latn",
+  "guk_Ethi",
+  "gul_Latn",
+  "gum_Latn",
+  "gun_Latn",
+  "guo_Latn",
+  "guq_Latn",
+  "gur_Latn",
+  "guw_Latn",
+  "gux_Latn",
+  "guz_Latn",
+  "gvc_Latn",
+  "gvf_Latn",
+  "gvl_Latn",
+  "gvn_Latn",
+  "gwi_Latn",
+  "gym_Latn",
+  "gyr_Latn",
+  "hac_Arab",
+  "hae_Latn",
+  "hag_Latn",
+  "hak_Hani",
+  "hak_Latn",
+  "hat_Latn",
+  "hau_Latn",
+  "hav_Latn",
+  "haw_Latn",
+  "hay_Latn",
+  "hbo_Hebr",
+  "hch_Latn",
+  "heb_Hebr",
+  "heg_Latn",
+  "heh_Latn",
+  "her_Latn",
+  "hif_Latn",
+  "hig_Latn",
+  "hil_Latn",
+  "hin_Deva",
+  "hin_Latn",
+  "hix_Latn",
+  "hla_Latn",
+  "hmo_Latn",
+  "hmr_Latn",
+  "hne_Deva",
+  "hnj_Latn",
+  "hnn_Latn",
+  "hns_Latn",
+  "hop_Latn",
+  "hot_Latn",
+  "hra_Latn",
+  "hrv_Latn",
+  "hrx_Latn",
+  "hsb_Latn",
+  "hto_Latn",
+  "hub_Latn",
+  "hui_Latn",
+  "hun_Latn",
+  "hus_Latn",
+  "huu_Latn",
+  "huv_Latn",
+  "hvn_Latn",
+  "hwc_Latn",
+  "hye_Armn",
+  "hyw_Armn",
+  "ian_Latn",
+  "iba_Latn",
+  "ibg_Latn",
+  "ibo_Latn",
+  "icr_Latn",
+  "ido_Latn",
+  "idu_Latn",
+  "ifb_Latn",
+  "ife_Latn",
+  "ifk_Latn",
+  "ifu_Latn",
+  "ify_Latn",
+  "ige_Latn",
+  "ign_Latn",
+  "ike_Cans",
+  "ikk_Latn",
+  "ikt_Latn",
+  "ikw_Latn",
+  "ile_Latn",
+  "ilo_Latn",
+  "imo_Latn",
+  "ina_Latn",
+  "inb_Latn",
+  "ind_Latn",
+  "inh_Cyrl",
+  "ino_Latn",
+  "iou_Latn",
+  "ipi_Latn",
+  "irk_Latn",
+  "isd_Latn",
+  "ish_Latn",
+  "isl_Latn",
+  "iso_Latn",
+  "ita_Latn",
+  "itv_Latn",
+  "ium_Latn",
+  "ivv_Latn",
+  "iws_Latn",
+  "ixl_Latn",
+  "izr_Latn",
+  "izz_Latn",
+  "jac_Latn",
+  "jae_Latn",
+  "jam_Latn",
+  "jav_Latn",
+  "jbo_Latn",
+  "jbu_Latn",
+  "jic_Latn",
+  "jiv_Latn",
+  "jpn_Jpan",
+  "jra_Latn",
+  "jvn_Latn",
+  "kaa_Cyrl",
+  "kaa_Latn",
+  "kab_Latn",
+  "kac_Latn",
+  "kal_Latn",
+  "kam_Latn",
+  "kan_Knda",
+  "kan_Latn",
+  "kao_Latn",
+  "kaq_Latn",
+  "kas_Arab",
+  "kas_Deva",
+  "kat_Geor",
+  "kaz_Cyrl",
+  "kbc_Latn",
+  "kbd_Cyrl",
+  "kbh_Latn",
+  "kbm_Latn",
+  "kbp_Latn",
+  "kbq_Latn",
+  "kbr_Latn",
+  "kby_Latn",
+  "kca_Cyrl",
+  "kcg_Latn",
+  "kck_Latn",
+  "kdc_Latn",
+  "kde_Latn",
+  "kdh_Latn",
+  "kdi_Latn",
+  "kdl_Latn",
+  "kea_Latn",
+  "kek_Latn",
+  "ken_Latn",
+  "keo_Latn",
+  "kew_Latn",
+  "kez_Latn",
+  "kff_Telu",
+  "kgf_Latn",
+  "kgk_Latn",
+  "kgp_Latn",
+  "kha_Latn",
+  "khk_Cyrl",
+  "khm_Khmr",
+  "khs_Latn",
+  "khz_Latn",
+  "kij_Latn",
+  "kik_Latn",
+  "kin_Latn",
+  "kir_Cyrl",
+  "kiu_Latn",
+  "kix_Latn",
+  "kjb_Latn",
+  "kje_Latn",
+  "kjh_Cyrl",
+  "kjs_Latn",
+  "kkc_Latn",
+  "kki_Latn",
+  "kkj_Latn",
+  "kkl_Latn",
+  "klt_Latn",
+  "klv_Latn",
+  "kmb_Latn",
+  "kmg_Latn",
+  "kmh_Latn",
+  "kmk_Latn",
+  "kmm_Latn",
+  "kmo_Latn",
+  "kmr_Cyrl",
+  "kmr_Latn",
+  "kms_Latn",
+  "kmu_Latn",
+  "kmy_Latn",
+  "knc_Arab",
+  "knc_Latn",
+  "kne_Latn",
+  "knf_Latn",
+  "kng_Latn",
+  "knj_Latn",
+  "knk_Latn",
+  "knv_Latn",
+  "koi_Cyrl",
+  "koo_Latn",
+  "kor_Hang",
+  "kos_Latn",
+  "kpe_Latn",
+  "kpf_Latn",
+  "kpg_Latn",
+  "kpj_Latn",
+  "kpr_Latn",
+  "kpv_Cyrl",
+  "kpw_Latn",
+  "kpx_Latn",
+  "kpz_Latn",
+  "kqc_Latn",
+  "kqe_Latn",
+  "kqf_Latn",
+  "kqn_Latn",
+  "kqp_Latn",
+  "kqw_Latn",
+  "krc_Cyrl",
+  "kri_Latn",
+  "krj_Latn",
+  "krl_Latn",
+  "kru_Deva",
+  "ksc_Latn",
+  "ksd_Latn",
+  "ksh_Latn",
+  "ksp_Latn",
+  "ksr_Latn",
+  "kss_Latn",
+  "ksw_Mymr",
+  "ktj_Latn",
+  "kto_Latn",
+  "ktu_Latn",
+  "ktz_Latn",
+  "kua_Latn",
+  "kud_Latn",
+  "kue_Latn",
+  "kum_Cyrl",
+  "kup_Latn",
+  "kus_Latn",
+  "kvg_Latn",
+  "kvn_Latn",
+  "kwd_Latn",
+  "kwf_Latn",
+  "kwi_Latn",
+  "kwj_Latn",
+  "kwn_Latn",
+  "kwy_Latn",
+  "kxc_Ethi",
+  "kxw_Latn",
+  "kyc_Latn",
+  "kyf_Latn",
+  "kyg_Latn",
+  "kyq_Latn",
+  "kyu_Kali",
+  "kyz_Latn",
+  "kze_Latn",
+  "kzj_Latn",
+  "lac_Latn",
+  "lad_Hebr",
+  "lad_Latn",
+  "lai_Latn",
+  "laj_Latn",
+  "lam_Latn",
+  "lao_Laoo",
+  "lat_Latn",
+  "lbb_Latn",
+  "lbe_Cyrl",
+  "lbj_Tibt",
+  "lbk_Latn",
+  "lcm_Latn",
+  "lcp_Thai",
+  "ldi_Latn",
+  "lee_Latn",
+  "lef_Latn",
+  "leh_Latn",
+  "leu_Latn",
+  "lew_Latn",
+  "lex_Latn",
+  "lez_Cyrl",
+  "lfn_Cyrl",
+  "lfn_Latn",
+  "lgg_Latn",
+  "lgl_Latn",
+  "lhu_Latn",
+  "lia_Latn",
+  "lid_Latn",
+  "lif_Deva",
+  "lif_Limb",
+  "lij_Latn",
+  "lim_Latn",
+  "lin_Latn",
+  "lip_Latn",
+  "lis_Lisu",
+  "lit_Latn",
+  "liv_Latn",
+  "ljp_Latn",
+  "lki_Arab",
+  "lld_Latn",
+  "llg_Latn",
+  "lmk_Latn",
+  "lmo_Latn",
+  "lmp_Latn",
+  "lnd_Latn",
+  "log_Latn",
+  "loq_Latn",
+  "loz_Latn",
+  "lrc_Arab",
+  "lsi_Latn",
+  "lsm_Latn",
+  "ltg_Latn",
+  "ltz_Latn",
+  "lua_Latn",
+  "lub_Latn",
+  "luc_Latn",
+  "lue_Latn",
+  "lug_Latn",
+  "lun_Latn",
+  "luo_Latn",
+  "lus_Latn",
+  "lvs_Latn",
+  "lwg_Latn",
+  "lwo_Latn",
+  "lww_Latn",
+  "lzh_Hani",
+  "maa_Latn",
+  "mad_Latn",
+  "mag_Deva",
+  "mah_Latn",
+  "mai_Deva",
+  "maj_Latn",
+  "mak_Latn",
+  "mal_Latn",
+  "mal_Mlym",
+  "mam_Latn",
+  "maq_Latn",
+  "mar_Deva",
+  "mar_Latn",
+  "mas_Latn",
+  "mau_Latn",
+  "mav_Latn",
+  "maz_Latn",
+  "mbb_Latn",
+  "mbc_Latn",
+  "mbd_Latn",
+  "mbf_Latn",
+  "mbh_Latn",
+  "mbi_Latn",
+  "mbj_Latn",
+  "mbl_Latn",
+  "mbs_Latn",
+  "mbt_Latn",
+  "mca_Latn",
+  "mcb_Latn",
+  "mcd_Latn",
+  "mcf_Latn",
+  "mck_Latn",
+  "mco_Latn",
+  "mcp_Latn",
+  "mcq_Latn",
+  "mcu_Latn",
+  "mdf_Cyrl",
+  "mdy_Ethi",
+  "med_Latn",
+  "mee_Latn",
+  "mej_Latn",
+  "mek_Latn",
+  "men_Latn",
+  "meq_Latn",
+  "mer_Latn",
+  "meu_Latn",
+  "mfe_Latn",
+  "mfi_Latn",
+  "mfq_Latn",
+  "mfy_Latn",
+  "mfz_Latn",
+  "mgh_Latn",
+  "mgr_Latn",
+  "mhi_Latn",
+  "mhl_Latn",
+  "mhr_Cyrl",
+  "mhx_Latn",
+  "mib_Latn",
+  "mic_Latn",
+  "mie_Latn",
+  "mif_Latn",
+  "mig_Latn",
+  "mih_Latn",
+  "mil_Latn",
+  "mim_Latn",
+  "min_Latn",
+  "mio_Latn",
+  "mip_Latn",
+  "miq_Latn",
+  "mir_Latn",
+  "mit_Latn",
+  "miy_Latn",
+  "miz_Latn",
+  "mjc_Latn",
+  "mjw_Latn",
+  "mkd_Cyrl",
+  "mkl_Latn",
+  "mkn_Latn",
+  "mks_Latn",
+  "mlh_Latn",
+  "mlp_Latn",
+  "mlt_Latn",
+  "mlu_Latn",
+  "mmn_Latn",
+  "mmo_Latn",
+  "mmx_Latn",
+  "mna_Latn",
+  "mnb_Latn",
+  "mni_Beng",
+  "mni_Latn",
+  "mni_Mtei",
+  "mnk_Latn",
+  "mns_Cyrl",
+  "mnw_Mymr",
+  "mnx_Latn",
+  "mny_Latn",
+  "mog_Latn",
+  "moh_Latn",
+  "mop_Latn",
+  "mor_Latn",
+  "mos_Latn",
+  "mox_Latn",
+  "mph_Latn",
+  "mpm_Latn",
+  "mpp_Latn",
+  "mps_Latn",
+  "mpt_Latn",
+  "mpx_Latn",
+  "mqb_Latn",
+  "mqj_Latn",
+  "mqy_Latn",
+  "mri_Latn",
+  "mrj_Cyrl",
+  "mrq_Latn",
+  "mrw_Latn",
+  "msb_Latn",
+  "msk_Latn",
+  "msy_Latn",
+  "mta_Latn",
+  "mti_Latn",
+  "mto_Latn",
+  "mtp_Latn",
+  "muh_Latn",
+  "mui_Latn",
+  "mup_Deva",
+  "mur_Latn",
+  "mus_Latn",
+  "mux_Latn",
+  "muy_Latn",
+  "mva_Latn",
+  "mvn_Latn",
+  "mvp_Latn",
+  "mwc_Latn",
+  "mwl_Latn",
+  "mwn_Latn",
+  "mwp_Latn",
+  "mwq_Latn",
+  "mwv_Latn",
+  "mww_Latn",
+  "mxb_Latn",
+  "mxp_Latn",
+  "mxq_Latn",
+  "mxt_Latn",
+  "mxv_Latn",
+  "mya_Mymr",
+  "myk_Latn",
+  "myu_Latn",
+  "myv_Cyrl",
+  "myw_Latn",
+  "myx_Latn",
+  "myy_Latn",
+  "mza_Latn",
+  "mzh_Latn",
+  "mzk_Latn",
+  "mzn_Arab",
+  "mzw_Latn",
+  "mzz_Latn",
+  "naf_Latn",
+  "nah_Latn",
+  "nak_Latn",
+  "nan_Hani",
+  "nan_Latn",
+  "nap_Latn",
+  "naq_Latn",
+  "nas_Latn",
+  "nav_Latn",
+  "nba_Latn",
+  "nbe_Latn",
+  "nbl_Latn",
+  "nbq_Latn",
+  "nbu_Latn",
+  "nca_Latn",
+  "nch_Latn",
+  "ncj_Latn",
+  "ncl_Latn",
+  "ncq_Laoo",
+  "ncu_Latn",
+  "ncx_Latn",
+  "ndc_Latn",
+  "nde_Latn",
+  "ndh_Latn",
+  "ndo_Latn",
+  "nds_Latn",
+  "neb_Latn",
+  "new_Deva",
+  "nfa_Latn",
+  "nfr_Latn",
+  "ngl_Latn",
+  "ngp_Latn",
+  "ngu_Latn",
+  "nhe_Latn",
+  "nhg_Latn",
+  "nhi_Latn",
+  "nho_Latn",
+  "nhr_Latn",
+  "nhu_Latn",
+  "nhw_Latn",
+  "nhx_Latn",
+  "nhy_Latn",
+  "nia_Latn",
+  "nif_Latn",
+  "nii_Latn",
+  "nij_Latn",
+  "nim_Latn",
+  "nin_Latn",
+  "niu_Latn",
+  "niy_Latn",
+  "njb_Latn",
+  "njm_Latn",
+  "njn_Latn",
+  "njo_Latn",
+  "njz_Latn",
+  "nko_Latn",
+  "nld_Latn",
+  "nlg_Latn",
+  "nmf_Latn",
+  "nmo_Latn",
+  "nmz_Latn",
+  "nnb_Latn",
+  "nno_Latn",
+  "nnq_Latn",
+  "nnw_Latn",
+  "noa_Latn",
+  "nob_Latn",
+  "nod_Thai",
+  "nog_Cyrl",
+  "non_Latn",
+  "nop_Latn",
+  "not_Latn",
+  "nou_Latn",
+  "nov_Latn",
+  "nph_Latn",
+  "npi_Deva",
+  "npi_Latn",
+  "npl_Latn",
+  "npy_Latn",
+  "nqo_Nkoo",
+  "nre_Latn",
+  "nrf_Latn",
+  "nrm_Latn",
+  "nse_Latn",
+  "nsm_Latn",
+  "nsn_Latn",
+  "nso_Latn",
+  "nss_Latn",
+  "nsu_Latn",
+  "ntp_Latn",
+  "ntr_Latn",
+  "ntu_Latn",
+  "nuj_Latn",
+  "nus_Latn",
+  "nuy_Latn",
+  "nvm_Latn",
+  "nwi_Latn",
+  "nya_Latn",
+  "nyf_Latn",
+  "nyn_Latn",
+  "nyo_Latn",
+  "nyu_Latn",
+  "nyy_Latn",
+  "nzi_Latn",
+  "nzm_Latn",
+  "obo_Latn",
+  "oci_Latn",
+  "ogo_Latn",
+  "ojb_Cans",
+  "ojb_Latn",
+  "oke_Latn",
+  "okv_Latn",
+  "old_Latn",
+  "olo_Latn",
+  "omw_Latn",
+  "ong_Latn",
+  "ons_Latn",
+  "opm_Latn",
+  "orv_Cyrl",
+  "ory_Latn",
+  "ory_Orya",
+  "oss_Cyrl",
+  "ota_Arab",
+  "ote_Latn",
+  "otm_Latn",
+  "oto_Latn",
+  "otq_Latn",
+  "ots_Latn",
+  "otw_Latn",
+  "ozm_Latn",
+  "pab_Latn",
+  "pad_Latn",
+  "pag_Latn",
+  "pah_Latn",
+  "pam_Latn",
+  "pan_Guru",
+  "pan_Latn",
+  "pao_Latn",
+  "pap_Latn",
+  "pau_Latn",
+  "pbb_Latn",
+  "pbt_Arab",
+  "pcd_Latn",
+  "pck_Latn",
+  "pcm_Latn",
+  "pdc_Latn",
+  "pdt_Latn",
+  "pem_Latn",
+  "pfl_Latn",
+  "pib_Latn",
+  "pio_Latn",
+  "pir_Latn",
+  "pis_Latn",
+  "pjt_Latn",
+  "plg_Latn",
+  "pls_Latn",
+  "plt_Latn",
+  "plu_Latn",
+  "plw_Latn",
+  "pma_Latn",
+  "pmf_Latn",
+  "pmq_Latn",
+  "pms_Latn",
+  "pnb_Arab",
+  "pnt_Grek",
+  "poe_Latn",
+  "poh_Latn",
+  "poi_Latn",
+  "pol_Latn",
+  "pon_Latn",
+  "por_Latn",
+  "pot_Latn",
+  "pov_Latn",
+  "poy_Latn",
+  "ppk_Latn",
+  "ppo_Latn",
+  "prf_Latn",
+  "prg_Latn",
+  "pri_Latn",
+  "ptp_Latn",
+  "ptu_Latn",
+  "pwg_Latn",
+  "pwn_Latn",
+  "pxm_Latn",
+  "qub_Latn",
+  "quc_Latn",
+  "quf_Latn",
+  "qug_Latn",
+  "quh_Latn",
+  "qup_Latn",
+  "quw_Latn",
+  "quy_Latn",
+  "quz_Latn",
+  "qva_Latn",
+  "qvc_Latn",
+  "qve_Latn",
+  "qvh_Latn",
+  "qvi_Latn",
+  "qvm_Latn",
+  "qvn_Latn",
+  "qvs_Latn",
+  "qvw_Latn",
+  "qvz_Latn",
+  "qwh_Latn",
+  "qxh_Latn",
+  "qxl_Latn",
+  "qxn_Latn",
+  "qxo_Latn",
+  "qxr_Latn",
+  "rad_Latn",
+  "rai_Latn",
+  "rap_Latn",
+  "rar_Latn",
+  "rav_Deva",
+  "raw_Latn",
+  "rcf_Latn",
+  "rej_Latn",
+  "rgu_Latn",
+  "rhg_Latn",
+  "ria_Latn",
+  "rim_Latn",
+  "rkb_Latn",
+  "rki_Mymr",
+  "rmc_Latn",
+  "rml_Latn",
+  "rmn_Cyrl",
+  "rmn_Grek",
+  "rmn_Latn",
+  "rmo_Latn",
+  "rmq_Latn",
+  "rmy_Cyrl",
+  "rmy_Latn",
+  "rnd_Latn",
+  "rng_Latn",
+  "roh_Latn",
+  "ron_Cyrl",
+  "ron_Latn",
+  "roo_Latn",
+  "rop_Latn",
+  "row_Latn",
+  "rro_Latn",
+  "rtm_Latn",
+  "rub_Latn",
+  "rue_Cyrl",
+  "ruf_Latn",
+  "rug_Latn",
+  "run_Latn",
+  "rup_Latn",
+  "rus_Cyrl",
+  "rwo_Latn",
+  "sab_Latn",
+  "sag_Latn",
+  "sah_Cyrl",
+  "san_Deva",
+  "san_Latn",
+  "sas_Latn",
+  "sat_Latn",
+  "sat_Olck",
+  "sba_Latn",
+  "sbe_Latn",
+  "sbl_Latn",
+  "sby_Latn",
+  "sck_Deva",
+  "scn_Latn",
+  "sco_Latn",
+  "sda_Latn",
+  "sdc_Latn",
+  "sdh_Arab",
+  "seh_Latn",
+  "ses_Latn",
+  "sey_Latn",
+  "sfw_Latn",
+  "sgb_Latn",
+  "sgc_Latn",
+  "sgh_Cyrl",
+  "sgs_Latn",
+  "sgw_Ethi",
+  "sgz_Latn",
+  "shi_Latn",
+  "shn_Mymr",
+  "shp_Latn",
+  "sid_Latn",
+  "sig_Latn",
+  "sil_Latn",
+  "sim_Latn",
+  "sin_Sinh",
+  "sja_Latn",
+  "skg_Latn",
+  "skr_Arab",
+  "slk_Latn",
+  "sll_Latn",
+  "slv_Latn",
+  "sma_Latn",
+  "sme_Latn",
+  "smj_Latn",
+  "smk_Latn",
+  "sml_Latn",
+  "smn_Latn",
+  "smo_Latn",
+  "sms_Latn",
+  "sna_Latn",
+  "snc_Latn",
+  "snd_Arab",
+  "snd_Deva",
+  "snd_Latn",
+  "snf_Latn",
+  "snn_Latn",
+  "snp_Latn",
+  "snw_Latn",
+  "sny_Latn",
+  "som_Latn",
+  "sop_Latn",
+  "soq_Latn",
+  "sot_Latn",
+  "soy_Latn",
+  "spa_Latn",
+  "spl_Latn",
+  "spm_Latn",
+  "spp_Latn",
+  "sps_Latn",
+  "spy_Latn",
+  "srd_Latn",
+  "srm_Latn",
+  "srn_Latn",
+  "srp_Cyrl",
+  "srp_Latn",
+  "srq_Latn",
+  "srr_Latn",
+  "ssd_Latn",
+  "ssg_Latn",
+  "ssw_Latn",
+  "ssx_Latn",
+  "stp_Latn",
+  "stq_Latn",
+  "sua_Latn",
+  "suc_Latn",
+  "sue_Latn",
+  "suk_Latn",
+  "sun_Latn",
+  "sur_Latn",
+  "sus_Arab",
+  "sus_Latn",
+  "suz_Deva",
+  "swc_Latn",
+  "swe_Latn",
+  "swg_Latn",
+  "swh_Latn",
+  "swp_Latn",
+  "sxb_Latn",
+  "sxn_Latn",
+  "syb_Latn",
+  "syc_Syrc",
+  "syl_Beng",
+  "syl_Latn",
+  "szb_Latn",
+  "szl_Latn",
+  "szy_Latn",
+  "tab_Cyrl",
+  "tac_Latn",
+  "tah_Latn",
+  "taj_Deva",
+  "tam_Latn",
+  "tam_Taml",
+  "taq_Latn",
+  "taq_Tfng",
+  "tar_Latn",
+  "tat_Cyrl",
+  "tat_Latn",
+  "tav_Latn",
+  "taw_Latn",
+  "tay_Latn",
+  "tbc_Latn",
+  "tbg_Latn",
+  "tbo_Latn",
+  "tby_Latn",
+  "tbz_Latn",
+  "tca_Latn",
+  "tcf_Latn",
+  "tcs_Latn",
+  "tcy_Knda",
+  "tcz_Latn",
+  "tdt_Latn",
+  "ted_Latn",
+  "tee_Latn",
+  "tel_Latn",
+  "tel_Telu",
+  "tem_Latn",
+  "teo_Latn",
+  "ter_Latn",
+  "tet_Latn",
+  "tew_Latn",
+  "tfr_Latn",
+  "tgk_Cyrl",
+  "tgo_Latn",
+  "tgp_Latn",
+  "tha_Thai",
+  "thk_Latn",
+  "thl_Deva",
+  "tif_Latn",
+  "tih_Latn",
+  "tim_Latn",
+  "tir_Ethi",
+  "tiv_Latn",
+  "tiy_Latn",
+  "tkl_Latn",
+  "tkr_Cyrl",
+  "tku_Latn",
+  "tlf_Latn",
+  "tlh_Latn",
+  "tll_Latn",
+  "tly_Latn",
+  "tmd_Latn",
+  "tna_Latn",
+  "tnc_Latn",
+  "tnk_Latn",
+  "tnn_Latn",
+  "tnp_Latn",
+  "tob_Latn",
+  "toc_Latn",
+  "tod_Latn",
+  "tog_Latn",
+  "toh_Latn",
+  "toi_Latn",
+  "toj_Latn",
+  "tok_Latn",
+  "ton_Latn",
+  "too_Latn",
+  "top_Latn",
+  "tos_Latn",
+  "tpa_Latn",
+  "tpi_Latn",
+  "tpm_Latn",
+  "tpp_Latn",
+  "tpt_Latn",
+  "tpz_Latn",
+  "trc_Latn",
+  "trn_Latn",
+  "trp_Latn",
+  "trq_Latn",
+  "trv_Latn",
+  "tsc_Latn",
+  "tsg_Latn",
+  "tsn_Latn",
+  "tso_Latn",
+  "tsw_Latn",
+  "tsz_Latn",
+  "ttc_Latn",
+  "tte_Latn",
+  "ttj_Latn",
+  "tuc_Latn",
+  "tue_Latn",
+  "tuf_Latn",
+  "tui_Latn",
+  "tuk_Arab",
+  "tuk_Cyrl",
+  "tuk_Latn",
+  "tum_Latn",
+  "tuo_Latn",
+  "tur_Latn",
+  "tuv_Latn",
+  "tvk_Latn",
+  "tvl_Latn",
+  "twi_Latn",
+  "twu_Latn",
+  "txq_Latn",
+  "txu_Latn",
+  "tyv_Cyrl",
+  "tzh_Latn",
+  "tzj_Latn",
+  "tzm_Tfng",
+  "tzo_Latn",
+  "ubr_Latn",
+  "ubu_Latn",
+  "udm_Cyrl",
+  "udu_Latn",
+  "uig_Arab",
+  "uig_Cyrl",
+  "uig_Latn",
+  "ukr_Cyrl",
+  "umb_Latn",
+  "und_Bali",
+  "und_Bamu",
+  "und_Bopo",
+  "und_Cans",
+  "und_Cher",
+  "und_Cyrl",
+  "und_Deva",
+  "und_Egyp",
+  "und_Ethi",
+  "und_Geor",
+  "und_Goth",
+  "und_Grek",
+  "und_Hebr",
+  "und_Hluw",
+  "und_Hung",
+  "und_Kana",
+  "und_Khmr",
+  "und_Lana",
+  "und_Laoo",
+  "und_Lina",
+  "und_Mlym",
+  "und_Mong",
+  "und_Mymr",
+  "und_Newa",
+  "und_Orya",
+  "und_Shaw",
+  "und_Sylo",
+  "und_Syrc",
+  "und_Taml",
+  "und_Tang",
+  "und_Telu",
+  "und_Thaa",
+  "und_Thai",
+  "und_Tibt",
+  "und_Vaii",
+  "und_Xsux",
+  "und_Yiii",
+  "upv_Latn",
+  "ura_Latn",
+  "urb_Latn",
+  "urd_Arab",
+  "urd_Latn",
+  "urh_Latn",
+  "urk_Thai",
+  "urt_Latn",
+  "usa_Latn",
+  "usp_Latn",
+  "uth_Latn",
+  "uvh_Latn",
+  "uvl_Latn",
+  "uzn_Cyrl",
+  "uzn_Latn",
+  "uzs_Arab",
+  "vap_Latn",
+  "var_Latn",
+  "vec_Latn",
+  "ven_Latn",
+  "vep_Latn",
+  "vid_Latn",
+  "vie_Latn",
+  "viv_Latn",
+  "vls_Latn",
+  "vmw_Latn",
+  "vmy_Latn",
+  "vol_Latn",
+  "vro_Latn",
+  "vun_Latn",
+  "waj_Latn",
+  "wal_Latn",
+  "wap_Latn",
+  "war_Latn",
+  "way_Latn",
+  "wba_Latn",
+  "wbm_Latn",
+  "wbp_Latn",
+  "wed_Latn",
+  "wer_Latn",
+  "whk_Latn",
+  "wib_Latn",
+  "wim_Latn",
+  "wiu_Latn",
+  "wln_Latn",
+  "wls_Latn",
+  "wlv_Latn",
+  "wmt_Latn",
+  "wmw_Latn",
+  "wnc_Latn",
+  "wnu_Latn",
+  "wol_Latn",
+  "wos_Latn",
+  "wrk_Latn",
+  "wrs_Latn",
+  "wsk_Latn",
+  "wuu_Hani",
+  "wuv_Latn",
+  "xal_Cyrl",
+  "xav_Latn",
+  "xbi_Latn",
+  "xbr_Latn",
+  "xed_Latn",
+  "xho_Latn",
+  "xla_Latn",
+  "xmf_Geor",
+  "xmm_Latn",
+  "xmv_Latn",
+  "xnn_Latn",
+  "xog_Latn",
+  "xon_Latn",
+  "xrb_Latn",
+  "xsi_Latn",
+  "xsm_Latn",
+  "xsr_Deva",
+  "xsu_Latn",
+  "xtd_Latn",
+  "xtm_Latn",
+  "xtn_Latn",
+  "xuo_Latn",
+  "yaa_Latn",
+  "yad_Latn",
+  "yal_Latn",
+  "yan_Latn",
+  "yao_Latn",
+  "yap_Latn",
+  "yaq_Latn",
+  "ybb_Latn",
+  "yby_Latn",
+  "ycn_Latn",
+  "ydd_Hebr",
+  "yka_Latn",
+  "yle_Latn",
+  "yli_Latn",
+  "yml_Latn",
+  "yom_Latn",
+  "yon_Latn",
+  "yor_Latn",
+  "yrb_Latn",
+  "yre_Latn",
+  "yrk_Cyrl",
+  "yrl_Latn",
+  "yss_Latn",
+  "yua_Latn",
+  "yue_Hani",
+  "yuj_Latn",
+  "yut_Latn",
+  "yuw_Latn",
+  "yva_Latn",
+  "zaa_Latn",
+  "zab_Latn",
+  "zac_Latn",
+  "zad_Latn",
+  "zae_Latn",
+  "zai_Latn",
+  "zam_Latn",
+  "zao_Latn",
+  "zar_Latn",
+  "zas_Latn",
+  "zat_Latn",
+  "zav_Latn",
+  "zaw_Latn",
+  "zdj_Latn",
+  "zea_Latn",
+  "zgh_Tfng",
+  "zia_Latn",
+  "ziw_Latn",
+  "zne_Latn",
+  "zom_Latn",
+  "zos_Latn",
+  "zpa_Latn",
+  "zpc_Latn",
+  "zpg_Latn",
+  "zpi_Latn",
+  "zpl_Latn",
+  "zpm_Latn",
+  "zpo_Latn",
+  "zpt_Latn",
+  "zpu_Latn",
+  "zpv_Latn",
+  "zpz_Latn",
+  "zsm_Latn",
+  "zsr_Latn",
+  "ztq_Latn",
+  "zty_Latn",
+  "zul_Latn",
+  "zyb_Latn",
+  "zyp_Latn"
+ ]
+}

millid.py

@@ -0,0 +1,1333 @@
+# /// script
+# requires-python = ">=3.10"
+# dependencies = [
+#     "torch>=2.4",
+#     "numpy",
+#     "pandas",
+#     "pyarrow",
+#     "huggingface_hub>=0.30",
+#     "safetensors",
+#     "fasttext-wheel",
+#     "wandb",
+#     "tyro>=0.8",
+# ]
+# ///
+"""MillID: MultiLingual Language IDentifier.
+
+A byte-level, encoder-only transformer that names the language of a passage of text, over
+the label set of baobabtech/millid-dataset (1,000+ language-script labels).
+
+One file, three uses:
+
+    # train on Hugging Face Jobs, evaluate against GlotLID, push to the Hub
+    hf jobs uv run --flavor h200 --timeout 4h --secrets HF_TOKEN \\
+        millid/millid.py train --dataset baobabtech/millid-dataset --push-to baobabtech/millid
+
+    # evaluate a trained model
+    python millid.py evaluate --model baobabtech/millid --dataset baobabtech/millid-dataset
+
+    # tune hyperparameters with a Weights & Biases sweep (agents run as Jobs too)
+    wandb sweep millid/sweep.yaml          # prints ENTITY/PROJECT/SWEEP_ID
+    hf jobs uv run --flavor h200 --secrets HF_TOKEN --secrets WANDB_API_KEY \\
+        millid/millid.py sweep-agent --sweep-id ENTITY/PROJECT/SWEEP_ID --count 6
+
+    # use it
+    from millid import MillID
+    model = MillID.from_pretrained("baobabtech/millid")
+    model.predict(["Lave men ou ak savon."], k=3)  # [[("hat_Latn", 0.98), ...]]
+
+One universal encoding
+----------------------
+Text: Unicode NFKC, whitespace collapsed, then UTF-8 bytes. Every script in every language is the
+same 256 symbols, so there is no tokenizer to train, no vocabulary to outgrow and no unknown
+token; a script the model has never seen is still bytes it can read.
+
+Labels: ISO 639-3 plus ISO 15924 script (`eng_Latn`, `amh_Ethi`), the dataset's labels.json
+fixing label i to labels[i]. A model trained with extra sources keeps those ids and appends its
+own labels after them.
+
+Architecture (ARCHITECTURE.md has the full design)
+------------
+    UTF-8 bytes, each embedded as byte + script + byte-in-character + hashed char 2/3/4-grams
+                -> depthwise convolution stem -> strided convolution (2 bytes per token)
+                -> N pre-norm blocks: RMSNorm, attention with RoPE, RMSNorm, SwiGLU
+                -> masked mean pooling -> language head (label + language + script vectors)
+
+Presets: tiny ~2M and small ~12M for trials, medium ~114M (default), large ~190M.
+
+The model is two parts, and the split is deliberate. `MillIDTextEncoder` turns bytes into one
+d_model vector; `LanguageHead` turns a vector into a language. MillID v2 adds images: an image
+encoder producing vectors in the same d_model space, fused with the text vector (or used alone
+for a scan with no text layer) before the same head. Checkpoint keys are `text.*` and `head.*`
+from v1 on, so v1 weights load into v2 unchanged.
+
+Configuration is CleanRL-style: each command is a typed dataclass (`TrainArgs`, ...) whose
+fields are the flags and whose field docstrings are the help, parsed by tyro. `python millid.py
+train --help` lists every setting; the resolved settings are saved with each run, in
+config.json and in W&B.
+
+Tracking: with WANDB_API_KEY set (or --wandb-project), every run logs its hyperparameters,
+training loss, learning rate, gradient norm and throughput, the validation curve, and the
+final per-set metrics and per-language tables to Weights & Biases.
+"""
+
+from __future__ import annotations
+
+import json
+import math
+import os
+import random
+import shutil
+import sys
+import time
+import unicodedata
+import zlib
+from dataclasses import asdict, dataclass, field
+from functools import lru_cache
+from pathlib import Path
+from typing import Literal
+
+import numpy as np
+import torch
+import torch.nn as nn
+import torch.nn.functional as F
+
+# --- the universal text encoding ---------------------------------------------------------
+#
+# A passage becomes four aligned sequences, one entry per UTF-8 byte:
+#
+#   ids      the byte, shifted by OFFSET; CLS first
+#   script   the Unicode script of the character the byte belongs to
+#   charpos  1 a one-byte character, 2 the first byte of a longer one, 3 a continuation byte
+#   ngrams   hashed character n-grams of 2, 3 and 4 characters ending at the byte's character
+#
+# Bytes make every language the same 256 symbols. The other three tell the model what bytes
+# alone hide: which writing system it is reading, where characters begin, and the character
+# n-grams that fastText and GlotLID identify languages by.
+
+PAD, CLS, EOS = 0, 1, 2
+OFFSET = 3  # byte b is token b + OFFSET
+VOCAB_SIZE = 256 + OFFSET
+SCRIPT_BUCKETS = 512
+SCRIPT_COMMON = 1  # digits, punctuation, symbols, spaces: shared by every script
+NGRAM_ORDERS = (2, 3, 4)
+
+
+def normalize(text: str) -> str:
+    """NFKC folds what PDF text layers and keyboards differ on (ligatures, full-width forms,
+    Arabic presentation forms) without changing the language of anything. Runs of whitespace
+    become one space."""
+    return " ".join(unicodedata.normalize("NFKC", str(text)).split())
+
+
+@lru_cache(maxsize=1 << 16)
+def char_script(ch: str) -> int:
+    """The script of a letter or mark, as an id: the first word of its Unicode name (LATIN,
+    ETHIOPIC, DEVANAGARI, CJK, HANGUL, ADLAM...), hashed. Python has no Unicode script property;
+    the name's first word is the same grouping for letters and marks, and hashing keeps the ids
+    stable when a newer Unicode adds scripts."""
+    if unicodedata.category(ch)[0] not in "LM":
+        return SCRIPT_COMMON
+    word = unicodedata.name(ch, "").split(" ", 1)[0]
+    if not word:
+        return SCRIPT_COMMON
+    return 2 + zlib.crc32(word.encode()) % (SCRIPT_BUCKETS - 2)
+
+
+_SCRIPT_TABLE_SIZE = 0x40000  # planes 0 to 3, every script in use; beyond, char_script per character
+_script_table: np.ndarray | None = None
+
+
+def script_table() -> np.ndarray:
+    """char_script for every code point below 0x40000, built once per process (about a second).
+    Built before the DataLoader forks, the workers share it."""
+    global _script_table
+    if _script_table is None:
+        uncached = char_script.__wrapped__
+        _script_table = np.fromiter((uncached(chr(c)) for c in range(_SCRIPT_TABLE_SIZE)), dtype=np.int64, count=_SCRIPT_TABLE_SIZE)
+    return _script_table
+
+
+# The n-gram hash: a polynomial over lowercased code points, read from the character back,
+# then splitmix64, so neighbouring n-grams land in unrelated buckets. Before the passage every
+# position holds _START, which no code point equals, so a word at the start of a passage has
+# n-grams of its own. numpy's uint64 arithmetic wraps, which is the modulus.
+_START = 0x110000
+_PRIME = np.uint64(0x100000001B3)
+_MIX1, _MIX2 = np.uint64(0xBF58476D1CE4E5B9), np.uint64(0x94D049BB133111EB)
+_ORDER_SEED = {n: np.uint64((0x9E3779B97F4A7C15 * n) & 0xFFFFFFFFFFFFFFFF) for n in NGRAM_ORDERS}
+
+
+def _splitmix(x: np.ndarray) -> np.ndarray:
+    x = (x ^ (x >> np.uint64(30))) * _MIX1
+    x = (x ^ (x >> np.uint64(27))) * _MIX2
+    return x ^ (x >> np.uint64(31))
+
+
+def _codepoints(text: str) -> np.ndarray:
+    # "replace": a lone surrogate (broken PDF text) becomes "?", one code point for one
+    return np.frombuffer(text.encode("utf-32-le", "replace"), dtype=np.uint32)
+
+
+_UTF8_LEAD = np.array([0, 0x00, 0xC0, 0xE0, 0xF0], dtype=np.int64)  # by sequence length
+
+
+def encode_batch(texts: list[str], max_len: int = 256, ngram_buckets: int = 32768, rng: random.Random | None = None) -> dict[str, torch.Tensor]:
+    """Passages as the model's input: the four per-byte sequences, CLS first, padded to the
+    longest, and the mask. A passage longer than max_len bytes is cut to a window of whole
+    characters: its start at inference, a random place in training.
+
+    The whole batch is one string, and every step one numpy operation over it, because the
+    training data workers run this for every batch: per passage it would be dozens of small
+    array operations, whose overhead is most of the cost."""
+    texts = [normalize(t) for t in texts]
+    b, budget = len(texts), max_len - 1
+    joined = "".join(texts)
+    cp = _codepoints(joined)
+    low = joined.lower()  # lower() may lengthen a character; then keep the first of its lowercase
+    low = _codepoints(low) if len(low) == len(joined) else _codepoints("".join(ch.lower()[0] for ch in joined))
+    lens = np.fromiter(map(len, texts), dtype=np.int64, count=b)
+    first = np.cumsum(lens) - lens  # each passage's first character in cp
+    after = first + lens
+    sizes = (1 + (cp >= 0x80) + (cp >= 0x800) + (cp >= 0x10000)).astype(np.int64)  # UTF-8 bytes per character
+    ends = np.concatenate([[0], np.cumsum(sizes)])  # ends[k]: the bytes before character k
+
+    # Each passage's window, characters lo..hi-1 of cp.
+    lo = first.copy()
+    if rng is not None:
+        long = np.flatnonzero(ends[after] - ends[first] > budget)
+        if len(long):
+            last = np.searchsorted(ends, ends[after[long]] - budget, side="left")  # the first start that fits the rest
+            u = np.array([rng.random() for _ in long])
+            lo[long] += (u * (last - first[long])).astype(np.int64)  # every start before `last` fills the window
+    hi = np.minimum(np.searchsorted(ends, ends[lo] + budget, side="right") - 1, after)
+    w = hi - lo
+    at = np.repeat(lo - (np.cumsum(w) - w), w) + np.arange(w.sum())  # every window character, in order
+    c = cp[at].astype(np.int64)
+
+    inside = c < _SCRIPT_TABLE_SIZE
+    script = script_table()[np.where(inside, c, 0)]
+    for k in np.flatnonzero(~inside):
+        script[k] = char_script(chr(c[k]))
+
+    # n-grams: the characters from this one back, _START before the start of its passage
+    into = at - np.repeat(first, w)
+    grams = np.empty((len(at), len(NGRAM_ORDERS)), dtype=np.int64)
+    h = np.zeros(len(at), dtype=np.uint64)
+    for n in range(1, max(NGRAM_ORDERS) + 1):
+        h = h * _PRIME + np.where(into >= n - 1, low[np.maximum(at - (n - 1), 0)], _START).astype(np.uint64)
+        if n in _ORDER_SEED:
+            grams[:, NGRAM_ORDERS.index(n)] = (_splitmix(h ^ _ORDER_SEED[n]) % np.uint64(ngram_buckets - 1)).astype(np.int64) + 1
+
+    # UTF-8, from the code points: byte k of an s-byte character
+    s = sizes[at]
+    cb, sb = np.repeat(c, s), np.repeat(s, s)
+    k = np.arange(len(cb)) - np.repeat(np.cumsum(s) - s, s)
+    shifted = cb >> (6 * (sb - 1 - k))
+    raw = np.where(k == 0, shifted | _UTF8_LEAD[sb], (shifted & 0x3F) | 0x80)
+    charpos = np.where(sb == 1, 1, np.where(k == 0, 2, 3))
+
+    nb = ends[hi] - ends[lo]  # bytes per passage
+    row = np.repeat(np.arange(b), nb)
+    col = 1 + np.arange(len(cb)) - np.repeat(np.cumsum(nb) - nb, nb)
+    width = 1 + int(nb.max(initial=0))
+    out = {name: np.zeros((b, width), dtype=np.int64) for name in ("ids", "script", "charpos")}
+    out["ngrams"] = np.zeros((b, width, len(NGRAM_ORDERS)), dtype=np.int64)
+    out["ids"][:, 0], out["script"][:, 0], out["charpos"][:, 0] = CLS, SCRIPT_COMMON, 1
+    out["ids"][row, col] = raw + OFFSET
+    out["script"][row, col] = np.repeat(script, s)
+    out["charpos"][row, col] = charpos
+    out["ngrams"][row, col] = np.repeat(grams, s, axis=0)
+    out = {name: torch.from_numpy(v) for name, v in out.items()}
+    out["mask"] = out["ids"] != PAD
+    return out
+
+
+@dataclass
+class Encoded:
+    """One passage as four aligned arrays, one entry per byte, CLS first."""
+
+    ids: np.ndarray  # [m]
+    script: np.ndarray  # [m]
+    charpos: np.ndarray  # [m]
+    ngrams: np.ndarray  # [m, len(NGRAM_ORDERS)]
+
+
+def encode(text: str, max_len: int = 256, ngram_buckets: int = 32768, rng: random.Random | None = None) -> Encoded:
+    """One passage, unpadded: encode_batch of one."""
+    x = encode_batch([text], max_len, ngram_buckets, rng)
+    m = int(x["mask"][0].sum())
+    return Encoded(*(x[name][0, :m].numpy() for name in ("ids", "script", "charpos", "ngrams")))
+
+
+def collate(items: list[Encoded]) -> dict[str, torch.Tensor]:
+    n, g = max(len(e.ids) for e in items), len(NGRAM_ORDERS)
+    ids = np.zeros((len(items), n), dtype=np.int64)
+    script = np.zeros_like(ids)
+    charpos = np.zeros_like(ids)
+    ngrams = np.zeros((len(items), n, g), dtype=np.int64)
+    for i, e in enumerate(items):
+        m = len(e.ids)
+        ids[i, :m], script[i, :m], charpos[i, :m], ngrams[i, :m] = e.ids, e.script, e.charpos, e.ngrams
+    out = {k: torch.from_numpy(v) for k, v in (("ids", ids), ("script", script), ("charpos", charpos), ("ngrams", ngrams))}
+    out["mask"] = out["ids"] != PAD
+    return out
+
+
+# --- the universal label encoding --------------------------------------------------------
+
+
+@dataclass
+class Labels:
+    labels: list[str]
+    aliases: dict[str, str] = field(default_factory=dict)
+    dropped: list[str] = field(default_factory=list)
+
+    def __post_init__(self) -> None:
+        self.index = {lab: i for i, lab in enumerate(self.labels)}
+
+    def __len__(self) -> int:
+        return len(self.labels)
+
+    def canonical(self, label: str) -> str | None:
+        if label in self.dropped:
+            return None
+        return self.aliases.get(label, label)
+
+    def extend(self, more) -> Labels:
+        """The same ids, with new labels appended after them."""
+        new = sorted({lab for lab in more if lab not in self.index})
+        return Labels(self.labels + new, self.aliases, self.dropped)
+
+    @classmethod
+    def load(cls, path: Path) -> Labels:
+        d = json.loads(Path(path).read_text(encoding="utf-8"))
+        return cls(d["labels"], d.get("aliases", {}), d.get("dropped", []))
+
+    def save(self, path: Path, trained: set[str] | None = None) -> None:
+        d = {
+            "scheme": "ISO 639-3 language + '_' + ISO 15924 script, e.g. eng_Latn, amh_Ethi",
+            "text_encoding": "Unicode NFKC, whitespace collapsed, then UTF-8 bytes",
+            "labels": self.labels,
+            "aliases": self.aliases,
+            "dropped": self.dropped,
+        }
+        if trained is not None:
+            d["trained"] = sorted(trained)
+        Path(path).write_text(json.dumps(d, indent=1, ensure_ascii=False), encoding="utf-8")
+
+
+# --- the model ---------------------------------------------------------------------------
+
+
+@dataclass
+class MillIDConfig:
+    num_labels: int = 0
+    max_len: int = 256
+    d_model: int = 768
+    n_layers: int = 12
+    n_heads: int = 12
+    dropout: float = 0.1
+    conv_kernel: int = 5
+    downsample: int = 2
+    ngram_buckets: int = 32768
+    script_buckets: int = SCRIPT_BUCKETS
+    rope_theta: float = 10_000.0
+    vocab_size: int = VOCAB_SIZE
+    modalities: tuple[str, ...] = ("text",)
+    model_type: str = "millid-byte-encoder"
+
+    @property
+    def d_ff(self) -> int:
+        """SwiGLU width: 8/3 d, rounded to 64, the same parameters as a 4d GELU layer."""
+        return max(64, round(8 * self.d_model / 3 / 64) * 64)
+
+
+PRESETS = {
+    "tiny": dict(d_model=192, n_layers=3, n_heads=3, downsample=1, ngram_buckets=4096),
+    "small": dict(d_model=384, n_layers=6, n_heads=6, downsample=2, ngram_buckets=16384),
+    "medium": dict(d_model=768, n_layers=12, n_heads=12, downsample=2, ngram_buckets=32768),
+    "large": dict(d_model=1024, n_layers=12, n_heads=16, downsample=2, ngram_buckets=32768),
+}
+
+
+def rope_tables(n: int, head_dim: int, theta: float) -> tuple[torch.Tensor, torch.Tensor]:
+    inv = 1.0 / (theta ** (torch.arange(0, head_dim, 2).float() / head_dim))
+    angles = torch.outer(torch.arange(n).float(), inv)
+    return angles.cos(), angles.sin()
+
+
+def apply_rope(x: torch.Tensor, cos: torch.Tensor, sin: torch.Tensor) -> torch.Tensor:
+    """Rotate each pair of features by its position's angle (x: batch, heads, length, head_dim)."""
+    c = cos[: x.size(2)].to(x.dtype)[None, None]
+    s = sin[: x.size(2)].to(x.dtype)[None, None]
+    x1, x2 = x[..., 0::2], x[..., 1::2]
+    return torch.stack((x1 * c - x2 * s, x1 * s + x2 * c), dim=-1).flatten(-2)
+
+
+class Attention(nn.Module):
+    def __init__(self, cfg: MillIDConfig):
+        super().__init__()
+        self.h = cfg.n_heads
+        self.hd = cfg.d_model // cfg.n_heads
+        self.qkv = nn.Linear(cfg.d_model, 3 * cfg.d_model, bias=False)
+        self.out = nn.Linear(cfg.d_model, cfg.d_model, bias=False)
+        self.p = cfg.dropout
+
+    def forward(self, x, cos, sin, key_mask):
+        b, n, _ = x.shape
+        q, k, v = self.qkv(x).view(b, n, 3, self.h, self.hd).permute(2, 0, 3, 1, 4)
+        q, k = apply_rope(q, cos, sin), apply_rope(k, cos, sin)
+        y = F.scaled_dot_product_attention(
+            q, k, v, attn_mask=key_mask[:, None, None, :], dropout_p=self.p if self.training else 0.0
+        )
+        return self.out(y.transpose(1, 2).reshape(b, n, -1))
+
+
+class SwiGLU(nn.Module):
+    def __init__(self, cfg: MillIDConfig):
+        super().__init__()
+        self.w1 = nn.Linear(cfg.d_model, cfg.d_ff, bias=False)
+        self.w3 = nn.Linear(cfg.d_model, cfg.d_ff, bias=False)
+        self.w2 = nn.Linear(cfg.d_ff, cfg.d_model, bias=False)
+        self.drop = nn.Dropout(cfg.dropout)
+
+    def forward(self, x):
+        return self.w2(self.drop(F.silu(self.w1(x)) * self.w3(x)))
+
+
+class Block(nn.Module):
+    """Pre-norm: RMSNorm, attention with RoPE, residual; RMSNorm, SwiGLU, residual."""
+
+    def __init__(self, cfg: MillIDConfig):
+        super().__init__()
+        self.norm1 = nn.RMSNorm(cfg.d_model)
+        self.attn = Attention(cfg)
+        self.norm2 = nn.RMSNorm(cfg.d_model)
+        self.ffn = SwiGLU(cfg)
+        self.drop = nn.Dropout(cfg.dropout)
+
+    def forward(self, x, cos, sin, key_mask):
+        x = x + self.drop(self.attn(self.norm1(x), cos, sin, key_mask))
+        return x + self.drop(self.ffn(self.norm2(x)))
+
+
+class MillIDTextEncoder(nn.Module):
+    """A passage's four byte sequences to one d_model vector: the representation a future image
+    branch is fused with."""
+
+    def __init__(self, cfg: MillIDConfig):
+        super().__init__()
+        d = cfg.d_model
+        self.byte_emb = nn.Embedding(cfg.vocab_size, d, padding_idx=PAD)
+        self.script_emb = nn.Embedding(cfg.script_buckets, d, padding_idx=PAD)
+        self.charpos_emb = nn.Embedding(4, d, padding_idx=PAD)
+        self.ngram_emb = nn.Embedding(cfg.ngram_buckets, d, padding_idx=PAD)
+        # Depthwise over each feature, then mixed: n-grams of conv_kernel bytes, per position.
+        self.stem = nn.Sequential(
+            nn.Conv1d(d, d, cfg.conv_kernel, padding=cfg.conv_kernel // 2, groups=d),
+            nn.GELU(),
+            nn.Conv1d(d, d, 1),
+        )
+        # Then every `downsample` bytes become one token: the transformer reads half as many.
+        self.r = cfg.downsample
+        self.down = nn.Conv1d(d, d, self.r, stride=self.r) if self.r > 1 else None
+        self.blocks = nn.ModuleList(Block(cfg) for _ in range(cfg.n_layers))
+        self.norm = nn.RMSNorm(d)
+        cos, sin = rope_tables(cfg.max_len // self.r + 2, d // cfg.n_heads, cfg.rope_theta)
+        self.register_buffer("cos", cos, persistent=False)
+        self.register_buffer("sin", sin, persistent=False)
+
+    def tokens(self, batch: dict[str, torch.Tensor]) -> tuple[torch.Tensor, torch.Tensor]:
+        """Every token's vector after the last layer, and which tokens are real."""
+        mask = batch["mask"]
+        x = (
+            self.byte_emb(batch["ids"])
+            + self.script_emb(batch["script"])
+            + self.charpos_emb(batch["charpos"])
+            + self.ngram_emb(batch["ngrams"]).sum(2)
+        )
+        m = mask.unsqueeze(-1).to(x.dtype)
+        x = (x + self.stem((x * m).transpose(1, 2)).transpose(1, 2)) * m
+        if self.down is not None:
+            pad = (-x.size(1)) % self.r
+            if pad:
+                x, mask = F.pad(x, (0, 0, 0, pad)), F.pad(mask, (0, pad))
+            x = self.down(x.transpose(1, 2)).transpose(1, 2)
+            mask = mask.view(mask.size(0), -1, self.r).any(-1)
+        for block in self.blocks:
+            x = block(x, self.cos, self.sin, mask)
+        return self.norm(x), mask
+
+    def forward(self, batch: dict[str, torch.Tensor]) -> torch.Tensor:
+        x, mask = self.tokens(batch)
+        m = mask.unsqueeze(-1).to(x.dtype)
+        return (x * m).sum(1) / m.sum(1).clamp(min=1.0)
+
+
+class LanguageHead(nn.Module):
+    """A vector to a score per language, shared by every modality.
+
+    Each language's vector is built from its parts: its own, its language's (shared by
+    `srp_Cyrl` and `srp_Latn`) and its script's (shared by every Ethiopic-script language). A
+    language with little data borrows from what it shares, and `language_vectors()` are the
+    learned language embeddings themselves.
+    """
+
+    def __init__(self, cfg: MillIDConfig, labels: list[str]):
+        super().__init__()
+        codes = sorted({lab.split("_", 1)[0] for lab in labels})
+        scripts = sorted({lab.split("_", 1)[1] if "_" in lab else "" for lab in labels})
+        code_id = {c: i for i, c in enumerate(codes)}
+        script_id = {sc: i for i, sc in enumerate(scripts)}
+        self.register_buffer("code_of", torch.tensor([code_id[lab.split("_", 1)[0]] for lab in labels]))
+        self.register_buffer(
+            "script_of", torch.tensor([script_id[lab.split("_", 1)[1] if "_" in lab else ""] for lab in labels])
+        )
+        d = cfg.d_model
+        self.label_emb = nn.Embedding(len(labels), d)
+        self.code_emb = nn.Embedding(len(codes), d)
+        self.script_emb = nn.Embedding(len(scripts), d)
+        self.bias = nn.Parameter(torch.zeros(len(labels)))
+        self.drop = nn.Dropout(cfg.dropout)
+
+    def language_vectors(self) -> torch.Tensor:
+        return self.label_emb.weight + self.code_emb(self.code_of) + self.script_emb(self.script_of)
+
+    def forward(self, z: torch.Tensor) -> torch.Tensor:
+        return F.linear(self.drop(z), self.language_vectors(), self.bias)
+
+
+class MillIDEncoder(nn.Module):
+    def __init__(self, cfg: MillIDConfig, labels: list[str]):
+        super().__init__()
+        self.cfg = cfg
+        self.text = MillIDTextEncoder(cfg)
+        self.head = LanguageHead(cfg, labels)
+        self.apply(self._init)
+        # Each residual branch's last projection starts small, so a deep stack starts close to
+        # the identity (GPT-2's scaling).
+        for block in self.text.blocks:
+            for w in (block.attn.out.weight, block.ffn.w2.weight):
+                nn.init.normal_(w, std=0.02 / math.sqrt(2 * cfg.n_layers))
+
+    @staticmethod
+    def _init(m: nn.Module) -> None:
+        if isinstance(m, nn.Linear):
+            nn.init.normal_(m.weight, std=0.02)
+            if m.bias is not None:
+                nn.init.zeros_(m.bias)
+        elif isinstance(m, nn.Embedding):
+            nn.init.normal_(m.weight, std=0.02)
+            if m.padding_idx is not None:
+                with torch.no_grad():
+                    m.weight[m.padding_idx].zero_()
+
+    def embed(self, batch: dict[str, torch.Tensor]) -> torch.Tensor:
+        """The passage as one vector, before the head: for similarity, clustering, fusion."""
+        return self.text(batch)
+
+    def forward(self, batch: dict[str, torch.Tensor]) -> torch.Tensor:
+        return self.head(self.text(batch))
+
+
+class MillID:
+    """A trained model, ready to answer: ranked (label, probability) per text."""
+
+    def __init__(self, model: MillIDEncoder, labels: Labels, trained: set[str] | None = None, device: str | None = None):
+        self.device = device or ("cuda" if torch.cuda.is_available() else "cpu")
+        self.model = model.to(self.device).eval()
+        self.labels = labels
+        # Logits of labels the model never saw a passage of are not answers.
+        self.trained = trained or set(labels.labels)
+        keep = torch.tensor([lab in self.trained for lab in labels.labels], device=self.device)
+        self.bias = torch.where(keep, 0.0, float("-inf"))
+
+    @classmethod
+    def from_pretrained(cls, path_or_repo: str, device: str | None = None) -> MillID:
+        from safetensors.torch import load_file
+
+        path = Path(path_or_repo)
+        if not path.exists():
+            from huggingface_hub import snapshot_download
+
+            path = Path(snapshot_download(path_or_repo, allow_patterns=["config.json", "labels.json", "model.safetensors"]))
+        cfg = MillIDConfig(**json.loads((path / "config.json").read_text())["model"])
+        meta = json.loads((path / "labels.json").read_text(encoding="utf-8"))
+        labels = Labels(meta["labels"], meta.get("aliases", {}), meta.get("dropped", []))
+        model = MillIDEncoder(cfg, labels.labels)
+        model.load_state_dict(load_file(str(path / "model.safetensors")))
+        return cls(model, labels, set(meta.get("trained", meta["labels"])), device)
+
+    def batch(self, texts: list[str]) -> dict[str, torch.Tensor]:
+        cfg = self.model.cfg
+        b = encode_batch(texts, cfg.max_len, cfg.ngram_buckets)
+        return {k: v.to(self.device) for k, v in b.items()}
+
+    @torch.no_grad()
+    def predict(self, texts: list[str], k: int = 5, batch_size: int = 512) -> list[list[tuple[str, float]]]:
+        out = []
+        for i in range(0, len(texts), batch_size):
+            with torch.autocast(self.device, dtype=torch.bfloat16, enabled=self.device == "cuda"):
+                logits = self.model(self.batch(texts[i : i + batch_size])).float()
+            probs = F.softmax(logits + self.bias, dim=-1)
+            p, idx = probs.topk(k, dim=-1)
+            for pr, ix in zip(p.tolist(), idx.tolist(), strict=True):
+                out.append([(self.labels.labels[j], v) for j, v in zip(ix, pr, strict=True)])
+        return out
+
+    @torch.no_grad()
+    def embed(self, texts: list[str]) -> torch.Tensor:
+        """Passage vectors, B x d_model."""
+        return self.model.embed(self.batch(texts)).float().cpu()
+
+
+# --- metrics (the same definitions as scripts/metrics.py, tested there) -----------------
+
+
+def per_language(true: list[str], pred: list[str]):
+    import pandas as pd
+
+    t, p = pd.Series(list(true)), pd.Series(list(pred))
+    n = len(t)
+    out = pd.DataFrame({"support": t.value_counts()})
+    out["tp"] = t[t.values == p.values].value_counts().reindex(out.index, fill_value=0)
+    out["fp"] = p.value_counts().reindex(out.index, fill_value=0) - out["tp"]
+    out["fn"] = out["support"] - out["tp"]
+    out["tn"] = n - out["tp"] - out["fp"] - out["fn"]
+    with np.errstate(divide="ignore", invalid="ignore"):
+        out["precision"] = np.where(out["tp"] + out["fp"] > 0, out["tp"] / (out["tp"] + out["fp"]), 0.0)
+        out["recall"] = out["tp"] / out["support"]
+        pr = out["precision"] + out["recall"]
+        out["f1"] = np.where(pr > 0, 2 * out["precision"] * out["recall"] / pr, 0.0)
+        out["specificity"] = out["tn"] / (out["tn"] + out["fp"])
+        out["fp_per_million"] = out["fp"] / (n - out["support"]) * 1e6
+    out["sensitivity"] = out["recall"]
+    out.index.name = "label"
+    return out.sort_index()
+
+
+def summarize(table, true: list[str], ranked: list[list[str]]) -> dict:
+    n = max(1, len(true))
+    s = {f"top{k}_accuracy": sum(t in r[:k] for t, r in zip(true, ranked, strict=True)) / n for k in (1, 3, 5)}
+    w = table["support"] / table["support"].sum()
+    s.update(
+        passages=int(table["support"].sum()),
+        languages=int(len(table)),
+        macro_precision=float(table["precision"].mean()),
+        macro_recall=float(table["recall"].mean()),
+        macro_f1=float(table["f1"].mean()),
+        macro_specificity=float(table["specificity"].mean()),
+        weighted_f1=float((table["f1"] * w).sum()),
+        median_f1=float(table["f1"].median()),
+        languages_f1_at_least_0_9=int((table["f1"] >= 0.9).sum()),
+        languages_f1_below_0_5=int((table["f1"] < 0.5).sum()),
+        mean_fp_per_million=float(table["fp_per_million"].mean()),
+    )
+    s["micro_f1"] = s["top1_accuracy"]
+    return s
+
+
+# --- data --------------------------------------------------------------------------------
+
+
+def load_dataset_dir(dataset: str) -> Path:
+    """A local build directory, or the dataset repo downloaded (parquet and labels.json only)."""
+    if Path(dataset).exists():
+        return Path(dataset)
+    from huggingface_hub import snapshot_download
+
+    return Path(snapshot_download(dataset, repo_type="dataset", allow_patterns=["data/*", "udhr/*", "labels.json", "stats.json"]))
+
+
+def read_split(root: Path, name: str):
+    import pandas as pd
+
+    if name == "udhr":
+        return pd.read_parquet(root / "udhr" / "test.parquet")
+    return pd.read_parquet(root / "data" / f"{name}.parquet")
+
+
+class Sampler:
+    """Training passages, drawn so that small languages are seen often enough to learn.
+
+    A language is drawn with probability proportional to n^alpha, n being its passage count:
+    alpha 1 is the data as it is, alpha 0 every language equally; 0.3 in between. Then a
+    passage of it is drawn, and sometimes cut short, because a short snippet is where
+    language identification is hardest and what a document pipeline sees in table cells.
+    """
+
+    def __init__(self, texts: list[str], label_ids: np.ndarray, alpha: float, short_p: float, seed: int):
+        self.texts = texts
+        self.rng = random.Random(seed)
+        self.np_rng = np.random.default_rng(seed)
+        order = np.argsort(label_ids, kind="stable")
+        self.by_label = np.split(order, np.flatnonzero(np.diff(label_ids[order])) + 1)
+        self.label_of = np.array([label_ids[g[0]] for g in self.by_label])
+        sizes = np.array([len(g) for g in self.by_label], dtype=float)
+        p = sizes**alpha
+        self.p = p / p.sum()
+        self.short_p = short_p
+
+    def draw(self, n: int) -> tuple[list[str], np.ndarray]:
+        groups = self.np_rng.choice(len(self.by_label), size=n, p=self.p)
+        texts, labels = [], []
+        for g in groups:
+            idx = self.by_label[g][self.rng.randrange(len(self.by_label[g]))]
+            texts.append(self._maybe_short(self.texts[idx]))
+            labels.append(self.label_of[g])
+        return texts, np.array(labels)
+
+    def _maybe_short(self, text: str) -> str:
+        if self.rng.random() >= self.short_p or len(text) <= 40:
+            return text
+        n = self.rng.randint(20, 80)
+        start = self.rng.randrange(0, max(1, len(text) - n))
+        if " " in text:  # start and end on word boundaries where the script has them
+            left = text.rfind(" ", 0, start) + 1
+            right = text.find(" ", left + n)
+            return text[left : right if right > 0 else len(text)]
+        return text[start : start + n]
+
+
+# --- tracking ----------------------------------------------------------------------------
+
+
+class Tracker:
+    """Weights & Biases when there is a key or a project, and nothing otherwise, so the same run
+    works locally without an account. Inside a sweep agent, the agent's run is used."""
+
+    def __init__(self, args, config: dict):
+        self.run = None
+        self.wandb = None
+        if args.no_wandb or not (args.wandb_project or os.environ.get("WANDB_API_KEY")):
+            return
+        import wandb
+
+        self.wandb = wandb
+        clean = asdict(args)
+        if wandb.run is not None:
+            self.run = wandb.run
+            self.run.config.update({**config}, allow_val_change=True)
+            self.owned = False
+        else:
+            self.run = wandb.init(
+                project=args.wandb_project or "millid",
+                entity=args.wandb_entity,
+                name=args.wandb_run_name,
+                tags=args.wandb_tags or None,
+                config={**clean, **config},
+                job_type="train",
+            )
+            self.owned = True
+        self.run.define_metric("train/*", step_metric="step")
+        self.run.define_metric("val/*", step_metric="step")
+
+    def log(self, data: dict, step: int) -> None:
+        if self.run:
+            self.run.log({"step": step, **data})
+
+    def summary(self, data: dict) -> None:
+        if self.run:
+            self.run.summary.update(data)
+
+    def table(self, key: str, frame) -> None:
+        if self.run:
+            self.run.log({key: self.wandb.Table(dataframe=frame.reset_index())})
+
+    def finish(self) -> None:
+        if self.run and self.owned:
+            self.run.finish()
+
+
+# --- training ----------------------------------------------------------------------------
+
+
+class TrainStream(torch.utils.data.IterableDataset):
+    """Endless training batches, encoded in DataLoader workers so the GPU never waits for
+    Python. Each worker draws with its own seed."""
+
+    def __init__(self, texts, label_ids, args, cfg: MillIDConfig):
+        self.texts, self.label_ids = texts, label_ids
+        self.args, self.cfg = args, cfg
+
+    def __iter__(self):
+        info = torch.utils.data.get_worker_info()
+        seed = self.args.seed * 1000 + (info.id if info else 0)
+        sampler = Sampler(self.texts, self.label_ids, self.args.alpha, self.args.short_p, seed)
+        rng = random.Random(seed)
+        while True:
+            texts, y = sampler.draw(self.args.batch_size)
+            batch = encode_batch(texts, self.cfg.max_len, self.cfg.ngram_buckets, rng)
+            batch["y"] = torch.from_numpy(y)
+            yield batch
+
+
+
+
+def stratified(frame, per_label: int, seed: int = 7):
+    return frame.sample(frac=1, random_state=seed).groupby("label").head(per_label)
+
+
+def evaluate_frame(model: MillID, frame, batch_size: int = 1024) -> tuple[dict, object, list]:
+    ranked = model.predict(frame["text"].tolist(), k=5, batch_size=batch_size)
+    pred = [r[0][0] for r in ranked]
+    table = per_language(frame["label"].tolist(), pred)
+    return summarize(table, frame["label"].tolist(), [[lab for lab, _ in r] for r in ranked]), table, ranked
+
+
+def train(args: TrainArgs) -> None:
+    import pandas as pd
+    from safetensors.torch import save_file
+
+    torch.manual_seed(args.seed)
+    if args.threads:
+        torch.set_num_threads(args.threads)
+    device = "cuda" if torch.cuda.is_available() else "cpu"
+    root = load_dataset_dir(args.dataset)
+    labels = Labels.load(root / "labels.json")
+    tr = read_split(root, "train")
+    va = read_split(root, "validation")
+    if args.commercial_only:
+        tr = tr[~tr["license"].str.contains("NC", na=False)]
+        va = va[~va["license"].str.contains("NC", na=False)]
+    if args.extra:
+        extra = pd.concat([pd.read_parquet(p, columns=["text", "label"]) for p in args.extra], ignore_index=True)
+        extra["label"] = extra["label"].map(labels.canonical)
+        extra = extra.dropna(subset=["label"])
+        evals = set(va["text"].map(normalize)) | set(read_split(root, "test")["text"].map(normalize)) | set(read_split(root, "udhr")["text"].map(normalize))
+        extra = extra[~extra["text"].map(normalize).isin(evals)]
+        labels = labels.extend(extra["label"].unique())
+        tr = pd.concat([tr[["text", "label"]], extra], ignore_index=True)
+        print(f"extra training passages: {len(extra):,}", flush=True)
+    trained = set(tr["label"])
+    label_ids = tr["label"].map(labels.index).to_numpy()
+    print(f"{device}; train {len(tr):,} passages, {len(trained)} labels; validation {len(va):,}; vocabulary {len(labels)}", flush=True)
+
+    cfg = MillIDConfig(num_labels=len(labels), max_len=args.max_len, dropout=args.dropout, **PRESETS[args.preset])
+    net = MillIDEncoder(cfg, labels.labels).to(device)
+    step_net = torch.compile(net) if args.compile and device == "cuda" else net
+    params = sum(p.numel() for p in net.parameters())
+    print(f"MillID {args.preset}: {params / 1e6:.1f}M parameters, {cfg}", flush=True)
+    tracker = Tracker(
+        args,
+        {"model": asdict(cfg), "parameters": params, "train_passages": int(len(tr)),
+         "trained_labels": len(trained), "vocabulary": len(labels), "validation_passages": int(len(va))},
+    )  # fmt: skip
+
+    decay = [p for n, p in net.named_parameters() if p.dim() >= 2 and "emb" not in n]
+    no_decay = [p for n, p in net.named_parameters() if p.dim() < 2 or "emb" in n]
+    opt = torch.optim.AdamW(
+        [{"params": decay, "weight_decay": args.weight_decay}, {"params": no_decay, "weight_decay": 0.0}],
+        lr=args.lr, betas=(0.9, 0.98), eps=1e-8, fused=device == "cuda",
+    )  # fmt: skip
+
+    def lr_at(step: int) -> float:
+        if step < args.warmup:
+            return args.lr * step / args.warmup
+        progress = (step - args.warmup) / max(1, args.steps - args.warmup)
+        return args.lr * (0.05 + 0.95 * 0.5 * (1 + math.cos(math.pi * progress)))
+
+    if args.workers < 0:
+        args.workers = 0 if os.name == "nt" else max(0, min(12, (os.cpu_count() or 2) - 2))
+    script_table()  # once, before the workers fork, so they share it
+    print(f"{args.workers} data workers", flush=True)
+    loader = torch.utils.data.DataLoader(
+        TrainStream(tr["text"].tolist(), label_ids, args, cfg),
+        batch_size=None,
+        num_workers=args.workers,
+        pin_memory=device == "cuda",
+        prefetch_factor=4 if args.workers else None,
+        persistent_workers=args.workers > 0,
+    )
+    stream = iter(loader)
+    va_small = stratified(va, args.eval_per_label)
+    out = Path(args.output_dir)
+    out.mkdir(parents=True, exist_ok=True)
+    log = open(out / "training_log.jsonl", "w", encoding="utf-8")
+    best, best_step, started, seen = -1.0, 0, time.monotonic(), 0
+    use_bf16 = device == "cuda" and torch.cuda.is_bf16_supported()
+
+    for step in range(1, args.steps + 1):
+        net.train()
+        batch = next(stream)
+        y = batch.pop("y").to(device, non_blocking=True)
+        batch = {k: v.to(device, non_blocking=True) for k, v in batch.items()}
+        for g in opt.param_groups:
+            g["lr"] = lr_at(step)
+        with torch.autocast(device, dtype=torch.bfloat16, enabled=use_bf16):
+            logits = step_net(batch)
+        loss = F.cross_entropy(logits.float(), y, label_smoothing=args.label_smoothing)
+        opt.zero_grad(set_to_none=True)
+        loss.backward()
+        grad_norm = torch.nn.utils.clip_grad_norm_(net.parameters(), 1.0)
+        opt.step()
+        seen += args.batch_size
+
+        if step % args.log_every == 0:
+            rate = seen / (time.monotonic() - started)
+            print(f"step {step}/{args.steps} loss {loss.item():.4f} lr {lr_at(step):.2e} {rate:,.0f} passages/s", flush=True)
+            tracker.log(
+                {"train/loss": loss.item(), "train/lr": lr_at(step), "train/grad_norm": float(grad_norm),
+                 "train/passages_per_s": rate, "train/epochs": seen / len(tr)},
+                step,
+            )  # fmt: skip
+        if step % args.eval_every == 0 or step == args.steps:
+            s, _, _ = evaluate_frame(MillID(net, labels, trained, device), va_small)
+            entry = {"step": step, "loss": round(loss.item(), 5), **{k: round(s[k], 5) for k in ("macro_f1", "top1_accuracy", "top3_accuracy")}}
+            log.write(json.dumps(entry) + "\n")
+            log.flush()
+            print(f"  validation @ {step}: macro F1 {s['macro_f1']:.4f} top-1 {s['top1_accuracy']:.4f}", flush=True)
+            if s["macro_f1"] > best:
+                best, best_step = s["macro_f1"], step
+                save_file({k: v.detach().cpu().contiguous() for k, v in net.state_dict().items()}, str(out / "model.safetensors"))
+            elif step - best_step >= args.patience:
+                print(f"no gain on validation for {args.patience} steps: stopping at {step}", flush=True)
+                break
+            tracker.log(
+                {f"val/{k}": s[k] for k in ("macro_f1", "top1_accuracy", "top3_accuracy", "macro_precision", "macro_recall")}
+                | {"val/best_macro_f1": best},
+                step,
+            )
+    log.close()
+    tracker.summary({"best_step": best_step, "val/best_macro_f1": best})
+
+    labels.save(out / "labels.json", trained)
+    config = {
+        "model": asdict(cfg),
+        "training": asdict(args),
+        "best_step": best_step,
+        "parameters": params,
+        "train_passages": int(len(tr)),
+        "trained_labels": len(trained),
+        "seconds": round(time.monotonic() - started),
+    }
+    (out / "config.json").write_text(json.dumps(config, indent=2, default=str), encoding="utf-8")
+    shutil.copy(__file__, out / "millid.py")
+    doc = Path(__file__).with_name("ARCHITECTURE.md")
+    if doc.exists():  # beside the script locally; a Job ships only the script
+        shutil.copy(doc, out / "ARCHITECTURE.md")
+    print(f"best validation macro F1 {best:.4f} at step {best_step}", flush=True)
+
+    if args.final_eval == "none":
+        tracker.finish()
+        return
+    model = MillID.from_pretrained(str(out))
+    sets = ("validation",) if args.final_eval == "validation" else ("validation", "test", "udhr")
+    names = json.loads((root / "labels.json").read_text(encoding="utf-8")).get("names", {})
+    results, boards = evaluate_all(model, root, out / "reports", args.compare_glotlid, sets, names)
+    tracker.summary(
+        {f"eval/{set_name}/{m}/{k}": v for set_name, by in results.items() for m, sm in by.items()
+         for k, v in sm.items() if isinstance(v, (int, float))}
+    )  # fmt: skip
+    for set_name, by in results.items():
+        rows = [{"model": m, **{k: v for k, v in sm.items() if isinstance(v, (int, float))}} for m, sm in by.items()]
+        tracker.table(f"leaderboard/{set_name}/models", pd.DataFrame(rows).set_index("model"))
+    for set_name, board in boards.items():
+        tracker.table(f"leaderboard/{set_name}/languages", board.round(4))
+        if "winner" in board:
+            tracker.summary({f"eval/{set_name}/languages_{w.lower()}": int((board["winner"] == w).sum()) for w in ("MillID", "GlotLID", "tie")})
+    write_card(out, config, results, args, boards)
+    tracker.finish()
+    if args.push_to:
+        from huggingface_hub import HfApi
+
+        api = HfApi()
+        api.create_repo(args.push_to, private=not args.public, exist_ok=True)
+        api.upload_folder(repo_id=args.push_to, folder_path=str(out), commit_message=f"MillID {args.preset}, step {best_step}")
+        print(f"pushed https://huggingface.co/{args.push_to}", flush=True)
+
+
+# --- evaluation and the GlotLID comparison ----------------------------------------------
+
+_glot = None
+
+
+def _glot_init(path: str) -> None:
+    global _glot
+    import fasttext
+
+    _glot = fasttext.load_model(path)
+
+
+def _glot_chunk(texts: list[str]) -> list[list[tuple[str, float]]]:
+    labels, probs = _glot.f.multilinePredict([normalize(t) for t in texts], 50, 0.0, "strict")
+    return [
+        [(lab.removeprefix("__label__"), float(p)) for lab, p in zip(ls, ps, strict=True)]
+        for ls, ps in zip(labels, probs, strict=True)
+    ]
+
+
+def _cpu_workers(gb_each: float) -> int:
+    """Processes the machine has cores and memory for, at most 8."""
+    cpus = os.cpu_count() or 2
+    try:
+        ram = os.sysconf("SC_PAGE_SIZE") * os.sysconf("SC_PHYS_PAGES") / 2**30
+    except (ValueError, OSError, AttributeError):
+        ram = 16.0
+    return max(1, min(8, cpus - 2, int(ram // (gb_each * 2))))
+
+
+class GlotLID:
+    """GlotLID's 50 best answers per passage, computed once in parallel processes (fastText
+    holds the GIL, and each process loads the 1.7 GB model once). Both views come from the
+    same answers: as it is, and restricted to MillID's labels."""
+
+    def __init__(self, workers: int | None = None):
+        from huggingface_hub import hf_hub_download
+
+        # GLOTLID_PATH: a copy already on disk, rather than 1.7 GB from the Hub again.
+        self.path = os.environ.get("GLOTLID_PATH") or hf_hub_download("cis-lmu/glotlid", "model.bin")
+        self.workers = workers or _cpu_workers(gb_each=1.8)
+
+    def rank(self, texts: list[str], chunk: int = 10_000) -> list[list[tuple[str, float]]]:
+        parts = [texts[i : i + chunk] for i in range(0, len(texts), chunk)]
+        if self.workers <= 1 or len(parts) == 1:
+            _glot_init(self.path)
+            return [r for part in parts for r in _glot_chunk(part)]
+        from concurrent.futures import ProcessPoolExecutor
+
+        with ProcessPoolExecutor(self.workers, initializer=_glot_init, initargs=(self.path,)) as pool:
+            return [r for result in pool.map(_glot_chunk, parts) for r in result]
+
+    @staticmethod
+    def view(ranked, allowed: set[str] | None = None, k: int = 5) -> list[list[tuple[str, float]]]:
+        out = []
+        for pairs in ranked:
+            if allowed is not None:
+                pairs = [(lab, p) for lab, p in pairs if lab in allowed]
+            out.append(pairs[:k] or [("unk", 0.0)])
+        return out
+
+
+def leaderboard(tables: dict, names: dict[str, str]):
+    """One row per language: MillID against GlotLID, as it is and restricted to MillID's
+    labels. `delta` is MillID's F1 minus restricted GlotLID's: the like-for-like comparison."""
+    import pandas as pd
+
+    m = tables["millid"]
+    out = pd.DataFrame({"language": [names.get(lab, lab) for lab in m.index], "support": m["support"]}, index=m.index)
+    for model, t in tables.items():
+        for col in ("f1", "precision", "recall"):
+            out[f"{model}_{col}"] = t[col].reindex(m.index)
+    if "glotlid@millid" in tables:
+        out["delta"] = out["millid_f1"] - out["glotlid@millid_f1"]
+        out["winner"] = np.where(out["delta"] > 0.01, "MillID", np.where(out["delta"] < -0.01, "GlotLID", "tie"))
+    out.index.name = "label"
+    return out.sort_values("support", ascending=False)
+
+
+def evaluate_all(model: MillID, root: Path, out: Path, compare: bool, which=("validation", "test", "udhr"), names=None) -> tuple[dict, dict]:
+    """MillID on validation, test and UDHR; with compare, GlotLID on test and UDHR, as it is and
+    restricted to MillID's labels. Writes per-language tables, summaries and a leaderboard per
+    set under out/<set>/. Returns the summaries and the leaderboards."""
+    names = names or {}
+    frames = {}
+    if "validation" in which:
+        frames["validation"] = read_split(root, "validation")
+    if "test" in which:
+        frames["test"] = read_split(root, "test")
+    if "udhr" in which:
+        u = read_split(root, "udhr").reset_index(drop=True)
+        frames["udhr"] = u[u["label"].isin(model.trained)]
+        frames["udhr-all"] = u
+    glot = GlotLID() if compare else None
+    glot_cache: dict[str, list] = {}
+    results, boards = {}, {}
+    for name, frame in frames.items():
+        texts = frame["text"].tolist()
+        rankings = {"millid": model.predict(texts, k=5, batch_size=1024)}
+        if glot is not None and name != "validation":
+            if name in ("udhr", "udhr-all"):
+                if "udhr" not in glot_cache:
+                    glot_cache["udhr"] = glot.rank(frames["udhr-all"]["text"].tolist())
+                full = glot_cache["udhr"]
+                ranked = [full[i] for i in frame.index]
+            else:
+                ranked = glot.rank(texts)
+            rankings["glotlid"] = GlotLID.view(ranked)
+            rankings["glotlid@millid"] = GlotLID.view(ranked, model.trained)
+        d = out / name
+        d.mkdir(parents=True, exist_ok=True)
+        results[name], tables = {}, {}
+        for mname, ranked in rankings.items():
+            pred = [r[0][0] for r in ranked]
+            table = per_language(frame["label"].tolist(), pred)
+            sm = summarize(table, frame["label"].tolist(), [[lab for lab, _ in r] for r in ranked])
+            if "size" in frame:
+                f = frame.assign(pred=pred)
+                sm["top1_by_size"] = {k: float((g["label"] == g["pred"]).mean()) for k, g in f.groupby("size")}
+            table.round(6).to_csv(d / f"{mname}_per_language.csv")
+            (d / f"{mname}_summary.json").write_text(json.dumps(sm, indent=2), encoding="utf-8")
+            results[name][mname], tables[mname] = sm, table
+            print(f"{name:10} {mname:15} top-1 {sm['top1_accuracy']:.4f} top-3 {sm['top3_accuracy']:.4f} macro F1 {sm['macro_f1']:.4f}", flush=True)
+        if len(tables) > 1:
+            boards[name] = leaderboard(tables, names)
+            boards[name].round(4).to_csv(d / "leaderboard.csv")
+    (out / "summary.json").write_text(json.dumps(results, indent=2), encoding="utf-8")
+    return results, boards
+
+
+def _board_md(board, set_name: str) -> str:
+    if "delta" not in board:
+        return ""
+    wins = (board["winner"] == "MillID").sum()
+    losses = (board["winner"] == "GlotLID").sum()
+    ties = (board["winner"] == "tie").sum()
+
+    def table(frame) -> str:
+        lines = ["| Label | Language | Passages | MillID F1 | GlotLID F1 | GlotLID F1, restricted |", "|---|---|---|---|---|---|"]
+        for lab, r in frame.iterrows():
+            lines.append(
+                f"| `{lab}` | {r['language']} | {int(r['support'])} | {r['millid_f1']:.3f} | {r['glotlid_f1']:.3f} | {r['glotlid@millid_f1']:.3f} |"
+            )
+        return "\n".join(lines)
+
+    return f"""### Leaderboard: {set_name}
+
+MillID's F1 against GlotLID's, language by language. Against GlotLID restricted to MillID's labels, MillID is
+better on **{wins}** languages, worse on **{losses}**, and within 0.01 on {ties}. The full table, with precision and
+recall, is `reports/{set_name}/leaderboard.csv`.
+
+The 20 languages with the most passages:
+
+{table(board.head(20))}
+
+Where MillID gains most:
+
+{table(board.sort_values("delta", ascending=False).head(15))}
+
+Where MillID loses most:
+
+{table(board.sort_values("delta").head(15))}
+"""
+
+
+def write_card(out: Path, config: dict, results: dict, args, boards: dict | None = None) -> None:
+    boards = boards or {}
+    rows = ["| Set | Model | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages |", "|---|---|---|---|---|---|---|---|---|---|"]
+    for set_name, by_model in results.items():
+        for mname, sm in by_model.items():
+            rows.append(
+                f"| {set_name} | {mname} | {sm['top1_accuracy']:.4f} | {sm['top3_accuracy']:.4f} | {sm['top5_accuracy']:.4f} | "
+                f"{sm['macro_precision']:.4f} | {sm['macro_recall']:.4f} | {sm['macro_f1']:.4f} | {sm['median_f1']:.4f} | {sm['languages']} |"
+            )
+    size_rows = ["| Set | Model | short | sentence | paragraph |", "|---|---|---|---|---|"]
+    for set_name, by_model in results.items():
+        for mname, sm in by_model.items():
+            b = sm.get("top1_by_size") or {}
+            if b:
+                size_rows.append(f"| {set_name} | {mname} | " + " | ".join(f"{b.get(k, float('nan')):.4f}" for k in ("short", "sentence", "paragraph")) + " |")
+    m = config["model"]
+    repo = args.push_to or "baobabtech/millid"
+    card = f"""---
+library_name: pytorch
+pipeline_tag: text-classification
+tags:
+- language-identification
+datasets:
+- {args.dataset}
+---
+
+# MillID {args.preset}: MultiLingual Language IDentifier
+
+A byte-level, encoder-only transformer that names the language of a passage: **{config['trained_labels']} language-script
+labels** (ISO 639-3 + script, e.g. `eng_Latn`, `amh_Ethi`). {config['parameters'] / 1e6:.1f}M parameters, trained from
+scratch on [{args.dataset}](https://huggingface.co/datasets/{args.dataset}).
+
+```python
+from millid import MillID   # millid.py, in this repository
+
+model = MillID.from_pretrained("{repo}")
+model.predict(["Lave men ou ak savon anvan ou manje."], k=3)
+```
+
+## Architecture
+
+UTF-8 bytes (after Unicode NFKC), each embedded as byte + Unicode script + byte-in-character + hashed character
+2-, 3- and 4-grams ({m['ngram_buckets']:,} buckets) -> depthwise convolution stem (kernel {m['conv_kernel']}) -> strided
+convolution, {m['downsample']} bytes per token -> {m['n_layers']} pre-norm blocks (RMSNorm, attention with RoPE,
+{m['n_heads']} heads, SwiGLU; d={m['d_model']}) -> masked mean pooling -> language head, each language's vector the sum of
+its own, its language's and its script's. Up to {m['max_len']} bytes per passage. See `ARCHITECTURE.md`.
+
+## Evaluation against GlotLID
+
+`validation` chose the checkpoint; `test` is split by document from training; `udhr` is the Universal Declaration
+of Human Rights, labelled by its translators, over the languages MillID knows, and `udhr-all` over all of them.
+`glotlid` is [GlotLID](https://huggingface.co/cis-lmu/glotlid) as it is; `glotlid@millid` is GlotLID restricted to
+MillID's labels, the like-for-like comparison. GlotLID's own labels came from training on data that includes UDHR
+and labelled FinePDFs and FineWeb-2, so its scores on `udhr` and on those sources are optimistic.
+
+{chr(10).join(rows)}
+
+Top-1 accuracy by passage length:
+
+{chr(10).join(size_rows)}
+
+{_board_md(boards['test'], 'test') if 'test' in boards else ''}
+{_board_md(boards['udhr'], 'udhr') if 'udhr' in boards else ''}
+Per-language precision, recall (sensitivity), F1 and specificity for every model are in `reports/<set>/`.
+
+## Training
+
+{config['train_passages']:,} passages, best validation macro F1 at step {config['best_step']}, {config['seconds'] / 3600:.1f} hours.
+Languages sampled in proportion to n^{args.alpha}; {int(args.short_p * 100)}% of passages cut to a 20 to 80 character
+snippet; batch {args.batch_size}, AdamW at {args.lr}, cosine schedule, label smoothing {args.label_smoothing}.
+"""
+    (out / "README.md").write_text(card, encoding="utf-8")
+
+
+# --- command line ------------------------------------------------------------------------
+
+
+@dataclass
+class TrainArgs:
+    """Train MillID, evaluate it against GlotLID, and optionally push it to the Hub."""
+
+    dataset: str = "baobabtech/millid-dataset"
+    """Hub dataset id, or a local build directory with data/, udhr/ and labels.json"""
+    preset: Literal["tiny", "small", "medium", "large"] = "medium"
+    """model size: tiny ~2M and small ~12M for trials, medium ~114M, large ~190M parameters"""
+    max_len: int = 256
+    """bytes per passage, [CLS] included; a longer passage is cut to a window"""
+    steps: int = 60_000
+    """optimiser steps"""
+    batch_size: int = 512
+    """passages per step"""
+    lr: float = 3e-4
+    """peak learning rate, after warm-up"""
+    warmup: int = 2_000
+    """steps of linear warm-up, then cosine decay to 5% of the peak"""
+    weight_decay: float = 0.01
+    """AdamW weight decay, on weight matrices only"""
+    dropout: float = 0.1
+    """dropout in the encoder and before the head"""
+    label_smoothing: float = 0.1
+    """cross-entropy label smoothing"""
+    alpha: float = 0.3
+    """language sampling: a language is drawn in proportion to n^alpha (1: as the data is, 0: uniform)"""
+    short_p: float = 0.25
+    """share of training passages cut to a 20 to 80 character snippet"""
+    eval_every: int = 2_000
+    """steps between validation passes, which choose the checkpoint"""
+    eval_per_label: int = 20
+    """validation passages per language at each pass"""
+    patience: int = 12_000
+    """stop after this many steps without a better validation macro F1"""
+    commercial_only: bool = False
+    """leave out rows licensed for non-commercial use only"""
+    extra: list[str] = field(default_factory=list)
+    """more training parquet files (text, label): trained on, never evaluated on"""
+    compare_glotlid: bool = False
+    """score GlotLID too, as it is and restricted to MillID's labels"""
+    final_eval: Literal["all", "validation", "none"] = "all"
+    """which sets to score after training"""
+    output_dir: str = "millid-out"
+    """where the model, its card and reports are written"""
+    push_to: str | None = None
+    """Hub model repo to push to, e.g. baobabtech/millid"""
+    public: bool = False
+    """make the pushed repo public; private otherwise"""
+    seed: int = 7
+    """random seed"""
+    log_every: int = 100
+    """steps between training-loss lines and W&B points"""
+    threads: int = 0
+    """CPU threads for PyTorch; 0 leaves PyTorch's default"""
+    workers: int = -1
+    """DataLoader workers encoding batches; -1 picks from the cores available, 0 encodes in the training process"""
+    compile: bool = False
+    """torch.compile the model for training (GPU only)"""
+    wandb_project: str | None = os.environ.get("WANDB_PROJECT")
+    """Weights & Biases project; with WANDB_API_KEY set, 'millid' when not given"""
+    wandb_entity: str | None = os.environ.get("WANDB_ENTITY")
+    """Weights & Biases team or user"""
+    wandb_run_name: str | None = None
+    """run name in Weights & Biases"""
+    wandb_tags: list[str] = field(default_factory=list)
+    """run tags in Weights & Biases"""
+    no_wandb: bool = False
+    """never log to Weights & Biases, even with a key"""
+
+
+@dataclass
+class EvaluateArgs:
+    """Evaluate a trained model on validation, test and UDHR."""
+
+    model: str
+    """model directory or Hub repo"""
+    dataset: str = "baobabtech/millid-dataset"
+    """Hub dataset id or local build directory"""
+    compare_glotlid: bool = False
+    """score GlotLID too"""
+    output_dir: str = "millid-eval"
+    """where the reports are written"""
+
+
+@dataclass
+class SweepArgs:
+    """Run Weights & Biases sweep trials in this process."""
+
+    sweep_id: str
+    """ENTITY/PROJECT/SWEEP_ID, from `wandb sweep millid/sweep.yaml`"""
+    count: int = 4
+    """trials this agent runs"""
+    dataset: str = "baobabtech/millid-dataset"
+    """used unless the sweep sets it"""
+
+
+@dataclass
+class PredictArgs:
+    """The language of each text."""
+
+    model: str
+    """model directory or Hub repo"""
+    texts: list[str] = field(default_factory=list)
+    """texts to identify"""
+    k: int = 3
+    """answers per text"""
+
+
+def sweep_agent(args: SweepArgs) -> None:
+    """Each trial takes its settings from the sweep and the TrainArgs defaults for the rest,
+    and reports val/best_macro_f1. No pushing, no GlotLID, validation only: a sweep chooses
+    settings, and the chosen ones are then trained in full."""
+    import wandb
+
+    def trial() -> None:
+        run = wandb.init()
+        a = TrainArgs(dataset=args.dataset)
+        for key, value in dict(run.config).items():
+            name = key.replace("-", "_")
+            if hasattr(a, name):
+                setattr(a, name, value)
+        a.push_to, a.compare_glotlid, a.final_eval = None, False, "validation"
+        a.output_dir = f"sweep/{run.id}"
+        train(a)
+        run.finish()
+
+    wandb.agent(args.sweep_id, function=trial, count=args.count)
+
+
+def main(argv: list[str] | None = None) -> None:
+    import tyro
+
+    args = tyro.extras.subcommand_cli_from_dict(
+        {"train": TrainArgs, "evaluate": EvaluateArgs, "sweep-agent": SweepArgs, "predict": PredictArgs},
+        args=argv,
+        prog="millid",
+    )
+    if isinstance(args, TrainArgs):
+        train(args)
+    elif isinstance(args, EvaluateArgs):
+        evaluate_all(MillID.from_pretrained(args.model), load_dataset_dir(args.dataset), Path(args.output_dir), args.compare_glotlid)
+    elif isinstance(args, SweepArgs):
+        sweep_agent(args)
+    else:
+        for text, answers in zip(args.texts, MillID.from_pretrained(args.model).predict(args.texts, args.k), strict=True):
+            print(text, "->", answers)
+
+
+if __name__ == "__main__":
+    os.environ.setdefault("TOKENIZERS_PARALLELISM", "false")
+    main(sys.argv[1:])

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b63a24bdf9c217439d224c73559f071527c6deacc4ccf2ecfc9993ff880f834f
+size 459982596

reports/summary.json

@@ -0,0 +1,200 @@
+{
+  "validation": {
+    "millid": {
+      "top1_accuracy": 0.9612766841404254,
+      "top3_accuracy": 0.9909250502014166,
+      "top5_accuracy": 0.9949330172578825,
+      "passages": 245511,
+      "languages": 1626,
+      "macro_precision": 0.9572524686749759,
+      "macro_recall": 0.9621461129267935,
+      "macro_f1": 0.9583443278968644,
+      "macro_specificity": 0.9999761949645174,
+      "weighted_f1": 0.9613285508140816,
+      "median_f1": 0.9849924924924924,
+      "languages_f1_at_least_0_9": 1462,
+      "languages_f1_below_0_5": 7,
+      "mean_fp_per_million": 23.80503548271208,
+      "micro_f1": 0.9612766841404254,
+      "top1_by_size": {
+        "paragraph": 0.985777175753471,
+        "sentence": 0.981756099992523,
+        "short": 0.936305012862407
+      }
+    }
+  },
+  "test": {
+    "millid": {
+      "top1_accuracy": 0.9568204690690267,
+      "top3_accuracy": 0.986063771189073,
+      "top5_accuracy": 0.9895716421557461,
+      "passages": 241457,
+      "languages": 1621,
+      "macro_precision": 0.9545250122642608,
+      "macro_recall": 0.9608553008590351,
+      "macro_f1": 0.9558663867116508,
+      "macro_specificity": 0.9999733850455484,
+      "weighted_f1": 0.9569594021717679,
+      "median_f1": 0.9838709677419354,
+      "languages_f1_at_least_0_9": 1445,
+      "languages_f1_below_0_5": 8,
+      "mean_fp_per_million": 26.614954451516923,
+      "micro_f1": 0.9568204690690267,
+      "top1_by_size": {
+        "paragraph": 0.979006552867891,
+        "sentence": 0.9781083036156198,
+        "short": 0.9323152204635388
+      }
+    },
+    "glotlid": {
+      "top1_accuracy": 0.972694931188576,
+      "top3_accuracy": 0.9928103140517773,
+      "top5_accuracy": 0.9935599299254112,
+      "passages": 241457,
+      "languages": 1621,
+      "macro_precision": 0.9779554288344202,
+      "macro_recall": 0.97455614917712,
+      "macro_f1": 0.9742516039920551,
+      "macro_specificity": 0.9999863693259885,
+      "weighted_f1": 0.9737439616979084,
+      "median_f1": 1.0,
+      "languages_f1_at_least_0_9": 1486,
+      "languages_f1_below_0_5": 7,
+      "mean_fp_per_million": 13.630674011364892,
+      "micro_f1": 0.972694931188576,
+      "top1_by_size": {
+        "paragraph": 0.9854785211552464,
+        "sentence": 0.9824993337309796,
+        "short": 0.960288298473714
+      }
+    },
+    "glotlid@millid": {
+      "top1_accuracy": 0.9733989902964089,
+      "top3_accuracy": 0.9929221352041978,
+      "top5_accuracy": 0.9936386188845219,
+      "passages": 241457,
+      "languages": 1621,
+      "macro_precision": 0.9716515008615504,
+      "macro_recall": 0.9759187769919735,
+      "macro_f1": 0.9710334289197641,
+      "macro_specificity": 0.9999835861379931,
+      "weighted_f1": 0.9729726149773406,
+      "median_f1": 1.0,
+      "languages_f1_at_least_0_9": 1477,
+      "languages_f1_below_0_5": 12,
+      "mean_fp_per_million": 16.413862007001015,
+      "micro_f1": 0.9733989902964089,
+      "top1_by_size": {
+        "paragraph": 0.9855796456597362,
+        "sentence": 0.9829942764318439,
+        "short": 0.9614012153759186
+      }
+    }
+  },
+  "udhr": {
+    "millid": {
+      "top1_accuracy": 0.8524451582907139,
+      "top3_accuracy": 0.9193964241937529,
+      "top5_accuracy": 0.9341054144300266,
+      "passages": 23659,
+      "languages": 358,
+      "macro_precision": 0.9187139434241347,
+      "macro_recall": 0.876978867900983,
+      "macro_f1": 0.8780555118719876,
+      "macro_specificity": 0.9998610487675311,
+      "weighted_f1": 0.8598690614077213,
+      "median_f1": 0.9909909909909909,
+      "languages_f1_at_least_0_9": 282,
+      "languages_f1_below_0_5": 35,
+      "mean_fp_per_million": 138.95123246877017,
+      "micro_f1": 0.8524451582907139
+    },
+    "glotlid": {
+      "top1_accuracy": 0.8598419206221734,
+      "top3_accuracy": 0.9279766684982459,
+      "top5_accuracy": 0.9420516505346802,
+      "passages": 23659,
+      "languages": 358,
+      "macro_precision": 0.9261030959501081,
+      "macro_recall": 0.8825915640670888,
+      "macro_f1": 0.8864649884094992,
+      "macro_specificity": 0.999887104475242,
+      "weighted_f1": 0.8701800337416647,
+      "median_f1": 0.9915248150542268,
+      "languages_f1_at_least_0_9": 287,
+      "languages_f1_below_0_5": 32,
+      "mean_fp_per_million": 112.89552475798357,
+      "micro_f1": 0.8598419206221734
+    },
+    "glotlid@millid": {
+      "top1_accuracy": 0.8614480747284331,
+      "top3_accuracy": 0.9294137537512152,
+      "top5_accuracy": 0.943319666934359,
+      "passages": 23659,
+      "languages": 358,
+      "macro_precision": 0.9257695969546421,
+      "macro_recall": 0.8844312457708232,
+      "macro_f1": 0.8873151713293488,
+      "macro_specificity": 0.9998860393705818,
+      "weighted_f1": 0.8709300475765809,
+      "median_f1": 0.9915248150542268,
+      "languages_f1_at_least_0_9": 291,
+      "languages_f1_below_0_5": 32,
+      "mean_fp_per_million": 113.96062941822754,
+      "micro_f1": 0.8614480747284331
+    }
+  },
+  "udhr-all": {
+    "millid": {
+      "top1_accuracy": 0.7301162075082359,
+      "top3_accuracy": 0.787459725590993,
+      "top5_accuracy": 0.8000579227455381,
+      "passages": 27623,
+      "languages": 429,
+      "macro_precision": 0.7415821358834683,
+      "macro_recall": 0.7318378431434776,
+      "macro_f1": 0.7184065533373333,
+      "macro_specificity": 0.9998030684269821,
+      "weighted_f1": 0.7228843826462673,
+      "median_f1": 0.9672131147540983,
+      "languages_f1_at_least_0_9": 266,
+      "languages_f1_below_0_5": 108,
+      "mean_fp_per_million": 196.93157301787522,
+      "micro_f1": 0.7301162075082359
+    },
+    "glotlid": {
+      "top1_accuracy": 0.750244361582739,
+      "top3_accuracy": 0.8144662056981501,
+      "top5_accuracy": 0.8281866560474966,
+      "passages": 27623,
+      "languages": 429,
+      "macro_precision": 0.7694575973118034,
+      "macro_recall": 0.7529055089081532,
+      "macro_f1": 0.7454327849166208,
+      "macro_specificity": 0.9998410395298513,
+      "weighted_f1": 0.7485822543592835,
+      "median_f1": 0.9795918367346939,
+      "languages_f1_at_least_0_9": 277,
+      "languages_f1_below_0_5": 97,
+      "mean_fp_per_million": 158.96047014874904,
+      "micro_f1": 0.750244361582739
+    },
+    "glotlid@millid": {
+      "top1_accuracy": 0.7378271730080006,
+      "top3_accuracy": 0.7960395322738297,
+      "top5_accuracy": 0.8079498968251095,
+      "passages": 27623,
+      "languages": 429,
+      "macro_precision": 0.7425329775774382,
+      "macro_recall": 0.7380568437901042,
+      "macro_f1": 0.724506747472521,
+      "macro_specificity": 0.999809579502659,
+      "weighted_f1": 0.7305913692421664,
+      "median_f1": 0.9747899159663865,
+      "languages_f1_at_least_0_9": 272,
+      "languages_f1_below_0_5": 105,
+      "mean_fp_per_million": 190.42049734090864,
+      "micro_f1": 0.7378271730080006
+    }
+  }
+}

reports/test/glotlid@millid_summary.json

@@ -0,0 +1,22 @@
+{
+  "top1_accuracy": 0.9733989902964089,
+  "top3_accuracy": 0.9929221352041978,
+  "top5_accuracy": 0.9936386188845219,
+  "passages": 241457,
+  "languages": 1621,
+  "macro_precision": 0.9716515008615504,
+  "macro_recall": 0.9759187769919735,
+  "macro_f1": 0.9710334289197641,
+  "macro_specificity": 0.9999835861379931,
+  "weighted_f1": 0.9729726149773406,
+  "median_f1": 1.0,
+  "languages_f1_at_least_0_9": 1477,
+  "languages_f1_below_0_5": 12,
+  "mean_fp_per_million": 16.413862007001015,
+  "micro_f1": 0.9733989902964089,
+  "top1_by_size": {
+    "paragraph": 0.9855796456597362,
+    "sentence": 0.9829942764318439,
+    "short": 0.9614012153759186
+  }
+}

reports/test/glotlid_per_language.csv

@@ -0,0 +1,1622 @@
+label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
+aai_Latn,142,142,0,0,241315,1.0,1.0,1.0,1.0,0.0,1.0
+aak_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+aau_Latn,214,214,0,0,241243,1.0,1.0,1.0,1.0,0.0,1.0
+aaz_Latn,98,98,1,0,241358,0.989899,1.0,0.994924,0.999996,4.143206,1.0
+aba_Latn,176,176,0,0,241281,1.0,1.0,1.0,1.0,0.0,1.0
+abk_Cyrl,285,285,0,0,241172,1.0,1.0,1.0,1.0,0.0,1.0
+abn_Latn,174,174,0,0,241283,1.0,1.0,1.0,1.0,0.0,1.0
+abq_Cyrl,147,147,0,0,241310,1.0,1.0,1.0,1.0,0.0,1.0
+abs_Latn,142,124,5,18,241310,0.96124,0.873239,0.915129,0.999979,20.719806,0.873239
+abt_Latn,169,169,0,0,241288,1.0,1.0,1.0,1.0,0.0,1.0
+abx_Latn,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+aby_Latn,161,161,0,0,241296,1.0,1.0,1.0,1.0,0.0,1.0
+abz_Latn,159,159,0,0,241298,1.0,1.0,1.0,1.0,0.0,1.0
+aca_Latn,168,168,0,0,241289,1.0,1.0,1.0,1.0,0.0,1.0
+acd_Latn,134,134,0,0,241323,1.0,1.0,1.0,1.0,0.0,1.0
+ace_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+acf_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+ach_Latn,242,242,2,0,241213,0.991803,1.0,0.995885,0.999992,8.291358,1.0
+acm_Arab,109,78,36,31,241312,0.684211,0.715596,0.699552,0.999851,149.162206,0.715596
+acn_Latn,95,95,0,0,241362,1.0,1.0,1.0,1.0,0.0,1.0
+acr_Latn,255,255,0,0,241202,1.0,1.0,1.0,1.0,0.0,1.0
+acu_Latn,220,220,0,0,241237,1.0,1.0,1.0,1.0,0.0,1.0
+ada_Latn,145,145,1,0,241311,0.993151,1.0,0.996564,0.999996,4.144013,1.0
+ade_Latn,31,31,0,0,241426,1.0,1.0,1.0,1.0,0.0,1.0
+adh_Latn,77,72,1,5,241379,0.986301,0.935065,0.96,0.999996,4.142845,0.935065
+adj_Latn,145,145,0,0,241312,1.0,1.0,1.0,1.0,0.0,1.0
+ady_Cyrl,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+adz_Latn,59,59,0,0,241398,1.0,1.0,1.0,1.0,0.0,1.0
+aeb_Arab,244,198,56,46,241157,0.779528,0.811475,0.795181,0.999768,232.159958,0.811475
+aeb_Latn,1,0,0,1,241456,0.0,0.0,0.0,1.0,0.0,0.0
+aer_Latn,16,16,0,0,241441,1.0,1.0,1.0,1.0,0.0,1.0
+aeu_Latn,148,148,0,0,241309,1.0,1.0,1.0,1.0,0.0,1.0
+aey_Latn,126,126,0,0,241331,1.0,1.0,1.0,1.0,0.0,1.0
+afr_Latn,569,555,3,14,240885,0.994624,0.975395,0.984916,0.999988,12.45392,0.975395
+agd_Latn,139,139,0,0,241318,1.0,1.0,1.0,1.0,0.0,1.0
+agg_Latn,111,111,0,0,241346,1.0,1.0,1.0,1.0,0.0,1.0
+agm_Latn,158,158,0,0,241299,1.0,1.0,1.0,1.0,0.0,1.0
+agn_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+agr_Latn,182,182,1,0,241274,0.994536,1.0,0.99726,0.999996,4.144648,1.0
+agt_Latn,87,87,0,0,241370,1.0,1.0,1.0,1.0,0.0,1.0
+agu_Latn,69,69,0,0,241388,1.0,1.0,1.0,1.0,0.0,1.0
+agx_Cyrl,124,124,0,0,241333,1.0,1.0,1.0,1.0,0.0,1.0
+ahk_Latn,164,164,0,0,241293,1.0,1.0,1.0,1.0,0.0,1.0
+aia_Latn,163,163,0,0,241294,1.0,1.0,1.0,1.0,0.0,1.0
+aii_Syrc,234,234,0,0,241223,1.0,1.0,1.0,1.0,0.0,1.0
+ain_Latn,1,0,0,1,241456,0.0,0.0,0.0,1.0,0.0,0.0
+ajg_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+aji_Latn,123,123,0,0,241334,1.0,1.0,1.0,1.0,0.0,1.0
+ajp_Arab,28,27,38,1,241391,0.415385,0.964286,0.580645,0.999843,157.39617,0.964286
+akb_Latn,87,87,0,0,241370,1.0,1.0,1.0,1.0,0.0,1.0
+ake_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+akh_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+akp_Latn,140,140,0,0,241317,1.0,1.0,1.0,1.0,0.0,1.0
+aln_Latn,117,71,0,46,241340,1.0,0.606838,0.755319,1.0,0.0,0.606838
+alp_Latn,95,95,0,0,241362,1.0,1.0,1.0,1.0,0.0,1.0
+alq_Latn,124,124,1,0,241332,0.992,1.0,0.995984,0.999996,4.143652,1.0
+als_Latn,213,213,43,0,241201,0.832031,1.0,0.908316,0.999822,178.242775,1.0
+alt_Cyrl,208,208,3,0,241246,0.985782,1.0,0.99284,0.999988,12.435285,1.0
+aly_Latn,152,152,0,0,241305,1.0,1.0,1.0,1.0,0.0,1.0
+alz_Latn,123,123,0,0,241334,1.0,1.0,1.0,1.0,0.0,1.0
+ame_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+amf_Latn,59,59,1,0,241397,0.983333,1.0,0.991597,0.999996,4.142536,1.0
+amh_Ethi,458,458,0,0,240999,1.0,1.0,1.0,1.0,0.0,1.0
+ami_Latn,173,173,0,0,241284,1.0,1.0,1.0,1.0,0.0,1.0
+amk_Latn,59,59,0,0,241398,1.0,1.0,1.0,1.0,0.0,1.0
+amm_Latn,170,170,0,0,241287,1.0,1.0,1.0,1.0,0.0,1.0
+amn_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+amp_Latn,172,172,0,0,241285,1.0,1.0,1.0,1.0,0.0,1.0
+amr_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+amu_Latn,142,142,0,0,241315,1.0,1.0,1.0,1.0,0.0,1.0
+amx_Latn,28,28,0,0,241429,1.0,1.0,1.0,1.0,0.0,1.0
+ang_Latn,197,197,1,0,241259,0.994949,1.0,0.997468,0.999996,4.144906,1.0
+ann_Latn,154,154,0,0,241303,1.0,1.0,1.0,1.0,0.0,1.0
+anp_Deva,252,192,195,60,241010,0.496124,0.761905,0.600939,0.999192,808.440953,0.761905
+anv_Latn,76,76,0,0,241381,1.0,1.0,1.0,1.0,0.0,1.0
+any_Latn,20,20,0,0,241437,1.0,1.0,1.0,1.0,0.0,1.0
+aoi_Latn,99,99,0,0,241358,1.0,1.0,1.0,1.0,0.0,1.0
+aoj_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+aom_Latn,156,156,0,0,241301,1.0,1.0,1.0,1.0,0.0,1.0
+aoz_Latn,25,24,0,1,241432,1.0,0.96,0.979592,1.0,0.0,0.96
+apb_Latn,125,125,0,0,241332,1.0,1.0,1.0,1.0,0.0,1.0
+apc_Arab,143,94,18,49,241296,0.839286,0.657343,0.737255,0.999925,74.591611,0.657343
+ape_Latn,155,155,0,0,241302,1.0,1.0,1.0,1.0,0.0,1.0
+apn_Latn,105,105,0,0,241352,1.0,1.0,1.0,1.0,0.0,1.0
+apr_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+apt_Latn,22,22,0,0,241435,1.0,1.0,1.0,1.0,0.0,1.0
+apu_Latn,213,213,0,0,241244,1.0,1.0,1.0,1.0,0.0,1.0
+apw_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+apy_Latn,65,65,0,0,241392,1.0,1.0,1.0,1.0,0.0,1.0
+apz_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+arb_Arab,745,593,195,152,240517,0.752538,0.795973,0.773646,0.99919,810.096713,0.795973
+arb_Latn,163,135,1,28,241293,0.992647,0.828221,0.90301,0.999996,4.144322,0.828221
+are_Latn,65,65,0,0,241392,1.0,1.0,1.0,1.0,0.0,1.0
+arg_Latn,194,194,4,0,241259,0.979798,1.0,0.989796,0.999983,16.579417,1.0
+arl_Latn,66,66,0,0,241391,1.0,1.0,1.0,1.0,0.0,1.0
+arn_Latn,250,250,0,0,241207,1.0,1.0,1.0,1.0,0.0,1.0
+arp_Latn,29,29,0,0,241428,1.0,1.0,1.0,1.0,0.0,1.0
+arq_Arab,113,94,2,19,241342,0.979167,0.831858,0.899522,0.999992,8.286927,0.831858
+ars_Arab,309,226,57,83,241091,0.798587,0.731392,0.763514,0.999764,236.369367,0.731392
+ary_Arab,192,120,115,72,241150,0.510638,0.625,0.562061,0.999523,476.654301,0.625
+arz_Arab,229,133,51,96,241177,0.722826,0.580786,0.644068,0.999789,211.418243,0.580786
+asm_Beng,467,466,0,1,240990,1.0,0.997859,0.998928,1.0,0.0,0.997859
+asm_Latn,59,58,3,1,241395,0.95082,0.983051,0.966667,0.999988,12.427609,0.983051
+aso_Latn,127,127,0,0,241330,1.0,1.0,1.0,1.0,0.0,1.0
+ast_Latn,244,244,17,0,241196,0.934866,1.0,0.966337,0.99993,70.47713,1.0
+ata_Latn,160,160,0,0,241297,1.0,1.0,1.0,1.0,0.0,1.0
+atb_Latn,152,152,0,0,241305,1.0,1.0,1.0,1.0,0.0,1.0
+atd_Latn,76,76,0,0,241381,1.0,1.0,1.0,1.0,0.0,1.0
+atg_Latn,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+ati_Latn,94,94,4,0,241359,0.959184,1.0,0.979167,0.999983,16.572548,1.0
+atj_Latn,108,108,14,0,241335,0.885246,1.0,0.93913,0.999942,58.007284,1.0
+att_Latn,121,121,0,0,241336,1.0,1.0,1.0,1.0,0.0,1.0
+auc_Latn,39,39,0,0,241418,1.0,1.0,1.0,1.0,0.0,1.0
+aui_Latn,114,114,1,0,241342,0.991304,1.0,0.995633,0.999996,4.14348,1.0
+auy_Latn,134,134,0,0,241323,1.0,1.0,1.0,1.0,0.0,1.0
+ava_Cyrl,240,240,0,0,241217,1.0,1.0,1.0,1.0,0.0,1.0
+avk_Latn,111,106,0,5,241346,1.0,0.954955,0.976959,1.0,0.0,0.954955
+avt_Latn,118,118,0,0,241339,1.0,1.0,1.0,1.0,0.0,1.0
+avu_Latn,181,181,0,0,241276,1.0,1.0,1.0,1.0,0.0,1.0
+awa_Deva,91,91,20,0,241346,0.81982,1.0,0.90099,0.999917,82.861712,1.0
+awb_Latn,167,167,0,0,241290,1.0,1.0,1.0,1.0,0.0,1.0
+awx_Latn,53,53,0,0,241404,1.0,1.0,1.0,1.0,0.0,1.0
+ayp_Arab,72,51,0,21,241385,1.0,0.708333,0.829268,1.0,0.0,0.708333
+ayr_Latn,309,309,0,0,241148,1.0,1.0,1.0,1.0,0.0,1.0
+azb_Arab,369,367,42,2,241046,0.897311,0.99458,0.943445,0.999826,174.210247,0.99458
+azg_Latn,97,97,0,0,241360,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Cyrl,144,144,3,0,241310,0.979592,1.0,0.989691,0.999988,12.431987,1.0
+azj_Latn,187,187,3,0,241267,0.984211,1.0,0.992042,0.999988,12.434202,1.0
+azz_Latn,73,73,0,0,241384,1.0,1.0,1.0,1.0,0.0,1.0
+bak_Cyrl,289,289,0,0,241168,1.0,1.0,1.0,1.0,0.0,1.0
+bam_Latn,287,287,1,0,241169,0.996528,1.0,0.998261,0.999996,4.146453,1.0
+ban_Latn,202,202,1,0,241254,0.995074,1.0,0.997531,0.999996,4.144992,1.0
+bao_Latn,101,101,0,0,241356,1.0,1.0,1.0,1.0,0.0,1.0
+bar_Latn,331,331,7,0,241119,0.97929,1.0,0.989537,0.999971,29.030465,1.0
+bas_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+bba_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+bbb_Latn,164,164,0,0,241293,1.0,1.0,1.0,1.0,0.0,1.0
+bbc_Latn,247,247,0,0,241210,1.0,1.0,1.0,1.0,0.0,1.0
+bbr_Latn,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+bcc_Arab,173,134,17,39,241267,0.887417,0.774566,0.82716,0.99993,70.456392,0.774566
+bch_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+bci_Latn,193,193,0,0,241264,1.0,1.0,1.0,1.0,0.0,1.0
+bcl_Latn,231,231,0,0,241226,1.0,1.0,1.0,1.0,0.0,1.0
+bco_Latn,118,118,0,0,241339,1.0,1.0,1.0,1.0,0.0,1.0
+bcw_Latn,10,10,0,0,241447,1.0,1.0,1.0,1.0,0.0,1.0
+bdd_Latn,139,139,0,0,241318,1.0,1.0,1.0,1.0,0.0,1.0
+bdh_Latn,180,180,0,0,241277,1.0,1.0,1.0,1.0,0.0,1.0
+bdq_Latn,9,6,0,3,241448,1.0,0.666667,0.8,1.0,0.0,0.666667
+bea_Latn,10,10,1,0,241446,0.909091,1.0,0.952381,0.999996,4.141696,1.0
+bef_Latn,147,147,0,0,241310,1.0,1.0,1.0,1.0,0.0,1.0
+bel_Cyrl,157,157,1,0,241299,0.993671,1.0,0.996825,0.999996,4.144219,1.0
+bem_Latn,222,216,4,6,241231,0.981818,0.972973,0.977376,0.999983,16.581342,0.972973
+ben_Beng,466,464,1,2,240990,0.997849,0.995708,0.996778,0.999996,4.149533,0.995708
+ben_Latn,126,108,12,18,241319,0.9,0.857143,0.878049,0.99995,49.724238,0.857143
+beq_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+bew_Latn,165,106,33,59,241259,0.76259,0.642424,0.697368,0.999863,136.763755,0.642424
+bfd_Latn,92,92,0,0,241365,1.0,1.0,1.0,1.0,0.0,1.0
+bgr_Latn,143,143,1,0,241313,0.993056,1.0,0.996516,0.999996,4.143978,1.0
+bgs_Latn,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+bgt_Latn,144,144,2,0,241311,0.986301,1.0,0.993103,0.999992,8.287991,1.0
+bgz_Latn,13,13,1,0,241443,0.928571,1.0,0.962963,0.999996,4.141747,1.0
+bhg_Latn,19,19,0,0,241438,1.0,1.0,1.0,1.0,0.0,1.0
+bhl_Latn,162,162,0,0,241295,1.0,1.0,1.0,1.0,0.0,1.0
+bho_Deva,290,290,7,0,241160,0.976431,1.0,0.988075,0.999971,29.02553,1.0
+bhw_Latn,169,169,0,0,241288,1.0,1.0,1.0,1.0,0.0,1.0
+bib_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+big_Latn,106,106,0,0,241351,1.0,1.0,1.0,1.0,0.0,1.0
+bim_Latn,136,136,0,0,241321,1.0,1.0,1.0,1.0,0.0,1.0
+bin_Latn,182,182,0,0,241275,1.0,1.0,1.0,1.0,0.0,1.0
+bis_Latn,257,257,0,0,241200,1.0,1.0,1.0,1.0,0.0,1.0
+biu_Latn,7,7,0,0,241450,1.0,1.0,1.0,1.0,0.0,1.0
+biv_Latn,94,94,0,0,241363,1.0,1.0,1.0,1.0,0.0,1.0
+bjn_Arab,116,83,1,33,241340,0.988095,0.715517,0.83,0.999996,4.143515,0.715517
+bjn_Latn,153,153,5,0,241299,0.968354,1.0,0.983923,0.999979,20.720751,1.0
+bjp_Latn,171,171,0,0,241286,1.0,1.0,1.0,1.0,0.0,1.0
+bjr_Latn,176,176,0,0,241281,1.0,1.0,1.0,1.0,0.0,1.0
+bjv_Latn,84,84,0,0,241373,1.0,1.0,1.0,1.0,0.0,1.0
+bkd_Latn,87,87,0,0,241370,1.0,1.0,1.0,1.0,0.0,1.0
+bkq_Latn,119,119,0,0,241338,1.0,1.0,1.0,1.0,0.0,1.0
+bku_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+bla_Latn,11,11,0,0,241446,1.0,1.0,1.0,1.0,0.0,1.0
+blh_Latn,101,101,0,0,241356,1.0,1.0,1.0,1.0,0.0,1.0
+blk_Mymr,159,135,0,24,241298,1.0,0.849057,0.918367,1.0,0.0,0.849057
+blt_Latn,39,39,0,0,241418,1.0,1.0,1.0,1.0,0.0,1.0
+blw_Latn,68,68,0,0,241389,1.0,1.0,1.0,1.0,0.0,1.0
+blz_Latn,93,93,0,0,241364,1.0,1.0,1.0,1.0,0.0,1.0
+bmh_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+bmk_Latn,11,11,0,0,241446,1.0,1.0,1.0,1.0,0.0,1.0
+bmq_Latn,30,30,0,0,241427,1.0,1.0,1.0,1.0,0.0,1.0
+bmr_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+bmu_Latn,106,106,0,0,241351,1.0,1.0,1.0,1.0,0.0,1.0
+bno_Latn,176,176,1,0,241280,0.99435,1.0,0.997167,0.999996,4.144545,1.0
+bnp_Latn,124,124,0,0,241333,1.0,1.0,1.0,1.0,0.0,1.0
+boa_Latn,59,59,0,0,241398,1.0,1.0,1.0,1.0,0.0,1.0
+bod_Tibt,406,405,11,1,241040,0.973558,0.997537,0.985401,0.999954,45.633497,0.997537
+boj_Latn,131,131,0,0,241326,1.0,1.0,1.0,1.0,0.0,1.0
+bon_Latn,131,131,0,0,241326,1.0,1.0,1.0,1.0,0.0,1.0
+bos_Latn,198,198,44,0,241215,0.818182,1.0,0.9,0.999818,182.376616,1.0
+box_Latn,50,50,1,0,241406,0.980392,1.0,0.990099,0.999996,4.142382,1.0
+bpr_Latn,101,101,0,0,241356,1.0,1.0,1.0,1.0,0.0,1.0
+bps_Latn,110,110,2,0,241345,0.982143,1.0,0.990991,0.999992,8.286824,1.0
+bpy_Beng,146,146,1,0,241310,0.993197,1.0,0.996587,0.999996,4.14403,1.0
+bqc_Latn,161,161,0,0,241296,1.0,1.0,1.0,1.0,0.0,1.0
+bqp_Latn,160,160,0,0,241297,1.0,1.0,1.0,1.0,0.0,1.0
+bre_Latn,277,277,0,0,241180,1.0,1.0,1.0,1.0,0.0,1.0
+brh_Arab,311,279,4,32,241142,0.985866,0.897106,0.939394,0.999983,16.587462,0.897106
+bru_Latn,141,141,1,0,241315,0.992958,1.0,0.996466,0.999996,4.143944,1.0
+brx_Deva,351,351,0,0,241106,1.0,1.0,1.0,1.0,0.0,1.0
+bsn_Latn,181,181,0,0,241276,1.0,1.0,1.0,1.0,0.0,1.0
+bsp_Latn,48,48,0,0,241409,1.0,1.0,1.0,1.0,0.0,1.0
+bsq_Latn,73,73,2,0,241382,0.973333,1.0,0.986486,0.999992,8.285553,1.0
+bss_Latn,142,142,0,0,241315,1.0,1.0,1.0,1.0,0.0,1.0
+btd_Latn,56,56,0,0,241401,1.0,1.0,1.0,1.0,0.0,1.0
+bth_Latn,33,33,0,0,241424,1.0,1.0,1.0,1.0,0.0,1.0
+bts_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+btx_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+bud_Latn,170,170,0,0,241287,1.0,1.0,1.0,1.0,0.0,1.0
+bug_Latn,78,78,9,0,241370,0.896552,1.0,0.945455,0.999963,37.285762,1.0
+buk_Latn,211,211,0,0,241246,1.0,1.0,1.0,1.0,0.0,1.0
+bul_Cyrl,289,289,2,0,241166,0.993127,1.0,0.996552,0.999992,8.292974,1.0
+bum_Latn,245,245,4,0,241208,0.983936,1.0,0.991903,0.999983,16.582923,1.0
+bus_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+bvd_Latn,206,206,0,0,241251,1.0,1.0,1.0,1.0,0.0,1.0
+bvr_Latn,159,159,0,0,241298,1.0,1.0,1.0,1.0,0.0,1.0
+bvz_Latn,93,93,0,0,241364,1.0,1.0,1.0,1.0,0.0,1.0
+bwd_Latn,51,51,0,0,241406,1.0,1.0,1.0,1.0,0.0,1.0
+bwu_Latn,56,56,1,0,241400,0.982456,1.0,0.99115,0.999996,4.142485,1.0
+bxh_Latn,76,76,0,0,241381,1.0,1.0,1.0,1.0,0.0,1.0
+bxr_Cyrl,277,277,4,0,241176,0.985765,1.0,0.992832,0.999983,16.585123,1.0
+byr_Latn,194,194,0,0,241263,1.0,1.0,1.0,1.0,0.0,1.0
+byx_Latn,206,206,0,0,241251,1.0,1.0,1.0,1.0,0.0,1.0
+bzd_Latn,160,160,0,0,241297,1.0,1.0,1.0,1.0,0.0,1.0
+bzh_Latn,146,146,0,0,241311,1.0,1.0,1.0,1.0,0.0,1.0
+bzi_Thai,115,115,0,0,241342,1.0,1.0,1.0,1.0,0.0,1.0
+bzj_Latn,164,164,2,0,241291,0.987952,1.0,0.993939,0.999992,8.288678,1.0
+caa_Latn,131,131,0,0,241326,1.0,1.0,1.0,1.0,0.0,1.0
+cab_Latn,201,201,0,0,241256,1.0,1.0,1.0,1.0,0.0,1.0
+cac_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+caf_Latn,174,174,0,0,241283,1.0,1.0,1.0,1.0,0.0,1.0
+cag_Latn,88,88,0,0,241369,1.0,1.0,1.0,1.0,0.0,1.0
+cak_Latn,173,173,0,0,241284,1.0,1.0,1.0,1.0,0.0,1.0
+cao_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+cap_Latn,226,226,0,0,241231,1.0,1.0,1.0,1.0,0.0,1.0
+caq_Latn,189,189,0,0,241268,1.0,1.0,1.0,1.0,0.0,1.0
+car_Latn,181,181,0,0,241276,1.0,1.0,1.0,1.0,0.0,1.0
+cas_Latn,74,74,0,0,241383,1.0,1.0,1.0,1.0,0.0,1.0
+cat_Latn,318,318,13,0,241126,0.960725,1.0,0.979969,0.999946,53.910815,1.0
+cav_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+cax_Latn,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+cbc_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+cbi_Latn,65,65,0,0,241392,1.0,1.0,1.0,1.0,0.0,1.0
+cbk_Latn,155,128,10,27,241292,0.927536,0.825806,0.87372,0.999959,41.441845,0.825806
+cbr_Latn,125,125,0,0,241332,1.0,1.0,1.0,1.0,0.0,1.0
+cbs_Latn,146,146,0,0,241311,1.0,1.0,1.0,1.0,0.0,1.0
+cbt_Latn,49,49,0,0,241408,1.0,1.0,1.0,1.0,0.0,1.0
+cbu_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+cbv_Latn,141,141,0,0,241316,1.0,1.0,1.0,1.0,0.0,1.0
+cce_Latn,133,130,2,3,241322,0.984848,0.977444,0.981132,0.999992,8.287613,0.977444
+cco_Latn,95,95,0,0,241362,1.0,1.0,1.0,1.0,0.0,1.0
+ccp_Latn,3,3,0,0,241454,1.0,1.0,1.0,1.0,0.0,1.0
+ceb_Latn,338,338,0,0,241119,1.0,1.0,1.0,1.0,0.0,1.0
+ceg_Latn,53,53,1,0,241403,0.981481,1.0,0.990654,0.999996,4.142433,1.0
+cek_Latn,67,51,32,16,241358,0.614458,0.761194,0.68,0.999867,132.565558,0.761194
+ces_Latn,183,183,0,0,241274,1.0,1.0,1.0,1.0,0.0,1.0
+cfm_Latn,133,133,7,0,241317,0.95,1.0,0.974359,0.999971,29.006647,1.0
+cgc_Latn,169,169,2,0,241286,0.988304,1.0,0.994118,0.999992,8.28885,1.0
+cha_Latn,348,348,0,0,241109,1.0,1.0,1.0,1.0,0.0,1.0
+chd_Latn,146,146,0,0,241311,1.0,1.0,1.0,1.0,0.0,1.0
+che_Cyrl,345,345,0,0,241112,1.0,1.0,1.0,1.0,0.0,1.0
+chf_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+chk_Latn,294,294,0,0,241163,1.0,1.0,1.0,1.0,0.0,1.0
+cho_Latn,36,33,0,3,241421,1.0,0.916667,0.956522,1.0,0.0,0.916667
+chq_Latn,56,56,0,0,241401,1.0,1.0,1.0,1.0,0.0,1.0
+chr_Cher,44,44,0,0,241413,1.0,1.0,1.0,1.0,0.0,1.0
+chu_Cyrl,168,144,14,24,241275,0.911392,0.857143,0.883436,0.999942,58.021708,0.857143
+chv_Cyrl,335,335,0,0,241122,1.0,1.0,1.0,1.0,0.0,1.0
+chw_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+chz_Latn,164,164,0,0,241293,1.0,1.0,1.0,1.0,0.0,1.0
+cjk_Latn,24,24,3,0,241430,0.888889,1.0,0.941176,0.999988,12.425808,1.0
+cjp_Latn,64,64,0,0,241393,1.0,1.0,1.0,1.0,0.0,1.0
+cjs_Cyrl,20,14,1,6,241436,0.933333,0.7,0.8,0.999996,4.141867,0.7
+cjv_Latn,78,78,0,0,241379,1.0,1.0,1.0,1.0,0.0,1.0
+ckb_Arab,421,402,25,19,241011,0.941452,0.954869,0.948113,0.999896,103.718947,0.954869
+ckm_Latn,119,87,17,32,241321,0.836538,0.731092,0.780269,0.99993,70.440627,0.731092
+cko_Latn,63,63,0,0,241394,1.0,1.0,1.0,1.0,0.0,1.0
+ckt_Cyrl,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+clu_Latn,76,76,1,0,241380,0.987013,1.0,0.993464,0.999996,4.142828,1.0
+cme_Latn,63,63,2,0,241392,0.969231,1.0,0.984375,0.999992,8.28521,1.0
+cmn_Hani,288,287,64,1,241105,0.817664,0.996528,0.898279,0.999735,265.374074,0.996528
+cmo_Latn,117,117,0,0,241340,1.0,1.0,1.0,1.0,0.0,1.0
+cnh_Latn,286,286,4,0,241167,0.986207,1.0,0.993056,0.999983,16.585742,1.0
+cni_Latn,170,170,0,0,241287,1.0,1.0,1.0,1.0,0.0,1.0
+cnk_Latn,115,78,5,37,241337,0.939759,0.678261,0.787879,0.999979,20.717488,0.678261
+cnr_Latn,147,147,36,0,241274,0.803279,1.0,0.890909,0.999851,149.185695,1.0
+cnw_Latn,8,8,1,0,241448,0.888889,1.0,0.941176,0.999996,4.141661,1.0
+coe_Latn,112,112,0,0,241345,1.0,1.0,1.0,1.0,0.0,1.0
+cof_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+cok_Latn,181,181,0,0,241276,1.0,1.0,1.0,1.0,0.0,1.0
+con_Latn,89,89,1,0,241367,0.988889,1.0,0.994413,0.999996,4.143051,1.0
+cop_Copt,92,91,0,1,241365,1.0,0.98913,0.994536,1.0,0.0,0.98913
+cor_Latn,290,290,1,0,241166,0.996564,1.0,0.998279,0.999996,4.146504,1.0
+cos_Latn,220,220,3,0,241234,0.986547,1.0,0.993228,0.999988,12.435903,1.0
+cot_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+cpb_Latn,124,124,0,0,241333,1.0,1.0,1.0,1.0,0.0,1.0
+cpc_Latn,389,389,0,0,241068,1.0,1.0,1.0,1.0,0.0,1.0
+cpu_Latn,47,47,0,0,241410,1.0,1.0,1.0,1.0,0.0,1.0
+cpy_Latn,147,147,0,0,241310,1.0,1.0,1.0,1.0,0.0,1.0
+crh_Cyrl,153,153,1,0,241303,0.993506,1.0,0.996743,0.999996,4.14415,1.0
+crh_Latn,189,189,22,0,241246,0.895735,1.0,0.945,0.999909,91.184906,1.0
+crj_Cans,21,21,0,0,241436,1.0,1.0,1.0,1.0,0.0,1.0
+crk_Cans,27,27,0,0,241430,1.0,1.0,1.0,1.0,0.0,1.0
+crk_Latn,225,225,12,0,241220,0.949367,1.0,0.974026,0.99995,49.744644,1.0
+crl_Cans,59,59,0,0,241398,1.0,1.0,1.0,1.0,0.0,1.0
+crm_Cans,203,203,0,0,241254,1.0,1.0,1.0,1.0,0.0,1.0
+crn_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+crs_Latn,218,218,4,0,241235,0.981982,1.0,0.990909,0.999983,16.581067,1.0
+crx_Latn,322,322,1,0,241134,0.996904,1.0,0.99845,0.999996,4.147055,1.0
+csb_Latn,307,307,1,0,241149,0.996753,1.0,0.998374,0.999996,4.146797,1.0
+csw_Latn,56,41,0,15,241401,1.0,0.732143,0.845361,1.0,0.0,0.732143
+csy_Latn,146,146,2,0,241309,0.986486,1.0,0.993197,0.999992,8.28806,1.0
+cta_Latn,98,98,0,0,241359,1.0,1.0,1.0,1.0,0.0,1.0
+ctd_Latn,196,196,36,0,241225,0.844828,1.0,0.915888,0.999851,149.215994,1.0
+cto_Latn,103,103,0,0,241354,1.0,1.0,1.0,1.0,0.0,1.0
+ctp_Latn,137,137,0,0,241320,1.0,1.0,1.0,1.0,0.0,1.0
+ctu_Latn,243,242,0,1,241214,1.0,0.995885,0.997938,1.0,0.0,0.995885
+cub_Latn,56,56,0,0,241401,1.0,1.0,1.0,1.0,0.0,1.0
+cui_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+cuk_Latn,245,245,1,0,241211,0.995935,1.0,0.997963,0.999996,4.145731,1.0
+cul_Latn,9,9,0,0,241448,1.0,1.0,1.0,1.0,0.0,1.0
+cut_Latn,136,136,0,0,241321,1.0,1.0,1.0,1.0,0.0,1.0
+cux_Latn,54,54,0,0,241403,1.0,1.0,1.0,1.0,0.0,1.0
+cwe_Latn,115,115,3,0,241339,0.974576,1.0,0.987124,0.999988,12.430493,1.0
+cwt_Latn,89,89,0,0,241368,1.0,1.0,1.0,1.0,0.0,1.0
+cya_Latn,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+cym_Latn,189,189,0,0,241268,1.0,1.0,1.0,1.0,0.0,1.0
+czt_Latn,135,135,11,0,241311,0.924658,1.0,0.960854,0.999954,45.582251,1.0
+daa_Latn,71,71,0,0,241386,1.0,1.0,1.0,1.0,0.0,1.0
+dad_Latn,142,142,1,0,241314,0.993007,1.0,0.996491,0.999996,4.143961,1.0
+daf_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+dag_Latn,149,131,123,18,241185,0.515748,0.879195,0.650124,0.99949,509.722015,0.879195
+dah_Latn,172,172,1,0,241284,0.99422,1.0,0.997101,0.999996,4.144476,1.0
+dak_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+dan_Latn,242,237,25,5,241190,0.90458,0.979339,0.940476,0.999896,103.641979,0.979339
+dar_Cyrl,227,227,0,0,241230,1.0,1.0,1.0,1.0,0.0,1.0
+ded_Latn,103,103,0,0,241354,1.0,1.0,1.0,1.0,0.0,1.0
+des_Latn,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+deu_Latn,356,356,50,0,241051,0.876847,1.0,0.934383,0.999793,207.381969,1.0
+dga_Latn,173,173,0,0,241284,1.0,1.0,1.0,1.0,0.0,1.0
+dgc_Latn,203,203,0,0,241254,1.0,1.0,1.0,1.0,0.0,1.0
+dgi_Latn,81,81,0,0,241376,1.0,1.0,1.0,1.0,0.0,1.0
+dgr_Latn,305,305,0,0,241152,1.0,1.0,1.0,1.0,0.0,1.0
+dgz_Latn,162,162,0,0,241295,1.0,1.0,1.0,1.0,0.0,1.0
+dhm_Latn,59,59,4,0,241394,0.936508,1.0,0.967213,0.999983,16.570146,1.0
+dhv_Latn,138,138,0,0,241319,1.0,1.0,1.0,1.0,0.0,1.0
+dig_Latn,224,224,2,0,241231,0.99115,1.0,0.995556,0.999992,8.29074,1.0
+dik_Latn,350,350,0,0,241107,1.0,1.0,1.0,1.0,0.0,1.0
+diq_Latn,134,134,21,0,241302,0.864516,1.0,0.927336,0.999913,87.020301,1.0
+div_Thaa,238,238,15,0,241204,0.940711,1.0,0.96945,0.999938,62.184156,1.0
+dje_Latn,131,127,0,4,241326,1.0,0.969466,0.984496,1.0,0.0,0.969466
+djk_Latn,187,187,0,0,241270,1.0,1.0,1.0,1.0,0.0,1.0
+djr_Latn,156,156,1,0,241300,0.993631,1.0,0.996805,0.999996,4.144202,1.0
+dks_Latn,3,3,0,0,241454,1.0,1.0,1.0,1.0,0.0,1.0
+dng_Cyrl,118,118,0,0,241339,1.0,1.0,1.0,1.0,0.0,1.0
+dnj_Latn,184,184,0,0,241273,1.0,1.0,1.0,1.0,0.0,1.0
+dnw_Latn,22,22,0,0,241435,1.0,1.0,1.0,1.0,0.0,1.0
+dob_Latn,77,77,0,0,241380,1.0,1.0,1.0,1.0,0.0,1.0
+doi_Deva,254,254,0,0,241203,1.0,1.0,1.0,1.0,0.0,1.0
+dop_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+dos_Latn,35,35,0,0,241422,1.0,1.0,1.0,1.0,0.0,1.0
+drg_Latn,13,13,0,0,241444,1.0,1.0,1.0,1.0,0.0,1.0
+dru_Latn,58,58,0,0,241399,1.0,1.0,1.0,1.0,0.0,1.0
+dsb_Latn,187,187,0,0,241270,1.0,1.0,1.0,1.0,0.0,1.0
+dtp_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+dts_Latn,113,113,1,0,241343,0.991228,1.0,0.995595,0.999996,4.143463,1.0
+dua_Latn,176,176,2,0,241279,0.988764,1.0,0.99435,0.999992,8.28909,1.0
+duo_Latn,56,56,0,0,241401,1.0,1.0,1.0,1.0,0.0,1.0
+dur_Latn,38,38,0,0,241419,1.0,1.0,1.0,1.0,0.0,1.0
+dwr_Latn,144,144,2,0,241311,0.986301,1.0,0.993103,0.999992,8.287991,1.0
+dww_Latn,145,145,0,0,241312,1.0,1.0,1.0,1.0,0.0,1.0
+dyi_Latn,249,249,0,0,241208,1.0,1.0,1.0,1.0,0.0,1.0
+dyo_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+dyu_Latn,390,390,0,0,241067,1.0,1.0,1.0,1.0,0.0,1.0
+dzo_Tibt,346,346,57,0,241054,0.858561,1.0,0.923899,0.999764,236.405639,1.0
+ebk_Latn,24,24,0,0,241433,1.0,1.0,1.0,1.0,0.0,1.0
+efi_Latn,268,268,0,0,241189,1.0,1.0,1.0,1.0,0.0,1.0
+ekk_Latn,615,420,6,195,240836,0.985915,0.682927,0.806916,0.999975,24.912598,0.682927
+eko_Latn,136,136,1,0,241320,0.992701,1.0,0.996337,0.999996,4.143858,1.0
+ell_Grek,394,393,52,1,241011,0.883146,0.997462,0.93683,0.999784,215.711246,0.997462
+emi_Latn,161,161,0,0,241296,1.0,1.0,1.0,1.0,0.0,1.0
+eml_Latn,198,198,5,0,241254,0.975369,1.0,0.987531,0.999979,20.724615,1.0
+emp_Latn,160,160,0,0,241297,1.0,1.0,1.0,1.0,0.0,1.0
+enb_Latn,93,93,0,0,241364,1.0,1.0,1.0,1.0,0.0,1.0
+eng_Latn,1444,1155,161,289,239852,0.87766,0.799861,0.836957,0.999329,670.796998,0.799861
+enl_Latn,24,24,1,0,241432,0.96,1.0,0.979592,0.999996,4.141936,1.0
+enm_Latn,81,58,3,23,241373,0.95082,0.716049,0.816901,0.999988,12.428742,0.716049
+enq_Latn,222,222,1,0,241234,0.995516,1.0,0.997753,0.999996,4.145335,1.0
+epo_Latn,294,293,0,1,241163,1.0,0.996599,0.998296,1.0,0.0,0.996599
+eri_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+ese_Latn,137,137,0,0,241320,1.0,1.0,1.0,1.0,0.0,1.0
+esi_Latn,9,9,5,0,241443,0.642857,1.0,0.782609,0.999979,20.708393,1.0
+esk_Latn,117,117,26,0,241314,0.818182,1.0,0.9,0.999892,107.731831,1.0
+ess_Latn,10,10,3,0,241444,0.769231,1.0,0.869565,0.999988,12.425087,1.0
+esu_Latn,232,232,1,0,241224,0.995708,1.0,0.997849,0.999996,4.145507,1.0
+etr_Latn,115,115,0,0,241342,1.0,1.0,1.0,1.0,0.0,1.0
+eus_Latn,254,254,7,0,241196,0.97318,1.0,0.986408,0.999971,29.021198,1.0
+eve_Cyrl,77,61,1,16,241379,0.983871,0.792208,0.877698,0.999996,4.142845,0.792208
+ewe_Latn,308,308,1,0,241148,0.996764,1.0,0.998379,0.999996,4.146814,1.0
+ewo_Latn,134,105,0,29,241323,1.0,0.783582,0.878661,1.0,0.0,0.783582
+ext_Latn,139,139,2,0,241316,0.985816,1.0,0.992857,0.999992,8.287819,1.0
+eza_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+faa_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+fai_Latn,133,133,0,0,241324,1.0,1.0,1.0,1.0,0.0,1.0
+fal_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+fan_Latn,57,57,12,0,241388,0.826087,1.0,0.904762,0.99995,49.710025,1.0
+fao_Latn,237,237,0,0,241220,1.0,1.0,1.0,1.0,0.0,1.0
+far_Latn,43,43,0,0,241414,1.0,1.0,1.0,1.0,0.0,1.0
+fas_Arab,396,385,50,11,241011,0.885057,0.972222,0.926594,0.999793,207.41638,0.972222
+fat_Latn,396,389,7,7,241054,0.982323,0.982323,0.982323,0.999971,29.038293,0.982323
+ffm_Latn,104,59,10,45,241343,0.855072,0.567308,0.682081,0.999959,41.433088,0.567308
+fij_Latn,344,344,0,0,241113,1.0,1.0,1.0,1.0,0.0,1.0
+fil_Latn,137,133,1,4,241319,0.992537,0.970803,0.98155,0.999996,4.143875,0.970803
+fin_Latn,368,368,7,0,241082,0.981333,1.0,0.990579,0.999971,29.034921,1.0
+fit_Latn,106,106,19,0,241332,0.848,1.0,0.917749,0.999921,78.723519,1.0
+fkv_Latn,156,129,4,27,241297,0.969925,0.826923,0.892734,0.999983,16.576807,0.826923
+fon_Latn,180,180,0,0,241277,1.0,1.0,1.0,1.0,0.0,1.0
+for_Latn,178,178,0,0,241279,1.0,1.0,1.0,1.0,0.0,1.0
+fra_Latn,1655,1509,91,146,239711,0.943125,0.911782,0.927189,0.999621,379.479737,0.911782
+frd_Latn,51,51,0,0,241406,1.0,1.0,1.0,1.0,0.0,1.0
+fro_Latn,287,236,3,51,241167,0.987448,0.8223,0.897338,0.999988,12.439358,0.8223
+frp_Latn,137,95,58,42,241262,0.620915,0.693431,0.655172,0.99976,240.34477,0.693431
+frr_Latn,88,88,0,0,241369,1.0,1.0,1.0,1.0,0.0,1.0
+fry_Latn,241,241,0,0,241216,1.0,1.0,1.0,1.0,0.0,1.0
+fub_Latn,16,16,4,0,241437,0.8,1.0,0.888889,0.999983,16.567194,1.0
+fue_Latn,25,25,0,0,241432,1.0,1.0,1.0,1.0,0.0,1.0
+fuf_Latn,166,166,24,0,241267,0.873684,1.0,0.932584,0.999901,99.464961,1.0
+fuh_Latn,146,146,27,0,241284,0.843931,1.0,0.915361,0.999888,111.888807,1.0
+fur_Latn,221,221,2,0,241234,0.991031,1.0,0.995495,0.999992,8.290637,1.0
+fuv_Arab,9,9,1,0,241447,0.9,1.0,0.947368,0.999996,4.141679,1.0
+fuv_Latn,164,128,14,36,241279,0.901408,0.780488,0.836601,0.999942,58.020747,0.780488
+gaa_Latn,168,166,0,2,241289,1.0,0.988095,0.994012,1.0,0.0,0.988095
+gag_Cyrl,128,103,7,25,241322,0.936364,0.804688,0.865546,0.999971,29.006046,0.804688
+gag_Latn,41,41,2,0,241414,0.953488,1.0,0.97619,0.999992,8.284455,1.0
+gah_Latn,88,88,0,0,241369,1.0,1.0,1.0,1.0,0.0,1.0
+gai_Latn,175,175,0,0,241282,1.0,1.0,1.0,1.0,0.0,1.0
+gam_Latn,125,125,0,0,241332,1.0,1.0,1.0,1.0,0.0,1.0
+gaw_Latn,151,151,1,0,241305,0.993421,1.0,0.9967,0.999996,4.144116,1.0
+gaz_Latn,441,419,33,22,240983,0.926991,0.950113,0.93841,0.999863,136.92037,0.950113
+gbi_Latn,81,81,0,0,241376,1.0,1.0,1.0,1.0,0.0,1.0
+gbo_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+gcf_Latn,154,154,0,0,241303,1.0,1.0,1.0,1.0,0.0,1.0
+gcr_Latn,118,118,0,0,241339,1.0,1.0,1.0,1.0,0.0,1.0
+gde_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+gdg_Latn,83,83,0,0,241374,1.0,1.0,1.0,1.0,0.0,1.0
+gdn_Latn,156,156,0,0,241301,1.0,1.0,1.0,1.0,0.0,1.0
+gdr_Latn,184,184,0,0,241273,1.0,1.0,1.0,1.0,0.0,1.0
+geb_Latn,87,87,0,0,241370,1.0,1.0,1.0,1.0,0.0,1.0
+gfk_Latn,125,125,0,0,241332,1.0,1.0,1.0,1.0,0.0,1.0
+ghs_Latn,125,125,1,0,241331,0.992063,1.0,0.996016,0.999996,4.143669,1.0
+gil_Latn,298,298,0,0,241159,1.0,1.0,1.0,1.0,0.0,1.0
+gjn_Latn,85,78,1,7,241371,0.987342,0.917647,0.95122,0.999996,4.142983,0.917647
+gkn_Latn,123,123,0,0,241334,1.0,1.0,1.0,1.0,0.0,1.0
+gla_Latn,223,223,2,0,241232,0.991111,1.0,0.995536,0.999992,8.290705,1.0
+gle_Latn,203,203,0,0,241254,1.0,1.0,1.0,1.0,0.0,1.0
+glg_Latn,215,215,18,0,241224,0.922747,1.0,0.959821,0.999925,74.613873,1.0
+glk_Arab,319,250,25,69,241113,0.909091,0.783699,0.841751,0.999896,103.675074,0.783699
+glv_Latn,357,357,0,0,241100,1.0,1.0,1.0,1.0,0.0,1.0
+gmh_Latn,177,116,2,61,241278,0.983051,0.655367,0.786441,0.999992,8.289125,0.655367
+gmv_Ethi,149,149,0,0,241308,1.0,1.0,1.0,1.0,0.0,1.0
+gmv_Latn,134,134,3,0,241320,0.978102,1.0,0.98893,0.999988,12.431472,1.0
+gnb_Latn,45,45,11,0,241401,0.803571,1.0,0.891089,0.999954,45.565258,1.0
+gnd_Latn,64,64,0,0,241393,1.0,1.0,1.0,1.0,0.0,1.0
+gng_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+gnn_Latn,191,191,0,0,241266,1.0,1.0,1.0,1.0,0.0,1.0
+gnw_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+gof_Ethi,38,38,0,0,241419,1.0,1.0,1.0,1.0,0.0,1.0
+gof_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+gog_Latn,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+goh_Latn,93,71,2,22,241362,0.972603,0.763441,0.855422,0.999992,8.28624,0.763441
+gom_Deva,170,170,9,0,241278,0.949721,1.0,0.974212,0.999963,37.299979,1.0
+gom_Latn,221,221,18,0,241218,0.924686,1.0,0.96087,0.999925,74.615729,1.0
+gor_Latn,149,149,0,0,241308,1.0,1.0,1.0,1.0,0.0,1.0
+gos_Latn,74,74,1,0,241382,0.986667,1.0,0.993289,0.999996,4.142794,1.0
+got_Goth,70,70,5,0,241382,0.933333,1.0,0.965517,0.999979,20.713626,1.0
+grc_Grek,317,317,0,0,241140,1.0,1.0,1.0,1.0,0.0,1.0
+grt_Beng,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+gso_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+gsw_Latn,208,208,22,0,241227,0.904348,1.0,0.949772,0.999909,91.192088,1.0
+gub_Latn,180,180,0,0,241277,1.0,1.0,1.0,1.0,0.0,1.0
+guc_Latn,252,252,0,0,241205,1.0,1.0,1.0,1.0,0.0,1.0
+gug_Latn,228,228,2,0,241227,0.991304,1.0,0.995633,0.999992,8.290877,1.0
+guh_Latn,207,207,0,0,241250,1.0,1.0,1.0,1.0,0.0,1.0
+gui_Latn,95,95,0,0,241362,1.0,1.0,1.0,1.0,0.0,1.0
+guj_Gujr,354,354,0,0,241103,1.0,1.0,1.0,1.0,0.0,1.0
+guj_Latn,42,36,13,6,241402,0.734694,0.857143,0.791209,0.999946,53.849181,0.857143
+guk_Ethi,36,36,0,0,241421,1.0,1.0,1.0,1.0,0.0,1.0
+gul_Latn,136,136,1,0,241320,0.992701,1.0,0.996337,0.999996,4.143858,1.0
+gum_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+gun_Latn,54,54,0,0,241403,1.0,1.0,1.0,1.0,0.0,1.0
+guo_Latn,138,138,0,0,241319,1.0,1.0,1.0,1.0,0.0,1.0
+guq_Latn,18,18,1,0,241438,0.947368,1.0,0.972973,0.999996,4.141833,1.0
+gur_Latn,161,159,2,2,241294,0.987578,0.987578,0.987578,0.999992,8.288575,0.987578
+guw_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+gux_Latn,141,141,0,0,241316,1.0,1.0,1.0,1.0,0.0,1.0
+guz_Latn,232,232,1,0,241224,0.995708,1.0,0.997849,0.999996,4.145507,1.0
+gvc_Latn,39,39,0,0,241418,1.0,1.0,1.0,1.0,0.0,1.0
+gvf_Latn,126,126,0,0,241331,1.0,1.0,1.0,1.0,0.0,1.0
+gvl_Latn,83,83,0,0,241374,1.0,1.0,1.0,1.0,0.0,1.0
+gvn_Latn,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+gwi_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+gym_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+gyr_Latn,48,48,0,0,241409,1.0,1.0,1.0,1.0,0.0,1.0
+hac_Arab,382,330,5,52,241070,0.985075,0.863874,0.920502,0.999979,20.740433,0.863874
+hae_Latn,75,44,15,31,241367,0.745763,0.586667,0.656716,0.999938,62.142165,0.586667
+hag_Latn,94,94,0,0,241363,1.0,1.0,1.0,1.0,0.0,1.0
+hak_Hani,29,21,1,8,241427,0.954545,0.724138,0.823529,0.999996,4.142022,0.724138
+hak_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+hat_Latn,338,337,2,1,241117,0.9941,0.997041,0.995569,0.999992,8.294659,0.997041
+hau_Latn,367,366,6,1,241084,0.983871,0.997275,0.990528,0.999975,24.886972,0.997275
+hav_Latn,61,61,3,0,241393,0.953125,1.0,0.976,0.999988,12.427712,1.0
+haw_Latn,214,214,1,0,241242,0.995349,1.0,0.997669,0.999996,4.145198,1.0
+hay_Latn,92,92,37,0,241328,0.713178,1.0,0.832579,0.999847,153.294802,1.0
+hbo_Hebr,189,189,6,0,241262,0.969231,1.0,0.984375,0.999975,24.868611,1.0
+hch_Latn,259,259,0,0,241198,1.0,1.0,1.0,1.0,0.0,1.0
+heb_Hebr,203,203,3,0,241251,0.985437,1.0,0.992665,0.999988,12.435027,1.0
+heg_Latn,93,93,0,0,241364,1.0,1.0,1.0,1.0,0.0,1.0
+heh_Latn,135,135,1,0,241321,0.992647,1.0,0.99631,0.999996,4.143841,1.0
+her_Latn,235,233,0,2,241222,1.0,0.991489,0.995726,1.0,0.0,0.991489
+hif_Latn,115,73,58,42,241284,0.557252,0.634783,0.593496,0.99976,240.322861,0.634783
+hig_Latn,89,89,0,0,241368,1.0,1.0,1.0,1.0,0.0,1.0
+hil_Latn,266,266,3,0,241188,0.988848,1.0,0.994393,0.999988,12.438275,1.0
+hin_Deva,392,306,53,86,241012,0.852368,0.780612,0.814913,0.99978,219.857715,0.780612
+hin_Latn,164,91,40,73,241253,0.694656,0.554878,0.616949,0.999834,165.773562,0.554878
+hix_Latn,222,222,0,0,241235,1.0,1.0,1.0,1.0,0.0,1.0
+hla_Latn,133,133,0,0,241324,1.0,1.0,1.0,1.0,0.0,1.0
+hmo_Latn,143,143,0,0,241314,1.0,1.0,1.0,1.0,0.0,1.0
+hmr_Latn,283,234,0,49,241174,1.0,0.826855,0.905222,1.0,0.0,0.826855
+hne_Deva,198,198,7,0,241252,0.965854,1.0,0.98263,0.999971,29.014462,1.0
+hnj_Latn,300,300,0,0,241157,1.0,1.0,1.0,1.0,0.0,1.0
+hnn_Latn,32,24,0,8,241425,1.0,0.75,0.857143,1.0,0.0,0.75
+hns_Latn,73,61,7,12,241377,0.897059,0.835616,0.865248,0.999971,28.999437,0.835616
+hop_Latn,8,8,2,0,241447,0.8,1.0,0.888889,0.999992,8.283323,1.0
+hot_Latn,168,168,0,0,241289,1.0,1.0,1.0,1.0,0.0,1.0
+hra_Latn,56,56,3,0,241398,0.949153,1.0,0.973913,0.999988,12.427455,1.0
+hrv_Latn,168,168,20,0,241269,0.893617,1.0,0.94382,0.999917,82.888155,1.0
+hrx_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+hsb_Latn,269,269,4,0,241184,0.985348,1.0,0.99262,0.999983,16.584573,1.0
+hto_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+hub_Latn,123,123,0,0,241334,1.0,1.0,1.0,1.0,0.0,1.0
+hui_Latn,93,93,0,0,241364,1.0,1.0,1.0,1.0,0.0,1.0
+hun_Latn,576,576,2,0,240879,0.99654,1.0,0.998267,0.999992,8.302855,1.0
+hus_Latn,109,106,1,3,241347,0.990654,0.972477,0.981481,0.999996,4.143395,0.972477
+huu_Latn,72,72,0,0,241385,1.0,1.0,1.0,1.0,0.0,1.0
+huv_Latn,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+hvn_Latn,11,11,0,0,241446,1.0,1.0,1.0,1.0,0.0,1.0
+hwc_Latn,165,165,5,0,241287,0.970588,1.0,0.985075,0.999979,20.721781,1.0
+hye_Armn,178,178,0,0,241279,1.0,1.0,1.0,1.0,0.0,1.0
+hyw_Armn,233,233,0,0,241224,1.0,1.0,1.0,1.0,0.0,1.0
+ian_Latn,112,112,2,0,241343,0.982456,1.0,0.99115,0.999992,8.286892,1.0
+iba_Latn,283,283,0,0,241174,1.0,1.0,1.0,1.0,0.0,1.0
+ibg_Latn,85,85,0,0,241372,1.0,1.0,1.0,1.0,0.0,1.0
+ibo_Latn,257,257,1,0,241199,0.996124,1.0,0.998058,0.999996,4.145937,1.0
+icr_Latn,24,12,1,12,241432,0.923077,0.5,0.648649,0.999996,4.141936,0.5
+ido_Latn,270,270,1,0,241186,0.99631,1.0,0.998152,0.999996,4.14616,1.0
+idu_Latn,99,99,0,0,241358,1.0,1.0,1.0,1.0,0.0,1.0
+ifb_Latn,137,137,0,0,241320,1.0,1.0,1.0,1.0,0.0,1.0
+ife_Latn,18,18,0,0,241439,1.0,1.0,1.0,1.0,0.0,1.0
+ifk_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+ifu_Latn,173,173,0,0,241284,1.0,1.0,1.0,1.0,0.0,1.0
+ify_Latn,118,118,0,0,241339,1.0,1.0,1.0,1.0,0.0,1.0
+ige_Latn,59,59,0,0,241398,1.0,1.0,1.0,1.0,0.0,1.0
+ign_Latn,44,44,0,0,241413,1.0,1.0,1.0,1.0,0.0,1.0
+ike_Cans,310,310,0,0,241147,1.0,1.0,1.0,1.0,0.0,1.0
+ikk_Latn,65,65,0,0,241392,1.0,1.0,1.0,1.0,0.0,1.0
+ikt_Latn,283,227,0,56,241174,1.0,0.80212,0.890196,1.0,0.0,0.80212
+ikw_Latn,21,21,0,0,241436,1.0,1.0,1.0,1.0,0.0,1.0
+ile_Latn,252,252,2,0,241203,0.992126,1.0,0.996047,0.999992,8.291702,1.0
+ilo_Latn,252,252,0,0,241205,1.0,1.0,1.0,1.0,0.0,1.0
+imo_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+ina_Latn,234,234,5,0,241218,0.979079,1.0,0.989429,0.999979,20.727708,1.0
+inb_Latn,89,89,1,0,241367,0.988889,1.0,0.994413,0.999996,4.143051,1.0
+ind_Latn,335,335,55,0,241067,0.858974,1.0,0.924138,0.999772,228.100298,1.0
+inh_Cyrl,139,139,9,0,241309,0.939189,1.0,0.968641,0.999963,37.295187,1.0
+ino_Latn,123,123,0,0,241334,1.0,1.0,1.0,1.0,0.0,1.0
+iou_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+ipi_Latn,63,63,0,0,241394,1.0,1.0,1.0,1.0,0.0,1.0
+irk_Latn,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+isd_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+ish_Latn,21,21,0,0,241436,1.0,1.0,1.0,1.0,0.0,1.0
+isl_Latn,276,276,31,0,241150,0.899023,1.0,0.946827,0.999871,128.534171,1.0
+iso_Latn,159,159,0,0,241298,1.0,1.0,1.0,1.0,0.0,1.0
+ita_Latn,342,333,29,9,241086,0.91989,0.973684,0.946023,0.99988,120.274558,0.973684
+itv_Latn,86,86,0,0,241371,1.0,1.0,1.0,1.0,0.0,1.0
+ium_Latn,184,184,0,0,241273,1.0,1.0,1.0,1.0,0.0,1.0
+ivv_Latn,17,17,0,0,241440,1.0,1.0,1.0,1.0,0.0,1.0
+iws_Latn,178,178,0,0,241279,1.0,1.0,1.0,1.0,0.0,1.0
+ixl_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+izr_Latn,97,97,0,0,241360,1.0,1.0,1.0,1.0,0.0,1.0
+izz_Latn,38,38,1,0,241418,0.974359,1.0,0.987013,0.999996,4.142176,1.0
+jac_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+jae_Latn,211,211,0,0,241246,1.0,1.0,1.0,1.0,0.0,1.0
+jam_Latn,196,177,29,19,241232,0.859223,0.903061,0.880597,0.99988,120.201773,0.903061
+jav_Latn,158,158,2,0,241297,0.9875,1.0,0.993711,0.999992,8.288472,1.0
+jbo_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+jbu_Latn,87,87,1,0,241369,0.988636,1.0,0.994286,0.999996,4.143017,1.0
+jic_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+jiv_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+jpn_Jpan,323,323,39,0,241095,0.892265,1.0,0.943066,0.999838,161.735798,1.0
+jra_Latn,177,177,2,0,241278,0.988827,1.0,0.994382,0.999992,8.289125,1.0
+jvn_Latn,115,115,1,0,241341,0.991379,1.0,0.995671,0.999996,4.143498,1.0
+kaa_Cyrl,181,181,0,0,241276,1.0,1.0,1.0,1.0,0.0,1.0
+kaa_Latn,182,137,0,45,241275,1.0,0.752747,0.858934,1.0,0.0,0.752747
+kab_Latn,165,165,5,0,241287,0.970588,1.0,0.985075,0.999979,20.721781,1.0
+kac_Latn,216,216,0,0,241241,1.0,1.0,1.0,1.0,0.0,1.0
+kal_Latn,369,369,19,0,241069,0.951031,1.0,0.974901,0.999921,78.809397,1.0
+kam_Latn,272,257,0,15,241185,1.0,0.944853,0.971645,1.0,0.0,0.944853
+kan_Knda,601,594,1,7,240855,0.998319,0.988353,0.993311,0.999996,4.151858,0.988353
+kan_Latn,264,240,4,24,241189,0.983607,0.909091,0.944882,0.999983,16.584229,0.909091
+kao_Latn,138,138,0,0,241319,1.0,1.0,1.0,1.0,0.0,1.0
+kaq_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+kas_Arab,118,118,1,0,241338,0.991597,1.0,0.995781,0.999996,4.143549,1.0
+kas_Deva,47,26,5,21,241405,0.83871,0.553191,0.666667,0.999979,20.711652,0.553191
+kat_Geor,324,324,15,0,241118,0.955752,1.0,0.977376,0.999938,62.206334,1.0
+kaz_Cyrl,340,340,2,0,241115,0.994152,1.0,0.997067,0.999992,8.294728,1.0
+kbc_Latn,149,149,0,0,241308,1.0,1.0,1.0,1.0,0.0,1.0
+kbd_Cyrl,238,238,1,0,241218,0.995816,1.0,0.997904,0.999996,4.14561,1.0
+kbh_Latn,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+kbm_Latn,152,152,0,0,241305,1.0,1.0,1.0,1.0,0.0,1.0
+kbp_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+kbq_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+kbr_Latn,95,95,0,0,241362,1.0,1.0,1.0,1.0,0.0,1.0
+kby_Latn,7,7,29,0,241421,0.194444,1.0,0.325581,0.99988,120.107683,1.0
+kca_Cyrl,345,345,1,0,241111,0.99711,1.0,0.998553,0.999996,4.14745,1.0
+kcg_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+kck_Latn,82,82,8,0,241367,0.911111,1.0,0.953488,0.999967,33.143449,1.0
+kdc_Latn,92,92,1,0,241364,0.989247,1.0,0.994595,0.999996,4.143103,1.0
+kde_Latn,178,178,1,0,241278,0.994413,1.0,0.997199,0.999996,4.14458,1.0
+kdh_Latn,34,34,0,0,241423,1.0,1.0,1.0,1.0,0.0,1.0
+kdi_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+kdl_Latn,64,64,1,0,241392,0.984615,1.0,0.992248,0.999996,4.142622,1.0
+kea_Latn,205,205,1,0,241251,0.995146,1.0,0.997567,0.999996,4.145043,1.0
+kek_Latn,183,183,1,0,241273,0.994565,1.0,0.997275,0.999996,4.144665,1.0
+ken_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+keo_Latn,60,60,0,0,241397,1.0,1.0,1.0,1.0,0.0,1.0
+kew_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+kez_Latn,89,89,0,0,241368,1.0,1.0,1.0,1.0,0.0,1.0
+kff_Telu,9,9,1,0,241447,0.9,1.0,0.947368,0.999996,4.141679,1.0
+kgf_Latn,166,166,0,0,241291,1.0,1.0,1.0,1.0,0.0,1.0
+kgk_Latn,36,36,0,0,241421,1.0,1.0,1.0,1.0,0.0,1.0
+kgp_Latn,131,131,0,0,241326,1.0,1.0,1.0,1.0,0.0,1.0
+kha_Latn,191,191,0,0,241266,1.0,1.0,1.0,1.0,0.0,1.0
+khk_Cyrl,262,262,1,0,241194,0.996198,1.0,0.998095,0.999996,4.146023,1.0
+khm_Khmr,187,187,4,0,241266,0.979058,1.0,0.989418,0.999983,16.578936,1.0
+khs_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+khz_Latn,158,158,0,0,241299,1.0,1.0,1.0,1.0,0.0,1.0
+kij_Latn,226,226,0,0,241231,1.0,1.0,1.0,1.0,0.0,1.0
+kik_Latn,193,193,0,0,241264,1.0,1.0,1.0,1.0,0.0,1.0
+kin_Latn,210,203,1,7,241246,0.995098,0.966667,0.980676,0.999996,4.145129,0.966667
+kir_Cyrl,242,242,2,0,241213,0.991803,1.0,0.995885,0.999992,8.291358,1.0
+kiu_Latn,293,238,35,55,241129,0.871795,0.812287,0.840989,0.999855,145.129455,0.812287
+kix_Latn,153,153,0,0,241304,1.0,1.0,1.0,1.0,0.0,1.0
+kjb_Latn,30,30,0,0,241427,1.0,1.0,1.0,1.0,0.0,1.0
+kje_Latn,119,119,5,0,241333,0.959677,1.0,0.979424,0.999979,20.717831,1.0
+kjh_Cyrl,154,154,4,0,241299,0.974684,1.0,0.987179,0.999983,16.576669,1.0
+kjs_Latn,201,201,0,0,241256,1.0,1.0,1.0,1.0,0.0,1.0
+kkc_Latn,169,169,0,0,241288,1.0,1.0,1.0,1.0,0.0,1.0
+kki_Latn,89,89,0,0,241368,1.0,1.0,1.0,1.0,0.0,1.0
+kkj_Latn,127,127,4,0,241326,0.969466,1.0,0.984496,0.999983,16.574815,1.0
+kkl_Latn,84,84,0,0,241373,1.0,1.0,1.0,1.0,0.0,1.0
+klt_Latn,28,28,1,0,241428,0.965517,1.0,0.982456,0.999996,4.142004,1.0
+klv_Latn,164,164,0,0,241293,1.0,1.0,1.0,1.0,0.0,1.0
+kmb_Latn,119,119,3,0,241335,0.97541,1.0,0.987552,0.999988,12.430699,1.0
+kmg_Latn,158,158,0,0,241299,1.0,1.0,1.0,1.0,0.0,1.0
+kmh_Latn,148,148,0,0,241309,1.0,1.0,1.0,1.0,0.0,1.0
+kmk_Latn,20,20,5,0,241432,0.8,1.0,0.888889,0.999979,20.709336,1.0
+kmm_Latn,19,19,1,0,241437,0.95,1.0,0.974359,0.999996,4.14185,1.0
+kmo_Latn,187,187,0,0,241270,1.0,1.0,1.0,1.0,0.0,1.0
+kmr_Cyrl,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+kmr_Latn,289,289,27,0,241141,0.914557,1.0,0.955372,0.999888,111.955152,1.0
+kms_Latn,98,98,1,0,241358,0.989899,1.0,0.994924,0.999996,4.143206,1.0
+kmu_Latn,142,142,0,0,241315,1.0,1.0,1.0,1.0,0.0,1.0
+knc_Arab,68,51,5,17,241384,0.910714,0.75,0.822581,0.999979,20.713454,0.75
+knc_Latn,293,266,0,27,241164,1.0,0.90785,0.951699,1.0,0.0,0.90785
+kne_Latn,76,76,0,0,241381,1.0,1.0,1.0,1.0,0.0,1.0
+knf_Latn,151,151,0,0,241306,1.0,1.0,1.0,1.0,0.0,1.0
+kng_Latn,362,362,0,0,241095,1.0,1.0,1.0,1.0,0.0,1.0
+knj_Latn,188,188,0,0,241269,1.0,1.0,1.0,1.0,0.0,1.0
+knk_Latn,47,47,0,0,241410,1.0,1.0,1.0,1.0,0.0,1.0
+knv_Latn,153,153,0,0,241304,1.0,1.0,1.0,1.0,0.0,1.0
+koi_Cyrl,131,131,0,0,241326,1.0,1.0,1.0,1.0,0.0,1.0
+koo_Latn,297,292,2,5,241158,0.993197,0.983165,0.988156,0.999992,8.293249,0.983165
+kor_Hang,265,265,5,0,241187,0.981481,1.0,0.990654,0.999979,20.730372,1.0
+kos_Latn,144,144,2,0,241311,0.986301,1.0,0.993103,0.999992,8.287991,1.0
+kpe_Latn,177,177,1,0,241279,0.994382,1.0,0.997183,0.999996,4.144562,1.0
+kpf_Latn,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+kpg_Latn,158,158,0,0,241299,1.0,1.0,1.0,1.0,0.0,1.0
+kpj_Latn,8,8,0,0,241449,1.0,1.0,1.0,1.0,0.0,1.0
+kpr_Latn,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+kpv_Cyrl,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+kpw_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+kpx_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+kpz_Latn,89,85,0,4,241368,1.0,0.955056,0.977011,1.0,0.0,0.955056
+kqc_Latn,146,146,0,0,241311,1.0,1.0,1.0,1.0,0.0,1.0
+kqe_Latn,43,43,1,0,241413,0.977273,1.0,0.988506,0.999996,4.142262,1.0
+kqf_Latn,64,64,0,0,241393,1.0,1.0,1.0,1.0,0.0,1.0
+kqn_Latn,286,275,3,11,241168,0.989209,0.961538,0.975177,0.999988,12.439307,0.961538
+kqp_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+kqw_Latn,58,58,0,0,241399,1.0,1.0,1.0,1.0,0.0,1.0
+krc_Cyrl,159,159,1,0,241297,0.99375,1.0,0.996865,0.999996,4.144253,1.0
+kri_Latn,161,160,0,1,241296,1.0,0.993789,0.996885,1.0,0.0,0.993789
+krj_Latn,98,98,0,0,241359,1.0,1.0,1.0,1.0,0.0,1.0
+krl_Latn,199,199,2,0,241256,0.99005,1.0,0.995,0.999992,8.289881,1.0
+kru_Deva,56,56,4,0,241397,0.933333,1.0,0.965517,0.999983,16.56994,1.0
+ksc_Latn,14,10,0,4,241443,1.0,0.714286,0.833333,1.0,0.0,0.714286
+ksd_Latn,202,202,0,0,241255,1.0,1.0,1.0,1.0,0.0,1.0
+ksh_Latn,169,169,1,0,241287,0.994118,1.0,0.99705,0.999996,4.144425,1.0
+ksp_Latn,20,20,1,0,241436,0.952381,1.0,0.97561,0.999996,4.141867,1.0
+ksr_Latn,127,127,1,0,241329,0.992188,1.0,0.996078,0.999996,4.143704,1.0
+kss_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+ksw_Mymr,299,299,0,0,241158,1.0,1.0,1.0,1.0,0.0,1.0
+ktj_Latn,18,18,0,0,241439,1.0,1.0,1.0,1.0,0.0,1.0
+kto_Latn,144,144,1,0,241312,0.993103,1.0,0.99654,0.999996,4.143996,1.0
+ktu_Latn,120,120,1,0,241336,0.991736,1.0,0.995851,0.999996,4.143583,1.0
+ktz_Latn,56,55,0,1,241401,1.0,0.982143,0.990991,1.0,0.0,0.982143
+kua_Latn,476,466,3,10,240978,0.993603,0.978992,0.986243,0.999988,12.449114,0.978992
+kud_Latn,153,153,1,0,241303,0.993506,1.0,0.996743,0.999996,4.14415,1.0
+kue_Latn,159,159,0,0,241298,1.0,1.0,1.0,1.0,0.0,1.0
+kum_Cyrl,169,169,1,0,241287,0.994118,1.0,0.99705,0.999996,4.144425,1.0
+kup_Latn,126,126,0,0,241331,1.0,1.0,1.0,1.0,0.0,1.0
+kus_Latn,45,45,0,0,241412,1.0,1.0,1.0,1.0,0.0,1.0
+kvg_Latn,53,53,0,0,241404,1.0,1.0,1.0,1.0,0.0,1.0
+kvn_Latn,115,115,0,0,241342,1.0,1.0,1.0,1.0,0.0,1.0
+kwd_Latn,147,147,0,0,241310,1.0,1.0,1.0,1.0,0.0,1.0
+kwf_Latn,150,150,0,0,241307,1.0,1.0,1.0,1.0,0.0,1.0
+kwi_Latn,83,83,1,0,241373,0.988095,1.0,0.994012,0.999996,4.142948,1.0
+kwj_Latn,182,182,0,0,241275,1.0,1.0,1.0,1.0,0.0,1.0
+kwn_Latn,275,275,2,0,241180,0.99278,1.0,0.996377,0.999992,8.292493,1.0
+kwy_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+kxc_Ethi,53,53,0,0,241404,1.0,1.0,1.0,1.0,0.0,1.0
+kxw_Latn,20,20,0,0,241437,1.0,1.0,1.0,1.0,0.0,1.0
+kyc_Latn,219,219,0,0,241238,1.0,1.0,1.0,1.0,0.0,1.0
+kyf_Latn,105,105,0,0,241352,1.0,1.0,1.0,1.0,0.0,1.0
+kyg_Latn,201,201,0,0,241256,1.0,1.0,1.0,1.0,0.0,1.0
+kyq_Latn,115,115,0,0,241342,1.0,1.0,1.0,1.0,0.0,1.0
+kyu_Kali,215,215,0,0,241242,1.0,1.0,1.0,1.0,0.0,1.0
+kyz_Latn,151,151,0,0,241306,1.0,1.0,1.0,1.0,0.0,1.0
+kze_Latn,136,136,0,0,241321,1.0,1.0,1.0,1.0,0.0,1.0
+kzj_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+lac_Latn,230,230,0,0,241227,1.0,1.0,1.0,1.0,0.0,1.0
+lad_Hebr,16,16,0,0,241441,1.0,1.0,1.0,1.0,0.0,1.0
+lad_Latn,302,302,1,0,241154,0.9967,1.0,0.998347,0.999996,4.146711,1.0
+lai_Latn,37,37,0,0,241420,1.0,1.0,1.0,1.0,0.0,1.0
+laj_Latn,85,85,1,0,241371,0.988372,1.0,0.994152,0.999996,4.142983,1.0
+lam_Latn,127,127,9,0,241321,0.933824,1.0,0.965779,0.999963,37.293333,1.0
+lao_Laoo,335,335,10,0,241112,0.971014,1.0,0.985294,0.999959,41.472781,1.0
+lat_Latn,282,282,0,0,241175,1.0,1.0,1.0,1.0,0.0,1.0
+lbb_Latn,168,168,0,0,241289,1.0,1.0,1.0,1.0,0.0,1.0
+lbe_Cyrl,219,219,0,0,241238,1.0,1.0,1.0,1.0,0.0,1.0
+lbj_Tibt,66,0,0,66,241391,0.0,0.0,0.0,1.0,0.0,0.0
+lbk_Latn,48,48,0,0,241409,1.0,1.0,1.0,1.0,0.0,1.0
+lcm_Latn,159,159,0,0,241298,1.0,1.0,1.0,1.0,0.0,1.0
+lcp_Thai,86,86,0,0,241371,1.0,1.0,1.0,1.0,0.0,1.0
+ldi_Latn,62,62,1,0,241394,0.984127,1.0,0.992,0.999996,4.142588,1.0
+lee_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+lef_Latn,66,66,0,0,241391,1.0,1.0,1.0,1.0,0.0,1.0
+leh_Latn,106,106,11,0,241340,0.905983,1.0,0.950673,0.999954,45.576774,1.0
+leu_Latn,157,157,0,0,241300,1.0,1.0,1.0,1.0,0.0,1.0
+lew_Latn,155,155,1,0,241301,0.99359,1.0,0.996785,0.999996,4.144184,1.0
+lex_Latn,163,163,0,0,241294,1.0,1.0,1.0,1.0,0.0,1.0
+lez_Cyrl,134,134,5,0,241318,0.964029,1.0,0.981685,0.999979,20.719119,1.0
+lfn_Cyrl,55,42,2,13,241400,0.954545,0.763636,0.848485,0.999992,8.284936,0.763636
+lfn_Latn,150,150,0,0,241307,1.0,1.0,1.0,1.0,0.0,1.0
+lgg_Latn,279,277,3,2,241175,0.989286,0.992832,0.991055,0.999988,12.438946,0.992832
+lgl_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+lhu_Latn,167,167,0,0,241290,1.0,1.0,1.0,1.0,0.0,1.0
+lia_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+lid_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+lif_Deva,71,71,0,0,241386,1.0,1.0,1.0,1.0,0.0,1.0
+lif_Limb,29,29,0,0,241428,1.0,1.0,1.0,1.0,0.0,1.0
+lij_Latn,245,245,4,0,241208,0.983936,1.0,0.991903,0.999983,16.582923,1.0
+lim_Latn,196,196,1,0,241260,0.994924,1.0,0.997455,0.999996,4.144889,1.0
+lin_Latn,215,214,1,1,241241,0.995349,0.995349,0.995349,0.999996,4.145215,0.995349
+lip_Latn,33,33,0,0,241424,1.0,1.0,1.0,1.0,0.0,1.0
+lis_Lisu,6,6,0,0,241451,1.0,1.0,1.0,1.0,0.0,1.0
+lit_Latn,330,330,5,0,241122,0.985075,1.0,0.992481,0.999979,20.735961,1.0
+liv_Latn,101,101,0,0,241356,1.0,1.0,1.0,1.0,0.0,1.0
+ljp_Latn,112,112,0,0,241345,1.0,1.0,1.0,1.0,0.0,1.0
+lki_Arab,15,8,11,7,241431,0.421053,0.533333,0.470588,0.999954,45.559596,0.533333
+lld_Latn,275,275,0,0,241182,1.0,1.0,1.0,1.0,0.0,1.0
+llg_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+lmk_Latn,35,35,0,0,241422,1.0,1.0,1.0,1.0,0.0,1.0
+lmo_Latn,276,276,16,0,241165,0.945205,1.0,0.971831,0.999934,66.340218,1.0
+lmp_Latn,151,151,0,0,241306,1.0,1.0,1.0,1.0,0.0,1.0
+lnd_Latn,5,5,0,0,241452,1.0,1.0,1.0,1.0,0.0,1.0
+log_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+loq_Latn,42,34,1,8,241414,0.971429,0.809524,0.883117,0.999996,4.142245,0.809524
+loz_Latn,268,266,5,2,241184,0.98155,0.992537,0.987013,0.999979,20.73063,0.992537
+lrc_Arab,40,30,12,10,241405,0.714286,0.75,0.731707,0.99995,49.706524,0.75
+lsm_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+ltg_Latn,259,259,1,0,241197,0.996154,1.0,0.998073,0.999996,4.145971,1.0
+ltz_Latn,251,251,0,0,241206,1.0,1.0,1.0,1.0,0.0,1.0
+lua_Latn,346,346,2,0,241109,0.994253,1.0,0.997118,0.999992,8.294935,1.0
+lub_Latn,147,147,4,0,241306,0.97351,1.0,0.986577,0.999983,16.576188,1.0
+luc_Latn,67,67,0,0,241390,1.0,1.0,1.0,1.0,0.0,1.0
+lue_Latn,327,324,4,3,241126,0.987805,0.990826,0.989313,0.999983,16.588562,0.990826
+lug_Latn,405,396,3,9,241049,0.992481,0.977778,0.985075,0.999988,12.445447,0.977778
+lun_Latn,86,84,0,2,241371,1.0,0.976744,0.988235,1.0,0.0,0.976744
+luo_Latn,415,415,1,0,241041,0.997596,1.0,0.998797,0.999996,4.148655,1.0
+lus_Latn,391,391,13,0,241053,0.967822,1.0,0.983648,0.999946,53.92714,1.0
+lvs_Latn,298,298,8,0,241151,0.973856,1.0,0.986755,0.999967,33.173135,1.0
+lwg_Latn,233,228,7,5,241217,0.970213,0.978541,0.974359,0.999971,29.018671,0.978541
+lwo_Latn,41,41,0,0,241416,1.0,1.0,1.0,1.0,0.0,1.0
+lww_Latn,96,96,0,0,241361,1.0,1.0,1.0,1.0,0.0,1.0
+lzh_Hani,143,82,0,61,241314,1.0,0.573427,0.728889,1.0,0.0,0.573427
+maa_Latn,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+mad_Latn,183,183,3,0,241271,0.983871,1.0,0.99187,0.999988,12.433996,1.0
+mag_Deva,97,97,3,0,241357,0.97,1.0,0.984772,0.999988,12.429566,1.0
+mah_Latn,143,143,2,0,241312,0.986207,1.0,0.993056,0.999992,8.287957,1.0
+mai_Deva,234,234,9,0,241214,0.962963,1.0,0.981132,0.999963,37.309875,1.0
+maj_Latn,38,38,0,0,241419,1.0,1.0,1.0,1.0,0.0,1.0
+mak_Latn,94,83,0,11,241363,1.0,0.882979,0.937853,1.0,0.0,0.882979
+mal_Latn,180,180,1,0,241276,0.994475,1.0,0.99723,0.999996,4.144614,1.0
+mal_Mlym,338,338,0,0,241119,1.0,1.0,1.0,1.0,0.0,1.0
+mam_Latn,233,233,0,0,241224,1.0,1.0,1.0,1.0,0.0,1.0
+maq_Latn,141,141,0,0,241316,1.0,1.0,1.0,1.0,0.0,1.0
+mar_Deva,589,576,0,13,240868,1.0,0.977929,0.988841,1.0,0.0,0.977929
+mar_Latn,98,79,2,19,241357,0.975309,0.806122,0.882682,0.999992,8.286412,0.806122
+mas_Latn,154,152,1,2,241302,0.993464,0.987013,0.990228,0.999996,4.144167,0.987013
+mau_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+mav_Latn,59,59,2,0,241396,0.967213,1.0,0.983333,0.999992,8.285073,1.0
+maz_Latn,149,149,0,0,241308,1.0,1.0,1.0,1.0,0.0,1.0
+mbb_Latn,212,212,0,0,241245,1.0,1.0,1.0,1.0,0.0,1.0
+mbc_Latn,46,46,1,0,241410,0.978723,1.0,0.989247,0.999996,4.142313,1.0
+mbd_Latn,14,14,0,0,241443,1.0,1.0,1.0,1.0,0.0,1.0
+mbf_Latn,48,42,0,6,241409,1.0,0.875,0.933333,1.0,0.0,0.875
+mbh_Latn,127,127,0,0,241330,1.0,1.0,1.0,1.0,0.0,1.0
+mbi_Latn,162,162,1,0,241294,0.993865,1.0,0.996923,0.999996,4.144305,1.0
+mbj_Latn,57,57,0,0,241400,1.0,1.0,1.0,1.0,0.0,1.0
+mbl_Latn,210,210,0,0,241247,1.0,1.0,1.0,1.0,0.0,1.0
+mbs_Latn,209,209,0,0,241248,1.0,1.0,1.0,1.0,0.0,1.0
+mbt_Latn,165,165,0,0,241292,1.0,1.0,1.0,1.0,0.0,1.0
+mca_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+mcb_Latn,47,47,0,0,241410,1.0,1.0,1.0,1.0,0.0,1.0
+mcd_Latn,203,203,0,0,241254,1.0,1.0,1.0,1.0,0.0,1.0
+mcf_Latn,20,20,0,0,241437,1.0,1.0,1.0,1.0,0.0,1.0
+mck_Latn,25,25,2,0,241430,0.925926,1.0,0.961538,0.999992,8.283906,1.0
+mco_Latn,128,128,13,0,241316,0.907801,1.0,0.951673,0.999946,53.868371,1.0
+mcp_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+mcq_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+mcu_Latn,103,103,0,0,241354,1.0,1.0,1.0,1.0,0.0,1.0
+mdf_Cyrl,217,217,3,0,241237,0.986364,1.0,0.993135,0.999988,12.435749,1.0
+mdy_Ethi,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+med_Latn,106,106,0,0,241351,1.0,1.0,1.0,1.0,0.0,1.0
+mee_Latn,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+mej_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+mek_Latn,65,65,0,0,241392,1.0,1.0,1.0,1.0,0.0,1.0
+men_Latn,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+meq_Latn,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+mer_Latn,97,96,1,1,241359,0.989691,0.989691,0.989691,0.999996,4.143189,0.989691
+meu_Latn,82,82,0,0,241375,1.0,1.0,1.0,1.0,0.0,1.0
+mfe_Latn,250,250,9,0,241198,0.965251,1.0,0.982318,0.999963,37.31235,1.0
+mfi_Latn,115,115,1,0,241341,0.991379,1.0,0.995671,0.999996,4.143498,1.0
+mfq_Latn,94,94,0,0,241363,1.0,1.0,1.0,1.0,0.0,1.0
+mfy_Latn,56,56,0,0,241401,1.0,1.0,1.0,1.0,0.0,1.0
+mfz_Latn,66,66,0,0,241391,1.0,1.0,1.0,1.0,0.0,1.0
+mgh_Latn,88,88,1,0,241368,0.988764,1.0,0.99435,0.999996,4.143034,1.0
+mgr_Latn,119,119,5,0,241333,0.959677,1.0,0.979424,0.999979,20.717831,1.0
+mhi_Latn,23,23,1,0,241433,0.958333,1.0,0.978723,0.999996,4.141919,1.0
+mhl_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+mhr_Cyrl,291,291,0,0,241166,1.0,1.0,1.0,1.0,0.0,1.0
+mhx_Latn,61,61,0,0,241396,1.0,1.0,1.0,1.0,0.0,1.0
+mib_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+mic_Latn,255,255,2,0,241200,0.992218,1.0,0.996094,0.999992,8.291805,1.0
+mie_Latn,71,71,0,0,241386,1.0,1.0,1.0,1.0,0.0,1.0
+mif_Latn,88,88,0,0,241369,1.0,1.0,1.0,1.0,0.0,1.0
+mig_Latn,18,18,0,0,241439,1.0,1.0,1.0,1.0,0.0,1.0
+mih_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+mil_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+mim_Latn,16,16,0,0,241441,1.0,1.0,1.0,1.0,0.0,1.0
+min_Latn,55,55,5,0,241397,0.916667,1.0,0.956522,0.999979,20.712339,1.0
+mio_Latn,68,68,0,0,241389,1.0,1.0,1.0,1.0,0.0,1.0
+mip_Latn,17,17,0,0,241440,1.0,1.0,1.0,1.0,0.0,1.0
+miq_Latn,184,184,0,0,241273,1.0,1.0,1.0,1.0,0.0,1.0
+mir_Latn,29,29,0,0,241428,1.0,1.0,1.0,1.0,0.0,1.0
+mit_Latn,86,86,0,0,241371,1.0,1.0,1.0,1.0,0.0,1.0
+miy_Latn,46,46,0,0,241411,1.0,1.0,1.0,1.0,0.0,1.0
+miz_Latn,83,83,0,0,241374,1.0,1.0,1.0,1.0,0.0,1.0
+mjc_Latn,49,49,0,0,241408,1.0,1.0,1.0,1.0,0.0,1.0
+mjw_Latn,155,155,0,0,241302,1.0,1.0,1.0,1.0,0.0,1.0
+mkd_Cyrl,331,331,4,0,241122,0.98806,1.0,0.993994,0.999983,16.588837,1.0
+mkl_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+mkn_Latn,114,114,5,0,241338,0.957983,1.0,0.978541,0.999979,20.717402,1.0
+mks_Latn,99,99,0,0,241358,1.0,1.0,1.0,1.0,0.0,1.0
+mlh_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+mlp_Latn,115,115,0,0,241342,1.0,1.0,1.0,1.0,0.0,1.0
+mlt_Latn,291,291,9,0,241157,0.97,1.0,0.984772,0.999963,37.318693,1.0
+mlu_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+mmn_Latn,111,111,0,0,241346,1.0,1.0,1.0,1.0,0.0,1.0
+mmo_Latn,148,148,0,0,241309,1.0,1.0,1.0,1.0,0.0,1.0
+mmx_Latn,124,124,0,0,241333,1.0,1.0,1.0,1.0,0.0,1.0
+mna_Latn,178,178,0,0,241279,1.0,1.0,1.0,1.0,0.0,1.0
+mnb_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+mni_Beng,304,304,0,0,241153,1.0,1.0,1.0,1.0,0.0,1.0
+mni_Latn,280,280,4,0,241173,0.985915,1.0,0.992908,0.999983,16.585329,1.0
+mni_Mtei,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+mnk_Latn,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+mns_Cyrl,146,146,0,0,241311,1.0,1.0,1.0,1.0,0.0,1.0
+mnw_Mymr,134,134,0,0,241323,1.0,1.0,1.0,1.0,0.0,1.0
+mny_Latn,56,48,2,8,241399,0.96,0.857143,0.90566,0.999992,8.28497,0.857143
+mog_Latn,2,2,0,0,241455,1.0,1.0,1.0,1.0,0.0,1.0
+moh_Latn,195,195,0,0,241262,1.0,1.0,1.0,1.0,0.0,1.0
+mop_Latn,128,128,1,0,241328,0.992248,1.0,0.996109,0.999996,4.143721,1.0
+mor_Latn,29,29,0,0,241428,1.0,1.0,1.0,1.0,0.0,1.0
+mos_Latn,133,133,0,0,241324,1.0,1.0,1.0,1.0,0.0,1.0
+mox_Latn,100,100,0,0,241357,1.0,1.0,1.0,1.0,0.0,1.0
+mpm_Latn,177,177,0,0,241280,1.0,1.0,1.0,1.0,0.0,1.0
+mpp_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+mps_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+mpt_Latn,29,29,0,0,241428,1.0,1.0,1.0,1.0,0.0,1.0
+mpx_Latn,205,205,0,0,241252,1.0,1.0,1.0,1.0,0.0,1.0
+mqb_Latn,69,69,0,0,241388,1.0,1.0,1.0,1.0,0.0,1.0
+mqj_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+mqy_Latn,35,33,0,2,241422,1.0,0.942857,0.970588,1.0,0.0,0.942857
+mri_Latn,162,162,0,0,241295,1.0,1.0,1.0,1.0,0.0,1.0
+mrj_Cyrl,120,120,1,0,241336,0.991736,1.0,0.995851,0.999996,4.143583,1.0
+mrq_Latn,29,29,0,0,241428,1.0,1.0,1.0,1.0,0.0,1.0
+mrw_Latn,162,162,0,0,241295,1.0,1.0,1.0,1.0,0.0,1.0
+msb_Latn,71,71,0,0,241386,1.0,1.0,1.0,1.0,0.0,1.0
+msk_Latn,129,129,1,0,241327,0.992308,1.0,0.996139,0.999996,4.143738,1.0
+msy_Latn,140,140,0,0,241317,1.0,1.0,1.0,1.0,0.0,1.0
+mta_Latn,20,20,0,0,241437,1.0,1.0,1.0,1.0,0.0,1.0
+mti_Latn,170,170,1,0,241286,0.994152,1.0,0.997067,0.999996,4.144442,1.0
+mto_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+mtp_Latn,85,85,0,0,241372,1.0,1.0,1.0,1.0,0.0,1.0
+muh_Latn,67,67,0,0,241390,1.0,1.0,1.0,1.0,0.0,1.0
+mui_Latn,107,70,9,37,241341,0.886076,0.654206,0.752688,0.999963,37.290242,0.654206
+mup_Deva,115,72,1,43,241341,0.986301,0.626087,0.765957,0.999996,4.143498,0.626087
+mur_Latn,312,312,0,0,241145,1.0,1.0,1.0,1.0,0.0,1.0
+mus_Latn,2,2,0,0,241455,1.0,1.0,1.0,1.0,0.0,1.0
+mux_Latn,191,191,1,0,241265,0.994792,1.0,0.997389,0.999996,4.144803,1.0
+muy_Latn,61,61,1,0,241395,0.983871,1.0,0.99187,0.999996,4.142571,1.0
+mva_Latn,119,119,0,0,241338,1.0,1.0,1.0,1.0,0.0,1.0
+mvn_Latn,73,73,0,0,241384,1.0,1.0,1.0,1.0,0.0,1.0
+mvp_Latn,22,22,0,0,241435,1.0,1.0,1.0,1.0,0.0,1.0
+mwc_Latn,95,95,0,0,241362,1.0,1.0,1.0,1.0,0.0,1.0
+mwl_Latn,157,150,4,7,241296,0.974026,0.955414,0.96463,0.999983,16.576875,0.955414
+mwn_Latn,121,121,1,0,241335,0.991803,1.0,0.995885,0.999996,4.143601,1.0
+mwp_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+mwq_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+mwv_Latn,133,133,0,0,241324,1.0,1.0,1.0,1.0,0.0,1.0
+mww_Latn,235,235,0,0,241222,1.0,1.0,1.0,1.0,0.0,1.0
+mxb_Latn,92,92,0,0,241365,1.0,1.0,1.0,1.0,0.0,1.0
+mxp_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+mxq_Latn,87,87,0,0,241370,1.0,1.0,1.0,1.0,0.0,1.0
+mxt_Latn,103,103,0,0,241354,1.0,1.0,1.0,1.0,0.0,1.0
+mxv_Latn,202,202,0,0,241255,1.0,1.0,1.0,1.0,0.0,1.0
+mya_Mymr,342,342,26,0,241089,0.929348,1.0,0.96338,0.999892,107.832362,1.0
+myk_Latn,43,43,0,0,241414,1.0,1.0,1.0,1.0,0.0,1.0
+myu_Latn,51,51,0,0,241406,1.0,1.0,1.0,1.0,0.0,1.0
+myv_Cyrl,156,156,0,0,241301,1.0,1.0,1.0,1.0,0.0,1.0
+myw_Latn,182,182,0,0,241275,1.0,1.0,1.0,1.0,0.0,1.0
+myx_Latn,113,113,15,0,241329,0.882812,1.0,0.937759,0.999938,62.151949,1.0
+myy_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+mza_Latn,69,69,0,0,241388,1.0,1.0,1.0,1.0,0.0,1.0
+mzh_Latn,26,25,0,1,241431,1.0,0.961538,0.980392,1.0,0.0,0.961538
+mzn_Arab,141,141,6,0,241310,0.959184,1.0,0.979167,0.999975,24.863664,1.0
+mzw_Latn,117,117,1,0,241339,0.991525,1.0,0.995745,0.999996,4.143532,1.0
+mzz_Latn,10,10,0,0,241447,1.0,1.0,1.0,1.0,0.0,1.0
+naf_Latn,203,203,0,0,241254,1.0,1.0,1.0,1.0,0.0,1.0
+nah_Latn,64,54,0,10,241393,1.0,0.84375,0.915254,1.0,0.0,0.84375
+nak_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+nan_Hani,75,67,17,8,241365,0.797619,0.893333,0.842767,0.99993,70.427787,0.893333
+nan_Latn,180,180,1,0,241276,0.994475,1.0,0.99723,0.999996,4.144614,1.0
+nap_Latn,172,131,8,41,241277,0.942446,0.761628,0.842444,0.999967,33.155812,0.761628
+naq_Latn,274,274,2,0,241181,0.992754,1.0,0.996364,0.999992,8.292458,1.0
+nas_Latn,153,153,1,0,241303,0.993506,1.0,0.996743,0.999996,4.14415,1.0
+nav_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+nba_Latn,231,231,5,0,241221,0.978814,1.0,0.989293,0.999979,20.727451,1.0
+nbe_Latn,72,72,0,0,241385,1.0,1.0,1.0,1.0,0.0,1.0
+nbl_Latn,528,498,25,30,240904,0.952199,0.943182,0.947669,0.999896,103.76501,0.943182
+nbq_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+nbu_Latn,351,351,0,0,241106,1.0,1.0,1.0,1.0,0.0,1.0
+nca_Latn,215,215,0,0,241242,1.0,1.0,1.0,1.0,0.0,1.0
+nch_Latn,121,121,0,0,241336,1.0,1.0,1.0,1.0,0.0,1.0
+ncj_Latn,152,152,4,0,241301,0.974359,1.0,0.987013,0.999983,16.576532,1.0
+ncl_Latn,139,139,0,0,241318,1.0,1.0,1.0,1.0,0.0,1.0
+ncq_Laoo,10,10,1,0,241446,0.909091,1.0,0.952381,0.999996,4.141696,1.0
+ncu_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+ncx_Latn,103,103,0,0,241354,1.0,1.0,1.0,1.0,0.0,1.0
+ndc_Latn,191,191,1,0,241265,0.994792,1.0,0.997389,0.999996,4.144803,1.0
+nde_Latn,256,256,63,0,241138,0.802508,1.0,0.890435,0.999739,261.192947,1.0
+ndh_Latn,30,30,1,0,241426,0.967742,1.0,0.983607,0.999996,4.142039,1.0
+ndo_Latn,325,317,4,8,241128,0.987539,0.975385,0.981424,0.999983,16.588425,0.975385
+nds_Latn,296,296,2,0,241159,0.993289,1.0,0.996633,0.999992,8.293215,1.0
+neb_Latn,11,5,0,6,241446,1.0,0.454545,0.625,1.0,0.0,0.454545
+new_Deva,112,112,3,0,241342,0.973913,1.0,0.986784,0.999988,12.430338,1.0
+nfa_Latn,46,46,0,0,241411,1.0,1.0,1.0,1.0,0.0,1.0
+nfr_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+ngl_Latn,175,175,1,0,241281,0.994318,1.0,0.997151,0.999996,4.144528,1.0
+ngp_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+ngu_Latn,181,181,0,0,241276,1.0,1.0,1.0,1.0,0.0,1.0
+nhe_Latn,97,97,0,0,241360,1.0,1.0,1.0,1.0,0.0,1.0
+nhg_Latn,128,128,1,0,241328,0.992248,1.0,0.996109,0.999996,4.143721,1.0
+nhi_Latn,102,102,1,0,241354,0.990291,1.0,0.995122,0.999996,4.143274,1.0
+nho_Latn,89,89,0,0,241368,1.0,1.0,1.0,1.0,0.0,1.0
+nhr_Latn,140,140,0,0,241317,1.0,1.0,1.0,1.0,0.0,1.0
+nhu_Latn,86,86,0,0,241371,1.0,1.0,1.0,1.0,0.0,1.0
+nhw_Latn,83,83,0,0,241374,1.0,1.0,1.0,1.0,0.0,1.0
+nhx_Latn,36,36,0,0,241421,1.0,1.0,1.0,1.0,0.0,1.0
+nhy_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+nia_Latn,242,242,0,0,241215,1.0,1.0,1.0,1.0,0.0,1.0
+nif_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+nii_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+nij_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+nim_Latn,76,76,1,0,241380,0.987013,1.0,0.993464,0.999996,4.142828,1.0
+nin_Latn,58,58,0,0,241399,1.0,1.0,1.0,1.0,0.0,1.0
+niu_Latn,204,204,0,0,241253,1.0,1.0,1.0,1.0,0.0,1.0
+njb_Latn,9,9,1,0,241447,0.9,1.0,0.947368,0.999996,4.141679,1.0
+njm_Latn,15,15,0,0,241442,1.0,1.0,1.0,1.0,0.0,1.0
+njn_Latn,148,148,0,0,241309,1.0,1.0,1.0,1.0,0.0,1.0
+njo_Latn,256,256,1,0,241200,0.996109,1.0,0.998051,0.999996,4.14592,1.0
+njz_Latn,18,18,0,0,241439,1.0,1.0,1.0,1.0,0.0,1.0
+nko_Latn,85,85,0,0,241372,1.0,1.0,1.0,1.0,0.0,1.0
+nld_Latn,259,259,18,0,241180,0.935018,1.0,0.966418,0.999925,74.627484,1.0
+nlg_Latn,57,57,0,0,241400,1.0,1.0,1.0,1.0,0.0,1.0
+nmf_Latn,294,294,0,0,241163,1.0,1.0,1.0,1.0,0.0,1.0
+nmo_Latn,38,38,1,0,241418,0.974359,1.0,0.987013,0.999996,4.142176,1.0
+nmz_Latn,35,35,0,0,241422,1.0,1.0,1.0,1.0,0.0,1.0
+nnb_Latn,108,108,2,0,241347,0.981818,1.0,0.990826,0.999992,8.286755,1.0
+nno_Latn,427,414,1,13,241029,0.99759,0.969555,0.983373,0.999996,4.148861,0.969555
+nnq_Latn,100,100,2,0,241355,0.980392,1.0,0.990099,0.999992,8.28648,1.0
+nnw_Latn,40,40,0,0,241417,1.0,1.0,1.0,1.0,0.0,1.0
+noa_Latn,113,113,0,0,241344,1.0,1.0,1.0,1.0,0.0,1.0
+nob_Latn,265,260,19,5,241173,0.9319,0.981132,0.955882,0.999921,78.775415,0.981132
+nod_Thai,99,99,1,0,241357,0.99,1.0,0.994975,0.999996,4.143223,1.0
+nog_Cyrl,219,219,0,0,241238,1.0,1.0,1.0,1.0,0.0,1.0
+non_Latn,182,144,1,38,241274,0.993103,0.791209,0.880734,0.999996,4.144648,0.791209
+nop_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+not_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+nou_Latn,84,84,0,0,241373,1.0,1.0,1.0,1.0,0.0,1.0
+nov_Latn,147,147,3,0,241307,0.98,1.0,0.989899,0.999988,12.432141,1.0
+nph_Latn,57,57,0,0,241400,1.0,1.0,1.0,1.0,0.0,1.0
+npi_Deva,273,270,3,3,241181,0.989011,0.989011,0.989011,0.999988,12.438636,0.989011
+npi_Latn,53,44,8,9,241396,0.846154,0.830189,0.838095,0.999967,33.139467,0.830189
+npl_Latn,93,93,1,0,241363,0.989362,1.0,0.994652,0.999996,4.14312,1.0
+npy_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+nqo_Nkoo,152,152,0,0,241305,1.0,1.0,1.0,1.0,0.0,1.0
+nre_Latn,42,42,0,0,241415,1.0,1.0,1.0,1.0,0.0,1.0
+nrf_Latn,63,40,1,23,241393,0.97561,0.634921,0.769231,0.999996,4.142605,0.634921
+nrm_Latn,107,64,57,43,241293,0.528926,0.598131,0.561404,0.999764,236.171535,0.598131
+nse_Latn,12,9,3,3,241442,0.75,0.75,0.75,0.999988,12.42519,0.75
+nsm_Latn,32,32,1,0,241424,0.969697,1.0,0.984615,0.999996,4.142073,1.0
+nsn_Latn,198,198,0,0,241259,1.0,1.0,1.0,1.0,0.0,1.0
+nso_Latn,479,461,12,18,240966,0.97463,0.962422,0.968487,0.99995,49.797077,0.962422
+nss_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+nsu_Latn,14,14,1,0,241442,0.933333,1.0,0.965517,0.999996,4.141764,1.0
+ntp_Latn,20,20,0,0,241437,1.0,1.0,1.0,1.0,0.0,1.0
+ntr_Latn,117,117,1,0,241339,0.991525,1.0,0.995745,0.999996,4.143532,1.0
+ntu_Latn,150,150,0,0,241307,1.0,1.0,1.0,1.0,0.0,1.0
+nuj_Latn,153,152,1,1,241303,0.993464,0.993464,0.993464,0.999996,4.14415,0.993464
+nus_Latn,199,199,0,0,241258,1.0,1.0,1.0,1.0,0.0,1.0
+nuy_Latn,81,81,0,0,241376,1.0,1.0,1.0,1.0,0.0,1.0
+nvm_Latn,9,9,0,0,241448,1.0,1.0,1.0,1.0,0.0,1.0
+nwi_Latn,152,152,0,0,241305,1.0,1.0,1.0,1.0,0.0,1.0
+nya_Latn,262,252,1,10,241194,0.996047,0.961832,0.978641,0.999996,4.146023,0.961832
+nyf_Latn,10,10,1,0,241446,0.909091,1.0,0.952381,0.999996,4.141696,1.0
+nyn_Latn,279,278,0,1,241178,1.0,0.996416,0.998205,1.0,0.0,0.996416
+nyo_Latn,100,100,7,0,241350,0.934579,1.0,0.966184,0.999971,29.002681,1.0
+nyu_Latn,149,149,7,0,241301,0.955128,1.0,0.977049,0.999971,29.00857,1.0
+nyy_Latn,259,259,0,0,241198,1.0,1.0,1.0,1.0,0.0,1.0
+nzi_Latn,184,184,0,0,241273,1.0,1.0,1.0,1.0,0.0,1.0
+obo_Latn,28,28,0,0,241429,1.0,1.0,1.0,1.0,0.0,1.0
+oci_Latn,333,333,10,0,241114,0.970845,1.0,0.985207,0.999959,41.472437,1.0
+ogo_Latn,177,177,0,0,241280,1.0,1.0,1.0,1.0,0.0,1.0
+ojb_Cans,237,237,1,0,241219,0.995798,1.0,0.997895,0.999996,4.145593,1.0
+ojb_Latn,62,62,3,0,241392,0.953846,1.0,0.976378,0.999988,12.427764,1.0
+oke_Latn,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+okv_Latn,97,97,0,0,241360,1.0,1.0,1.0,1.0,0.0,1.0
+old_Latn,11,11,2,0,241444,0.846154,1.0,0.916667,0.999992,8.283426,1.0
+olo_Latn,245,245,0,0,241212,1.0,1.0,1.0,1.0,0.0,1.0
+omw_Latn,49,49,0,0,241408,1.0,1.0,1.0,1.0,0.0,1.0
+ong_Latn,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+ons_Latn,7,7,0,0,241450,1.0,1.0,1.0,1.0,0.0,1.0
+opm_Latn,92,92,0,0,241365,1.0,1.0,1.0,1.0,0.0,1.0
+orv_Cyrl,239,170,16,69,241202,0.913978,0.711297,0.8,0.999934,66.330042,0.711297
+ory_Latn,96,94,2,2,241359,0.979167,0.979167,0.979167,0.999992,8.286343,0.979167
+ory_Orya,511,508,6,3,240940,0.988327,0.994129,0.99122,0.999975,24.901845,0.994129
+oss_Cyrl,152,152,0,0,241305,1.0,1.0,1.0,1.0,0.0,1.0
+ota_Arab,66,44,0,22,241391,1.0,0.666667,0.8,1.0,0.0,0.666667
+ote_Latn,85,85,1,0,241371,0.988372,1.0,0.994152,0.999996,4.142983,1.0
+otm_Latn,137,137,0,0,241320,1.0,1.0,1.0,1.0,0.0,1.0
+otq_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+ots_Latn,44,44,0,0,241413,1.0,1.0,1.0,1.0,0.0,1.0
+otw_Latn,29,26,0,3,241428,1.0,0.896552,0.945455,1.0,0.0,0.896552
+ozm_Latn,82,82,0,0,241375,1.0,1.0,1.0,1.0,0.0,1.0
+pab_Latn,126,126,1,0,241330,0.992126,1.0,0.996047,0.999996,4.143686,1.0
+pad_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+pag_Latn,122,122,1,0,241334,0.99187,1.0,0.995918,0.999996,4.143618,1.0
+pah_Latn,144,144,1,0,241312,0.993103,1.0,0.99654,0.999996,4.143996,1.0
+pam_Latn,90,90,4,0,241363,0.957447,1.0,0.978261,0.999983,16.572274,1.0
+pan_Guru,460,460,0,0,240997,1.0,1.0,1.0,1.0,0.0,1.0
+pan_Latn,232,193,12,39,241213,0.941463,0.831897,0.883295,0.99995,49.746088,0.831897
+pao_Latn,133,133,0,0,241324,1.0,1.0,1.0,1.0,0.0,1.0
+pap_Latn,423,423,3,0,241031,0.992958,1.0,0.996466,0.999988,12.446377,1.0
+pau_Latn,265,265,0,0,241192,1.0,1.0,1.0,1.0,0.0,1.0
+pbb_Latn,169,169,0,0,241288,1.0,1.0,1.0,1.0,0.0,1.0
+pbt_Arab,419,419,6,0,241032,0.985882,1.0,0.992891,0.999975,24.892341,1.0
+pcd_Latn,199,199,7,0,241251,0.966019,1.0,0.982716,0.999971,29.014582,1.0
+pck_Latn,164,138,7,26,241286,0.951724,0.841463,0.893204,0.999971,29.010373,0.841463
+pcm_Latn,251,194,39,57,241167,0.832618,0.772908,0.801653,0.999838,161.68752,0.772908
+pdc_Latn,139,139,1,0,241317,0.992857,1.0,0.996416,0.999996,4.14391,1.0
+pdt_Latn,180,180,1,0,241276,0.994475,1.0,0.99723,0.999996,4.144614,1.0
+pem_Latn,111,111,1,0,241345,0.991071,1.0,0.995516,0.999996,4.143429,1.0
+pfl_Latn,222,222,7,0,241228,0.969432,1.0,0.984479,0.999971,29.017348,1.0
+pib_Latn,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+pio_Latn,59,59,0,0,241398,1.0,1.0,1.0,1.0,0.0,1.0
+pir_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+pis_Latn,197,197,10,0,241250,0.951691,1.0,0.975248,0.999959,41.449059,1.0
+pjt_Latn,179,179,0,0,241278,1.0,1.0,1.0,1.0,0.0,1.0
+plg_Latn,38,38,0,0,241419,1.0,1.0,1.0,1.0,0.0,1.0
+pls_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+plt_Latn,248,248,26,0,241183,0.905109,1.0,0.950192,0.999892,107.790339,1.0
+plu_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+plw_Latn,8,8,0,0,241449,1.0,1.0,1.0,1.0,0.0,1.0
+pma_Latn,120,120,1,0,241336,0.991736,1.0,0.995851,0.999996,4.143583,1.0
+pmf_Latn,10,10,0,0,241447,1.0,1.0,1.0,1.0,0.0,1.0
+pmq_Latn,46,41,0,5,241411,1.0,0.891304,0.942529,1.0,0.0,0.891304
+pms_Latn,174,174,1,0,241282,0.994286,1.0,0.997135,0.999996,4.144511,1.0
+pnb_Arab,220,220,21,0,241216,0.912863,1.0,0.954447,0.999913,87.051323,1.0
+pnt_Grek,181,181,1,0,241275,0.994505,1.0,0.997245,0.999996,4.144631,1.0
+poe_Latn,49,49,0,0,241408,1.0,1.0,1.0,1.0,0.0,1.0
+poh_Latn,154,154,0,0,241303,1.0,1.0,1.0,1.0,0.0,1.0
+poi_Latn,141,141,0,0,241316,1.0,1.0,1.0,1.0,0.0,1.0
+pol_Latn,254,253,8,1,241195,0.969349,0.996063,0.982524,0.999967,33.167083,0.996063
+pon_Latn,178,178,1,0,241278,0.994413,1.0,0.997199,0.999996,4.14458,1.0
+por_Latn,657,630,44,27,240756,0.934718,0.958904,0.946657,0.999817,182.724252,0.958904
+pot_Latn,46,46,0,0,241411,1.0,1.0,1.0,1.0,0.0,1.0
+pov_Latn,70,70,0,0,241387,1.0,1.0,1.0,1.0,0.0,1.0
+poy_Latn,37,37,0,0,241420,1.0,1.0,1.0,1.0,0.0,1.0
+ppk_Latn,137,137,0,0,241320,1.0,1.0,1.0,1.0,0.0,1.0
+ppo_Latn,210,210,0,0,241247,1.0,1.0,1.0,1.0,0.0,1.0
+prf_Latn,45,45,0,0,241412,1.0,1.0,1.0,1.0,0.0,1.0
+prg_Latn,134,134,0,0,241323,1.0,1.0,1.0,1.0,0.0,1.0
+pri_Latn,161,156,2,5,241294,0.987342,0.968944,0.978056,0.999992,8.288575,0.968944
+ptp_Latn,147,147,0,0,241310,1.0,1.0,1.0,1.0,0.0,1.0
+ptu_Latn,146,146,0,0,241311,1.0,1.0,1.0,1.0,0.0,1.0
+pwg_Latn,141,141,0,0,241316,1.0,1.0,1.0,1.0,0.0,1.0
+pwn_Latn,77,77,4,0,241376,0.950617,1.0,0.974684,0.999983,16.571381,1.0
+pxm_Latn,63,49,1,14,241393,0.98,0.777778,0.867257,0.999996,4.142605,0.777778
+qub_Latn,180,170,6,10,241271,0.965909,0.944444,0.955056,0.999975,24.867683,0.944444
+quc_Latn,310,310,0,0,241147,1.0,1.0,1.0,1.0,0.0,1.0
+quf_Latn,211,211,1,0,241245,0.995283,1.0,0.997636,0.999996,4.145146,1.0
+qug_Latn,90,85,0,5,241367,1.0,0.944444,0.971429,1.0,0.0,0.944444
+quh_Latn,159,117,3,42,241295,0.975,0.735849,0.83871,0.999988,12.432759,0.735849
+qup_Latn,79,68,5,11,241373,0.931507,0.860759,0.894737,0.999979,20.714398,0.860759
+quw_Latn,139,139,0,0,241318,1.0,1.0,1.0,1.0,0.0,1.0
+quy_Latn,271,233,49,38,241137,0.826241,0.859779,0.842676,0.999797,203.162704,0.859779
+quz_Latn,205,144,34,61,241218,0.808989,0.702439,0.751958,0.999859,140.931474,0.702439
+qva_Latn,39,39,3,0,241415,0.928571,1.0,0.962963,0.999988,12.42658,1.0
+qvc_Latn,53,53,5,0,241399,0.913793,1.0,0.954955,0.999979,20.712167,1.0
+qve_Latn,54,54,12,0,241391,0.818182,1.0,0.9,0.99995,49.709407,1.0
+qvh_Latn,95,95,3,0,241359,0.969388,1.0,0.984456,0.999988,12.429463,1.0
+qvi_Latn,98,98,3,0,241356,0.970297,1.0,0.984925,0.999988,12.429617,1.0
+qvm_Latn,88,88,1,0,241368,0.988764,1.0,0.99435,0.999996,4.143034,1.0
+qvn_Latn,106,106,1,0,241350,0.990654,1.0,0.995305,0.999996,4.143343,1.0
+qvs_Latn,148,148,8,0,241301,0.948718,1.0,0.973684,0.999967,33.152514,1.0
+qvw_Latn,175,175,0,0,241282,1.0,1.0,1.0,1.0,0.0,1.0
+qvz_Latn,191,191,0,0,241266,1.0,1.0,1.0,1.0,0.0,1.0
+qwh_Latn,117,110,0,7,241340,1.0,0.940171,0.969163,1.0,0.0,0.940171
+qxh_Latn,105,105,1,0,241351,0.990566,1.0,0.995261,0.999996,4.143326,1.0
+qxl_Latn,66,66,0,0,241391,1.0,1.0,1.0,1.0,0.0,1.0
+qxn_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+qxo_Latn,93,93,1,0,241363,0.989362,1.0,0.994652,0.999996,4.14312,1.0
+qxr_Latn,93,93,2,0,241362,0.978947,1.0,0.989362,0.999992,8.28624,1.0
+rad_Latn,155,155,0,0,241302,1.0,1.0,1.0,1.0,0.0,1.0
+rai_Latn,168,168,0,0,241289,1.0,1.0,1.0,1.0,0.0,1.0
+rap_Latn,107,107,1,0,241349,0.990741,1.0,0.995349,0.999996,4.14336,1.0
+rar_Latn,368,368,2,0,241087,0.994595,1.0,0.99729,0.999992,8.295692,1.0
+rav_Deva,45,45,0,0,241412,1.0,1.0,1.0,1.0,0.0,1.0
+raw_Latn,97,97,0,0,241360,1.0,1.0,1.0,1.0,0.0,1.0
+rcf_Latn,169,169,0,0,241288,1.0,1.0,1.0,1.0,0.0,1.0
+rej_Latn,33,29,0,4,241424,1.0,0.878788,0.935484,1.0,0.0,0.878788
+rgu_Latn,47,47,0,0,241410,1.0,1.0,1.0,1.0,0.0,1.0
+ria_Latn,23,23,0,0,241434,1.0,1.0,1.0,1.0,0.0,1.0
+rim_Latn,10,10,0,0,241447,1.0,1.0,1.0,1.0,0.0,1.0
+rkb_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+rmc_Latn,341,341,1,0,241115,0.997076,1.0,0.998536,0.999996,4.147381,1.0
+rml_Latn,37,30,0,7,241420,1.0,0.810811,0.895522,1.0,0.0,0.810811
+rmn_Cyrl,223,223,0,0,241234,1.0,1.0,1.0,1.0,0.0,1.0
+rmn_Grek,185,128,2,57,241270,0.984615,0.691892,0.812698,0.999992,8.2894,0.691892
+rmn_Latn,236,236,2,0,241219,0.991597,1.0,0.995781,0.999992,8.291152,1.0
+rmo_Latn,85,85,2,0,241370,0.977011,1.0,0.988372,0.999992,8.285965,1.0
+rmq_Latn,17,17,1,0,241439,0.944444,1.0,0.971429,0.999996,4.141816,1.0
+rmy_Cyrl,101,74,8,27,241348,0.902439,0.732673,0.808743,0.999967,33.146058,0.732673
+rmy_Latn,265,265,3,0,241189,0.988806,1.0,0.994371,0.999988,12.438223,1.0
+rnd_Latn,164,164,1,0,241292,0.993939,1.0,0.99696,0.999996,4.144339,1.0
+rng_Latn,209,209,6,0,241242,0.972093,1.0,0.985849,0.999975,24.870673,1.0
+roh_Latn,307,307,0,0,241150,1.0,1.0,1.0,1.0,0.0,1.0
+ron_Cyrl,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+ron_Latn,369,368,2,1,241086,0.994595,0.99729,0.99594,0.999992,8.295726,0.99729
+roo_Latn,145,145,0,0,241312,1.0,1.0,1.0,1.0,0.0,1.0
+rop_Latn,184,184,0,0,241273,1.0,1.0,1.0,1.0,0.0,1.0
+row_Latn,138,138,1,0,241318,0.992806,1.0,0.99639,0.999996,4.143893,1.0
+rro_Latn,137,137,0,0,241320,1.0,1.0,1.0,1.0,0.0,1.0
+rtm_Latn,174,174,0,0,241283,1.0,1.0,1.0,1.0,0.0,1.0
+rub_Latn,31,31,0,0,241426,1.0,1.0,1.0,1.0,0.0,1.0
+rue_Cyrl,301,301,13,0,241143,0.958599,1.0,0.978862,0.999946,53.907015,1.0
+ruf_Latn,173,173,1,0,241283,0.994253,1.0,0.997118,0.999996,4.144494,1.0
+rug_Latn,181,181,0,0,241276,1.0,1.0,1.0,1.0,0.0,1.0
+run_Latn,291,291,13,0,241153,0.957237,1.0,0.978151,0.999946,53.904779,1.0
+rup_Latn,166,166,1,0,241290,0.994012,1.0,0.996997,0.999996,4.144373,1.0
+rus_Cyrl,1538,512,39,1026,239880,0.92922,0.3329,0.490187,0.999837,162.554862,0.3329
+rwo_Latn,177,177,1,0,241279,0.994382,1.0,0.997183,0.999996,4.144562,1.0
+sab_Latn,170,170,0,0,241287,1.0,1.0,1.0,1.0,0.0,1.0
+sag_Latn,237,237,0,0,241220,1.0,1.0,1.0,1.0,0.0,1.0
+sah_Cyrl,260,260,12,0,241185,0.955882,1.0,0.977444,0.99995,49.751863,1.0
+san_Deva,239,235,1,4,241217,0.995763,0.983264,0.989474,0.999996,4.145628,0.983264
+san_Latn,146,140,4,6,241307,0.972222,0.958904,0.965517,0.999983,16.57612,0.958904
+sas_Latn,126,126,0,0,241331,1.0,1.0,1.0,1.0,0.0,1.0
+sat_Latn,239,239,3,0,241215,0.987603,1.0,0.993763,0.999988,12.436883,1.0
+sat_Olck,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+sbe_Latn,94,94,0,0,241363,1.0,1.0,1.0,1.0,0.0,1.0
+sbl_Latn,74,74,0,0,241383,1.0,1.0,1.0,1.0,0.0,1.0
+sby_Latn,100,81,0,19,241357,1.0,0.81,0.895028,1.0,0.0,0.81
+sck_Deva,15,10,4,5,241438,0.714286,0.666667,0.689655,0.999983,16.567126,0.666667
+scn_Latn,172,172,5,0,241280,0.971751,1.0,0.985673,0.999979,20.722382,1.0
+sco_Latn,210,210,25,0,241222,0.893617,1.0,0.94382,0.999896,103.628232,1.0
+sda_Latn,49,49,0,0,241408,1.0,1.0,1.0,1.0,0.0,1.0
+sdc_Latn,39,39,1,0,241417,0.975,1.0,0.987342,0.999996,4.142193,1.0
+sdh_Arab,400,399,38,1,241019,0.913043,0.9975,0.953405,0.999842,157.639065,0.9975
+seh_Latn,162,162,3,0,241292,0.981818,1.0,0.990826,0.999988,12.432914,1.0
+ses_Latn,130,130,0,0,241327,1.0,1.0,1.0,1.0,0.0,1.0
+sey_Latn,69,69,0,0,241388,1.0,1.0,1.0,1.0,0.0,1.0
+sgb_Latn,115,115,5,0,241337,0.958333,1.0,0.978723,0.999979,20.717488,1.0
+sgc_Latn,184,184,0,0,241273,1.0,1.0,1.0,1.0,0.0,1.0
+sgh_Cyrl,9,7,5,2,241443,0.583333,0.777778,0.666667,0.999979,20.708393,0.777778
+sgs_Latn,218,218,0,0,241239,1.0,1.0,1.0,1.0,0.0,1.0
+sgw_Ethi,96,96,1,0,241360,0.989691,1.0,0.994819,0.999996,4.143171,1.0
+sgz_Latn,136,136,2,0,241319,0.985507,1.0,0.992701,0.999992,8.287716,1.0
+shi_Latn,133,121,0,12,241324,1.0,0.909774,0.952756,1.0,0.0,0.909774
+shn_Mymr,174,174,2,0,241281,0.988636,1.0,0.994286,0.999992,8.289022,1.0
+shp_Latn,96,96,0,0,241361,1.0,1.0,1.0,1.0,0.0,1.0
+sid_Latn,193,193,0,0,241264,1.0,1.0,1.0,1.0,0.0,1.0
+sig_Latn,89,89,0,0,241368,1.0,1.0,1.0,1.0,0.0,1.0
+sil_Latn,49,49,0,0,241408,1.0,1.0,1.0,1.0,0.0,1.0
+sim_Latn,99,99,0,0,241358,1.0,1.0,1.0,1.0,0.0,1.0
+sin_Sinh,232,232,0,0,241225,1.0,1.0,1.0,1.0,0.0,1.0
+sja_Latn,124,124,0,0,241333,1.0,1.0,1.0,1.0,0.0,1.0
+skg_Latn,104,104,4,0,241349,0.962963,1.0,0.981132,0.999983,16.573235,1.0
+skr_Arab,116,95,0,21,241341,1.0,0.818966,0.900474,1.0,0.0,0.818966
+slk_Latn,374,374,1,0,241082,0.997333,1.0,0.998665,0.999996,4.147949,1.0
+sll_Latn,160,160,0,0,241297,1.0,1.0,1.0,1.0,0.0,1.0
+slv_Latn,338,338,12,0,241107,0.965714,1.0,0.982558,0.99995,49.767957,1.0
+sma_Latn,327,327,0,0,241130,1.0,1.0,1.0,1.0,0.0,1.0
+sme_Latn,246,246,3,0,241208,0.987952,1.0,0.993939,0.999988,12.437244,1.0
+smj_Latn,407,407,0,0,241050,1.0,1.0,1.0,1.0,0.0,1.0
+smk_Latn,172,172,2,0,241283,0.988506,1.0,0.99422,0.999992,8.288953,1.0
+sml_Latn,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+smn_Latn,293,293,0,0,241164,1.0,1.0,1.0,1.0,0.0,1.0
+smo_Latn,426,426,2,0,241029,0.995327,1.0,0.997658,0.999992,8.297688,1.0
+sms_Latn,178,178,1,0,241278,0.994413,1.0,0.997199,0.999996,4.14458,1.0
+sna_Latn,415,415,0,0,241042,1.0,1.0,1.0,1.0,0.0,1.0
+snc_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+snd_Arab,325,325,2,0,241130,0.993884,1.0,0.996933,0.999992,8.294212,1.0
+snd_Deva,267,267,1,0,241189,0.996269,1.0,0.998131,0.999996,4.146109,1.0
+snd_Latn,155,119,18,36,241284,0.868613,0.767742,0.815068,0.999925,74.59532,0.767742
+snf_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+snn_Latn,96,96,0,0,241361,1.0,1.0,1.0,1.0,0.0,1.0
+snp_Latn,159,159,0,0,241298,1.0,1.0,1.0,1.0,0.0,1.0
+snw_Latn,25,25,0,0,241432,1.0,1.0,1.0,1.0,0.0,1.0
+sny_Latn,163,163,0,0,241294,1.0,1.0,1.0,1.0,0.0,1.0
+som_Latn,439,435,1,4,241017,0.997706,0.990888,0.994286,0.999996,4.149068,0.990888
+sop_Latn,140,140,0,0,241317,1.0,1.0,1.0,1.0,0.0,1.0
+soq_Latn,124,124,0,0,241333,1.0,1.0,1.0,1.0,0.0,1.0
+sot_Latn,491,475,6,16,240960,0.987526,0.967413,0.977366,0.999975,24.899778,0.967413
+soy_Latn,60,60,0,0,241397,1.0,1.0,1.0,1.0,0.0,1.0
+spa_Latn,1136,1046,19,90,240302,0.98216,0.920775,0.950477,0.999921,79.060923,0.920775
+spl_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+spm_Latn,59,59,0,0,241398,1.0,1.0,1.0,1.0,0.0,1.0
+spp_Latn,155,155,0,0,241302,1.0,1.0,1.0,1.0,0.0,1.0
+sps_Latn,187,187,0,0,241270,1.0,1.0,1.0,1.0,0.0,1.0
+spy_Latn,136,136,0,0,241321,1.0,1.0,1.0,1.0,0.0,1.0
+srd_Latn,139,139,0,0,241318,1.0,1.0,1.0,1.0,0.0,1.0
+srm_Latn,125,125,0,0,241332,1.0,1.0,1.0,1.0,0.0,1.0
+srn_Latn,303,303,0,0,241154,1.0,1.0,1.0,1.0,0.0,1.0
+srp_Cyrl,269,269,6,0,241182,0.978182,1.0,0.988971,0.999975,24.87686,1.0
+srp_Latn,235,160,0,75,241222,1.0,0.680851,0.810127,1.0,0.0,0.680851
+srq_Latn,43,43,0,0,241414,1.0,1.0,1.0,1.0,0.0,1.0
+srr_Latn,49,49,1,0,241407,0.98,1.0,0.989899,0.999996,4.142365,1.0
+ssd_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+ssg_Latn,220,220,0,0,241237,1.0,1.0,1.0,1.0,0.0,1.0
+ssw_Latn,322,306,8,16,241127,0.974522,0.950311,0.962264,0.999967,33.176436,0.950311
+ssx_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+stp_Latn,62,62,0,0,241395,1.0,1.0,1.0,1.0,0.0,1.0
+stq_Latn,57,57,0,0,241400,1.0,1.0,1.0,1.0,0.0,1.0
+sua_Latn,60,60,0,0,241397,1.0,1.0,1.0,1.0,0.0,1.0
+suc_Latn,29,29,0,0,241428,1.0,1.0,1.0,1.0,0.0,1.0
+sue_Latn,154,154,0,0,241303,1.0,1.0,1.0,1.0,0.0,1.0
+suk_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+sun_Latn,143,143,7,0,241307,0.953333,1.0,0.976109,0.999971,29.007849,1.0
+sur_Latn,68,68,0,0,241389,1.0,1.0,1.0,1.0,0.0,1.0
+sus_Arab,116,116,1,0,241340,0.991453,1.0,0.995708,0.999996,4.143515,1.0
+sus_Latn,173,173,0,0,241284,1.0,1.0,1.0,1.0,0.0,1.0
+suz_Deva,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+swc_Latn,273,188,28,85,241156,0.87037,0.688645,0.768916,0.999884,116.093937,0.688645
+swe_Latn,328,326,22,2,241107,0.936782,0.993902,0.964497,0.999909,91.23747,0.993902
+swg_Latn,134,109,0,25,241323,1.0,0.813433,0.897119,1.0,0.0,0.813433
+swh_Latn,592,545,51,47,240814,0.91443,0.920608,0.917508,0.999788,211.736865,0.920608
+swp_Latn,143,143,1,0,241313,0.993056,1.0,0.996516,0.999996,4.143978,1.0
+sxb_Latn,134,134,0,0,241323,1.0,1.0,1.0,1.0,0.0,1.0
+sxn_Latn,137,137,1,0,241319,0.992754,1.0,0.996364,0.999996,4.143875,1.0
+syb_Latn,98,98,0,0,241359,1.0,1.0,1.0,1.0,0.0,1.0
+syc_Syrc,193,193,13,0,241251,0.936893,1.0,0.967419,0.999946,53.882883,1.0
+syl_Beng,115,115,0,0,241342,1.0,1.0,1.0,1.0,0.0,1.0
+syl_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+szl_Latn,320,320,2,0,241135,0.993789,1.0,0.996885,0.999992,8.29404,1.0
+szy_Latn,123,123,1,0,241333,0.991935,1.0,0.995951,0.999996,4.143635,1.0
+tab_Cyrl,196,196,0,0,241261,1.0,1.0,1.0,1.0,0.0,1.0
+tac_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+tah_Latn,242,242,1,0,241214,0.995885,1.0,0.997938,0.999996,4.145679,1.0
+taj_Deva,86,86,0,0,241371,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Latn,170,170,0,0,241287,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Taml,754,754,10,0,240693,0.986911,1.0,0.993412,0.999958,41.544975,1.0
+taq_Latn,106,106,6,0,241345,0.946429,1.0,0.972477,0.999975,24.860059,1.0
+taq_Tfng,104,70,21,34,241332,0.769231,0.673077,0.717949,0.999913,87.009484,0.673077
+tar_Latn,190,190,0,0,241267,1.0,1.0,1.0,1.0,0.0,1.0
+tat_Cyrl,201,201,4,0,241252,0.980488,1.0,0.990148,0.999983,16.579899,1.0
+tat_Latn,161,161,2,0,241294,0.98773,1.0,0.993827,0.999992,8.288575,1.0
+tav_Latn,36,36,0,0,241421,1.0,1.0,1.0,1.0,0.0,1.0
+taw_Latn,20,20,0,0,241437,1.0,1.0,1.0,1.0,0.0,1.0
+tay_Latn,106,106,1,0,241350,0.990654,1.0,0.995305,0.999996,4.143343,1.0
+tbc_Latn,131,131,0,0,241326,1.0,1.0,1.0,1.0,0.0,1.0
+tbg_Latn,136,136,0,0,241321,1.0,1.0,1.0,1.0,0.0,1.0
+tbo_Latn,202,202,0,0,241255,1.0,1.0,1.0,1.0,0.0,1.0
+tby_Latn,107,107,0,0,241350,1.0,1.0,1.0,1.0,0.0,1.0
+tbz_Latn,148,148,0,0,241309,1.0,1.0,1.0,1.0,0.0,1.0
+tca_Latn,127,127,0,0,241330,1.0,1.0,1.0,1.0,0.0,1.0
+tcf_Latn,146,146,0,0,241311,1.0,1.0,1.0,1.0,0.0,1.0
+tcs_Latn,128,128,0,0,241329,1.0,1.0,1.0,1.0,0.0,1.0
+tcy_Knda,99,99,7,0,241351,0.933962,1.0,0.965854,0.999971,29.002561,1.0
+tcz_Latn,291,291,5,0,241161,0.983108,1.0,0.991482,0.999979,20.732607,1.0
+tdt_Latn,57,57,75,0,241325,0.431818,1.0,0.603175,0.999689,310.687655,1.0
+ted_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+tee_Latn,158,158,0,0,241299,1.0,1.0,1.0,1.0,0.0,1.0
+tel_Latn,199,178,3,21,241255,0.983425,0.894472,0.936842,0.999988,12.434821,0.894472
+tel_Telu,555,553,5,2,240897,0.991039,0.996396,0.993711,0.999979,20.755328,0.996396
+tem_Latn,35,35,0,0,241422,1.0,1.0,1.0,1.0,0.0,1.0
+teo_Latn,225,222,0,3,241232,1.0,0.986667,0.993289,1.0,0.0,0.986667
+ter_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+tet_Latn,395,313,0,82,241062,1.0,0.792405,0.884181,1.0,0.0,0.792405
+tew_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+tfr_Latn,99,99,1,0,241357,0.99,1.0,0.994975,0.999996,4.143223,1.0
+tgk_Cyrl,413,413,2,0,241042,0.995181,1.0,0.997585,0.999992,8.29724,1.0
+tgo_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+tgp_Latn,189,189,0,0,241268,1.0,1.0,1.0,1.0,0.0,1.0
+tha_Thai,431,414,0,17,241026,1.0,0.960557,0.979882,1.0,0.0,0.960557
+thk_Latn,126,126,0,0,241331,1.0,1.0,1.0,1.0,0.0,1.0
+thl_Deva,121,97,1,24,241335,0.989796,0.801653,0.885845,0.999996,4.143601,0.801653
+tif_Latn,161,161,1,0,241295,0.993827,1.0,0.996904,0.999996,4.144288,1.0
+tih_Latn,10,10,0,0,241447,1.0,1.0,1.0,1.0,0.0,1.0
+tim_Latn,143,143,0,0,241314,1.0,1.0,1.0,1.0,0.0,1.0
+tir_Ethi,339,331,0,8,241118,1.0,0.976401,0.98806,1.0,0.0,0.976401
+tiv_Latn,199,199,4,0,241254,0.980296,1.0,0.99005,0.999983,16.579761,1.0
+tiy_Latn,115,115,0,0,241342,1.0,1.0,1.0,1.0,0.0,1.0
+tkl_Latn,208,208,0,0,241249,1.0,1.0,1.0,1.0,0.0,1.0
+tkr_Cyrl,69,69,0,0,241388,1.0,1.0,1.0,1.0,0.0,1.0
+tku_Latn,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+tlf_Latn,68,68,0,0,241389,1.0,1.0,1.0,1.0,0.0,1.0
+tlh_Latn,118,118,0,0,241339,1.0,1.0,1.0,1.0,0.0,1.0
+tll_Latn,186,186,0,0,241271,1.0,1.0,1.0,1.0,0.0,1.0
+tly_Latn,123,123,0,0,241334,1.0,1.0,1.0,1.0,0.0,1.0
+tmd_Latn,109,109,0,0,241348,1.0,1.0,1.0,1.0,0.0,1.0
+tna_Latn,49,49,0,0,241408,1.0,1.0,1.0,1.0,0.0,1.0
+tnk_Latn,117,117,0,0,241340,1.0,1.0,1.0,1.0,0.0,1.0
+tnn_Latn,140,140,1,0,241316,0.992908,1.0,0.996441,0.999996,4.143927,1.0
+tnp_Latn,169,169,0,0,241288,1.0,1.0,1.0,1.0,0.0,1.0
+tob_Latn,85,85,0,0,241372,1.0,1.0,1.0,1.0,0.0,1.0
+toc_Latn,119,119,0,0,241338,1.0,1.0,1.0,1.0,0.0,1.0
+tod_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+tog_Latn,105,105,0,0,241352,1.0,1.0,1.0,1.0,0.0,1.0
+toh_Latn,88,88,4,0,241365,0.956522,1.0,0.977778,0.999983,16.572136,1.0
+toi_Latn,232,231,4,1,241221,0.982979,0.99569,0.989293,0.999983,16.582029,0.99569
+toj_Latn,137,137,0,0,241320,1.0,1.0,1.0,1.0,0.0,1.0
+tok_Latn,106,106,0,0,241351,1.0,1.0,1.0,1.0,0.0,1.0
+ton_Latn,298,298,0,0,241159,1.0,1.0,1.0,1.0,0.0,1.0
+too_Latn,102,102,0,0,241355,1.0,1.0,1.0,1.0,0.0,1.0
+top_Latn,259,259,0,0,241198,1.0,1.0,1.0,1.0,0.0,1.0
+tos_Latn,77,77,0,0,241380,1.0,1.0,1.0,1.0,0.0,1.0
+tpi_Latn,302,302,1,0,241154,0.9967,1.0,0.998347,0.999996,4.146711,1.0
+tpm_Latn,7,7,0,0,241450,1.0,1.0,1.0,1.0,0.0,1.0
+tpp_Latn,86,86,0,0,241371,1.0,1.0,1.0,1.0,0.0,1.0
+tpt_Latn,115,115,1,0,241341,0.991379,1.0,0.995671,0.999996,4.143498,1.0
+tpz_Latn,154,154,0,0,241303,1.0,1.0,1.0,1.0,0.0,1.0
+trc_Latn,76,76,0,0,241381,1.0,1.0,1.0,1.0,0.0,1.0
+trn_Latn,57,57,0,0,241400,1.0,1.0,1.0,1.0,0.0,1.0
+trp_Latn,186,186,0,0,241271,1.0,1.0,1.0,1.0,0.0,1.0
+trq_Latn,35,35,0,0,241422,1.0,1.0,1.0,1.0,0.0,1.0
+trv_Latn,159,159,5,0,241293,0.969512,1.0,0.98452,0.999979,20.721266,1.0
+tsc_Latn,184,182,20,2,241253,0.90099,0.98913,0.943005,0.999917,82.893652,0.98913
+tsg_Latn,170,170,1,0,241286,0.994152,1.0,0.997067,0.999996,4.144442,1.0
+tsn_Latn,456,438,18,18,240983,0.960526,0.960526,0.960526,0.999925,74.688487,0.960526
+tso_Latn,581,532,0,49,240876,1.0,0.915663,0.955975,1.0,0.0,0.915663
+tsw_Latn,64,64,0,0,241393,1.0,1.0,1.0,1.0,0.0,1.0
+tsz_Latn,159,159,0,0,241298,1.0,1.0,1.0,1.0,0.0,1.0
+ttc_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+tte_Latn,132,132,1,0,241324,0.992481,1.0,0.996226,0.999996,4.143789,1.0
+ttj_Latn,28,26,1,2,241428,0.962963,0.928571,0.945455,0.999996,4.142004,0.928571
+tuc_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+tue_Latn,78,78,0,0,241379,1.0,1.0,1.0,1.0,0.0,1.0
+tuf_Latn,56,56,0,0,241401,1.0,1.0,1.0,1.0,0.0,1.0
+tui_Latn,4,2,0,2,241453,1.0,0.5,0.666667,1.0,0.0,0.5
+tuk_Arab,135,89,10,46,241312,0.89899,0.659259,0.760684,0.999959,41.43841,0.659259
+tuk_Cyrl,129,109,4,20,241324,0.964602,0.844961,0.900826,0.999983,16.574952,0.844961
+tuk_Latn,227,227,1,0,241229,0.995614,1.0,0.997802,0.999996,4.145421,1.0
+tum_Latn,265,264,1,1,241191,0.996226,0.996226,0.996226,0.999996,4.146074,0.996226
+tuo_Latn,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+tur_Latn,430,429,1,1,241026,0.997674,0.997674,0.997674,0.999996,4.148913,0.997674
+tuv_Latn,22,22,3,0,241432,0.88,1.0,0.93617,0.999988,12.425705,1.0
+tvk_Latn,170,170,0,0,241287,1.0,1.0,1.0,1.0,0.0,1.0
+tvl_Latn,158,158,0,0,241299,1.0,1.0,1.0,1.0,0.0,1.0
+twi_Latn,359,353,4,6,241094,0.988796,0.983287,0.986034,0.999983,16.590764,0.983287
+twu_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+txq_Latn,145,145,3,0,241309,0.97973,1.0,0.989761,0.999988,12.432038,1.0
+txu_Latn,166,166,0,0,241291,1.0,1.0,1.0,1.0,0.0,1.0
+tyv_Cyrl,273,273,5,0,241179,0.982014,1.0,0.990926,0.999979,20.73106,1.0
+tzh_Latn,347,347,0,0,241110,1.0,1.0,1.0,1.0,0.0,1.0
+tzj_Latn,190,190,0,0,241267,1.0,1.0,1.0,1.0,0.0,1.0
+tzm_Tfng,157,157,71,0,241229,0.688596,1.0,0.815584,0.999706,294.239536,1.0
+tzo_Latn,294,294,0,0,241163,1.0,1.0,1.0,1.0,0.0,1.0
+ubr_Latn,194,194,0,0,241263,1.0,1.0,1.0,1.0,0.0,1.0
+ubu_Latn,211,211,0,0,241246,1.0,1.0,1.0,1.0,0.0,1.0
+udm_Cyrl,159,159,3,0,241295,0.981481,1.0,0.990654,0.999988,12.432759,1.0
+udu_Latn,98,98,0,0,241359,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Arab,334,334,0,0,241123,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Cyrl,253,253,1,0,241203,0.996063,1.0,0.998028,0.999996,4.145868,1.0
+uig_Latn,197,197,8,0,241252,0.960976,1.0,0.9801,0.999967,33.159247,1.0
+ukr_Cyrl,322,322,2,0,241133,0.993827,1.0,0.996904,0.999992,8.294109,1.0
+umb_Latn,100,100,1,0,241356,0.990099,1.0,0.995025,0.999996,4.14324,1.0
+und_Bali,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+und_Bamu,18,18,0,0,241439,1.0,1.0,1.0,1.0,0.0,1.0
+und_Bopo,58,58,0,0,241399,1.0,1.0,1.0,1.0,0.0,1.0
+und_Cans,84,77,0,7,241373,1.0,0.916667,0.956522,1.0,0.0,0.916667
+und_Cher,40,40,0,0,241417,1.0,1.0,1.0,1.0,0.0,1.0
+und_Cyrl,78,78,5,0,241374,0.939759,1.0,0.968944,0.999979,20.714312,1.0
+und_Deva,5,4,2,1,241450,0.666667,0.8,0.727273,0.999992,8.28322,0.8
+und_Egyp,37,37,0,0,241420,1.0,1.0,1.0,1.0,0.0,1.0
+und_Ethi,14,14,0,0,241443,1.0,1.0,1.0,1.0,0.0,1.0
+und_Geor,32,17,0,15,241425,1.0,0.53125,0.693878,1.0,0.0,0.53125
+und_Goth,22,17,0,5,241435,1.0,0.772727,0.871795,1.0,0.0,0.772727
+und_Grek,108,108,3,0,241346,0.972973,1.0,0.986301,0.999988,12.430132,1.0
+und_Hebr,47,37,0,10,241410,1.0,0.787234,0.880952,1.0,0.0,0.787234
+und_Hluw,16,16,2,0,241439,0.888889,1.0,0.941176,0.999992,8.283597,1.0
+und_Hung,80,80,0,0,241377,1.0,1.0,1.0,1.0,0.0,1.0
+und_Kana,136,103,0,33,241321,1.0,0.757353,0.861925,1.0,0.0,0.757353
+und_Khmr,18,13,0,5,241439,1.0,0.722222,0.83871,1.0,0.0,0.722222
+und_Lana,40,40,0,0,241417,1.0,1.0,1.0,1.0,0.0,1.0
+und_Laoo,20,9,0,11,241437,1.0,0.45,0.62069,1.0,0.0,0.45
+und_Lina,22,22,1,0,241434,0.956522,1.0,0.977778,0.999996,4.141902,1.0
+und_Mlym,35,35,0,0,241422,1.0,1.0,1.0,1.0,0.0,1.0
+und_Mong,93,93,0,0,241364,1.0,1.0,1.0,1.0,0.0,1.0
+und_Mymr,27,18,0,9,241430,1.0,0.666667,0.8,1.0,0.0,0.666667
+und_Newa,153,153,0,0,241304,1.0,1.0,1.0,1.0,0.0,1.0
+und_Orya,25,17,1,8,241431,0.944444,0.68,0.790698,0.999996,4.141953,0.68
+und_Shaw,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+und_Sylo,95,95,0,0,241362,1.0,1.0,1.0,1.0,0.0,1.0
+und_Syrc,43,30,0,13,241414,1.0,0.697674,0.821918,1.0,0.0,0.697674
+und_Taml,52,42,0,10,241405,1.0,0.807692,0.893617,1.0,0.0,0.807692
+und_Tang,28,28,3,0,241426,0.903226,1.0,0.949153,0.999988,12.426013,1.0
+und_Telu,49,44,0,5,241408,1.0,0.897959,0.946237,1.0,0.0,0.897959
+und_Thaa,29,14,0,15,241428,1.0,0.482759,0.651163,1.0,0.0,0.482759
+und_Thai,23,23,0,0,241434,1.0,1.0,1.0,1.0,0.0,1.0
+und_Tibt,24,23,0,1,241433,1.0,0.958333,0.978723,1.0,0.0,0.958333
+und_Vaii,12,12,1,0,241444,0.923077,1.0,0.96,0.999996,4.14173,1.0
+und_Xsux,43,43,1,0,241413,0.977273,1.0,0.988506,0.999996,4.142262,1.0
+und_Yiii,38,38,9,0,241410,0.808511,1.0,0.894118,0.999963,37.279584,1.0
+upv_Latn,50,50,0,0,241407,1.0,1.0,1.0,1.0,0.0,1.0
+ura_Latn,75,75,0,0,241382,1.0,1.0,1.0,1.0,0.0,1.0
+urb_Latn,112,112,0,0,241345,1.0,1.0,1.0,1.0,0.0,1.0
+urd_Arab,257,257,38,0,241162,0.871186,1.0,0.931159,0.999842,157.545605,1.0
+urd_Latn,204,166,55,38,241198,0.751131,0.813725,0.781176,0.999772,227.97644,0.813725
+urh_Latn,159,159,1,0,241297,0.99375,1.0,0.996865,0.999996,4.144253,1.0
+urk_Thai,111,111,0,0,241346,1.0,1.0,1.0,1.0,0.0,1.0
+urt_Latn,96,96,0,0,241361,1.0,1.0,1.0,1.0,0.0,1.0
+usa_Latn,157,157,0,0,241300,1.0,1.0,1.0,1.0,0.0,1.0
+usp_Latn,90,90,0,0,241367,1.0,1.0,1.0,1.0,0.0,1.0
+uth_Latn,19,19,0,0,241438,1.0,1.0,1.0,1.0,0.0,1.0
+uvh_Latn,100,100,0,0,241357,1.0,1.0,1.0,1.0,0.0,1.0
+uvl_Latn,164,164,0,0,241293,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Cyrl,213,213,0,0,241244,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Latn,436,436,5,0,241016,0.988662,1.0,0.994299,0.999979,20.74508,1.0
+uzs_Arab,283,283,15,0,241159,0.949664,1.0,0.974182,0.999938,62.195759,1.0
+vap_Latn,140,119,4,21,241313,0.96748,0.85,0.904943,0.999983,16.575707,0.85
+var_Latn,38,38,0,0,241419,1.0,1.0,1.0,1.0,0.0,1.0
+vec_Latn,49,37,0,12,241408,1.0,0.755102,0.860465,1.0,0.0,0.755102
+ven_Latn,387,381,4,6,241066,0.98961,0.984496,0.987047,0.999983,16.592691,0.984496
+vep_Latn,113,113,1,0,241343,0.991228,1.0,0.995595,0.999996,4.143463,1.0
+vid_Latn,104,104,0,0,241353,1.0,1.0,1.0,1.0,0.0,1.0
+vie_Latn,338,338,2,0,241117,0.994118,1.0,0.99705,0.999992,8.294659,1.0
+viv_Latn,166,166,0,0,241291,1.0,1.0,1.0,1.0,0.0,1.0
+vls_Latn,98,98,2,0,241357,0.98,1.0,0.989899,0.999992,8.286412,1.0
+vmw_Latn,386,386,1,0,241070,0.997416,1.0,0.998706,0.999996,4.148156,1.0
+vmy_Latn,120,120,0,0,241337,1.0,1.0,1.0,1.0,0.0,1.0
+vol_Latn,82,82,1,0,241374,0.987952,1.0,0.993939,0.999996,4.142931,1.0
+vro_Latn,448,448,10,0,240999,0.978166,1.0,0.988962,0.999959,41.492226,1.0
+vun_Latn,82,82,0,0,241375,1.0,1.0,1.0,1.0,0.0,1.0
+waj_Latn,128,128,0,0,241329,1.0,1.0,1.0,1.0,0.0,1.0
+wal_Latn,284,284,0,0,241173,1.0,1.0,1.0,1.0,0.0,1.0
+wap_Latn,20,20,0,0,241437,1.0,1.0,1.0,1.0,0.0,1.0
+war_Latn,193,193,2,0,241262,0.989744,1.0,0.994845,0.999992,8.289674,1.0
+way_Latn,27,27,0,0,241430,1.0,1.0,1.0,1.0,0.0,1.0
+wba_Latn,63,63,1,0,241393,0.984375,1.0,0.992126,0.999996,4.142605,1.0
+wbm_Latn,42,42,0,0,241415,1.0,1.0,1.0,1.0,0.0,1.0
+wbp_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+wed_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+wer_Latn,143,143,0,0,241314,1.0,1.0,1.0,1.0,0.0,1.0
+whk_Latn,13,13,1,0,241443,0.928571,1.0,0.962963,0.999996,4.141747,1.0
+wib_Latn,17,17,0,0,241440,1.0,1.0,1.0,1.0,0.0,1.0
+wim_Latn,110,110,0,0,241347,1.0,1.0,1.0,1.0,0.0,1.0
+wiu_Latn,132,132,0,0,241325,1.0,1.0,1.0,1.0,0.0,1.0
+wln_Latn,305,305,2,0,241150,0.993485,1.0,0.996732,0.999992,8.293524,1.0
+wls_Latn,68,65,0,3,241389,1.0,0.955882,0.977444,1.0,0.0,0.955882
+wlv_Latn,82,82,1,0,241374,0.987952,1.0,0.993939,0.999996,4.142931,1.0
+wmt_Latn,30,30,0,0,241427,1.0,1.0,1.0,1.0,0.0,1.0
+wmw_Latn,39,39,3,0,241415,0.928571,1.0,0.962963,0.999988,12.42658,1.0
+wnc_Latn,197,197,0,0,241260,1.0,1.0,1.0,1.0,0.0,1.0
+wnu_Latn,147,147,0,0,241310,1.0,1.0,1.0,1.0,0.0,1.0
+wol_Latn,214,214,3,0,241240,0.986175,1.0,0.993039,0.999988,12.435594,1.0
+wos_Latn,183,183,1,0,241273,0.994565,1.0,0.997275,0.999996,4.144665,1.0
+wrk_Latn,185,185,0,0,241272,1.0,1.0,1.0,1.0,0.0,1.0
+wrs_Latn,158,158,1,0,241298,0.993711,1.0,0.996845,0.999996,4.144236,1.0
+wsk_Latn,128,128,0,0,241329,1.0,1.0,1.0,1.0,0.0,1.0
+wuu_Hani,148,148,6,0,241303,0.961039,1.0,0.980132,0.999975,24.864385,1.0
+wuv_Latn,144,144,0,0,241313,1.0,1.0,1.0,1.0,0.0,1.0
+xal_Cyrl,295,295,1,0,241161,0.996622,1.0,0.998308,0.999996,4.14659,1.0
+xav_Latn,103,103,2,0,241352,0.980952,1.0,0.990385,0.999992,8.286583,1.0
+xbi_Latn,165,165,0,0,241292,1.0,1.0,1.0,1.0,0.0,1.0
+xbr_Latn,8,8,0,0,241449,1.0,1.0,1.0,1.0,0.0,1.0
+xed_Latn,138,138,0,0,241319,1.0,1.0,1.0,1.0,0.0,1.0
+xho_Latn,367,338,12,29,241078,0.965714,0.920981,0.942817,0.99995,49.773943,0.920981
+xla_Latn,151,151,0,0,241306,1.0,1.0,1.0,1.0,0.0,1.0
+xmf_Geor,132,132,2,0,241323,0.985075,1.0,0.992481,0.999992,8.287579,1.0
+xmm_Latn,32,28,6,4,241419,0.823529,0.875,0.848485,0.999975,24.852439,0.875
+xmv_Latn,130,97,0,33,241327,1.0,0.746154,0.854626,1.0,0.0,0.746154
+xnn_Latn,77,77,1,0,241379,0.987179,1.0,0.993548,0.999996,4.142845,1.0
+xog_Latn,93,91,1,2,241363,0.98913,0.978495,0.983784,0.999996,4.14312,0.978495
+xon_Latn,118,118,0,0,241339,1.0,1.0,1.0,1.0,0.0,1.0
+xrb_Latn,91,91,1,0,241365,0.98913,1.0,0.994536,0.999996,4.143086,1.0
+xsi_Latn,154,154,1,0,241302,0.993548,1.0,0.996764,0.999996,4.144167,1.0
+xsm_Latn,159,159,1,0,241297,0.99375,1.0,0.996865,0.999996,4.144253,1.0
+xsr_Deva,167,167,0,0,241290,1.0,1.0,1.0,1.0,0.0,1.0
+xsu_Latn,3,3,0,0,241454,1.0,1.0,1.0,1.0,0.0,1.0
+xtd_Latn,73,73,0,0,241384,1.0,1.0,1.0,1.0,0.0,1.0
+xtm_Latn,39,39,0,0,241418,1.0,1.0,1.0,1.0,0.0,1.0
+xtn_Latn,135,135,0,0,241322,1.0,1.0,1.0,1.0,0.0,1.0
+xuo_Latn,62,62,0,0,241395,1.0,1.0,1.0,1.0,0.0,1.0
+yaa_Latn,56,56,0,0,241401,1.0,1.0,1.0,1.0,0.0,1.0
+yad_Latn,46,46,0,0,241411,1.0,1.0,1.0,1.0,0.0,1.0
+yal_Latn,129,129,0,0,241328,1.0,1.0,1.0,1.0,0.0,1.0
+yan_Latn,14,14,0,0,241443,1.0,1.0,1.0,1.0,0.0,1.0
+yao_Latn,137,137,2,0,241318,0.985612,1.0,0.992754,0.999992,8.287751,1.0
+yap_Latn,210,210,1,0,241246,0.995261,1.0,0.997625,0.999996,4.145129,1.0
+yaq_Latn,60,60,0,0,241397,1.0,1.0,1.0,1.0,0.0,1.0
+ybb_Latn,20,5,1,15,241436,0.833333,0.25,0.384615,0.999996,4.141867,0.25
+yby_Latn,121,121,0,0,241336,1.0,1.0,1.0,1.0,0.0,1.0
+ycn_Latn,79,79,0,0,241378,1.0,1.0,1.0,1.0,0.0,1.0
+ydd_Hebr,430,430,1,0,241026,0.99768,1.0,0.998839,0.999996,4.148913,1.0
+yka_Latn,215,215,1,0,241241,0.99537,1.0,0.99768,0.999996,4.145215,1.0
+yle_Latn,119,119,0,0,241338,1.0,1.0,1.0,1.0,0.0,1.0
+yli_Latn,145,145,0,0,241312,1.0,1.0,1.0,1.0,0.0,1.0
+yml_Latn,173,173,0,0,241284,1.0,1.0,1.0,1.0,0.0,1.0
+yom_Latn,117,117,1,0,241339,0.991525,1.0,0.995745,0.999996,4.143532,1.0
+yon_Latn,127,127,0,0,241330,1.0,1.0,1.0,1.0,0.0,1.0
+yor_Latn,308,308,2,0,241147,0.993548,1.0,0.996764,0.999992,8.293628,1.0
+yrb_Latn,188,188,0,0,241269,1.0,1.0,1.0,1.0,0.0,1.0
+yre_Latn,111,111,0,0,241346,1.0,1.0,1.0,1.0,0.0,1.0
+yrk_Cyrl,61,58,0,3,241396,1.0,0.95082,0.97479,1.0,0.0,0.95082
+yss_Latn,231,231,0,0,241226,1.0,1.0,1.0,1.0,0.0,1.0
+yua_Latn,326,324,1,2,241130,0.996923,0.993865,0.995392,0.999996,4.147123,0.993865
+yue_Hani,194,159,3,35,241260,0.981481,0.819588,0.893258,0.999988,12.434563,0.819588
+yuj_Latn,205,205,0,0,241252,1.0,1.0,1.0,1.0,0.0,1.0
+yut_Latn,262,262,0,0,241195,1.0,1.0,1.0,1.0,0.0,1.0
+yuw_Latn,136,136,0,0,241321,1.0,1.0,1.0,1.0,0.0,1.0
+yva_Latn,25,25,0,0,241432,1.0,1.0,1.0,1.0,0.0,1.0
+zaa_Latn,63,63,1,0,241393,0.984375,1.0,0.992126,0.999996,4.142605,1.0
+zab_Latn,116,116,0,0,241341,1.0,1.0,1.0,1.0,0.0,1.0
+zac_Latn,138,138,0,0,241319,1.0,1.0,1.0,1.0,0.0,1.0
+zad_Latn,12,12,0,0,241445,1.0,1.0,1.0,1.0,0.0,1.0
+zae_Latn,37,37,0,0,241420,1.0,1.0,1.0,1.0,0.0,1.0
+zai_Latn,80,80,1,0,241376,0.987654,1.0,0.993789,0.999996,4.142897,1.0
+zam_Latn,52,52,0,0,241405,1.0,1.0,1.0,1.0,0.0,1.0
+zao_Latn,77,77,0,0,241380,1.0,1.0,1.0,1.0,0.0,1.0
+zar_Latn,108,108,0,0,241349,1.0,1.0,1.0,1.0,0.0,1.0
+zas_Latn,58,58,0,0,241399,1.0,1.0,1.0,1.0,0.0,1.0
+zat_Latn,261,261,0,0,241196,1.0,1.0,1.0,1.0,0.0,1.0
+zav_Latn,78,78,0,0,241379,1.0,1.0,1.0,1.0,0.0,1.0
+zaw_Latn,99,99,0,0,241358,1.0,1.0,1.0,1.0,0.0,1.0
+zdj_Latn,28,28,0,0,241429,1.0,1.0,1.0,1.0,0.0,1.0
+zea_Latn,192,192,3,0,241262,0.984615,1.0,0.992248,0.999988,12.43446,1.0
+zgh_Tfng,135,64,12,71,241310,0.842105,0.474074,0.606635,0.99995,49.726092,0.474074
+zia_Latn,76,76,0,0,241381,1.0,1.0,1.0,1.0,0.0,1.0
+ziw_Latn,142,142,1,0,241314,0.993007,1.0,0.996491,0.999996,4.143961,1.0
+zne_Latn,195,195,0,0,241262,1.0,1.0,1.0,1.0,0.0,1.0
+zom_Latn,260,205,9,55,241188,0.957944,0.788462,0.864979,0.999963,37.313897,0.788462
+zos_Latn,171,171,0,0,241286,1.0,1.0,1.0,1.0,0.0,1.0
+zpa_Latn,174,174,1,0,241282,0.994286,1.0,0.997135,0.999996,4.144511,1.0
+zpc_Latn,134,134,0,0,241323,1.0,1.0,1.0,1.0,0.0,1.0
+zpg_Latn,15,15,0,0,241442,1.0,1.0,1.0,1.0,0.0,1.0
+zpi_Latn,28,28,0,0,241429,1.0,1.0,1.0,1.0,0.0,1.0
+zpl_Latn,91,91,0,0,241366,1.0,1.0,1.0,1.0,0.0,1.0
+zpm_Latn,111,111,0,0,241346,1.0,1.0,1.0,1.0,0.0,1.0
+zpo_Latn,39,39,0,0,241418,1.0,1.0,1.0,1.0,0.0,1.0
+zpt_Latn,30,30,0,0,241427,1.0,1.0,1.0,1.0,0.0,1.0
+zpu_Latn,122,122,0,0,241335,1.0,1.0,1.0,1.0,0.0,1.0
+zpv_Latn,147,147,0,0,241310,1.0,1.0,1.0,1.0,0.0,1.0
+zpz_Latn,114,114,0,0,241343,1.0,1.0,1.0,1.0,0.0,1.0
+zsm_Latn,244,244,22,0,241191,0.917293,1.0,0.956863,0.999909,91.205698,1.0
+zsr_Latn,124,124,0,0,241333,1.0,1.0,1.0,1.0,0.0,1.0
+ztq_Latn,187,187,0,0,241270,1.0,1.0,1.0,1.0,0.0,1.0
+zty_Latn,177,177,0,0,241280,1.0,1.0,1.0,1.0,0.0,1.0
+zul_Latn,594,500,22,94,240841,0.957854,0.841751,0.896057,0.999909,91.33823,0.841751
+zyb_Latn,153,153,1,0,241303,0.993506,1.0,0.996743,0.999996,4.14415,1.0
+zyp_Latn,178,178,0,0,241279,1.0,1.0,1.0,1.0,0.0,1.0

reports/test/glotlid_summary.json

@@ -0,0 +1,22 @@
+{
+  "top1_accuracy": 0.972694931188576,
+  "top3_accuracy": 0.9928103140517773,
+  "top5_accuracy": 0.9935599299254112,
+  "passages": 241457,
+  "languages": 1621,
+  "macro_precision": 0.9779554288344202,
+  "macro_recall": 0.97455614917712,
+  "macro_f1": 0.9742516039920551,
+  "macro_specificity": 0.9999863693259885,
+  "weighted_f1": 0.9737439616979084,
+  "median_f1": 1.0,
+  "languages_f1_at_least_0_9": 1486,
+  "languages_f1_below_0_5": 7,
+  "mean_fp_per_million": 13.630674011364892,
+  "micro_f1": 0.972694931188576,
+  "top1_by_size": {
+    "paragraph": 0.9854785211552464,
+    "sentence": 0.9824993337309796,
+    "short": 0.960288298473714
+  }
+}

reports/test/millid_summary.json

@@ -0,0 +1,22 @@
+{
+  "top1_accuracy": 0.9568204690690267,
+  "top3_accuracy": 0.986063771189073,
+  "top5_accuracy": 0.9895716421557461,
+  "passages": 241457,
+  "languages": 1621,
+  "macro_precision": 0.9545250122642608,
+  "macro_recall": 0.9608553008590351,
+  "macro_f1": 0.9558663867116508,
+  "macro_specificity": 0.9999733850455484,
+  "weighted_f1": 0.9569594021717679,
+  "median_f1": 0.9838709677419354,
+  "languages_f1_at_least_0_9": 1445,
+  "languages_f1_below_0_5": 8,
+  "mean_fp_per_million": 26.614954451516923,
+  "micro_f1": 0.9568204690690267,
+  "top1_by_size": {
+    "paragraph": 0.979006552867891,
+    "sentence": 0.9781083036156198,
+    "short": 0.9323152204635388
+  }
+}

reports/udhr-all/glotlid@millid_per_language.csv

@@ -0,0 +1,430 @@
+label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
+aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+abk_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+ace_Latn,61,60,0,1,27562,1.0,0.983607,0.991736,1.0,0.0,0.983607
+acu_Latn,180,134,0,46,27443,1.0,0.744444,0.853503,1.0,0.0,0.744444
+ada_Latn,59,59,8,0,27556,0.880597,1.0,0.936508,0.99971,290.233638,1.0
+ady_Cyrl,56,54,0,2,27567,1.0,0.964286,0.981818,1.0,0.0,0.964286
+afr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+agr_Latn,57,56,2,1,27564,0.965517,0.982456,0.973913,0.999927,72.553145,0.982456
+aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+ajg_Latn,59,59,60,0,27504,0.495798,1.0,0.662921,0.997823,2176.752286,1.0
+als_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
+alt_Cyrl,51,51,4,0,27568,0.927273,1.0,0.962264,0.999855,145.074713,1.0
+amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+ame_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+amh_Ethi,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
+ami_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
+amr_Latn,61,61,3,0,27559,0.953125,1.0,0.976,0.999891,108.845512,1.0
+arb_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+arl_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+arn_Latn,58,48,0,10,27565,1.0,0.827586,0.90566,1.0,0.0,0.827586
+ast_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+auc_Latn,154,0,0,154,27469,0.0,0.0,0.0,1.0,0.0,0.0
+ayr_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Cyrl,56,56,1,0,27566,0.982456,1.0,0.99115,0.999964,36.275257,1.0
+azj_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+bam_Latn,57,50,50,7,27516,0.5,0.877193,0.636943,0.998186,1813.828629,0.877193
+ban_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+bba_Latn,58,58,10,0,27555,0.852941,1.0,0.920635,0.999637,362.778886,1.0
+bci_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+bcl_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+bel_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bem_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
+bho_Deva,56,49,0,7,27567,1.0,0.875,0.933333,1.0,0.0,0.875
+bin_Latn,47,41,0,6,27576,1.0,0.87234,0.931818,1.0,0.0,0.87234
+bis_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
+boa_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+bod_Tibt,60,50,1,10,27562,0.980392,0.833333,0.900901,0.999964,36.280521,0.833333
+bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+bos_Latn,59,27,87,32,27477,0.236842,0.457627,0.312139,0.996844,3156.290814,0.457627
+bre_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+bug_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+bul_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bum_Latn,58,3,6,55,27559,0.333333,0.051724,0.089552,0.999782,217.667332,0.051724
+cab_Latn,60,58,0,2,27563,1.0,0.966667,0.983051,1.0,0.0,0.966667
+cak_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+cat_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+cbi_Latn,62,61,2,1,27559,0.968254,0.983871,0.976,0.999927,72.566307,0.983871
+cbr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+cbs_Latn,43,41,10,2,27570,0.803922,0.953488,0.87234,0.999637,362.581581,0.953488
+cbt_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+cbu_Latn,57,45,1,12,27565,0.978261,0.789474,0.873786,0.999964,36.276573,0.789474
+ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+ceb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+ces_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+cfm_Latn,57,55,1,2,27565,0.982143,0.964912,0.973451,0.999964,36.276573,0.964912
+cha_Latn,57,49,1,8,27565,0.98,0.859649,0.915888,0.999964,36.276573,0.859649
+chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+chk_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+chr_Cher,115,57,0,58,27508,1.0,0.495652,0.662791,1.0,0.0,0.495652
+chv_Cyrl,25,25,4,0,27594,0.862069,1.0,0.925926,0.999855,144.938039,1.0
+cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+cjk_Latn,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
+cjs_Cyrl,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
+cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
+cmn_Hani,319,293,175,26,27129,0.626068,0.918495,0.7446,0.993591,6409.317316,0.918495
+cnh_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+cni_Latn,52,52,4,0,27567,0.928571,1.0,0.962963,0.999855,145.079975,1.0
+cnr_Latn,59,1,6,58,27558,0.142857,0.016949,0.030303,0.999782,217.675229,0.016949
+cof_Latn,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
+cos_Latn,59,58,1,1,27563,0.983051,0.983051,0.983051,0.999964,36.279205,0.983051
+cot_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
+cpu_Latn,60,57,0,3,27563,1.0,0.95,0.974359,1.0,0.0,0.95
+crh_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+cri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+crs_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
+ctd_Latn,60,34,0,26,27563,1.0,0.566667,0.723404,1.0,0.0,0.566667
+cym_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+dag_Latn,57,56,29,1,27537,0.658824,0.982456,0.788732,0.998948,1052.020605,0.982456
+dan_Latn,61,59,0,2,27562,1.0,0.967213,0.983333,1.0,0.0,0.967213
+ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+deu_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
+dga_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+div_Thaa,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+dje_Latn,54,49,13,5,27556,0.790323,0.907407,0.844828,0.999528,471.544126,0.907407
+duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+dyo_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+dyu_Latn,58,18,43,40,27522,0.295082,0.310345,0.302521,0.99844,1559.949211,0.310345
+dzo_Tibt,59,58,10,1,27554,0.852941,0.983051,0.913386,0.999637,362.792048,0.983051
+ekk_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+ell_Grek,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
+emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+eng_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+epo_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+ese_Latn,35,34,0,1,27588,1.0,0.971429,0.985507,1.0,0.0,0.971429
+eus_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+eve_Cyrl,49,39,112,10,27462,0.258278,0.795918,0.39,0.995938,4061.797345,0.795918
+evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+ewe_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fao_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+fas_Arab,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
+fat_Latn,57,57,4,0,27562,0.934426,1.0,0.966102,0.999855,145.10629,1.0
+fij_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fil_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+fin_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+fkv_Latn,58,29,0,29,27565,1.0,0.5,0.666667,1.0,0.0,0.5
+fon_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+fra_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
+fry_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+fuf_Latn,58,21,8,37,27557,0.724138,0.362069,0.482759,0.99971,290.223109,0.362069
+fur_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fuv_Latn,108,63,13,45,27502,0.828947,0.583333,0.684783,0.999528,472.469562,0.583333
+fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+gaa_Latn,59,59,4,0,27560,0.936508,1.0,0.967213,0.999855,145.116819,1.0
+gag_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
+gaz_Latn,60,59,2,1,27561,0.967213,0.983333,0.975207,0.999927,72.561042,0.983333
+gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+gjn_Latn,60,58,7,2,27556,0.892308,0.966667,0.928,0.999746,253.963647,0.966667
+gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+gla_Latn,62,60,0,2,27561,1.0,0.967742,0.983607,1.0,0.0,0.967742
+gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+gle_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
+glg_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+glv_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+gsw_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+guc_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+gug_Latn,49,49,1,0,27573,0.98,1.0,0.989899,0.999964,36.266048,1.0
+guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+guu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+gyr_Latn,49,48,0,1,27574,1.0,0.979592,0.989691,1.0,0.0,0.979592
+hak_Hani,48,1,1,47,27574,0.5,0.020833,0.04,0.999964,36.264733,0.020833
+hat_Latn,117,114,2,3,27504,0.982759,0.974359,0.978541,0.999927,72.711408,0.974359
+hau_Latn,155,155,1,0,27467,0.99359,1.0,0.996785,0.999964,36.406,1.0
+haw_Latn,58,55,0,3,27565,1.0,0.948276,0.973451,1.0,0.0,0.948276
+hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+heb_Hebr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+hil_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+hin_Deva,59,56,2,3,27562,0.965517,0.949153,0.957265,0.999927,72.55841,0.949153
+hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+hnj_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+hns_Latn,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
+hrv_Latn,58,56,40,2,27525,0.583333,0.965517,0.727273,0.998549,1451.115545,0.965517
+hsb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
+hun_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+hus_Latn,175,170,0,5,27448,1.0,0.971429,0.985507,1.0,0.0,0.971429
+huu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+hye_Armn,70,70,0,0,27553,1.0,1.0,1.0,1.0,0.0,1.0
+ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
+ibo_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+ido_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+idu_Latn,51,45,0,6,27572,1.0,0.882353,0.9375,1.0,0.0,0.882353
+iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
+ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
+ike_Cans,44,44,2,0,27577,0.956522,1.0,0.977778,0.999927,72.518946,1.0
+ilo_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+ina_Latn,58,58,19,0,27546,0.753247,1.0,0.859259,0.999311,689.279884,1.0
+ind_Latn,60,51,3,9,27560,0.944444,0.85,0.894737,0.999891,108.841563,0.85
+isl_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+ita_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
+jav_Java,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+jav_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
+jiv_Latn,60,59,29,1,27534,0.670455,0.983333,0.797297,0.998948,1052.135109,0.983333
+jpn_Jpan,140,140,4,0,27479,0.972222,1.0,0.985915,0.999854,145.544518,1.0
+kaa_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kab_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+kal_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kaz_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kbd_Cyrl,55,55,3,0,27565,0.948276,1.0,0.973451,0.999891,108.821822,1.0
+kbp_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+kbr_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+kde_Latn,51,49,1,2,27571,0.98,0.960784,0.970297,0.999964,36.268678,0.960784
+kdh_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+kea_Latn,58,58,62,0,27503,0.483333,1.0,0.651685,0.997751,2249.229095,1.0
+kek_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+kha_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+khk_Cyrl,57,56,3,1,27563,0.949153,0.982456,0.965517,0.999891,108.829718,0.982456
+khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+kin_Latn,59,47,0,12,27564,1.0,0.79661,0.886792,1.0,0.0,0.79661
+kir_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kjh_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+kmb_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
+kmr_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+knc_Latn,64,64,0,0,27559,1.0,1.0,1.0,1.0,0.0,1.0
+kng_Latn,115,16,35,99,27473,0.313725,0.13913,0.192771,0.998728,1272.357132,0.13913
+koi_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+koo_Latn,54,50,0,4,27569,1.0,0.925926,0.961538,1.0,0.0,0.925926
+kor_Hang,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kqn_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+kqs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+kri_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+krl_Latn,183,1,0,182,27440,1.0,0.005464,0.01087,1.0,0.0,0.005464
+ktu_Latn,118,83,43,35,27462,0.65873,0.70339,0.680328,0.998437,1563.352118,0.70339
+kwi_Latn,145,114,1,31,27477,0.991304,0.786207,0.876923,0.999964,36.392751,0.786207
+lad_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+lat_Latn,118,116,1,2,27504,0.991453,0.983051,0.987234,0.999964,36.357026,0.983051
+lia_Latn,45,45,1,0,27577,0.978261,1.0,0.989011,0.999964,36.260788,1.0
+lij_Latn,58,58,22,0,27543,0.725,1.0,0.84058,0.999202,798.11355,1.0
+lin_Latn,110,110,0,0,27513,1.0,1.0,1.0,1.0,0.0,1.0
+lit_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+lld_Latn,59,34,1,25,27563,0.971429,0.576271,0.723404,0.999964,36.279205,0.576271
+lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+lob_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
+loz_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+ltz_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+lua_Latn,58,34,0,24,27565,1.0,0.586207,0.73913,1.0,0.0,0.586207
+lue_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+lug_Latn,49,49,0,0,27574,1.0,1.0,1.0,1.0,0.0,1.0
+lun_Latn,56,55,0,1,27567,1.0,0.982143,0.990991,1.0,0.0,0.982143
+lus_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
+lvs_Latn,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
+mad_Latn,60,58,6,2,27557,0.90625,0.966667,0.935484,0.999782,217.683126,0.966667
+mag_Deva,53,51,5,2,27565,0.910714,0.962264,0.93578,0.999819,181.356547,0.962264
+mah_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+mai_Deva,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
+mam_Latn,58,52,1,6,27564,0.981132,0.896552,0.936937,0.999964,36.277889,0.896552
+mar_Deva,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+maz_Latn,59,54,6,5,27558,0.9,0.915254,0.907563,0.999782,217.675229,0.915254
+mcd_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+mcf_Latn,62,62,1,0,27560,0.984127,1.0,0.992,0.999964,36.283154,1.0
+men_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
+mfq_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
+mic_Latn,59,16,0,43,27564,1.0,0.271186,0.426667,1.0,0.0,0.271186
+min_Latn,59,59,6,0,27558,0.907692,1.0,0.951613,0.999782,217.675229,1.0
+miq_Latn,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
+mkd_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+mlt_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+mnw_Mymr,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+mor_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+mos_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+mri_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+mto_Latn,51,0,5,51,27567,0.0,0.0,0.0,0.999819,181.343392,0.0
+mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+mxv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+mya_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+nan_Hani,48,0,19,48,27556,0.0,0.0,0.0,0.999311,689.029918,0.0
+nav_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+nba_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+nbl_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+ndo_Latn,58,57,4,1,27561,0.934426,0.982759,0.957983,0.999855,145.111555,0.982759
+nds_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+nio_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+niu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+njo_Latn,64,63,1,1,27558,0.984375,0.984375,0.984375,0.999964,36.285787,0.984375
+nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
+nld_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
+nno_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
+nob_Latn,62,62,3,0,27558,0.953846,1.0,0.976378,0.999891,108.849461,1.0
+not_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+npi_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
+nso_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nya_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
+nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
+nyn_Latn,50,48,0,2,27573,1.0,0.96,0.979592,1.0,0.0,0.96
+nzi_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+oci_Latn,398,92,0,306,27225,1.0,0.231156,0.37551,1.0,0.0,0.231156
+ojb_Cans,43,40,0,3,27580,1.0,0.930233,0.963855,1.0,0.0,0.930233
+oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+oss_Cyrl,44,44,1,0,27578,0.977778,1.0,0.988764,0.999964,36.259473,1.0
+ote_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+pam_Latn,66,66,0,0,27557,1.0,1.0,1.0,1.0,0.0,1.0
+pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+pap_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
+pau_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+pbb_Latn,56,31,9,25,27558,0.775,0.553571,0.645833,0.999674,326.47731,0.553571
+pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+pcd_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
+pcm_Latn,56,56,9,0,27558,0.861538,1.0,0.92562,0.999674,326.47731,1.0
+pis_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+plt_Latn,53,53,1,0,27569,0.981481,1.0,0.990654,0.999964,36.271309,1.0
+pnb_Arab,61,61,43,0,27519,0.586538,1.0,0.739394,0.99844,1560.119004,1.0
+pol_Latn,59,59,98,0,27466,0.375796,1.0,0.546296,0.996445,3555.362066,1.0
+pon_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+por_Latn,115,115,19,0,27489,0.858209,1.0,0.923695,0.999309,690.708158,1.0
+pov_Latn,115,82,0,33,27508,1.0,0.713043,0.832487,1.0,0.0,0.713043
+ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+quc_Latn,58,50,1,8,27564,0.980392,0.862069,0.917431,0.999964,36.277889,0.862069
+que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+qug_Latn,182,0,0,182,27441,0.0,0.0,0.0,1.0,0.0,0.0
+quh_Latn,57,55,2,2,27564,0.964912,0.964912,0.964912,0.999927,72.553145,0.964912
+quy_Latn,60,59,34,1,27529,0.634409,0.983333,0.771242,0.998766,1233.537714,0.983333
+quz_Latn,57,53,37,4,27529,0.588889,0.929825,0.721088,0.998658,1342.233186,0.929825
+qva_Latn,59,1,2,58,27562,0.333333,0.016949,0.032258,0.999927,72.55841,0.016949
+qvc_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
+qvh_Latn,58,5,3,53,27562,0.625,0.086207,0.151515,0.999891,108.833666,0.086207
+qvm_Latn,60,20,0,40,27563,1.0,0.333333,0.5,1.0,0.0,0.333333
+qvn_Latn,57,17,0,40,27566,1.0,0.298246,0.459459,1.0,0.0,0.298246
+qwh_Latn,59,36,15,23,27549,0.705882,0.610169,0.654545,0.999456,544.188071,0.610169
+qxn_Latn,57,1,0,56,27566,1.0,0.017544,0.034483,1.0,0.0,0.017544
+qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
+rar_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+rmn_Latn,116,87,0,29,27507,1.0,0.75,0.857143,1.0,0.0,0.75
+roh_Latn,399,399,1,0,27223,0.9975,1.0,0.998748,0.999963,36.732295,1.0
+ron_Latn,97,97,0,0,27526,1.0,1.0,1.0,1.0,0.0,1.0
+run_Latn,58,58,14,0,27551,0.805556,1.0,0.892308,0.999492,507.890441,1.0
+rup_Latn,57,57,4,0,27562,0.934426,1.0,0.966102,0.999855,145.10629,1.0
+rus_Cyrl,58,58,29,0,27536,0.666667,1.0,0.8,0.998948,1052.05877,1.0
+sag_Latn,59,24,0,35,27564,1.0,0.40678,0.578313,1.0,0.0,0.40678
+sah_Cyrl,57,57,63,0,27503,0.475,1.0,0.644068,0.997715,2285.424073,1.0
+san_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
+san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+sco_Latn,58,55,2,3,27563,0.964912,0.948276,0.956522,0.999927,72.555777,0.948276
+sey_Latn,61,58,102,3,27460,0.3625,0.95082,0.524887,0.996299,3700.747406,0.95082
+shk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+shp_Latn,62,52,0,10,27561,1.0,0.83871,0.912281,1.0,0.0,0.83871
+sid_Latn,57,57,11,0,27555,0.838235,1.0,0.912,0.999601,399.042298,1.0
+sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+skr_Arab,63,21,0,42,27560,1.0,0.333333,0.5,1.0,0.0,0.333333
+slk_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+slv_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
+sme_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+smo_Latn,63,63,0,0,27560,1.0,1.0,1.0,1.0,0.0,1.0
+sna_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+snn_Latn,136,47,0,89,27487,1.0,0.345588,0.513661,1.0,0.0,0.345588
+som_Latn,57,57,8,0,27558,0.876923,1.0,0.934426,0.99971,290.212581,1.0
+sot_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+spa_Latn,78,77,5,1,27540,0.939024,0.987179,0.9625,0.999818,181.521147,0.987179
+src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+srp_Cyrl,59,58,58,1,27506,0.5,0.983051,0.662857,0.997896,2104.193876,0.983051
+srp_Latn,59,18,3,41,27561,0.857143,0.305085,0.45,0.999891,108.837614,0.305085
+srr_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
+ssw_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+suk_Latn,58,57,42,1,27523,0.575758,0.982759,0.726115,0.998476,1523.671322,0.982759
+sun_Latn,66,65,0,1,27557,1.0,0.984848,0.992366,1.0,0.0,0.984848
+sus_Latn,58,58,9,0,27556,0.865672,1.0,0.928,0.999673,326.500998,1.0
+swb_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+swe_Latn,61,61,1,0,27561,0.983871,1.0,0.99187,0.999964,36.281837,1.0
+swh_Latn,58,56,5,2,27560,0.918033,0.965517,0.941176,0.999819,181.389443,0.965517
+tah_Latn,57,39,0,18,27566,1.0,0.684211,0.8125,1.0,0.0,0.684211
+taj_Deva,1,1,0,0,27622,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
+tat_Cyrl,57,57,17,0,27549,0.77027,1.0,0.870229,0.999383,616.701734,1.0
+tbz_Latn,60,14,0,46,27563,1.0,0.233333,0.378378,1.0,0.0,0.233333
+tca_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+tdt_Latn,57,48,52,9,27514,0.48,0.842105,0.611465,0.998114,1886.381775,0.842105
+tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tem_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+tet_Latn,58,6,9,52,27556,0.4,0.103448,0.164384,0.999673,326.500998,0.103448
+tgk_Cyrl,57,57,7,0,27559,0.890625,1.0,0.942149,0.999746,253.936008,1.0
+tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
+tha_Thai,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
+tir_Ethi,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tiv_Latn,67,67,2,0,27554,0.971014,1.0,0.985294,0.999927,72.579475,1.0
+tly_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+tob_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+toi_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+toj_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+ton_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+top_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+tpi_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tsn_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+tso_Latn,114,73,0,41,27509,1.0,0.640351,0.780749,1.0,0.0,0.640351
+tsz_Latn,59,57,11,2,27553,0.838235,0.966102,0.897638,0.999601,399.071252,0.966102
+tuk_Cyrl,57,57,6,0,27560,0.904762,1.0,0.95,0.999782,217.659436,1.0
+tuk_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+tur_Latn,59,59,36,0,27528,0.621053,1.0,0.766234,0.998694,1306.051371,1.0
+twi_Latn,116,116,1,0,27506,0.991453,1.0,0.995708,0.999964,36.354383,1.0
+tyv_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+tzh_Latn,25,25,1,0,27597,0.961538,1.0,0.980392,0.999964,36.23451,1.0
+tzm_Tfng,1,1,30,0,27592,0.032258,1.0,0.0625,0.998914,1086.090797,1.0
+tzo_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
+udu_Latn,60,60,9,0,27554,0.869565,1.0,0.930233,0.999673,326.524689,1.0
+uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Latn,59,59,31,0,27533,0.655556,1.0,0.791946,0.998875,1124.655348,1.0
+ukr_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+umb_Latn,107,105,0,2,27516,1.0,0.981308,0.990566,1.0,0.0,0.981308
+ura_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
+urd_Arab,108,106,1,2,27514,0.990654,0.981481,0.986047,0.999964,36.343812,0.981481
+uzn_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
+vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+vec_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
+ven_Latn,89,89,0,0,27534,1.0,1.0,1.0,1.0,0.0,1.0
+vep_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+vie_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+vmw_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
+war_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+wln_Latn,59,56,56,3,27508,0.5,0.949153,0.654971,0.997968,2031.635467,0.949153
+wol_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+wuu_Hani,48,47,125,1,27450,0.273256,0.979167,0.427273,0.995467,4533.091568,0.979167
+wwa_Latn,39,0,0,39,27584,0.0,0.0,0.0,1.0,0.0,0.0
+xho_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+xsm_Latn,59,58,45,1,27519,0.563107,0.983051,0.716049,0.998367,1632.564214,0.983051
+yad_Latn,55,53,0,2,27568,1.0,0.963636,0.981481,1.0,0.0,0.963636
+yao_Latn,52,51,0,1,27571,1.0,0.980769,0.990291,1.0,0.0,0.980769
+yap_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+yor_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
+yrk_Cyrl,55,52,3,3,27565,0.945455,0.945455,0.945455,0.999891,108.821822,0.945455
+yua_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+yue_Hani,49,20,0,29,27574,1.0,0.408163,0.57971,1.0,0.0,0.408163
+zam_Latn,60,0,5,60,27558,0.0,0.0,0.0,0.999819,181.402605,0.0
+zdj_Latn,50,49,44,1,27529,0.526882,0.98,0.685315,0.998404,1595.763972,0.98
+zgh_Tfng,60,18,0,42,27563,1.0,0.3,0.461538,1.0,0.0,0.3
+zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
+zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+zul_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
+zyb_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0

reports/udhr-all/glotlid@millid_summary.json

@@ -0,0 +1,17 @@
+{
+  "top1_accuracy": 0.7378271730080006,
+  "top3_accuracy": 0.7960395322738297,
+  "top5_accuracy": 0.8079498968251095,
+  "passages": 27623,
+  "languages": 429,
+  "macro_precision": 0.7425329775774382,
+  "macro_recall": 0.7380568437901042,
+  "macro_f1": 0.724506747472521,
+  "macro_specificity": 0.999809579502659,
+  "weighted_f1": 0.7305913692421664,
+  "median_f1": 0.9747899159663865,
+  "languages_f1_at_least_0_9": 272,
+  "languages_f1_below_0_5": 105,
+  "mean_fp_per_million": 190.42049734090864,
+  "micro_f1": 0.7378271730080006
+}

reports/udhr-all/glotlid_per_language.csv

@@ -0,0 +1,430 @@
+label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
+aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+abk_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+ace_Latn,61,60,0,1,27562,1.0,0.983607,0.991736,1.0,0.0,0.983607
+acu_Latn,180,134,0,46,27443,1.0,0.744444,0.853503,1.0,0.0,0.744444
+ada_Latn,59,59,8,0,27556,0.880597,1.0,0.936508,0.99971,290.233638,1.0
+ady_Cyrl,56,54,0,2,27567,1.0,0.964286,0.981818,1.0,0.0,0.964286
+afr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+agr_Latn,57,56,2,1,27564,0.965517,0.982456,0.973913,0.999927,72.553145,0.982456
+aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+ajg_Latn,59,59,59,0,27505,0.5,1.0,0.666667,0.99786,2140.473081,1.0
+als_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
+alt_Cyrl,51,51,4,0,27568,0.927273,1.0,0.962264,0.999855,145.074713,1.0
+amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+ame_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+amh_Ethi,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
+ami_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
+amr_Latn,61,61,3,0,27559,0.953125,1.0,0.976,0.999891,108.845512,1.0
+arb_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+arl_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+arn_Latn,58,47,0,11,27565,1.0,0.810345,0.895238,1.0,0.0,0.810345
+ast_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+auc_Latn,154,0,0,154,27469,0.0,0.0,0.0,1.0,0.0,0.0
+ayr_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Cyrl,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+bam_Latn,57,50,34,7,27532,0.595238,0.877193,0.70922,0.998767,1233.403468,0.877193
+ban_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+bba_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
+bci_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bcl_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+bel_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bem_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
+bho_Deva,56,49,0,7,27567,1.0,0.875,0.933333,1.0,0.0,0.875
+bin_Latn,47,41,0,6,27576,1.0,0.87234,0.931818,1.0,0.0,0.87234
+bis_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
+boa_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+bod_Tibt,60,50,1,10,27562,0.980392,0.833333,0.900901,0.999964,36.280521,0.833333
+bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+bos_Latn,59,27,87,32,27477,0.236842,0.457627,0.312139,0.996844,3156.290814,0.457627
+bre_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+bug_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+bul_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bum_Latn,58,3,1,55,27564,0.75,0.051724,0.096774,0.999964,36.277889,0.051724
+cab_Latn,60,58,0,2,27563,1.0,0.966667,0.983051,1.0,0.0,0.966667
+cak_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+cat_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+cbi_Latn,62,61,1,1,27560,0.983871,0.983871,0.983871,0.999964,36.283154,0.983871
+cbr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+cbs_Latn,43,41,10,2,27570,0.803922,0.953488,0.87234,0.999637,362.581581,0.953488
+cbt_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+cbu_Latn,57,45,0,12,27566,1.0,0.789474,0.882353,1.0,0.0,0.789474
+ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+ceb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+ces_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+cfm_Latn,57,55,1,2,27565,0.982143,0.964912,0.973451,0.999964,36.276573,0.964912
+cha_Latn,57,49,1,8,27565,0.98,0.859649,0.915888,0.999964,36.276573,0.859649
+chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+chk_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+chr_Cher,115,57,0,58,27508,1.0,0.495652,0.662791,1.0,0.0,0.495652
+chv_Cyrl,25,25,4,0,27594,0.862069,1.0,0.925926,0.999855,144.938039,1.0
+cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+cjk_Latn,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
+cjs_Cyrl,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
+cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
+cmn_Hani,319,293,175,26,27129,0.626068,0.918495,0.7446,0.993591,6409.317316,0.918495
+cnh_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+cni_Latn,52,52,4,0,27567,0.928571,1.0,0.962963,0.999855,145.079975,1.0
+cnr_Latn,59,1,6,58,27558,0.142857,0.016949,0.030303,0.999782,217.675229,0.016949
+cof_Latn,59,51,0,8,27564,1.0,0.864407,0.927273,1.0,0.0,0.864407
+cos_Latn,59,58,1,1,27563,0.983051,0.983051,0.983051,0.999964,36.279205,0.983051
+cot_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
+cpu_Latn,60,57,0,3,27563,1.0,0.95,0.974359,1.0,0.0,0.95
+crh_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+cri_Latn,58,36,0,22,27565,1.0,0.62069,0.765957,1.0,0.0,0.62069
+crs_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
+ctd_Latn,60,32,0,28,27563,1.0,0.533333,0.695652,1.0,0.0,0.533333
+cym_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+dag_Latn,57,56,24,1,27542,0.7,0.982456,0.817518,0.999129,870.637742,0.982456
+dan_Latn,61,59,0,2,27562,1.0,0.967213,0.983333,1.0,0.0,0.967213
+ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+deu_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
+dga_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+div_Thaa,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+dje_Latn,54,48,10,6,27559,0.827586,0.888889,0.857143,0.999637,362.72625,0.888889
+duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+dyo_Latn,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
+dyu_Latn,58,18,10,40,27555,0.642857,0.310345,0.418605,0.999637,362.778886,0.310345
+dzo_Tibt,59,58,10,1,27554,0.852941,0.983051,0.913386,0.999637,362.792048,0.983051
+ekk_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+ell_Grek,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
+emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+eng_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+epo_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+ese_Latn,35,34,0,1,27588,1.0,0.971429,0.985507,1.0,0.0,0.971429
+eus_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+eve_Cyrl,49,39,111,10,27463,0.26,0.795918,0.39196,0.995974,4025.531298,0.795918
+evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+ewe_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fao_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+fas_Arab,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
+fat_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
+fij_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fil_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+fin_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+fkv_Latn,58,29,0,29,27565,1.0,0.5,0.666667,1.0,0.0,0.5
+fon_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+fra_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+fry_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+fuf_Latn,58,21,8,37,27557,0.724138,0.362069,0.482759,0.99971,290.223109,0.362069
+fur_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fuv_Latn,108,62,12,46,27503,0.837838,0.574074,0.681319,0.999564,436.12575,0.574074
+fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+gaa_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
+gag_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
+gaz_Latn,60,59,2,1,27561,0.967213,0.983333,0.975207,0.999927,72.561042,0.983333
+gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+gjn_Latn,60,58,7,2,27556,0.892308,0.966667,0.928,0.999746,253.963647,0.966667
+gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+gla_Latn,62,60,0,2,27561,1.0,0.967742,0.983607,1.0,0.0,0.967742
+gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+gle_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
+glg_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+glv_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+gsw_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+guc_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+gug_Latn,49,49,1,0,27573,0.98,1.0,0.989899,0.999964,36.266048,1.0
+guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+guu_Latn,58,0,4,58,27561,0.0,0.0,0.0,0.999855,145.111555,0.0
+gyr_Latn,49,48,0,1,27574,1.0,0.979592,0.989691,1.0,0.0,0.979592
+hak_Hani,48,1,1,47,27574,0.5,0.020833,0.04,0.999964,36.264733,0.020833
+hat_Latn,117,114,2,3,27504,0.982759,0.974359,0.978541,0.999927,72.711408,0.974359
+hau_Latn,155,155,1,0,27467,0.99359,1.0,0.996785,0.999964,36.406,1.0
+haw_Latn,58,55,0,3,27565,1.0,0.948276,0.973451,1.0,0.0,0.948276
+hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+heb_Hebr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+hil_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+hin_Deva,59,56,2,3,27562,0.965517,0.949153,0.957265,0.999927,72.55841,0.949153
+hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+hnj_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+hns_Latn,59,52,0,7,27564,1.0,0.881356,0.936937,1.0,0.0,0.881356
+hrv_Latn,58,56,40,2,27525,0.583333,0.965517,0.727273,0.998549,1451.115545,0.965517
+hsb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
+hun_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+hus_Latn,175,170,0,5,27448,1.0,0.971429,0.985507,1.0,0.0,0.971429
+huu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+hye_Armn,70,70,0,0,27553,1.0,1.0,1.0,1.0,0.0,1.0
+ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
+ibo_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+ido_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+idu_Latn,51,40,0,11,27572,1.0,0.784314,0.879121,1.0,0.0,0.784314
+iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
+ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
+ike_Cans,44,44,2,0,27577,0.956522,1.0,0.977778,0.999927,72.518946,1.0
+ilo_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+ina_Latn,58,58,19,0,27546,0.753247,1.0,0.859259,0.999311,689.279884,1.0
+ind_Latn,60,51,3,9,27560,0.944444,0.85,0.894737,0.999891,108.841563,0.85
+isl_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+ita_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
+jav_Java,60,57,0,3,27563,1.0,0.95,0.974359,1.0,0.0,0.95
+jav_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
+jiv_Latn,60,59,29,1,27534,0.670455,0.983333,0.797297,0.998948,1052.135109,0.983333
+jpn_Jpan,140,140,3,0,27480,0.979021,1.0,0.989399,0.999891,109.158389,1.0
+kaa_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kab_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+kal_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kaz_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kbd_Cyrl,55,55,3,0,27565,0.948276,1.0,0.973451,0.999891,108.821822,1.0
+kbp_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+kbr_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+kde_Latn,51,49,1,2,27571,0.98,0.960784,0.970297,0.999964,36.268678,0.960784
+kdh_Latn,59,45,0,14,27564,1.0,0.762712,0.865385,1.0,0.0,0.762712
+kea_Latn,58,58,28,0,27537,0.674419,1.0,0.805556,0.998984,1015.780882,1.0
+kek_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+kha_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+khk_Cyrl,57,56,3,1,27563,0.949153,0.982456,0.965517,0.999891,108.829718,0.982456
+khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+kin_Latn,59,47,0,12,27564,1.0,0.79661,0.886792,1.0,0.0,0.79661
+kir_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kjh_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+kmb_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
+kmr_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+knc_Latn,64,64,0,0,27559,1.0,1.0,1.0,1.0,0.0,1.0
+kng_Latn,115,16,35,99,27473,0.313725,0.13913,0.192771,0.998728,1272.357132,0.13913
+koi_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+koo_Latn,54,50,0,4,27569,1.0,0.925926,0.961538,1.0,0.0,0.925926
+kor_Hang,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kqn_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+kqs_Latn,58,39,0,19,27565,1.0,0.672414,0.804124,1.0,0.0,0.672414
+kri_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+krl_Latn,183,1,0,182,27440,1.0,0.005464,0.01087,1.0,0.0,0.005464
+ktu_Latn,118,83,43,35,27462,0.65873,0.70339,0.680328,0.998437,1563.352118,0.70339
+kwi_Latn,145,114,1,31,27477,0.991304,0.786207,0.876923,0.999964,36.392751,0.786207
+lad_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+lat_Latn,118,116,1,2,27504,0.991453,0.983051,0.987234,0.999964,36.357026,0.983051
+lia_Latn,45,45,1,0,27577,0.978261,1.0,0.989011,0.999964,36.260788,1.0
+lij_Latn,58,58,22,0,27543,0.725,1.0,0.84058,0.999202,798.11355,1.0
+lin_Latn,110,110,0,0,27513,1.0,1.0,1.0,1.0,0.0,1.0
+lit_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+lld_Latn,59,34,0,25,27564,1.0,0.576271,0.731183,1.0,0.0,0.576271
+lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+lob_Latn,58,55,13,3,27552,0.808824,0.948276,0.873016,0.999528,471.612552,0.948276
+lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
+loz_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+ltz_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+lua_Latn,58,34,0,24,27565,1.0,0.586207,0.73913,1.0,0.0,0.586207
+lue_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+lug_Latn,49,49,0,0,27574,1.0,1.0,1.0,1.0,0.0,1.0
+lun_Latn,56,55,0,1,27567,1.0,0.982143,0.990991,1.0,0.0,0.982143
+lus_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+lvs_Latn,115,115,0,0,27508,1.0,1.0,1.0,1.0,0.0,1.0
+mad_Latn,60,58,4,2,27559,0.935484,0.966667,0.95082,0.999855,145.122084,0.966667
+mag_Deva,53,51,5,2,27565,0.910714,0.962264,0.93578,0.999819,181.356547,0.962264
+mah_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+mai_Deva,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
+mam_Latn,58,52,1,6,27564,0.981132,0.896552,0.936937,0.999964,36.277889,0.896552
+mar_Deva,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+maz_Latn,59,54,5,5,27559,0.915254,0.915254,0.915254,0.999819,181.396024,0.915254
+mcd_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+mcf_Latn,62,62,1,0,27560,0.984127,1.0,0.992,0.999964,36.283154,1.0
+men_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+mfq_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
+mic_Latn,59,16,0,43,27564,1.0,0.271186,0.426667,1.0,0.0,0.271186
+min_Latn,59,59,6,0,27558,0.907692,1.0,0.951613,0.999782,217.675229,1.0
+miq_Latn,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
+mkd_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+mlt_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+mnw_Mymr,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+mor_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+mos_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+mri_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+mto_Latn,51,0,5,51,27567,0.0,0.0,0.0,0.999819,181.343392,0.0
+mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+mxv_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+mya_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+nan_Hani,48,0,4,48,27571,0.0,0.0,0.0,0.999855,145.05893,0.0
+nav_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+nba_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+nbl_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+ndo_Latn,58,57,4,1,27561,0.934426,0.982759,0.957983,0.999855,145.111555,0.982759
+nds_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+nio_Cyrl,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
+niu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+njo_Latn,64,63,1,1,27558,0.984375,0.984375,0.984375,0.999964,36.285787,0.984375
+nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
+nld_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nno_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+nob_Latn,62,62,3,0,27558,0.953846,1.0,0.976378,0.999891,108.849461,1.0
+not_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+npi_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
+nso_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nya_Latn,116,116,0,0,27507,1.0,1.0,1.0,1.0,0.0,1.0
+nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
+nyn_Latn,50,48,0,2,27573,1.0,0.96,0.979592,1.0,0.0,0.96
+nzi_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+oci_Latn,398,92,0,306,27225,1.0,0.231156,0.37551,1.0,0.0,0.231156
+ojb_Cans,43,40,0,3,27580,1.0,0.930233,0.963855,1.0,0.0,0.930233
+oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+oss_Cyrl,44,44,1,0,27578,0.977778,1.0,0.988764,0.999964,36.259473,1.0
+ote_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+pam_Latn,66,66,0,0,27557,1.0,1.0,1.0,1.0,0.0,1.0
+pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+pap_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
+pau_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+pbb_Latn,56,31,9,25,27558,0.775,0.553571,0.645833,0.999674,326.47731,0.553571
+pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+pcd_Latn,58,0,2,58,27563,0.0,0.0,0.0,0.999927,72.555777,0.0
+pcm_Latn,56,55,8,1,27559,0.873016,0.982143,0.92437,0.99971,290.202053,0.982143
+pis_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+plt_Latn,53,53,0,0,27570,1.0,1.0,1.0,1.0,0.0,1.0
+pnb_Arab,61,61,43,0,27519,0.586538,1.0,0.739394,0.99844,1560.119004,1.0
+pol_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+pon_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+por_Latn,115,115,3,0,27505,0.974576,1.0,0.987124,0.999891,109.059183,1.0
+pov_Latn,115,82,0,33,27508,1.0,0.713043,0.832487,1.0,0.0,0.713043
+ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+quc_Latn,58,50,1,8,27564,0.980392,0.862069,0.917431,0.999964,36.277889,0.862069
+que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+qug_Latn,182,0,0,182,27441,0.0,0.0,0.0,1.0,0.0,0.0
+quh_Latn,57,52,2,5,27564,0.962963,0.912281,0.936937,0.999927,72.553145,0.912281
+quy_Latn,60,59,34,1,27529,0.634409,0.983333,0.771242,0.998766,1233.537714,0.983333
+quz_Latn,57,51,36,6,27530,0.586207,0.894737,0.708333,0.998694,1305.956613,0.894737
+qva_Latn,59,1,2,58,27562,0.333333,0.016949,0.032258,0.999927,72.55841,0.016949
+qvc_Latn,58,58,12,0,27553,0.828571,1.0,0.90625,0.999565,435.334664,1.0
+qvh_Latn,58,5,3,53,27562,0.625,0.086207,0.151515,0.999891,108.833666,0.086207
+qvm_Latn,60,20,0,40,27563,1.0,0.333333,0.5,1.0,0.0,0.333333
+qvn_Latn,57,17,0,40,27566,1.0,0.298246,0.459459,1.0,0.0,0.298246
+qwh_Latn,59,36,15,23,27549,0.705882,0.610169,0.654545,0.999456,544.188071,0.610169
+qxn_Latn,57,1,0,56,27566,1.0,0.017544,0.034483,1.0,0.0,0.017544
+qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
+rar_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+rmn_Latn,116,87,0,29,27507,1.0,0.75,0.857143,1.0,0.0,0.75
+roh_Latn,399,399,1,0,27223,0.9975,1.0,0.998748,0.999963,36.732295,1.0
+ron_Latn,97,97,0,0,27526,1.0,1.0,1.0,1.0,0.0,1.0
+run_Latn,58,58,14,0,27551,0.805556,1.0,0.892308,0.999492,507.890441,1.0
+rup_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
+rus_Cyrl,58,58,29,0,27536,0.666667,1.0,0.8,0.998948,1052.05877,1.0
+sag_Latn,59,24,0,35,27564,1.0,0.40678,0.578313,1.0,0.0,0.40678
+sah_Cyrl,57,57,63,0,27503,0.475,1.0,0.644068,0.997715,2285.424073,1.0
+san_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
+san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+sco_Latn,58,55,2,3,27563,0.964912,0.948276,0.956522,0.999927,72.555777,0.948276
+sey_Latn,61,56,101,5,27461,0.356688,0.918033,0.513761,0.996336,3664.465569,0.918033
+shk_Latn,55,47,0,8,27568,1.0,0.854545,0.921569,1.0,0.0,0.854545
+shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+shp_Latn,62,52,0,10,27561,1.0,0.83871,0.912281,1.0,0.0,0.83871
+sid_Latn,57,57,11,0,27555,0.838235,1.0,0.912,0.999601,399.042298,1.0
+sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+skr_Arab,63,21,0,42,27560,1.0,0.333333,0.5,1.0,0.0,0.333333
+slk_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+slv_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
+sme_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+smo_Latn,63,63,0,0,27560,1.0,1.0,1.0,1.0,0.0,1.0
+sna_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+snn_Latn,136,47,0,89,27487,1.0,0.345588,0.513661,1.0,0.0,0.345588
+som_Latn,57,57,8,0,27558,0.876923,1.0,0.934426,0.99971,290.212581,1.0
+sot_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+spa_Latn,78,77,2,1,27543,0.974684,0.987179,0.980892,0.999927,72.608459,0.987179
+src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+srp_Cyrl,59,58,58,1,27506,0.5,0.983051,0.662857,0.997896,2104.193876,0.983051
+srp_Latn,59,18,3,41,27561,0.857143,0.305085,0.45,0.999891,108.837614,0.305085
+srr_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
+ssw_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+suk_Latn,58,57,42,1,27523,0.575758,0.982759,0.726115,0.998476,1523.671322,0.982759
+sun_Latn,66,65,0,1,27557,1.0,0.984848,0.992366,1.0,0.0,0.984848
+sus_Latn,58,58,9,0,27556,0.865672,1.0,0.928,0.999673,326.500998,1.0
+swb_Latn,58,57,13,1,27552,0.814286,0.982759,0.890625,0.999528,471.612552,0.982759
+swe_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+swh_Latn,58,56,3,2,27562,0.949153,0.965517,0.957265,0.999891,108.833666,0.965517
+tah_Latn,57,39,0,18,27566,1.0,0.684211,0.8125,1.0,0.0,0.684211
+taj_Deva,1,1,0,0,27622,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
+tat_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+tbz_Latn,60,14,0,46,27563,1.0,0.233333,0.378378,1.0,0.0,0.233333
+tca_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+tdt_Latn,57,48,52,9,27514,0.48,0.842105,0.611465,0.998114,1886.381775,0.842105
+tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tem_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+tet_Latn,58,6,8,52,27557,0.428571,0.103448,0.166667,0.99971,290.223109,0.103448
+tgk_Cyrl,57,57,7,0,27559,0.890625,1.0,0.942149,0.999746,253.936008,1.0
+tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
+tha_Thai,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
+tir_Ethi,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tiv_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
+tly_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+tob_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+toi_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+toj_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+ton_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+top_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+tpi_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tsn_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+tso_Latn,114,73,0,41,27509,1.0,0.640351,0.780749,1.0,0.0,0.640351
+tsz_Latn,59,56,11,3,27553,0.835821,0.949153,0.888889,0.999601,399.071252,0.949153
+tuk_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+tuk_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+tur_Latn,59,59,35,0,27529,0.62766,1.0,0.771242,0.99873,1269.772167,1.0
+twi_Latn,116,116,1,0,27506,0.991453,1.0,0.995708,0.999964,36.354383,1.0
+tyv_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+tzh_Latn,25,25,1,0,27597,0.961538,1.0,0.980392,0.999964,36.23451,1.0
+tzm_Tfng,1,1,30,0,27592,0.032258,1.0,0.0625,0.998914,1086.090797,1.0
+tzo_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
+udu_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Latn,59,59,26,0,27538,0.694118,1.0,0.819444,0.999057,943.259324,1.0
+ukr_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+umb_Latn,107,105,0,2,27516,1.0,0.981308,0.990566,1.0,0.0,0.981308
+ura_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
+urd_Arab,108,106,1,2,27514,0.990654,0.981481,0.986047,0.999964,36.343812,0.981481
+uzn_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
+vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+vec_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
+ven_Latn,89,89,0,0,27534,1.0,1.0,1.0,1.0,0.0,1.0
+vep_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+vie_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+vmw_Latn,58,56,1,2,27564,0.982456,0.965517,0.973913,0.999964,36.277889,0.965517
+war_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+wln_Latn,59,56,56,3,27508,0.5,0.949153,0.654971,0.997968,2031.635467,0.949153
+wol_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+wuu_Hani,48,47,123,1,27452,0.276471,0.979167,0.431193,0.995539,4460.562103,0.979167
+wwa_Latn,39,39,2,0,27582,0.95122,1.0,0.975,0.999927,72.5058,1.0
+xho_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+xsm_Latn,59,58,7,1,27557,0.892308,0.983051,0.935484,0.999746,253.954433,0.983051
+yad_Latn,55,53,0,2,27568,1.0,0.963636,0.981481,1.0,0.0,0.963636
+yao_Latn,52,51,0,1,27571,1.0,0.980769,0.990291,1.0,0.0,0.980769
+yap_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+yor_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
+yrk_Cyrl,55,52,1,3,27567,0.981132,0.945455,0.962963,0.999964,36.273941,0.945455
+yua_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+yue_Hani,49,20,0,29,27574,1.0,0.408163,0.57971,1.0,0.0,0.408163
+zam_Latn,60,0,5,60,27558,0.0,0.0,0.0,0.999819,181.402605,0.0
+zdj_Latn,50,48,1,2,27572,0.979592,0.96,0.969697,0.999964,36.267363,0.96
+zgh_Tfng,60,18,0,42,27563,1.0,0.3,0.461538,1.0,0.0,0.3
+zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
+zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+zul_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
+zyb_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0

reports/udhr-all/glotlid_summary.json

@@ -0,0 +1,17 @@
+{
+  "top1_accuracy": 0.750244361582739,
+  "top3_accuracy": 0.8144662056981501,
+  "top5_accuracy": 0.8281866560474966,
+  "passages": 27623,
+  "languages": 429,
+  "macro_precision": 0.7694575973118034,
+  "macro_recall": 0.7529055089081532,
+  "macro_f1": 0.7454327849166208,
+  "macro_specificity": 0.9998410395298513,
+  "weighted_f1": 0.7485822543592835,
+  "median_f1": 0.9795918367346939,
+  "languages_f1_at_least_0_9": 277,
+  "languages_f1_below_0_5": 97,
+  "mean_fp_per_million": 158.96047014874904,
+  "micro_f1": 0.750244361582739
+}

reports/udhr-all/leaderboard.csv

@@ -0,0 +1,430 @@
+label,language,support,millid_f1,millid_precision,millid_recall,glotlid_f1,glotlid_precision,glotlid_recall,glotlid@millid_f1,glotlid@millid_precision,glotlid@millid_recall,delta,winner
+roh_Latn,Romansh,399,0.9912,0.9975,0.985,0.9987,0.9975,1.0,0.9987,0.9975,1.0,-0.0076,tie
+oci_Latn,Occitan,398,0.3299,0.9753,0.1985,0.3755,1.0,0.2312,0.3755,1.0,0.2312,-0.0457,GlotLID
+cmn_Hani,Chinese (Mandarin),319,0.7753,0.649,0.9624,0.7446,0.6261,0.9185,0.7446,0.6261,0.9185,0.0307,MillID
+krl_Latn,Karelian,183,0.0,0.0,0.0,0.0109,1.0,0.0055,0.0109,1.0,0.0055,-0.0109,GlotLID
+qug_Latn,Chimborazo Highland Quichua,182,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+acu_Latn,Achuar-Shiwiar,180,0.7474,0.9908,0.6,0.8535,1.0,0.7444,0.8535,1.0,0.7444,-0.1061,GlotLID
+hus_Latn,Huastec,175,0.9914,1.0,0.9829,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0058,tie
+hau_Latn,Hausa,155,0.9936,0.9873,1.0,0.9968,0.9936,1.0,0.9968,0.9936,1.0,-0.0032,tie
+auc_Latn,Waorani,154,0.0503,0.8,0.026,0.0,0.0,0.0,0.0,0.0,0.0,0.0503,MillID
+kwi_Latn,Awa-Cuaiquer,145,0.775,0.9789,0.6414,0.8769,0.9913,0.7862,0.8769,0.9913,0.7862,-0.1019,GlotLID
+lot_Latn,lot_Latn,140,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+jpn_Jpan,Japanese,140,1.0,1.0,1.0,0.9894,0.979,1.0,0.9859,0.9722,1.0,0.0141,MillID
+snn_Latn,Siona,136,0.7731,0.902,0.6765,0.5137,1.0,0.3456,0.5137,1.0,0.3456,0.2594,MillID
+lat_Latn,Latin,118,0.9916,0.9833,1.0,0.9872,0.9915,0.9831,0.9872,0.9915,0.9831,0.0044,tie
+ktu_Latn,Kituba (Democratic Republic of Congo),118,0.7687,0.6626,0.9153,0.6803,0.6587,0.7034,0.6803,0.6587,0.7034,0.0884,MillID
+hat_Latn,Haitian Creole,117,0.9914,1.0,0.9829,0.9785,0.9828,0.9744,0.9785,0.9828,0.9744,0.0128,MillID
+nya_Latn,Nyanja,116,0.9871,0.9829,0.9914,1.0,1.0,1.0,1.0,1.0,1.0,-0.0129,GlotLID
+twi_Latn,Twi,116,0.9871,0.9829,0.9914,0.9957,0.9915,1.0,0.9957,0.9915,1.0,-0.0086,tie
+kmb_Latn,Kimbundu,116,0.9787,0.9664,0.9914,1.0,1.0,1.0,1.0,1.0,1.0,-0.0213,GlotLID
+rmn_Latn,Balkan Romani,116,0.6667,1.0,0.5,0.8571,1.0,0.75,0.8571,1.0,0.75,-0.1905,GlotLID
+kng_Latn,Koongo,115,0.0469,0.2308,0.0261,0.1928,0.3137,0.1391,0.1928,0.3137,0.1391,-0.1459,GlotLID
+pov_Latn,Upper Guinea Crioulo,115,0.8384,1.0,0.7217,0.8325,1.0,0.713,0.8325,1.0,0.713,0.0059,tie
+chr_Cher,Cherokee,115,0.7151,1.0,0.5565,0.6628,1.0,0.4957,0.6628,1.0,0.4957,0.0523,MillID
+lvs_Latn,Standard Latvian,115,0.9957,0.9914,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0043,tie
+ell_Grek,Greek,115,0.655,1.0,0.487,1.0,1.0,1.0,1.0,1.0,1.0,-0.345,GlotLID
+por_Latn,Portuguese,115,0.9957,0.9914,1.0,0.9871,0.9746,1.0,0.9237,0.8582,1.0,0.072,MillID
+fas_Arab,Persian,114,0.9912,1.0,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,-0.0088,tie
+tso_Latn,Tsonga,114,0.8768,1.0,0.7807,0.7807,1.0,0.6404,0.7807,1.0,0.6404,0.0961,MillID
+tha_Thai,Thai,114,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+cjk_Latn,Chokwe,114,0.9493,1.0,0.9035,1.0,1.0,1.0,1.0,1.0,1.0,-0.0507,GlotLID
+lin_Latn,Lingala,110,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+urd_Arab,Urdu,108,0.9953,1.0,0.9907,0.986,0.9907,0.9815,0.986,0.9907,0.9815,0.0093,tie
+fuv_Latn,Nigerian Fulfulde,108,0.3678,0.4848,0.2963,0.6813,0.8378,0.5741,0.6848,0.8289,0.5833,-0.317,GlotLID
+umb_Latn,Umbundu,107,0.8737,1.0,0.7757,0.9906,1.0,0.9813,0.9906,1.0,0.9813,-0.1169,GlotLID
+mal_Mlym,Malayalam,100,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ron_Latn,Romanian,97,0.9949,0.9898,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0051,tie
+ven_Latn,Venda,89,0.9727,0.9468,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0273,GlotLID
+spa_Latn,Spanish,78,0.9872,0.9872,0.9872,0.9809,0.9747,0.9872,0.9625,0.939,0.9872,0.0247,MillID
+hye_Armn,Armenian,70,0.9928,1.0,0.9857,1.0,1.0,1.0,1.0,1.0,1.0,-0.0072,tie
+tam_Taml,Tamil,68,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tiv_Latn,Tiv,67,0.9926,0.9853,1.0,1.0,1.0,1.0,0.9853,0.971,1.0,0.0073,tie
+deu_Latn,German,67,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ibb_Latn,ibb_Latn,67,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+sun_Latn,Sundanese,66,0.9767,1.0,0.9545,0.9924,1.0,0.9848,0.9924,1.0,0.9848,-0.0156,GlotLID
+pam_Latn,Pampanga,66,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+njo_Latn,Ao Naga,64,0.9846,0.9697,1.0,0.9844,0.9844,0.9844,0.9844,0.9844,0.9844,0.0002,tie
+knc_Latn,Central Kanuri,64,0.9846,0.9697,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0154,GlotLID
+skr_Arab,Saraiki,63,0.9231,1.0,0.8571,0.5,1.0,0.3333,0.5,1.0,0.3333,0.4231,MillID
+smo_Latn,Samoan,63,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+mcf_Latn,Matsés,62,1.0,1.0,1.0,0.992,0.9841,1.0,0.992,0.9841,1.0,0.008,tie
+shp_Latn,Shipibo-Conibo,62,0.4103,1.0,0.2581,0.9123,1.0,0.8387,0.9123,1.0,0.8387,-0.502,GlotLID
+cbi_Latn,Chachi,62,1.0,1.0,1.0,0.9839,0.9839,0.9839,0.976,0.9683,0.9839,0.024,MillID
+nob_Latn,Norwegian Bokmål,62,0.9516,0.9516,0.9516,0.9764,0.9538,1.0,0.9764,0.9538,1.0,-0.0248,GlotLID
+gla_Latn,Scottish Gaelic,62,0.9683,0.9531,0.9839,0.9836,1.0,0.9677,0.9836,1.0,0.9677,-0.0154,GlotLID
+swe_Latn,Swedish,61,1.0,1.0,1.0,1.0,1.0,1.0,0.9919,0.9839,1.0,0.0081,tie
+sey_Latn,Secoya,61,0.5839,0.5263,0.6557,0.5138,0.3567,0.918,0.5249,0.3625,0.9508,0.0591,MillID
+fin_Latn,Finnish,61,0.9836,0.9836,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,-0.0164,GlotLID
+pnb_Arab,Western Panjabi,61,0.9313,0.8714,1.0,0.7394,0.5865,1.0,0.7394,0.5865,1.0,0.1919,MillID
+amr_Latn,Amarakaeri,61,1.0,1.0,1.0,0.976,0.9531,1.0,0.976,0.9531,1.0,0.024,MillID
+ace_Latn,Acehnese,61,0.9833,1.0,0.9672,0.9917,1.0,0.9836,0.9917,1.0,0.9836,-0.0084,tie
+dan_Latn,Danish,61,0.9587,0.9667,0.9508,0.9833,1.0,0.9672,0.9833,1.0,0.9672,-0.0247,GlotLID
+boa_Latn,Bora,61,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+vai_Vaii,vai_Vaii,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+wol_Latn,Wolof,60,0.8889,0.8,1.0,0.9836,0.9677,1.0,0.9836,0.9677,1.0,-0.0947,GlotLID
+fil_Latn,Filipino,60,0.9916,1.0,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+mad_Latn,Madurese,60,0.9655,1.0,0.9333,0.9508,0.9355,0.9667,0.9355,0.9062,0.9667,0.03,MillID
+war_Latn,Waray,60,1.0,1.0,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.0083,tie
+ban_Latn,Balinese,60,0.9831,1.0,0.9667,1.0,1.0,1.0,1.0,1.0,1.0,-0.0169,GlotLID
+tca_Latn,Ticuna,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ton_Latn,Tongan,60,1.0,1.0,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.0083,tie
+zam_Latn,Miahuatlán Zapotec,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+zgh_Tfng,Standard Moroccan Tamazight,60,0.8235,1.0,0.7,0.4615,1.0,0.3,0.4615,1.0,0.3,0.362,MillID
+tbz_Latn,Ditammari,60,0.3333,1.0,0.2,0.3784,1.0,0.2333,0.3784,1.0,0.2333,-0.045,GlotLID
+cab_Latn,Garifuna,60,0.9836,0.9677,1.0,0.9831,1.0,0.9667,0.9831,1.0,0.9667,0.0006,tie
+cic_Latn,cic_Latn,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+cbr_Latn,Cashibo-Cacataibo,60,0.9917,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0083,tie
+bod_Tibt,Tibetan,60,0.9748,0.9831,0.9667,0.9009,0.9804,0.8333,0.9009,0.9804,0.8333,0.0739,MillID
+bug_Latn,Buginese,60,0.9492,0.9655,0.9333,0.9917,0.9836,1.0,0.9917,0.9836,1.0,-0.0426,GlotLID
+sna_Latn,Shona,60,0.9836,0.9677,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,-0.0081,tie
+jav_Java,jav_Java,60,0.0,0.0,0.0,0.9744,1.0,0.95,0.0,0.0,0.0,0.0,tie
+afr_Latn,Afrikaans,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+arl_Latn,Arabela,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+udu_Latn,Uduk,60,0.9836,0.9677,1.0,0.9836,0.9677,1.0,0.9302,0.8696,1.0,0.0534,MillID
+vie_Latn,Vietnamese,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+mcd_Latn,Sharanahua,60,1.0,1.0,1.0,0.9836,0.9677,1.0,0.9836,0.9677,1.0,0.0164,MillID
+jav_Latn,Javanese,60,0.9672,0.9516,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,-0.0244,GlotLID
+jiv_Latn,Shuar,60,0.7066,0.5514,0.9833,0.7973,0.6705,0.9833,0.7973,0.6705,0.9833,-0.0907,GlotLID
+gjn_Latn,Gonja,60,0.9916,1.0,0.9833,0.928,0.8923,0.9667,0.928,0.8923,0.9667,0.0636,MillID
+gaz_Latn,Oromo (West Central),60,0.9916,1.0,0.9833,0.9752,0.9672,0.9833,0.9752,0.9672,0.9833,0.0164,MillID
+quy_Latn,Ayacucho Quechua,60,0.6667,0.5185,0.9333,0.7712,0.6344,0.9833,0.7712,0.6344,0.9833,-0.1046,GlotLID
+qvm_Latn,Margos-Yarowilca-Lauricocha Quechua,60,0.0938,0.75,0.05,0.5,1.0,0.3333,0.5,1.0,0.3333,-0.4062,GlotLID
+ctd_Latn,Tedim Chin,60,0.7879,1.0,0.65,0.6957,1.0,0.5333,0.7234,1.0,0.5667,0.0645,MillID
+cot_Latn,Caquinte,60,0.9831,1.0,0.9667,0.9916,1.0,0.9833,0.9916,1.0,0.9833,-0.0085,tie
+cym_Latn,Welsh,60,0.9917,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0083,tie
+cpu_Latn,Pichis Ashéninka,60,0.5714,1.0,0.4,0.9744,1.0,0.95,0.9744,1.0,0.95,-0.4029,GlotLID
+ekk_Latn,Estonian,60,0.9917,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0083,tie
+ind_Latn,Indonesian,60,0.6526,0.8857,0.5167,0.8947,0.9444,0.85,0.8947,0.9444,0.85,-0.2421,GlotLID
+tuk_Latn,Turkmen,59,0.9833,0.9672,1.0,1.0,1.0,1.0,0.9916,0.9833,1.0,-0.0083,tie
+tsz_Latn,Purepecha,59,0.8345,0.725,0.9831,0.8889,0.8358,0.9492,0.8976,0.8382,0.9661,-0.0631,GlotLID
+yua_Latn,Yucateco,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tur_Latn,Turkish,59,0.9593,0.9219,1.0,0.7712,0.6277,1.0,0.7662,0.6211,1.0,0.1931,MillID
+ssw_Latn,Swati,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+srp_Latn,Serbian,59,0.4754,0.4603,0.4915,0.45,0.8571,0.3051,0.45,0.8571,0.3051,0.0254,MillID
+bos_Cyrl,bos_Cyrl,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+ceb_Latn,Cebuano,59,0.9833,0.9672,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0167,GlotLID
+bre_Latn,Breton,59,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0085,tie
+ccp_Cakm,ccp_Cakm,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+chj_Latn,chj_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+bis_Latn,Bislama,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+top_Latn,Papantla Totonac,59,0.9752,0.9516,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,-0.0164,GlotLID
+tly_Latn,Talysh,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie
+tob_Latn,Toba,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+slv_Latn,Slovenian,59,0.9483,0.9649,0.9322,0.9752,0.9516,1.0,0.9752,0.9516,1.0,-0.0269,GlotLID
+src_Latn,src_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+srp_Cyrl,Serbian,59,0.6552,0.4957,0.9661,0.6629,0.5,0.9831,0.6629,0.5,0.9831,-0.0077,tie
+sin_Sinh,Sinhala,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+bos_Latn,Bosnian,59,0.2281,0.2364,0.2203,0.3121,0.2368,0.4576,0.3121,0.2368,0.4576,-0.0841,GlotLID
+hun_Latn,Hungarian,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+oki_Latn,oki_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+orh_Latn,orh_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+ote_Latn,Mezquital Otomi,59,0.0635,0.5,0.0339,0.0,0.0,0.0,0.0,0.0,0.0,0.0635,MillID
+gaa_Latn,Ga,59,0.9916,0.9833,1.0,0.9752,0.9516,1.0,0.9672,0.9365,1.0,0.0244,MillID
+gld_Cyrl,gld_Cyrl,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+fij_Latn,Fijian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+eus_Latn,Basque,59,0.9593,0.9219,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,-0.0322,GlotLID
+ewe_Latn,Ewe,59,0.9516,0.9077,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0484,GlotLID
+pbu_Arab,pbu_Arab,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+not_Latn,Nomatsiguenga,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie
+fur_Latn,Friulian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+gag_Latn,Gagauz,59,0.9828,1.0,0.9661,0.9915,1.0,0.9831,0.9915,1.0,0.9831,-0.0087,tie
+qwh_Latn,Huaylas Ancash Quechua,59,0.4955,0.3374,0.9322,0.6545,0.7059,0.6102,0.6545,0.7059,0.6102,-0.159,GlotLID
+cnr_Latn,Serbian (Montenegro),59,0.0,0.0,0.0,0.0303,0.1429,0.0169,0.0303,0.1429,0.0169,-0.0303,GlotLID
+crh_Latn,Crimean Tatar,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+dga_Latn,Southern Dagaare,59,0.9748,0.9667,0.9831,0.9915,1.0,0.9831,0.9916,0.9833,1.0,-0.0168,GlotLID
+dzo_Tibt,Dzongkha,59,0.9748,0.9667,0.9831,0.9134,0.8529,0.9831,0.9134,0.8529,0.9831,0.0614,MillID
+cjs_Cyrl,Shor,59,0.9649,1.0,0.9322,0.9369,1.0,0.8814,0.9369,1.0,0.8814,0.028,MillID
+cos_Latn,Corsican,59,0.9916,0.9833,1.0,0.9831,0.9831,0.9831,0.9831,0.9831,0.9831,0.0085,tie
+cof_Latn,Colorado,59,1.0,1.0,1.0,0.9273,1.0,0.8644,0.9369,1.0,0.8814,0.0631,MillID
+qva_Latn,Ambo-Pasco Quechua,59,0.0,0.0,0.0,0.0323,0.3333,0.0169,0.0323,0.3333,0.0169,-0.0323,GlotLID
+sag_Latn,Sango,59,0.9915,1.0,0.9831,0.5783,1.0,0.4068,0.5783,1.0,0.4068,0.4131,MillID
+ppl_Latn,ppl_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+rar_Latn,Rarotongan,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+pol_Latn,Polish,59,0.9655,0.9825,0.9492,1.0,1.0,1.0,0.5463,0.3758,1.0,0.4192,MillID
+nzi_Latn,Nzima,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+hsb_Latn,Upper Sorbian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+hns_Latn,Caribbean Hindustani,59,0.9739,1.0,0.9492,0.9369,1.0,0.8814,0.9369,1.0,0.8814,0.037,MillID
+hms_Latn,hms_Latn,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+hin_Deva,Hindi,59,0.6067,0.9,0.4576,0.9573,0.9655,0.9492,0.9573,0.9655,0.9492,-0.3505,GlotLID
+ltz_Latn,Luxembourgish,59,0.9916,0.9833,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0001,tie
+mar_Deva,Marathi,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+lld_Latn,Ladin,59,0.8596,0.8909,0.8305,0.7312,1.0,0.5763,0.7234,0.9714,0.5763,0.1362,MillID
+gsw_Latn,Swiss German,59,0.8081,1.0,0.678,0.9915,1.0,0.9831,0.9915,1.0,0.9831,-0.1834,GlotLID
+maz_Latn,Central Mazahua,59,0.6941,0.5315,1.0,0.9153,0.9153,0.9153,0.9076,0.9,0.9153,-0.2134,GlotLID
+mor_Latn,Moro,59,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0085,tie
+mlt_Latn,Maltese,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+nba_Latn,Nyemba,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nav_Latn,Navajo,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+men_Latn,Mende,59,0.9672,0.9365,1.0,0.9916,0.9833,1.0,0.9833,0.9672,1.0,-0.0161,GlotLID
+mic_Latn,Mi'kmaw,59,0.9916,0.9833,1.0,0.4267,1.0,0.2712,0.4267,1.0,0.2712,0.5649,MillID
+min_Latn,Minangkabau,59,0.9748,0.9667,0.9831,0.9516,0.9077,1.0,0.9516,0.9077,1.0,0.0232,MillID
+kbp_Latn,Kabiyè,59,0.9147,0.8429,1.0,1.0,1.0,1.0,0.9916,0.9833,1.0,-0.0769,GlotLID
+kin_Latn,Kinyarwanda,59,0.9412,0.9333,0.9492,0.8868,1.0,0.7966,0.8868,1.0,0.7966,0.0544,MillID
+khm_Khmr,Khmer,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kqn_Latn,Kaonde,59,0.9752,0.9516,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0248,GlotLID
+kdh_Latn,Tem,59,1.0,1.0,1.0,0.8654,1.0,0.7627,0.9915,1.0,0.9831,0.0085,tie
+wln_Latn,Walloon,59,0.6667,0.5043,0.9831,0.655,0.5,0.9492,0.655,0.5,0.9492,0.0117,MillID
+kbr_Latn,Kafa,59,0.9916,0.9833,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0001,tie
+ydd_Hebr,Eastern Yiddish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+xsm_Latn,Kasem,59,0.8636,0.7808,0.9661,0.9355,0.8923,0.9831,0.716,0.5631,0.9831,0.1476,MillID
+ayr_Latn,Central Aymara,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+uig_Latn,Uyghur,59,0.631,0.4609,1.0,0.8194,0.6941,1.0,0.7919,0.6556,1.0,-0.1609,GlotLID
+bcl_Latn,Central Bikol,59,0.9833,0.9672,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,-0.0083,tie
+ame_Latn,Yanesha',59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ada_Latn,Adangme,59,0.9752,0.9516,1.0,0.9365,0.8806,1.0,0.9365,0.8806,1.0,0.0387,MillID
+ajg_Latn,Aja (Benin),59,0.6448,0.4758,1.0,0.6667,0.5,1.0,0.6629,0.4958,1.0,-0.0181,GlotLID
+als_Latn,Albanian (Tosk),59,0.9828,1.0,0.9661,0.9833,0.9672,1.0,0.9833,0.9672,1.0,-0.0006,tie
+azj_Latn,North Azerbaijani,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,tie
+ast_Latn,Asturian,58,0.9655,0.9655,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0345,GlotLID
+arn_Latn,Mapuche,58,0.9744,0.9661,0.9828,0.8952,1.0,0.8103,0.9057,1.0,0.8276,0.0687,MillID
+arb_Arab,Arabic (Modern Standard),58,0.9259,1.0,0.8621,1.0,1.0,1.0,1.0,1.0,1.0,-0.0741,GlotLID
+ami_Latn,Amis,58,0.0339,1.0,0.0172,0.0,0.0,0.0,0.0,0.0,0.0,0.0339,MillID
+tzo_Latn,Tzotzil,58,0.9735,1.0,0.9483,0.9828,0.9828,0.9828,0.9828,0.9828,0.9828,-0.0093,tie
+uig_Arab,Uyghur,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ukr_Cyrl,Ukrainian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ben_Beng,Bangla,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+bel_Cyrl,Belarusian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+bci_Latn,Baoulé,58,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.0085,tie
+bba_Latn,Baatonum,58,0.8028,0.6786,0.9828,0.9744,0.9661,0.9828,0.9206,0.8529,1.0,-0.1178,GlotLID
+bax_Latn,bax_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+vec_Latn,Venetian,58,0.912,0.8507,0.9828,0.9831,0.9667,1.0,0.9831,0.9667,1.0,-0.0711,GlotLID
+uzn_Latn,Northern Uzbek,58,0.9134,0.8406,1.0,0.9667,0.9355,1.0,0.9667,0.9355,1.0,-0.0533,GlotLID
+vep_Latn,Veps,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+uzn_Cyrl,Northern Uzbek,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kal_Latn,Kalaallisut,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kan_Knda,Kannada,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kat_Geor,Georgian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kaz_Cyrl,Kazakh,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kea_Latn,Kabuverdianu,58,0.5714,0.4,1.0,0.8056,0.6744,1.0,0.6517,0.4833,1.0,-0.0803,GlotLID
+kha_Latn,Khasi,58,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0085,tie
+kir_Cyrl,Kyrgyz,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ina_Latn,Interlingua,58,0.8593,0.7532,1.0,0.8593,0.7532,1.0,0.8593,0.7532,1.0,0.0,tie
+ilo_Latn,Iloko,58,1.0,1.0,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.0087,tie
+yap_Latn,Yapese,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,tie
+xho_Latn,Xhosa,58,0.9204,0.9455,0.8966,1.0,1.0,1.0,1.0,1.0,1.0,-0.0796,GlotLID
+vmw_Latn,Makhuwa,58,0.9825,1.0,0.9655,0.9739,0.9825,0.9655,0.9828,0.9828,0.9828,-0.0003,tie
+kab_Latn,Kabyle,58,0.9915,0.9831,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.0001,tie
+kaa_Cyrl,Kara-Kalpak,58,0.9831,0.9667,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0169,GlotLID
+ita_Latn,Italian,58,0.9573,0.9492,0.9655,0.9062,0.8286,1.0,0.9062,0.8286,1.0,0.051,MillID
+isl_Latn,Icelandic,58,0.9455,1.0,0.8966,1.0,1.0,1.0,1.0,1.0,1.0,-0.0545,GlotLID
+glg_Latn,Galician,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+glv_Latn,Manx,58,0.9206,0.8529,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0794,GlotLID
+guj_Gujr,Gujarati,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+guc_Latn,Wayuu,58,0.8788,0.7838,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.1212,GlotLID
+haw_Latn,Hawaiian,58,0.9915,0.9831,1.0,0.9735,1.0,0.9483,0.9735,1.0,0.9483,0.018,MillID
+guu_Latn,guu_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nds_Latn,Low German,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+hrv_Latn,Croatian,58,0.5371,0.4017,0.8103,0.7273,0.5833,0.9655,0.7273,0.5833,0.9655,-0.1901,GlotLID
+hnj_Latn,Hmong Njua,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+hil_Latn,Hiligaynon,58,0.9739,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0261,GlotLID
+mfq_Latn,Moba,58,0.9915,0.9831,1.0,0.9748,0.9508,1.0,0.9748,0.9508,1.0,0.0167,MillID
+mkd_Cyrl,Macedonian,58,0.9667,0.9355,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0333,GlotLID
+lue_Latn,Luvale,58,0.9667,0.9355,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,-0.0246,GlotLID
+lus_Latn,Mizo,58,1.0,1.0,1.0,1.0,1.0,1.0,0.9748,0.9508,1.0,0.0252,MillID
+mai_Deva,Maithili,58,0.8593,0.7532,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.1407,GlotLID
+mah_Latn,Marshallese,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+mam_Latn,Mam,58,1.0,1.0,1.0,0.9369,0.9811,0.8966,0.9369,0.9811,0.8966,0.0631,MillID
+mxi_Latn,mxi_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+lob_Latn,lob_Latn,58,0.0,0.0,0.0,0.873,0.8088,0.9483,0.0,0.0,0.0,0.0,tie
+lua_Latn,Luba-Lulua,58,0.55,1.0,0.3793,0.7391,1.0,0.5862,0.7391,1.0,0.5862,-0.1891,GlotLID
+lit_Latn,Lithuanian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+lij_Latn,Ligurian,58,0.9508,0.9062,1.0,0.8406,0.725,1.0,0.8406,0.725,1.0,0.1102,MillID
+loz_Latn,Lozi,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+lad_Latn,Ladino,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+kor_Hang,Korean,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kqs_Latn,kqs_Latn,58,0.0,0.0,0.0,0.8041,1.0,0.6724,0.0,0.0,0.0,0.0,tie
+kri_Latn,Krio,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kmr_Latn,Northern Kurdish,58,0.9739,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0261,GlotLID
+niu_Latn,Niuean,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+nhn_Latn,nhn_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+ibo_Latn,Igbo,58,0.9748,0.9508,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0167,GlotLID
+huu_Latn,Murui Huitoto,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+heb_Hebr,Hebrew,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+hea_Latn,hea_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+mzi_Latn,mzi_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+mxv_Latn,Metlatónoc Mixtec,58,0.2121,0.875,0.1207,0.0,0.0,0.0,0.0,0.0,0.0,0.2121,MillID
+nbl_Latn,South Ndebele,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+ndo_Latn,Ndonga,58,0.9431,0.8923,1.0,0.958,0.9344,0.9828,0.958,0.9344,0.9828,-0.0149,GlotLID
+ddn_Latn,ddn_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+qvh_Latn,Huamalíes-Dos de Mayo Huánuco Quechua,58,0.2154,1.0,0.1207,0.1515,0.625,0.0862,0.1515,0.625,0.0862,0.0639,MillID
+bul_Cyrl,Bulgarian,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+snk_Latn,snk_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+suk_Latn,Sukuma,58,0.7,0.549,0.9655,0.7261,0.5758,0.9828,0.7261,0.5758,0.9828,-0.0261,GlotLID
+srr_Latn,Serer,58,0.9831,0.9667,1.0,0.9508,0.9062,1.0,0.9508,0.9062,1.0,0.0322,MillID
+tpi_Latn,Tok Pisin,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tsn_Latn,Tswana,58,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0085,tie
+tyv_Cyrl,Tuvinian,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,tie
+tir_Ethi,Tigrinya,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+tel_Telu,Telugu,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+zul_Latn,Zulu,58,0.9107,0.9444,0.8793,0.9744,0.9661,0.9828,0.9744,0.9661,0.9828,-0.0636,GlotLID
+ztu_Latn,ztu_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+zlm_Latn,zlm_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+tet_Latn,Tetum,58,0.6892,0.5667,0.8793,0.1667,0.4286,0.1034,0.1644,0.4,0.1034,0.5248,MillID
+bum_Latn,Bulu,58,0.3188,1.0,0.1897,0.0968,0.75,0.0517,0.0896,0.3333,0.0517,0.2293,MillID
+cat_Latn,Catalan,58,0.9355,0.8788,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0645,GlotLID
+ces_Latn,Czech,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+swb_Latn,swb_Latn,58,0.0,0.0,0.0,0.8906,0.8143,0.9828,0.0,0.0,0.0,0.0,tie
+sus_Latn,Susu,58,0.931,0.931,0.931,0.928,0.8657,1.0,0.928,0.8657,1.0,0.003,tie
+swh_Latn,Swahili,58,0.9204,0.9455,0.8966,0.9573,0.9492,0.9655,0.9412,0.918,0.9655,-0.0208,GlotLID
+chk_Latn,Chuukese,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+dyu_Latn,Dyula,58,0.0,0.0,0.0,0.4186,0.6429,0.3103,0.3025,0.2951,0.3103,-0.3025,GlotLID
+emk_Latn,emk_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+sco_Latn,Scots,58,0.9739,0.9825,0.9655,0.9565,0.9649,0.9483,0.9565,0.9649,0.9483,0.0174,MillID
+slr_Latn,slr_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+sme_Latn,Northern Sami,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+quc_Latn,Kʼicheʼ,58,1.0,1.0,1.0,0.9174,0.9804,0.8621,0.9174,0.9804,0.8621,0.0826,MillID
+qvc_Latn,Cajamarca Quechua,58,0.7891,0.6517,1.0,0.9062,0.8286,1.0,0.9062,0.8286,1.0,-0.1171,GlotLID
+que_Latn,que_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+cnh_Latn,Hakha Chin,58,0.9828,0.9828,0.9828,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0087,tie
+crs_Latn,Seselwa Creole French,58,0.9744,0.9661,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0256,GlotLID
+pcd_Latn,Picard,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+pan_Guru,Punjabi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+rgn_Latn,rgn_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+cri_Latn,cri_Latn,58,0.0,0.0,0.0,0.766,1.0,0.6207,0.0,0.0,0.0,0.0,tie
+rus_Cyrl,Russian,58,0.9256,0.8889,0.9655,0.8,0.6667,1.0,0.8,0.6667,1.0,0.1256,MillID
+run_Latn,Rundi,58,0.9391,0.9474,0.931,0.8923,0.8056,1.0,0.8923,0.8056,1.0,0.0468,MillID
+eng_Latn,English,58,0.9744,0.9661,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0256,GlotLID
+epo_Latn,Esperanto,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID
+fkv_Latn,Kven Finnish,58,0.6966,1.0,0.5345,0.6667,1.0,0.5,0.6667,1.0,0.5,0.03,MillID
+fuf_Latn,Pular,58,0.8081,0.9756,0.6897,0.4828,0.7241,0.3621,0.4828,0.7241,0.3621,0.3253,MillID
+fuf_Adlm,fuf_Adlm,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+fry_Latn,Western Frisian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+fra_Latn,French,58,0.9573,0.9492,0.9655,0.9915,0.9831,1.0,0.9748,0.9508,1.0,-0.0175,GlotLID
+fon_Latn,Fon,58,0.9483,0.9483,0.9483,0.9913,1.0,0.9828,0.9913,1.0,0.9828,-0.043,GlotLID
+gej_Latn,gej_Latn,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+pap_Latn,Papiamento,58,1.0,1.0,1.0,0.9831,0.9667,1.0,0.9831,0.9667,1.0,0.0169,MillID
+nno_Latn,Norwegian Nynorsk,58,0.9744,0.9661,0.9828,0.9915,0.9831,1.0,0.9831,0.9667,1.0,-0.0087,tie
+nld_Latn,Dutch,58,1.0,1.0,1.0,1.0,1.0,1.0,0.9062,0.8286,1.0,0.0938,MillID
+nso_Latn,Northern Sotho,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+oaa_Cyrl,oaa_Cyrl,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+lns_Latn,lns_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+khk_Cyrl,Halh Mongolian,57,1.0,1.0,1.0,0.9655,0.9492,0.9825,0.9655,0.9492,0.9825,0.0345,MillID
+zyb_Latn,Yongbei Zhuang,57,0.8201,0.6951,1.0,0.9828,0.9661,1.0,0.9744,0.95,1.0,-0.1542,GlotLID
+aar_Latn,aar_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+abk_Cyrl,Abkhazian,57,0.9744,0.95,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0256,GlotLID
+toj_Latn,Tojolabal,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+tdt_Latn,Tetun Dili,57,0.4884,0.7241,0.3684,0.6115,0.48,0.8421,0.6115,0.48,0.8421,-0.1231,GlotLID
+tah_Latn,Tahitian,57,0.973,1.0,0.9474,0.8125,1.0,0.6842,0.8125,1.0,0.6842,0.1605,MillID
+tuk_Cyrl,Turkmen,57,0.9558,0.9643,0.9474,0.9913,0.9828,1.0,0.95,0.9048,1.0,0.0058,tie
+cfm_Latn,Falam Chin,57,0.9744,0.95,1.0,0.9735,0.9821,0.9649,0.9735,0.9821,0.9649,0.0009,tie
+toi_Latn,Tonga (Zambia),57,0.9636,1.0,0.9298,1.0,1.0,1.0,1.0,1.0,1.0,-0.0364,GlotLID
+tat_Cyrl,Tatar,57,0.9412,0.9032,0.9825,1.0,1.0,1.0,0.8702,0.7703,1.0,0.0709,MillID
+som_Latn,Somali,57,0.8201,0.6951,1.0,0.9344,0.8769,1.0,0.9344,0.8769,1.0,-0.1143,GlotLID
+tgk_Cyrl,Tajik,57,0.9421,0.8906,1.0,0.9421,0.8906,1.0,0.9421,0.8906,1.0,0.0,tie
+cha_Latn,Chamorro,57,0.9739,0.9655,0.9825,0.9159,0.98,0.8596,0.9159,0.98,0.8596,0.058,MillID
+cbt_Latn,Chayahuita,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0087,tie
+sid_Latn,Sidamo,57,1.0,1.0,1.0,0.912,0.8382,1.0,0.912,0.8382,1.0,0.088,MillID
+sah_Cyrl,Yakut,57,0.8085,0.6786,1.0,0.6441,0.475,1.0,0.6441,0.475,1.0,0.1644,MillID
+rup_Latn,Aromanian,57,0.9913,0.9828,1.0,0.9744,0.95,1.0,0.9661,0.9344,1.0,0.0252,MillID
+cak_Latn,Kaqchikel,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+cbu_Latn,Candoshi-Shapra,57,0.3714,1.0,0.2281,0.8824,1.0,0.7895,0.8738,0.9783,0.7895,-0.5024,GlotLID
+pis_Latn,Pijin,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0087,tie
+qvn_Latn,North Junín Quechua,57,0.2188,1.0,0.1228,0.4595,1.0,0.2982,0.4595,1.0,0.2982,-0.2407,GlotLID
+piu_Latn,piu_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+pon_Latn,Pohnpeian,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+quh_Latn,South Bolivian Quechua,57,0.9828,0.9661,1.0,0.9369,0.963,0.9123,0.9649,0.9649,0.9649,0.0178,MillID
+sot_Latn,Southern Sotho,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0087,tie
+buc_Latn,buc_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+dag_Latn,Dagbani,57,0.9492,0.918,0.9825,0.8175,0.7,0.9825,0.7887,0.6588,0.9825,0.1604,MillID
+pau_Latn,Palauan,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+fvr_Latn,fvr_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+evn_Cyrl,evn_Cyrl,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+fat_Latn,Fanti,57,0.9744,0.95,1.0,0.9744,0.95,1.0,0.9661,0.9344,1.0,0.0083,tie
+fao_Latn,Faroese,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+mri_Latn,Māori,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+hni_Latn,hni_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+lao_Laoo,Lao,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+koi_Cyrl,Komi-Permyak,57,0.8367,1.0,0.7193,1.0,1.0,1.0,1.0,1.0,1.0,-0.1633,GlotLID
+quz_Latn,Cusco Quechua,57,0.7143,0.6024,0.8772,0.7083,0.5862,0.8947,0.7211,0.5889,0.9298,-0.0068,tie
+qxn_Latn,Northern Conchucos Ancash Quechua,57,0.0345,1.0,0.0175,0.0345,1.0,0.0175,0.0345,1.0,0.0175,0.0,tie
+csa_Latn,csa_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+dip_Latn,dip_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+duu_Latn,duu_Latn,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+bam_Latn,Bambara,57,0.5251,0.3852,0.8246,0.7092,0.5952,0.8772,0.6369,0.5,0.8772,-0.1118,GlotLID
+aii_Syrc,Assyrian Neo-Aramaic,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+bem_Latn,Bemba,57,0.9828,0.9661,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID
+agr_Latn,Aguaruna,57,0.9573,0.9333,0.9825,0.9739,0.9655,0.9825,0.9739,0.9655,0.9825,-0.0166,GlotLID
+kjh_Cyrl,Khakas,57,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0,tie
+yor_Latn,Yoruba,57,0.8837,0.7917,1.0,0.9828,0.9661,1.0,0.9828,0.9661,1.0,-0.099,GlotLID
+kek_Latn,Kekchí,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0087,tie
+div_Thaa,Divehi,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+zro_Latn,zro_Latn,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+mya_Mymr,Burmese,56,0.9565,0.9322,0.9821,1.0,1.0,1.0,1.0,1.0,1.0,-0.0435,GlotLID
+mos_Latn,Mossi,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+lun_Latn,Lunda,56,1.0,1.0,1.0,0.991,1.0,0.9821,0.991,1.0,0.9821,0.009,tie
+amc_Latn,amc_Latn,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+ura_Latn,Urarina,56,1.0,1.0,1.0,0.9825,0.9655,1.0,0.9825,0.9655,1.0,0.0175,MillID
+ady_Cyrl,Adyghe,56,0.991,1.0,0.9821,0.9818,1.0,0.9643,0.9818,1.0,0.9643,0.0092,tie
+azj_Cyrl,North Azerbaijani,56,0.9825,0.9655,1.0,1.0,1.0,1.0,0.9912,0.9825,1.0,-0.0087,tie
+niv_Cyrl,niv_Cyrl,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+gkp_Latn,gkp_Latn,56,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+pbb_Latn,Páez,56,0.8485,0.9767,0.75,0.6458,0.775,0.5536,0.6458,0.775,0.5536,0.2027,MillID
+pcm_Latn,Nigerian Pidgin,56,0.9825,0.9655,1.0,0.9244,0.873,0.9821,0.9256,0.8615,1.0,0.0568,MillID
+shn_Mymr,Shan,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+slk_Latn,Slovak,56,0.9821,0.9821,0.9821,1.0,1.0,1.0,1.0,1.0,1.0,-0.0179,GlotLID
+gle_Latn,Irish,56,0.9912,0.9825,1.0,0.9825,0.9655,1.0,0.9825,0.9655,1.0,0.0087,tie
+bho_Deva,Bhojpuri,56,0.6429,0.9643,0.4821,0.9333,1.0,0.875,0.9333,1.0,0.875,-0.2905,GlotLID
+yad_Latn,Yagua,55,1.0,1.0,1.0,0.9815,1.0,0.9636,0.9815,1.0,0.9636,0.0185,MillID
+dyo_Latn,Jola-Fonyi,55,0.9725,0.9815,0.9636,0.9908,1.0,0.9818,1.0,1.0,1.0,-0.0275,GlotLID
+tem_Latn,Timne,55,0.991,0.9821,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.009,tie
+san_Deva,Sanskrit,55,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.0,tie
+shk_Latn,shk_Latn,55,0.0,0.0,0.0,0.9216,1.0,0.8545,0.0,0.0,0.0,0.0,tie
+npi_Deva,Nepali,55,1.0,1.0,1.0,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.0092,tie
+ido_Latn,Ido,55,0.9815,1.0,0.9636,1.0,1.0,1.0,1.0,1.0,1.0,-0.0185,GlotLID
+mnw_Mymr,Mon,55,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+guk_Latn,guk_Latn,55,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+kbd_Cyrl,Kabardian,55,0.991,0.9821,1.0,0.9735,0.9483,1.0,0.9735,0.9483,1.0,0.0175,MillID
+yrk_Cyrl,Nenets,55,0.955,0.9464,0.9636,0.963,0.9811,0.9455,0.9455,0.9455,0.9455,0.0095,tie
+hlt_Latn,hlt_Latn,55,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+dje_Latn,Zarma,54,0.7963,0.7963,0.7963,0.8571,0.8276,0.8889,0.8448,0.7903,0.9074,-0.0485,GlotLID
+qxu_Latn,qxu_Latn,54,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+blt_Tavt,blt_Tavt,54,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+koo_Latn,Konzo,54,0.9623,0.9808,0.9444,0.9615,1.0,0.9259,0.9615,1.0,0.9259,0.0007,tie
+mag_Deva,Magahi,53,0.8037,0.7963,0.8113,0.9358,0.9107,0.9623,0.9358,0.9107,0.9623,-0.132,GlotLID
+plt_Latn,Malagasy (Plateau),53,0.9815,0.9636,1.0,1.0,1.0,1.0,0.9907,0.9815,1.0,-0.0092,tie
+iii_Yiii,iii_Yiii,53,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nku_Latn,nku_Latn,52,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+cni_Latn,Asháninka,52,0.7075,0.5474,1.0,0.963,0.9286,1.0,0.963,0.9286,1.0,-0.2555,GlotLID
+yao_Latn,Yao,52,1.0,1.0,1.0,0.9903,1.0,0.9808,0.9903,1.0,0.9808,0.0097,tie
+ykg_Cyrl,ykg_Cyrl,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+idu_Latn,Idoma,51,0.9091,0.9375,0.8824,0.8791,1.0,0.7843,0.9375,1.0,0.8824,-0.0284,GlotLID
+kde_Latn,Makonde,51,0.9184,0.9574,0.8824,0.9703,0.98,0.9608,0.9703,0.98,0.9608,-0.0519,GlotLID
+kkh_Lana,kkh_Lana,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+amh_Ethi,Amharic,51,0.9901,1.0,0.9804,1.0,1.0,1.0,1.0,1.0,1.0,-0.0099,tie
+alt_Cyrl,Southern Altai,51,0.9808,0.9623,1.0,0.9623,0.9273,1.0,0.9623,0.9273,1.0,0.0185,MillID
+miq_Latn,Mískito,51,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+mto_Latn,Totontepec Mixe,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nio_Cyrl,nio_Cyrl,51,0.0,0.0,0.0,1.0,1.0,1.0,0.0,0.0,0.0,0.0,tie
+san_Gran,san_Gran,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+ijs_Latn,ijs_Latn,50,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nyn_Latn,Nyankole,50,0.9709,0.9434,1.0,0.9796,1.0,0.96,0.9796,1.0,0.96,-0.0087,tie
+zdj_Latn,Ngazidja Comorian,50,0.6452,0.4762,1.0,0.9697,0.9796,0.96,0.6853,0.5269,0.98,-0.0402,GlotLID
+yue_Hani,Cantonese,49,0.6452,0.6818,0.6122,0.5797,1.0,0.4082,0.5797,1.0,0.4082,0.0655,MillID
+gan_Hani,gan_Hani,49,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nym_Latn,nym_Latn,49,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+eve_Cyrl,Even,49,0.3887,0.2424,0.9796,0.392,0.26,0.7959,0.39,0.2583,0.7959,-0.0013,tie
+lug_Latn,Ganda,49,0.9697,0.96,0.9796,1.0,1.0,1.0,1.0,1.0,1.0,-0.0303,GlotLID
+gyr_Latn,Guarayu,49,0.339,1.0,0.2041,0.9897,1.0,0.9796,0.9897,1.0,0.9796,-0.6507,GlotLID
+gug_Latn,Paraguayan Guaraní,49,0.9515,0.9074,1.0,0.9899,0.98,1.0,0.9899,0.98,1.0,-0.0384,GlotLID
+wuu_Hani,Wu Chinese,48,0.4699,0.3185,0.8958,0.4312,0.2765,0.9792,0.4273,0.2733,0.9792,0.0427,MillID
+cjy_Hani,cjy_Hani,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+hsn_Hani,hsn_Hani,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nan_Hani,Min Nan Chinese,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+hak_Hani,Hakka Chinese,48,0.0,0.0,0.0,0.04,0.5,0.0208,0.04,0.5,0.0208,-0.04,GlotLID
+bin_Latn,Bini,47,0.9787,0.9787,0.9787,0.9318,1.0,0.8723,0.9318,1.0,0.8723,0.0469,MillID
+lia_Latn,West-Central Limba,45,0.9462,0.9167,0.9778,0.989,0.9783,1.0,0.989,0.9783,1.0,-0.0428,GlotLID
+oss_Cyrl,Ossetic,44,0.9263,0.8627,1.0,0.9888,0.9778,1.0,0.9888,0.9778,1.0,-0.0624,GlotLID
+ike_Cans,Eastern Canadian Inuktitut,44,1.0,1.0,1.0,0.9778,0.9565,1.0,0.9778,0.9565,1.0,0.0222,MillID
+cbs_Latn,Cashinahua,43,0.9053,0.8269,1.0,0.8723,0.8039,0.9535,0.8723,0.8039,0.9535,0.0329,MillID
+csw_Cans,csw_Cans,43,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+ojb_Cans,Northwestern Ojibwa,43,1.0,1.0,1.0,0.9639,1.0,0.9302,0.9639,1.0,0.9302,0.0361,MillID
+bfa_Latn,bfa_Latn,42,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+wwa_Latn,wwa_Latn,39,0.0,0.0,0.0,0.975,0.9512,1.0,0.0,0.0,0.0,0.0,tie
+ese_Latn,Ese Ejja,35,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0,tie
+tzh_Latn,Tzeltal,25,0.9434,0.8929,1.0,0.9804,0.9615,1.0,0.9804,0.9615,1.0,-0.037,GlotLID
+chv_Cyrl,Chuvash,25,0.9804,0.9615,1.0,0.9259,0.8621,1.0,0.9259,0.8621,1.0,0.0545,MillID
+zlm_Arab,zlm_Arab,24,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+tzm_Tfng,Central Atlas Tamazight,1,0.3333,0.2,1.0,0.0625,0.0323,1.0,0.0625,0.0323,1.0,0.2708,MillID
+tgl_Tglg,tgl_Tglg,1,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+taj_Deva,Eastern Tamang,1,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie

reports/udhr-all/millid_per_language.csv

@@ -0,0 +1,430 @@
+label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
+aar_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+abk_Cyrl,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
+ace_Latn,61,59,0,2,27562,1.0,0.967213,0.983333,1.0,0.0,0.967213
+acu_Latn,180,108,1,72,27442,0.990826,0.6,0.747405,0.999964,36.439165,0.6
+ada_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
+ady_Cyrl,56,55,0,1,27567,1.0,0.982143,0.990991,1.0,0.0,0.982143
+afr_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+agr_Latn,57,56,4,1,27562,0.933333,0.982456,0.957265,0.999855,145.10629,0.982456
+aii_Syrc,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+ajg_Latn,59,59,65,0,27499,0.475806,1.0,0.644809,0.997642,2358.148309,1.0
+als_Latn,59,57,0,2,27564,1.0,0.966102,0.982759,1.0,0.0,0.966102
+alt_Cyrl,51,51,2,0,27570,0.962264,1.0,0.980769,0.999927,72.537357,1.0
+amc_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+ame_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+amh_Ethi,51,50,0,1,27572,1.0,0.980392,0.990099,1.0,0.0,0.980392
+ami_Latn,58,1,0,57,27565,1.0,0.017241,0.033898,1.0,0.0,0.017241
+amr_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+arb_Arab,58,50,0,8,27565,1.0,0.862069,0.925926,1.0,0.0,0.862069
+arl_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+arn_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
+ast_Latn,58,56,2,2,27563,0.965517,0.965517,0.965517,0.999927,72.555777,0.965517
+auc_Latn,154,4,1,150,27468,0.8,0.025974,0.050314,0.999964,36.404674,0.025974
+ayr_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Cyrl,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
+azj_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+bam_Latn,57,47,75,10,27491,0.385246,0.824561,0.52514,0.997279,2720.742944,0.824561
+ban_Latn,60,58,0,2,27563,1.0,0.966667,0.983051,1.0,0.0,0.966667
+bax_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+bba_Latn,58,57,27,1,27538,0.678571,0.982759,0.802817,0.99902,979.502993,0.982759
+bci_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bcl_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
+bel_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bem_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
+ben_Beng,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+bfa_Latn,42,0,0,42,27581,0.0,0.0,0.0,1.0,0.0,0.0
+bho_Deva,56,27,1,29,27566,0.964286,0.482143,0.642857,0.999964,36.275257,0.482143
+bin_Latn,47,46,1,1,27575,0.978723,0.978723,0.978723,0.999964,36.263417,0.978723
+bis_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+blt_Tavt,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
+boa_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+bod_Tibt,60,58,1,2,27562,0.983051,0.966667,0.97479,0.999964,36.280521,0.966667
+bos_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+bos_Latn,59,13,42,46,27522,0.236364,0.220339,0.22807,0.998476,1523.7266,0.220339
+bre_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+buc_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+bug_Latn,60,56,2,4,27561,0.965517,0.933333,0.949153,0.999927,72.561042,0.933333
+bul_Cyrl,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+bum_Latn,58,11,0,47,27565,1.0,0.189655,0.318841,1.0,0.0,0.189655
+cab_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+cak_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+cat_Latn,58,58,8,0,27557,0.878788,1.0,0.935484,0.99971,290.223109,1.0
+cbi_Latn,62,62,0,0,27561,1.0,1.0,1.0,1.0,0.0,1.0
+cbr_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+cbs_Latn,43,43,9,0,27571,0.826923,1.0,0.905263,0.999674,326.323423,1.0
+cbt_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+cbu_Latn,57,13,0,44,27566,1.0,0.22807,0.371429,1.0,0.0,0.22807
+ccp_Cakm,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+ceb_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
+ces_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+cfm_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
+cha_Latn,57,56,2,1,27564,0.965517,0.982456,0.973913,0.999927,72.553145,0.982456
+chj_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+chk_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+chr_Cher,115,64,0,51,27508,1.0,0.556522,0.715084,1.0,0.0,0.556522
+chv_Cyrl,25,25,1,0,27597,0.961538,1.0,0.980392,0.999964,36.23451,1.0
+cic_Latn,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+cjk_Latn,114,103,0,11,27509,1.0,0.903509,0.949309,1.0,0.0,0.903509
+cjs_Cyrl,59,55,0,4,27564,1.0,0.932203,0.964912,1.0,0.0,0.932203
+cjy_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
+cmn_Hani,319,307,166,12,27138,0.649049,0.962382,0.775253,0.99392,6079.695283,0.962382
+cnh_Latn,58,57,1,1,27564,0.982759,0.982759,0.982759,0.999964,36.277889,0.982759
+cni_Latn,52,52,43,0,27528,0.547368,1.0,0.707483,0.99844,1559.609735,1.0
+cnr_Latn,59,0,1,59,27563,0.0,0.0,0.0,0.999964,36.279205,0.0
+cof_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+cos_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+cot_Latn,60,58,0,2,27563,1.0,0.966667,0.983051,1.0,0.0,0.966667
+cpu_Latn,60,24,0,36,27563,1.0,0.4,0.571429,1.0,0.0,0.4
+crh_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+cri_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+crs_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
+csa_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+csw_Cans,43,0,0,43,27580,0.0,0.0,0.0,1.0,0.0,0.0
+ctd_Latn,60,39,0,21,27563,1.0,0.65,0.787879,1.0,0.0,0.65
+cym_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+dag_Latn,57,56,5,1,27561,0.918033,0.982456,0.949153,0.999819,181.382863,0.982456
+dan_Latn,61,58,2,3,27560,0.966667,0.95082,0.958678,0.999927,72.563675,0.95082
+ddn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+deu_Latn,67,67,0,0,27556,1.0,1.0,1.0,1.0,0.0,1.0
+dga_Latn,59,58,2,1,27562,0.966667,0.983051,0.97479,0.999927,72.55841,0.983051
+dip_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+div_Thaa,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+dje_Latn,54,43,11,11,27558,0.796296,0.796296,0.796296,0.999601,398.998876,0.796296
+duu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+dyo_Latn,55,53,1,2,27567,0.981481,0.963636,0.972477,0.999964,36.273941,0.963636
+dyu_Latn,58,0,37,58,27528,0.0,0.0,0.0,0.998658,1342.281879,0.0
+dzo_Tibt,59,58,2,1,27562,0.966667,0.983051,0.97479,0.999927,72.55841,0.983051
+ekk_Latn,60,60,1,0,27562,0.983607,1.0,0.991736,0.999964,36.280521,1.0
+ell_Grek,115,56,0,59,27508,1.0,0.486957,0.654971,1.0,0.0,0.486957
+emk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+eng_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
+epo_Latn,58,56,0,2,27565,1.0,0.965517,0.982456,1.0,0.0,0.965517
+ese_Latn,35,34,0,1,27588,1.0,0.971429,0.985507,1.0,0.0,0.971429
+eus_Latn,59,59,5,0,27559,0.921875,1.0,0.95935,0.999819,181.396024,1.0
+eve_Cyrl,49,48,150,1,27424,0.242424,0.979592,0.388664,0.99456,5439.907159,0.979592
+evn_Cyrl,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+ewe_Latn,59,59,6,0,27558,0.907692,1.0,0.951613,0.999782,217.675229,1.0
+fao_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+fas_Arab,114,112,0,2,27509,1.0,0.982456,0.99115,1.0,0.0,0.982456
+fat_Latn,57,57,3,0,27563,0.95,1.0,0.974359,0.999891,108.829718,1.0
+fij_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fil_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
+fin_Latn,61,60,1,1,27561,0.983607,0.983607,0.983607,0.999964,36.281837,0.983607
+fkv_Latn,58,31,0,27,27565,1.0,0.534483,0.696629,1.0,0.0,0.534483
+fon_Latn,58,55,3,3,27562,0.948276,0.948276,0.948276,0.999891,108.833666,0.948276
+fra_Latn,58,56,3,2,27562,0.949153,0.965517,0.957265,0.999891,108.833666,0.965517
+fry_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+fuf_Adlm,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+fuf_Latn,58,40,1,18,27564,0.97561,0.689655,0.808081,0.999964,36.277889,0.689655
+fur_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+fuv_Latn,108,32,34,76,27481,0.484848,0.296296,0.367816,0.998764,1235.689624,0.296296
+fvr_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+gaa_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+gag_Latn,59,57,0,2,27564,1.0,0.966102,0.982759,1.0,0.0,0.966102
+gan_Hani,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
+gaz_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
+gej_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+gjn_Latn,60,59,0,1,27563,1.0,0.983333,0.991597,1.0,0.0,0.983333
+gkp_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+gla_Latn,62,61,3,1,27558,0.953125,0.983871,0.968254,0.999891,108.849461,0.983871
+gld_Cyrl,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+gle_Latn,56,56,1,0,27566,0.982456,1.0,0.99115,0.999964,36.275257,1.0
+glg_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+glv_Latn,58,58,10,0,27555,0.852941,1.0,0.920635,0.999637,362.778886,1.0
+gsw_Latn,59,40,0,19,27564,1.0,0.677966,0.808081,1.0,0.0,0.677966
+guc_Latn,58,58,16,0,27549,0.783784,1.0,0.878788,0.99942,580.446218,1.0
+gug_Latn,49,49,5,0,27569,0.907407,1.0,0.951456,0.999819,181.330239,1.0
+guj_Gujr,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+guk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+guu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+gyr_Latn,49,10,0,39,27574,1.0,0.204082,0.338983,1.0,0.0,0.204082
+hak_Hani,48,0,3,48,27572,0.0,0.0,0.0,0.999891,108.794198,0.0
+hat_Latn,117,115,0,2,27506,1.0,0.982906,0.991379,1.0,0.0,0.982906
+hau_Latn,155,155,2,0,27466,0.987261,1.0,0.99359,0.999927,72.811999,1.0
+haw_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+hea_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+heb_Hebr,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+hil_Latn,58,56,1,2,27564,0.982456,0.965517,0.973913,0.999964,36.277889,0.965517
+hin_Deva,59,27,3,32,27561,0.9,0.457627,0.606742,0.999891,108.837614,0.457627
+hlt_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+hms_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+hni_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+hnj_Latn,58,0,1,58,27564,0.0,0.0,0.0,0.999964,36.277889,0.0
+hns_Latn,59,56,0,3,27564,1.0,0.949153,0.973913,1.0,0.0,0.949153
+hrv_Latn,58,47,70,11,27495,0.401709,0.810345,0.537143,0.997461,2539.452204,0.810345
+hsb_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+hsn_Hani,48,0,0,48,27575,0.0,0.0,0.0,1.0,0.0,0.0
+hun_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+hus_Latn,175,172,0,3,27448,1.0,0.982857,0.991354,1.0,0.0,0.982857
+huu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+hye_Armn,70,69,0,1,27553,1.0,0.985714,0.992806,1.0,0.0,0.985714
+ibb_Latn,67,0,0,67,27556,0.0,0.0,0.0,1.0,0.0,0.0
+ibo_Latn,58,58,3,0,27562,0.95082,1.0,0.97479,0.999891,108.833666,1.0
+ido_Latn,55,53,0,2,27568,1.0,0.963636,0.981481,1.0,0.0,0.963636
+idu_Latn,51,45,3,6,27569,0.9375,0.882353,0.909091,0.999891,108.806035,0.882353
+iii_Yiii,53,0,0,53,27570,0.0,0.0,0.0,1.0,0.0,0.0
+ijs_Latn,50,0,0,50,27573,0.0,0.0,0.0,1.0,0.0,0.0
+ike_Cans,44,44,0,0,27579,1.0,1.0,1.0,1.0,0.0,1.0
+ilo_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+ina_Latn,58,58,19,0,27546,0.753247,1.0,0.859259,0.999311,689.279884,1.0
+ind_Latn,60,31,4,29,27559,0.885714,0.516667,0.652632,0.999855,145.122084,0.516667
+isl_Latn,58,52,0,6,27565,1.0,0.896552,0.945455,1.0,0.0,0.896552
+ita_Latn,58,56,3,2,27562,0.949153,0.965517,0.957265,0.999891,108.833666,0.965517
+jav_Java,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+jav_Latn,60,59,3,1,27560,0.951613,0.983333,0.967213,0.999891,108.841563,0.983333
+jiv_Latn,60,59,48,1,27515,0.551402,0.983333,0.706587,0.998259,1741.465007,0.983333
+jpn_Jpan,140,140,0,0,27483,1.0,1.0,1.0,1.0,0.0,1.0
+kaa_Cyrl,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
+kab_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+kal_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kan_Knda,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kat_Geor,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kaz_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kbd_Cyrl,55,55,1,0,27567,0.982143,1.0,0.990991,0.999964,36.273941,1.0
+kbp_Latn,59,59,11,0,27553,0.842857,1.0,0.914729,0.999601,399.071252,1.0
+kbr_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+kde_Latn,51,45,2,6,27570,0.957447,0.882353,0.918367,0.999927,72.537357,0.882353
+kdh_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+kea_Latn,58,58,87,0,27478,0.4,1.0,0.571429,0.996844,3156.176311,1.0
+kek_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+kha_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+khk_Cyrl,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+khm_Khmr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+kin_Latn,59,56,4,3,27560,0.933333,0.949153,0.941176,0.999855,145.116819,0.949153
+kir_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kjh_Cyrl,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+kkh_Lana,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+kmb_Latn,116,115,4,1,27503,0.966387,0.991379,0.978723,0.999855,145.41753,0.991379
+kmr_Latn,58,56,1,2,27564,0.982456,0.965517,0.973913,0.999964,36.277889,0.965517
+knc_Latn,64,64,2,0,27557,0.969697,1.0,0.984615,0.999927,72.571574,1.0
+kng_Latn,115,3,10,112,27498,0.230769,0.026087,0.046875,0.999636,363.530609,0.026087
+koi_Cyrl,57,41,0,16,27566,1.0,0.719298,0.836735,1.0,0.0,0.719298
+koo_Latn,54,51,1,3,27568,0.980769,0.944444,0.962264,0.999964,36.272625,0.944444
+kor_Hang,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+kqn_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
+kqs_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+kri_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+krl_Latn,183,0,0,183,27440,0.0,0.0,0.0,1.0,0.0,0.0
+ktu_Latn,118,108,55,10,27450,0.662577,0.915254,0.768683,0.998,1999.63643,0.915254
+kwi_Latn,145,93,2,52,27476,0.978947,0.641379,0.775,0.999927,72.785501,0.641379
+lad_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+lao_Laoo,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+lat_Latn,118,118,2,0,27503,0.983333,1.0,0.991597,0.999927,72.714052,1.0
+lia_Latn,45,44,4,1,27574,0.916667,0.977778,0.946237,0.999855,145.04315,0.977778
+lij_Latn,58,58,6,0,27559,0.90625,1.0,0.95082,0.999782,217.667332,1.0
+lin_Latn,110,110,0,0,27513,1.0,1.0,1.0,1.0,0.0,1.0
+lit_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+lld_Latn,59,49,6,10,27558,0.890909,0.830508,0.859649,0.999782,217.675229,0.830508
+lns_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+lob_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+lot_Latn,140,0,0,140,27483,0.0,0.0,0.0,1.0,0.0,0.0
+loz_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+ltz_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+lua_Latn,58,22,0,36,27565,1.0,0.37931,0.55,1.0,0.0,0.37931
+lue_Latn,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
+lug_Latn,49,48,2,1,27572,0.96,0.979592,0.969697,0.999927,72.532095,0.979592
+lun_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+lus_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+lvs_Latn,115,115,1,0,27507,0.991379,1.0,0.995671,0.999964,36.353061,1.0
+mad_Latn,60,56,0,4,27563,1.0,0.933333,0.965517,1.0,0.0,0.933333
+mag_Deva,53,43,11,10,27559,0.796296,0.811321,0.803738,0.999601,398.984403,0.811321
+mah_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+mai_Deva,58,58,19,0,27546,0.753247,1.0,0.859259,0.999311,689.279884,1.0
+mal_Mlym,100,100,0,0,27523,1.0,1.0,1.0,1.0,0.0,1.0
+mam_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+mar_Deva,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+maz_Latn,59,59,52,0,27512,0.531532,1.0,0.694118,0.998113,1886.518648,1.0
+mcd_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+mcf_Latn,62,62,0,0,27561,1.0,1.0,1.0,1.0,0.0,1.0
+men_Latn,59,59,4,0,27560,0.936508,1.0,0.967213,0.999855,145.116819,1.0
+mfq_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+mic_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+min_Latn,59,58,2,1,27562,0.966667,0.983051,0.97479,0.999927,72.55841,0.983051
+miq_Latn,51,51,0,0,27572,1.0,1.0,1.0,1.0,0.0,1.0
+mkd_Cyrl,58,58,4,0,27561,0.935484,1.0,0.966667,0.999855,145.111555,1.0
+mlt_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+mnw_Mymr,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+mor_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+mos_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+mri_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+mto_Latn,51,0,1,51,27571,0.0,0.0,0.0,0.999964,36.268678,0.0
+mxi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+mxv_Latn,58,7,1,51,27564,0.875,0.12069,0.212121,0.999964,36.277889,0.12069
+mya_Mymr,56,55,4,1,27563,0.932203,0.982143,0.956522,0.999855,145.101027,0.982143
+mzi_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+nan_Hani,48,0,1,48,27574,0.0,0.0,0.0,0.999964,36.264733,0.0
+nav_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+nba_Latn,59,0,2,59,27562,0.0,0.0,0.0,0.999927,72.55841,0.0
+nbl_Latn,58,0,1,58,27564,0.0,0.0,0.0,0.999964,36.277889,0.0
+ndo_Latn,58,58,7,0,27558,0.892308,1.0,0.943089,0.999746,253.94522,1.0
+nds_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nhn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+nio_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+niu_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+niv_Cyrl,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+njo_Latn,64,64,2,0,27557,0.969697,1.0,0.984615,0.999927,72.571574,1.0
+nku_Latn,52,0,0,52,27571,0.0,0.0,0.0,1.0,0.0,0.0
+nld_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nno_Latn,58,57,2,1,27563,0.966102,0.982759,0.974359,0.999927,72.555777,0.982759
+nob_Latn,62,59,3,3,27558,0.951613,0.951613,0.951613,0.999891,108.849461,0.951613
+not_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+npi_Deva,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+nso_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+nya_Latn,116,115,2,1,27505,0.982906,0.991379,0.987124,0.999927,72.708765,0.991379
+nym_Latn,49,0,0,49,27574,0.0,0.0,0.0,1.0,0.0,0.0
+nyn_Latn,50,50,3,0,27570,0.943396,1.0,0.970874,0.999891,108.802089,1.0
+nzi_Latn,59,59,1,0,27563,0.983333,1.0,0.991597,0.999964,36.279205,1.0
+oaa_Cyrl,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+oci_Latn,398,79,2,319,27223,0.975309,0.198492,0.329854,0.999927,73.461892,0.198492
+ojb_Cans,43,43,0,0,27580,1.0,1.0,1.0,1.0,0.0,1.0
+oki_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+orh_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+oss_Cyrl,44,44,7,0,27572,0.862745,1.0,0.926316,0.999746,253.81631,1.0
+ote_Latn,59,2,2,57,27562,0.5,0.033898,0.063492,0.999927,72.55841,0.033898
+pam_Latn,66,66,0,0,27557,1.0,1.0,1.0,1.0,0.0,1.0
+pan_Guru,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+pap_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+pau_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+pbb_Latn,56,42,1,14,27566,0.976744,0.75,0.848485,0.999964,36.275257,0.75
+pbu_Arab,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+pcd_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+pcm_Latn,56,56,2,0,27565,0.965517,1.0,0.982456,0.999927,72.550513,1.0
+pis_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+piu_Latn,57,0,0,57,27566,0.0,0.0,0.0,1.0,0.0,0.0
+plt_Latn,53,53,2,0,27568,0.963636,1.0,0.981481,0.999927,72.542619,1.0
+pnb_Arab,61,61,9,0,27553,0.871429,1.0,0.931298,0.999673,326.536536,1.0
+pol_Latn,59,56,1,3,27563,0.982456,0.949153,0.965517,0.999964,36.279205,0.949153
+pon_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+por_Latn,115,115,1,0,27507,0.991379,1.0,0.995671,0.999964,36.353061,1.0
+pov_Latn,115,83,0,32,27508,1.0,0.721739,0.838384,1.0,0.0,0.721739
+ppl_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+quc_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+que_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+qug_Latn,182,0,0,182,27441,0.0,0.0,0.0,1.0,0.0,0.0
+quh_Latn,57,57,2,0,27564,0.966102,1.0,0.982759,0.999927,72.553145,1.0
+quy_Latn,60,56,52,4,27511,0.518519,0.933333,0.666667,0.998113,1886.587091,0.933333
+quz_Latn,57,50,33,7,27533,0.60241,0.877193,0.714286,0.998803,1197.126895,0.877193
+qva_Latn,59,0,2,59,27562,0.0,0.0,0.0,0.999927,72.55841,0.0
+qvc_Latn,58,58,31,0,27534,0.651685,1.0,0.789116,0.998875,1124.614547,1.0
+qvh_Latn,58,7,0,51,27565,1.0,0.12069,0.215385,1.0,0.0,0.12069
+qvm_Latn,60,3,1,57,27562,0.75,0.05,0.09375,0.999964,36.280521,0.05
+qvn_Latn,57,7,0,50,27566,1.0,0.122807,0.21875,1.0,0.0,0.122807
+qwh_Latn,59,55,108,4,27456,0.337423,0.932203,0.495495,0.996082,3918.154114,0.932203
+qxn_Latn,57,1,0,56,27566,1.0,0.017544,0.034483,1.0,0.0,0.017544
+qxu_Latn,54,0,0,54,27569,0.0,0.0,0.0,1.0,0.0,0.0
+rar_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+rgn_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+rmn_Latn,116,58,0,58,27507,1.0,0.5,0.666667,1.0,0.0,0.5
+roh_Latn,399,393,1,6,27223,0.997462,0.984962,0.991173,0.999963,36.732295,0.984962
+ron_Latn,97,97,1,0,27525,0.989796,1.0,0.994872,0.999964,36.329289,1.0
+run_Latn,58,54,3,4,27562,0.947368,0.931034,0.93913,0.999891,108.833666,0.931034
+rup_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+rus_Cyrl,58,56,7,2,27558,0.888889,0.965517,0.92562,0.999746,253.94522,0.965517
+sag_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+sah_Cyrl,57,57,27,0,27539,0.678571,1.0,0.808511,0.999021,979.46746,1.0
+san_Deva,55,54,0,1,27568,1.0,0.981818,0.990826,1.0,0.0,0.981818
+san_Gran,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+sco_Latn,58,56,1,2,27564,0.982456,0.965517,0.973913,0.999964,36.277889,0.965517
+sey_Latn,61,40,36,21,27526,0.526316,0.655738,0.583942,0.998694,1306.146143,0.655738
+shk_Latn,55,0,0,55,27568,0.0,0.0,0.0,1.0,0.0,0.0
+shn_Mymr,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+shp_Latn,62,16,0,46,27561,1.0,0.258065,0.410256,1.0,0.0,0.258065
+sid_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+sin_Sinh,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+skr_Arab,63,54,0,9,27560,1.0,0.857143,0.923077,1.0,0.0,0.857143
+slk_Latn,56,55,1,1,27566,0.982143,0.982143,0.982143,0.999964,36.275257,0.982143
+slr_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+slv_Latn,59,55,2,4,27562,0.964912,0.932203,0.948276,0.999927,72.55841,0.932203
+sme_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+smo_Latn,63,63,0,0,27560,1.0,1.0,1.0,1.0,0.0,1.0
+sna_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+snk_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+snn_Latn,136,92,10,44,27477,0.901961,0.676471,0.773109,0.999636,363.808346,0.676471
+som_Latn,57,57,25,0,27541,0.695122,1.0,0.820144,0.999093,906.914315,1.0
+sot_Latn,57,57,0,0,27566,1.0,1.0,1.0,1.0,0.0,1.0
+spa_Latn,78,77,1,1,27544,0.987179,0.987179,0.987179,0.999964,36.304229,0.987179
+src_Latn,59,0,0,59,27564,0.0,0.0,0.0,1.0,0.0,0.0
+srp_Cyrl,59,57,58,2,27506,0.495652,0.966102,0.655172,0.997896,2104.193876,0.966102
+srp_Latn,59,29,34,30,27530,0.460317,0.491525,0.47541,0.998767,1233.492962,0.491525
+srr_Latn,58,58,2,0,27563,0.966667,1.0,0.983051,0.999927,72.555777,1.0
+ssw_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+suk_Latn,58,56,46,2,27519,0.54902,0.965517,0.7,0.998331,1668.782877,0.965517
+sun_Latn,66,63,0,3,27557,1.0,0.954545,0.976744,1.0,0.0,0.954545
+sus_Latn,58,54,4,4,27561,0.931034,0.931034,0.931034,0.999855,145.111555,0.931034
+swb_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+swe_Latn,61,61,0,0,27562,1.0,1.0,1.0,1.0,0.0,1.0
+swh_Latn,58,52,3,6,27562,0.945455,0.896552,0.920354,0.999891,108.833666,0.896552
+tah_Latn,57,54,0,3,27566,1.0,0.947368,0.972973,1.0,0.0,0.947368
+taj_Deva,1,1,0,0,27622,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Taml,68,68,0,0,27555,1.0,1.0,1.0,1.0,0.0,1.0
+tat_Cyrl,57,56,6,1,27560,0.903226,0.982456,0.941176,0.999782,217.659436,0.982456
+tbz_Latn,60,12,0,48,27563,1.0,0.2,0.333333,1.0,0.0,0.2
+tca_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+tdt_Latn,57,21,8,36,27558,0.724138,0.368421,0.488372,0.99971,290.212581,0.368421
+tel_Telu,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tem_Latn,55,55,1,0,27567,0.982143,1.0,0.990991,0.999964,36.273941,1.0
+tet_Latn,58,51,39,7,27526,0.566667,0.87931,0.689189,0.998585,1414.837656,0.87931
+tgk_Cyrl,57,57,7,0,27559,0.890625,1.0,0.942149,0.999746,253.936008,1.0
+tgl_Tglg,1,0,0,1,27622,0.0,0.0,0.0,1.0,0.0,0.0
+tha_Thai,114,114,0,0,27509,1.0,1.0,1.0,1.0,0.0,1.0
+tir_Ethi,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+tiv_Latn,67,67,1,0,27555,0.985294,1.0,0.992593,0.999964,36.289737,1.0
+tly_Latn,59,58,0,1,27564,1.0,0.983051,0.991453,1.0,0.0,0.983051
+tob_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+toi_Latn,57,53,0,4,27566,1.0,0.929825,0.963636,1.0,0.0,0.929825
+toj_Latn,57,57,1,0,27565,0.982759,1.0,0.991304,0.999964,36.276573,1.0
+ton_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+top_Latn,59,59,3,0,27561,0.951613,1.0,0.975207,0.999891,108.837614,1.0
+tpi_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tsn_Latn,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+tso_Latn,114,89,0,25,27509,1.0,0.780702,0.876847,1.0,0.0,0.780702
+tsz_Latn,59,58,22,1,27542,0.725,0.983051,0.834532,0.999202,798.142505,0.983051
+tuk_Cyrl,57,54,2,3,27564,0.964286,0.947368,0.955752,0.999927,72.553145,0.947368
+tuk_Latn,59,59,2,0,27562,0.967213,1.0,0.983333,0.999927,72.55841,1.0
+tur_Latn,59,59,5,0,27559,0.921875,1.0,0.95935,0.999819,181.396024,1.0
+twi_Latn,116,115,2,1,27505,0.982906,0.991379,0.987124,0.999927,72.708765,0.991379
+tyv_Cyrl,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+tzh_Latn,25,25,3,0,27595,0.892857,1.0,0.943396,0.999891,108.703529,1.0
+tzm_Tfng,1,1,4,0,27618,0.2,1.0,0.333333,0.999855,144.812106,1.0
+tzo_Latn,58,55,0,3,27565,1.0,0.948276,0.973451,1.0,0.0,0.948276
+udu_Latn,60,60,2,0,27561,0.967742,1.0,0.983607,0.999927,72.561042,1.0
+uig_Arab,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Latn,59,59,69,0,27495,0.460938,1.0,0.631016,0.997497,2503.265128,1.0
+ukr_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+umb_Latn,107,83,0,24,27516,1.0,0.775701,0.873684,1.0,0.0,0.775701
+ura_Latn,56,56,0,0,27567,1.0,1.0,1.0,1.0,0.0,1.0
+urd_Arab,108,107,0,1,27515,1.0,0.990741,0.995349,1.0,0.0,0.990741
+uzn_Cyrl,58,58,0,0,27565,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Latn,58,58,11,0,27554,0.84058,1.0,0.913386,0.999601,399.056775,1.0
+vai_Vaii,60,0,0,60,27563,0.0,0.0,0.0,1.0,0.0,0.0
+vec_Latn,58,57,10,1,27555,0.850746,0.982759,0.912,0.999637,362.778886,0.982759
+ven_Latn,89,89,5,0,27529,0.946809,1.0,0.972678,0.999818,181.593666,1.0
+vep_Latn,58,57,0,1,27565,1.0,0.982759,0.991304,1.0,0.0,0.982759
+vie_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+vmw_Latn,58,56,0,2,27565,1.0,0.965517,0.982456,1.0,0.0,0.965517
+war_Latn,60,60,0,0,27563,1.0,1.0,1.0,1.0,0.0,1.0
+wln_Latn,59,58,57,1,27507,0.504348,0.983051,0.666667,0.997932,2067.914671,0.983051
+wol_Latn,60,60,15,0,27548,0.8,1.0,0.888889,0.999456,544.207815,1.0
+wuu_Hani,48,43,92,5,27483,0.318519,0.895833,0.469945,0.996664,3336.355394,0.895833
+wwa_Latn,39,0,0,39,27584,0.0,0.0,0.0,1.0,0.0,0.0
+xho_Latn,58,52,3,6,27562,0.945455,0.896552,0.920354,0.999891,108.833666,0.896552
+xsm_Latn,59,57,16,2,27548,0.780822,0.966102,0.863636,0.99942,580.467276,0.966102
+yad_Latn,55,55,0,0,27568,1.0,1.0,1.0,1.0,0.0,1.0
+yao_Latn,52,52,0,0,27571,1.0,1.0,1.0,1.0,0.0,1.0
+yap_Latn,58,58,1,0,27564,0.983051,1.0,0.991453,0.999964,36.277889,1.0
+ydd_Hebr,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+ykg_Cyrl,51,0,0,51,27572,0.0,0.0,0.0,1.0,0.0,0.0
+yor_Latn,57,57,15,0,27551,0.791667,1.0,0.883721,0.999456,544.148589,1.0
+yrk_Cyrl,55,53,3,2,27565,0.946429,0.963636,0.954955,0.999891,108.821822,0.963636
+yua_Latn,59,59,0,0,27564,1.0,1.0,1.0,1.0,0.0,1.0
+yue_Hani,49,30,14,19,27560,0.681818,0.612245,0.645161,0.999492,507.724668,0.612245
+zam_Latn,60,0,4,60,27559,0.0,0.0,0.0,0.999855,145.122084,0.0
+zdj_Latn,50,50,55,0,27518,0.47619,1.0,0.645161,0.998005,1994.704965,1.0
+zgh_Tfng,60,42,0,18,27563,1.0,0.7,0.823529,1.0,0.0,0.7
+zlm_Arab,24,0,0,24,27599,0.0,0.0,0.0,1.0,0.0,0.0
+zlm_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+zro_Latn,56,0,0,56,27567,0.0,0.0,0.0,1.0,0.0,0.0
+ztu_Latn,58,0,0,58,27565,0.0,0.0,0.0,1.0,0.0,0.0
+zul_Latn,58,51,3,7,27562,0.944444,0.87931,0.910714,0.999891,108.833666,0.87931
+zyb_Latn,57,57,25,0,27541,0.695122,1.0,0.820144,0.999093,906.914315,1.0

reports/udhr-all/millid_summary.json

@@ -0,0 +1,17 @@
+{
+  "top1_accuracy": 0.7301162075082359,
+  "top3_accuracy": 0.787459725590993,
+  "top5_accuracy": 0.8000579227455381,
+  "passages": 27623,
+  "languages": 429,
+  "macro_precision": 0.7415821358834683,
+  "macro_recall": 0.7318378431434776,
+  "macro_f1": 0.7184065533373333,
+  "macro_specificity": 0.9998030684269821,
+  "weighted_f1": 0.7228843826462673,
+  "median_f1": 0.9672131147540983,
+  "languages_f1_at_least_0_9": 266,
+  "languages_f1_below_0_5": 108,
+  "mean_fp_per_million": 196.93157301787522,
+  "micro_f1": 0.7301162075082359
+}

reports/udhr/glotlid@millid_per_language.csv

@@ -0,0 +1,359 @@
+label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
+abk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+ace_Latn,61,60,0,1,23598,1.0,0.983607,0.991736,1.0,0.0,0.983607
+acu_Latn,180,134,0,46,23479,1.0,0.744444,0.853503,1.0,0.0,0.744444
+ada_Latn,59,59,8,0,23592,0.880597,1.0,0.936508,0.999661,338.983051,1.0
+ady_Cyrl,56,54,0,2,23603,1.0,0.964286,0.981818,1.0,0.0,0.964286
+afr_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+agr_Latn,57,56,2,1,23600,0.965517,0.982456,0.973913,0.999915,84.738581,0.982456
+aii_Syrc,57,0,0,57,23602,0.0,0.0,0.0,1.0,0.0,0.0
+ajg_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+als_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+alt_Cyrl,51,51,4,0,23604,0.927273,1.0,0.962264,0.999831,169.43409,1.0
+ame_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+amh_Ethi,51,51,0,0,23608,1.0,1.0,1.0,1.0,0.0,1.0
+ami_Latn,58,0,1,58,23600,0.0,0.0,0.0,0.999958,42.371086,0.0
+amr_Latn,61,61,3,0,23595,0.953125,1.0,0.976,0.999873,127.129418,1.0
+arb_Arab,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+arl_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+arn_Latn,58,48,0,10,23601,1.0,0.827586,0.90566,1.0,0.0,0.827586
+ast_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+auc_Latn,154,0,0,154,23505,0.0,0.0,0.0,1.0,0.0,0.0
+ayr_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Cyrl,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+bam_Latn,57,50,26,7,23576,0.657895,0.877193,0.75188,0.998898,1101.601559,0.877193
+ban_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+bba_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bci_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bcl_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+bel_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bem_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+ben_Beng,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bho_Deva,56,49,0,7,23603,1.0,0.875,0.933333,1.0,0.0,0.875
+bin_Latn,47,41,0,6,23612,1.0,0.87234,0.931818,1.0,0.0,0.87234
+bis_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+boa_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+bod_Tibt,60,50,1,10,23598,0.980392,0.833333,0.900901,0.999958,42.374677,0.833333
+bos_Latn,59,27,87,32,23513,0.236842,0.457627,0.312139,0.996314,3686.440678,0.457627
+bre_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+bug_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+bul_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bum_Latn,58,3,0,55,23601,1.0,0.051724,0.098361,1.0,0.0,0.051724
+cab_Latn,60,58,0,2,23599,1.0,0.966667,0.983051,1.0,0.0,0.966667
+cak_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+cat_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+cbi_Latn,62,61,0,1,23597,1.0,0.983871,0.99187,1.0,0.0,0.983871
+cbr_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+cbs_Latn,43,41,1,2,23615,0.97619,0.953488,0.964706,0.999958,42.344173,0.953488
+cbt_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+cbu_Latn,57,45,1,12,23601,0.978261,0.789474,0.873786,0.999958,42.369291,0.789474
+ceb_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+ces_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+cfm_Latn,57,55,0,2,23602,1.0,0.964912,0.982143,1.0,0.0,0.964912
+cha_Latn,57,49,0,8,23602,1.0,0.859649,0.924528,1.0,0.0,0.859649
+chk_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+chr_Cher,115,57,0,58,23544,1.0,0.495652,0.662791,1.0,0.0,0.495652
+chv_Cyrl,25,25,0,0,23634,1.0,1.0,1.0,1.0,0.0,1.0
+cjk_Latn,114,114,0,0,23545,1.0,1.0,1.0,1.0,0.0,1.0
+cjs_Cyrl,59,52,0,7,23600,1.0,0.881356,0.936937,1.0,0.0,0.881356
+cmn_Hani,319,293,63,26,23277,0.823034,0.918495,0.868148,0.997301,2699.228792,0.918495
+cnh_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+cni_Latn,52,52,4,0,23603,0.928571,1.0,0.962963,0.999831,169.441267,1.0
+cnr_Latn,59,1,6,58,23594,0.142857,0.016949,0.030303,0.999746,254.237288,0.016949
+cof_Latn,59,52,0,7,23600,1.0,0.881356,0.936937,1.0,0.0,0.881356
+cos_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+cot_Latn,60,59,0,1,23599,1.0,0.983333,0.991597,1.0,0.0,0.983333
+cpu_Latn,60,57,0,3,23599,1.0,0.95,0.974359,1.0,0.0,0.95
+crh_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+crs_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ctd_Latn,60,34,0,26,23599,1.0,0.566667,0.723404,1.0,0.0,0.566667
+cym_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+dag_Latn,57,56,2,1,23600,0.965517,0.982456,0.973913,0.999915,84.738581,0.982456
+dan_Latn,61,59,0,2,23598,1.0,0.967213,0.983333,1.0,0.0,0.967213
+deu_Latn,67,67,0,0,23592,1.0,1.0,1.0,1.0,0.0,1.0
+dga_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+div_Thaa,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+dje_Latn,54,49,0,5,23605,1.0,0.907407,0.951456,1.0,0.0,0.907407
+dyo_Latn,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+dyu_Latn,58,18,7,40,23594,0.72,0.310345,0.433735,0.999703,296.597602,0.310345
+dzo_Tibt,59,58,10,1,23590,0.852941,0.983051,0.913386,0.999576,423.728814,0.983051
+ekk_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+ell_Grek,115,115,0,0,23544,1.0,1.0,1.0,1.0,0.0,1.0
+eng_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+epo_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ese_Latn,35,34,0,1,23624,1.0,0.971429,0.985507,1.0,0.0,0.971429
+eus_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+eve_Cyrl,49,39,0,10,23610,1.0,0.795918,0.886364,1.0,0.0,0.795918
+ewe_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fao_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+fas_Arab,114,114,0,0,23545,1.0,1.0,1.0,1.0,0.0,1.0
+fat_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+fij_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fil_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+fin_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+fkv_Latn,58,29,0,29,23601,1.0,0.5,0.666667,1.0,0.0,0.5
+fon_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+fra_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+fry_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+fuf_Latn,58,21,8,37,23593,0.724138,0.362069,0.482759,0.999661,338.968688,0.362069
+fur_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fuv_Latn,108,63,12,45,23539,0.84,0.583333,0.688525,0.99949,509.532504,0.583333
+gaa_Latn,59,59,2,0,23598,0.967213,1.0,0.983333,0.999915,84.745763,1.0
+gag_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+gaz_Latn,60,59,2,1,23597,0.967213,0.983333,0.975207,0.999915,84.749354,0.983333
+gjn_Latn,60,58,0,2,23599,1.0,0.966667,0.983051,1.0,0.0,0.966667
+gla_Latn,62,60,0,2,23597,1.0,0.967742,0.983607,1.0,0.0,0.967742
+gle_Latn,56,56,2,0,23601,0.965517,1.0,0.982456,0.999915,84.734991,1.0
+glg_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+glv_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gsw_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+guc_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gug_Latn,49,49,0,0,23610,1.0,1.0,1.0,1.0,0.0,1.0
+guj_Gujr,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gyr_Latn,49,48,0,1,23610,1.0,0.979592,0.989691,1.0,0.0,0.979592
+hak_Hani,48,1,0,47,23611,1.0,0.020833,0.040816,1.0,0.0,0.020833
+hat_Latn,117,114,2,3,23540,0.982759,0.974359,0.978541,0.999915,84.954549,0.974359
+hau_Latn,155,155,0,0,23504,1.0,1.0,1.0,1.0,0.0,1.0
+haw_Latn,58,55,0,3,23601,1.0,0.948276,0.973451,1.0,0.0,0.948276
+heb_Hebr,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+hil_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+hin_Deva,59,56,2,3,23598,0.965517,0.949153,0.957265,0.999915,84.745763,0.949153
+hnj_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+hns_Latn,59,52,0,7,23600,1.0,0.881356,0.936937,1.0,0.0,0.881356
+hrv_Latn,58,56,40,2,23561,0.583333,0.965517,0.727273,0.998305,1694.843439,0.965517
+hsb_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+hun_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+hus_Latn,175,170,0,5,23484,1.0,0.971429,0.985507,1.0,0.0,0.971429
+huu_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+hye_Armn,70,70,0,0,23589,1.0,1.0,1.0,1.0,0.0,1.0
+ibo_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ido_Latn,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+idu_Latn,51,45,0,6,23608,1.0,0.882353,0.9375,1.0,0.0,0.882353
+ike_Cans,44,44,2,0,23613,0.956522,1.0,0.977778,0.999915,84.691933,1.0
+ilo_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+ina_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ind_Latn,60,51,2,9,23597,0.962264,0.85,0.902655,0.999915,84.749354,0.85
+isl_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ita_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+jav_Latn,60,59,0,1,23599,1.0,0.983333,0.991597,1.0,0.0,0.983333
+jiv_Latn,60,59,28,1,23571,0.678161,0.983333,0.802721,0.998814,1186.490953,0.983333
+jpn_Jpan,140,140,0,0,23519,1.0,1.0,1.0,1.0,0.0,1.0
+kaa_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kab_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+kal_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kan_Knda,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kat_Geor,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kaz_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kbd_Cyrl,55,55,3,0,23601,0.948276,1.0,0.973451,0.999873,127.097102,1.0
+kbp_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kbr_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+kde_Latn,51,49,1,2,23607,0.98,0.960784,0.970297,0.999958,42.358523,0.960784
+kdh_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+kea_Latn,58,58,8,0,23593,0.878788,1.0,0.935484,0.999661,338.968688,1.0
+kek_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+kha_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+khk_Cyrl,57,56,0,1,23602,1.0,0.982456,0.99115,1.0,0.0,0.982456
+khm_Khmr,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kin_Latn,59,47,0,12,23600,1.0,0.79661,0.886792,1.0,0.0,0.79661
+kir_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kjh_Cyrl,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+kmb_Latn,116,116,0,0,23543,1.0,1.0,1.0,1.0,0.0,1.0
+kmr_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+knc_Latn,64,64,0,0,23595,1.0,1.0,1.0,1.0,0.0,1.0
+kng_Latn,115,16,35,99,23509,0.313725,0.13913,0.192771,0.998513,1486.578321,0.13913
+koi_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+koo_Latn,54,50,0,4,23605,1.0,0.925926,0.961538,1.0,0.0,0.925926
+kor_Hang,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kqn_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kri_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+krl_Latn,183,1,0,182,23476,1.0,0.005464,0.01087,1.0,0.0,0.005464
+ktu_Latn,118,83,43,35,23498,0.65873,0.70339,0.680328,0.998173,1826.600399,0.70339
+kwi_Latn,145,114,1,31,23513,0.991304,0.786207,0.876923,0.999957,42.527856,0.786207
+lad_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+lao_Laoo,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+lat_Latn,118,116,0,2,23541,1.0,0.983051,0.991453,1.0,0.0,0.983051
+lia_Latn,45,45,0,0,23614,1.0,1.0,1.0,1.0,0.0,1.0
+lij_Latn,58,58,19,0,23582,0.753247,1.0,0.859259,0.999195,805.050633,1.0
+lin_Latn,110,110,0,0,23549,1.0,1.0,1.0,1.0,0.0,1.0
+lit_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+lld_Latn,59,34,0,25,23600,1.0,0.576271,0.731183,1.0,0.0,0.576271
+loz_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ltz_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+lua_Latn,58,34,0,24,23601,1.0,0.586207,0.73913,1.0,0.0,0.586207
+lue_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+lug_Latn,49,49,0,0,23610,1.0,1.0,1.0,1.0,0.0,1.0
+lun_Latn,56,55,0,1,23603,1.0,0.982143,0.990991,1.0,0.0,0.982143
+lus_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+lvs_Latn,115,115,0,0,23544,1.0,1.0,1.0,1.0,0.0,1.0
+mad_Latn,60,58,1,2,23598,0.983051,0.966667,0.97479,0.999958,42.374677,0.966667
+mag_Deva,53,51,4,2,23602,0.927273,0.962264,0.944444,0.999831,169.448445,0.962264
+mah_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mai_Deva,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mal_Mlym,100,100,0,0,23559,1.0,1.0,1.0,1.0,0.0,1.0
+mam_Latn,58,52,0,6,23601,1.0,0.896552,0.945455,1.0,0.0,0.896552
+mar_Deva,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+maz_Latn,59,54,2,5,23598,0.964286,0.915254,0.93913,0.999915,84.745763,0.915254
+mcd_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+mcf_Latn,62,62,1,0,23596,0.984127,1.0,0.992,0.999958,42.378268,1.0
+men_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+mfq_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mic_Latn,59,16,0,43,23600,1.0,0.271186,0.426667,1.0,0.0,0.271186
+min_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+miq_Latn,51,51,0,0,23608,1.0,1.0,1.0,1.0,0.0,1.0
+mkd_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mlt_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+mnw_Mymr,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+mor_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+mos_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+mri_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+mto_Latn,51,0,2,51,23606,0.0,0.0,0.0,0.999915,84.717045,0.0
+mxv_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+mya_Mymr,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+nan_Hani,48,0,1,48,23610,0.0,0.0,0.0,0.999958,42.35314,0.0
+nav_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+nba_Latn,59,0,0,59,23600,0.0,0.0,0.0,1.0,0.0,0.0
+nbl_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+ndo_Latn,58,57,4,1,23597,0.934426,0.982759,0.957983,0.999831,169.484344,0.982759
+nds_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+niu_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+njo_Latn,64,63,0,1,23595,1.0,0.984375,0.992126,1.0,0.0,0.984375
+nld_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nno_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nob_Latn,62,62,3,0,23594,0.953846,1.0,0.976378,0.999873,127.134805,1.0
+not_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+npi_Deva,55,54,0,1,23604,1.0,0.981818,0.990826,1.0,0.0,0.981818
+nso_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nya_Latn,116,116,0,0,23543,1.0,1.0,1.0,1.0,0.0,1.0
+nyn_Latn,50,48,0,2,23609,1.0,0.96,0.979592,1.0,0.0,0.96
+nzi_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+oci_Latn,398,92,0,306,23261,1.0,0.231156,0.37551,1.0,0.0,0.231156
+ojb_Cans,43,40,0,3,23616,1.0,0.930233,0.963855,1.0,0.0,0.930233
+oss_Cyrl,44,44,0,0,23615,1.0,1.0,1.0,1.0,0.0,1.0
+ote_Latn,59,0,0,59,23600,0.0,0.0,0.0,1.0,0.0,0.0
+pam_Latn,66,66,0,0,23593,1.0,1.0,1.0,1.0,0.0,1.0
+pan_Guru,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+pap_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+pau_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+pbb_Latn,56,31,0,25,23603,1.0,0.553571,0.712644,1.0,0.0,0.553571
+pcd_Latn,58,0,2,58,23599,0.0,0.0,0.0,0.999915,84.742172,0.0
+pcm_Latn,56,56,7,0,23596,0.888889,1.0,0.941176,0.999703,296.57247,1.0
+pis_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+plt_Latn,53,53,1,0,23605,0.981481,1.0,0.990654,0.999958,42.362111,1.0
+pnb_Arab,61,61,43,0,23555,0.586538,1.0,0.739394,0.998178,1822.188321,1.0
+pol_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+pon_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+por_Latn,115,115,1,0,23543,0.991379,1.0,0.995671,0.999958,42.473666,1.0
+pov_Latn,115,82,0,33,23544,1.0,0.713043,0.832487,1.0,0.0,0.713043
+quc_Latn,58,50,1,8,23600,0.980392,0.862069,0.917431,0.999958,42.371086,0.862069
+qug_Latn,182,0,0,182,23477,0.0,0.0,0.0,1.0,0.0,0.0
+quh_Latn,57,55,2,2,23600,0.964912,0.964912,0.964912,0.999915,84.738581,0.964912
+quy_Latn,60,59,33,1,23566,0.641304,0.983333,0.776316,0.998602,1398.364337,0.983333
+quz_Latn,57,53,7,4,23595,0.883333,0.929825,0.905983,0.999703,296.585035,0.929825
+qva_Latn,59,1,1,58,23599,0.5,0.016949,0.032787,0.999958,42.372881,0.016949
+qvc_Latn,58,58,12,0,23589,0.828571,1.0,0.90625,0.999492,508.453032,1.0
+qvh_Latn,58,5,2,53,23599,0.714286,0.086207,0.153846,0.999915,84.742172,0.086207
+qvm_Latn,60,20,0,40,23599,1.0,0.333333,0.5,1.0,0.0,0.333333
+qvn_Latn,57,17,0,40,23602,1.0,0.298246,0.459459,1.0,0.0,0.298246
+qwh_Latn,59,36,15,23,23585,0.705882,0.610169,0.654545,0.999364,635.59322,0.610169
+qxn_Latn,57,1,0,56,23602,1.0,0.017544,0.034483,1.0,0.0,0.017544
+rar_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+rmn_Latn,116,87,0,29,23543,1.0,0.75,0.857143,1.0,0.0,0.75
+roh_Latn,399,399,1,0,23259,0.9975,1.0,0.998748,0.999957,42.992261,1.0
+ron_Latn,97,97,0,0,23562,1.0,1.0,1.0,1.0,0.0,1.0
+run_Latn,58,58,13,0,23588,0.816901,1.0,0.899225,0.999449,550.824118,1.0
+rup_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+rus_Cyrl,58,58,4,0,23597,0.935484,1.0,0.966667,0.999831,169.484344,1.0
+sag_Latn,59,24,0,35,23600,1.0,0.40678,0.578313,1.0,0.0,0.40678
+sah_Cyrl,57,57,5,0,23597,0.919355,1.0,0.957983,0.999788,211.846454,1.0
+san_Deva,55,54,0,1,23604,1.0,0.981818,0.990826,1.0,0.0,0.981818
+sco_Latn,58,55,0,3,23601,1.0,0.948276,0.973451,1.0,0.0,0.948276
+sey_Latn,61,58,78,3,23520,0.426471,0.95082,0.588832,0.996695,3305.364861,0.95082
+shn_Mymr,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+shp_Latn,62,52,0,10,23597,1.0,0.83871,0.912281,1.0,0.0,0.83871
+sid_Latn,57,57,9,0,23593,0.863636,1.0,0.926829,0.999619,381.323617,1.0
+sin_Sinh,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+skr_Arab,63,21,0,42,23596,1.0,0.333333,0.5,1.0,0.0,0.333333
+slk_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+slv_Latn,59,59,3,0,23597,0.951613,1.0,0.975207,0.999873,127.118644,1.0
+sme_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+smo_Latn,63,63,0,0,23596,1.0,1.0,1.0,1.0,0.0,1.0
+sna_Latn,60,60,1,0,23598,0.983607,1.0,0.991736,0.999958,42.374677,1.0
+snn_Latn,136,47,0,89,23523,1.0,0.345588,0.513661,1.0,0.0,0.345588
+som_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+sot_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+spa_Latn,78,77,1,1,23580,0.987179,0.987179,0.987179,0.999958,42.407023,0.987179
+srp_Cyrl,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+srp_Latn,59,18,3,41,23597,0.857143,0.305085,0.45,0.999873,127.118644,0.305085
+srr_Latn,58,58,2,0,23599,0.966667,1.0,0.983051,0.999915,84.742172,1.0
+ssw_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+suk_Latn,58,57,1,1,23600,0.982759,0.982759,0.982759,0.999958,42.371086,0.982759
+sun_Latn,66,65,0,1,23593,1.0,0.984848,0.992366,1.0,0.0,0.984848
+sus_Latn,58,58,3,0,23598,0.95082,1.0,0.97479,0.999873,127.113258,1.0
+swe_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+swh_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+tah_Latn,57,39,0,18,23602,1.0,0.684211,0.8125,1.0,0.0,0.684211
+taj_Deva,1,1,0,0,23658,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Taml,68,68,0,0,23591,1.0,1.0,1.0,1.0,0.0,1.0
+tat_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+tbz_Latn,60,14,0,46,23599,1.0,0.233333,0.378378,1.0,0.0,0.233333
+tca_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+tdt_Latn,57,48,52,9,23550,0.48,0.842105,0.611465,0.997797,2203.203118,0.842105
+tel_Telu,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tem_Latn,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+tet_Latn,58,6,8,52,23593,0.428571,0.103448,0.166667,0.999661,338.968688,0.103448
+tgk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+tha_Thai,114,114,0,0,23545,1.0,1.0,1.0,1.0,0.0,1.0
+tir_Ethi,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tiv_Latn,67,67,0,0,23592,1.0,1.0,1.0,1.0,0.0,1.0
+tly_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+tob_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+toi_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+toj_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+ton_Latn,60,60,1,0,23598,0.983607,1.0,0.991736,0.999958,42.374677,1.0
+top_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+tpi_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tsn_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+tso_Latn,114,73,0,41,23545,1.0,0.640351,0.780749,1.0,0.0,0.640351
+tsz_Latn,59,57,1,2,23599,0.982759,0.966102,0.974359,0.999958,42.372881,0.966102
+tuk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+tuk_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+tur_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+twi_Latn,116,116,1,0,23542,0.991453,1.0,0.995708,0.999958,42.47547,1.0
+tyv_Cyrl,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+tzh_Latn,25,25,1,0,23633,0.961538,1.0,0.980392,0.999958,42.311924,1.0
+tzm_Tfng,1,1,29,0,23629,0.033333,1.0,0.064516,0.998774,1225.800998,1.0
+tzo_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+udu_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Arab,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Latn,59,59,3,0,23597,0.951613,1.0,0.975207,0.999873,127.118644,1.0
+ukr_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+umb_Latn,107,105,0,2,23552,1.0,0.981308,0.990566,1.0,0.0,0.981308
+ura_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+urd_Arab,108,106,1,2,23550,0.990654,0.981481,0.986047,0.999958,42.461042,0.981481
+uzn_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+vec_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ven_Latn,89,89,0,0,23570,1.0,1.0,1.0,1.0,0.0,1.0
+vep_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+vie_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+vmw_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+war_Latn,60,60,1,0,23598,0.983607,1.0,0.991736,0.999958,42.374677,1.0
+wln_Latn,59,56,56,3,23544,0.5,0.949153,0.654971,0.997627,2372.881356,0.949153
+wol_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+wuu_Hani,48,47,75,1,23536,0.385246,0.979167,0.552941,0.996824,3176.485536,0.979167
+xho_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+xsm_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+yad_Latn,55,53,0,2,23604,1.0,0.963636,0.981481,1.0,0.0,0.963636
+yao_Latn,52,51,0,1,23607,1.0,0.980769,0.990291,1.0,0.0,0.980769
+yap_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ydd_Hebr,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+yor_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+yrk_Cyrl,55,52,0,3,23604,1.0,0.945455,0.971963,1.0,0.0,0.945455
+yua_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+yue_Hani,49,20,0,29,23610,1.0,0.408163,0.57971,1.0,0.0,0.408163
+zam_Latn,60,0,2,60,23597,0.0,0.0,0.0,0.999915,84.749354,0.0
+zdj_Latn,50,49,0,1,23609,1.0,0.98,0.989899,1.0,0.0,0.98
+zgh_Tfng,60,18,0,42,23599,1.0,0.3,0.461538,1.0,0.0,0.3
+zul_Latn,58,57,2,1,23599,0.966102,0.982759,0.974359,0.999915,84.742172,0.982759
+zyb_Latn,57,57,3,0,23599,0.95,1.0,0.974359,0.999873,127.107872,1.0

reports/udhr/glotlid@millid_summary.json

@@ -0,0 +1,17 @@
+{
+  "top1_accuracy": 0.8614480747284331,
+  "top3_accuracy": 0.9294137537512152,
+  "top5_accuracy": 0.943319666934359,
+  "passages": 23659,
+  "languages": 358,
+  "macro_precision": 0.9257695969546421,
+  "macro_recall": 0.8844312457708232,
+  "macro_f1": 0.8873151713293488,
+  "macro_specificity": 0.9998860393705818,
+  "weighted_f1": 0.8709300475765809,
+  "median_f1": 0.9915248150542268,
+  "languages_f1_at_least_0_9": 291,
+  "languages_f1_below_0_5": 32,
+  "mean_fp_per_million": 113.96062941822754,
+  "micro_f1": 0.8614480747284331
+}

reports/udhr/glotlid_per_language.csv

@@ -0,0 +1,359 @@
+label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
+abk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+ace_Latn,61,60,0,1,23598,1.0,0.983607,0.991736,1.0,0.0,0.983607
+acu_Latn,180,134,0,46,23479,1.0,0.744444,0.853503,1.0,0.0,0.744444
+ada_Latn,59,59,8,0,23592,0.880597,1.0,0.936508,0.999661,338.983051,1.0
+ady_Cyrl,56,54,0,2,23603,1.0,0.964286,0.981818,1.0,0.0,0.964286
+afr_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+agr_Latn,57,56,2,1,23600,0.965517,0.982456,0.973913,0.999915,84.738581,0.982456
+aii_Syrc,57,0,0,57,23602,0.0,0.0,0.0,1.0,0.0,0.0
+ajg_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+als_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+alt_Cyrl,51,51,4,0,23604,0.927273,1.0,0.962264,0.999831,169.43409,1.0
+ame_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+amh_Ethi,51,51,0,0,23608,1.0,1.0,1.0,1.0,0.0,1.0
+ami_Latn,58,0,1,58,23600,0.0,0.0,0.0,0.999958,42.371086,0.0
+amr_Latn,61,61,3,0,23595,0.953125,1.0,0.976,0.999873,127.129418,1.0
+arb_Arab,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+arl_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+arn_Latn,58,47,0,11,23601,1.0,0.810345,0.895238,1.0,0.0,0.810345
+ast_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+auc_Latn,154,0,0,154,23505,0.0,0.0,0.0,1.0,0.0,0.0
+ayr_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Cyrl,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+bam_Latn,57,50,26,7,23576,0.657895,0.877193,0.75188,0.998898,1101.601559,0.877193
+ban_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+bba_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+bci_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bcl_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+bel_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bem_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+ben_Beng,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bho_Deva,56,49,0,7,23603,1.0,0.875,0.933333,1.0,0.0,0.875
+bin_Latn,47,41,0,6,23612,1.0,0.87234,0.931818,1.0,0.0,0.87234
+bis_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+boa_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+bod_Tibt,60,50,1,10,23598,0.980392,0.833333,0.900901,0.999958,42.374677,0.833333
+bos_Latn,59,27,87,32,23513,0.236842,0.457627,0.312139,0.996314,3686.440678,0.457627
+bre_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+bug_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+bul_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bum_Latn,58,3,0,55,23601,1.0,0.051724,0.098361,1.0,0.0,0.051724
+cab_Latn,60,58,0,2,23599,1.0,0.966667,0.983051,1.0,0.0,0.966667
+cak_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+cat_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+cbi_Latn,62,61,0,1,23597,1.0,0.983871,0.99187,1.0,0.0,0.983871
+cbr_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+cbs_Latn,43,41,1,2,23615,0.97619,0.953488,0.964706,0.999958,42.344173,0.953488
+cbt_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+cbu_Latn,57,45,0,12,23602,1.0,0.789474,0.882353,1.0,0.0,0.789474
+ceb_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+ces_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+cfm_Latn,57,55,0,2,23602,1.0,0.964912,0.982143,1.0,0.0,0.964912
+cha_Latn,57,49,0,8,23602,1.0,0.859649,0.924528,1.0,0.0,0.859649
+chk_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+chr_Cher,115,57,0,58,23544,1.0,0.495652,0.662791,1.0,0.0,0.495652
+chv_Cyrl,25,25,0,0,23634,1.0,1.0,1.0,1.0,0.0,1.0
+cjk_Latn,114,114,0,0,23545,1.0,1.0,1.0,1.0,0.0,1.0
+cjs_Cyrl,59,52,0,7,23600,1.0,0.881356,0.936937,1.0,0.0,0.881356
+cmn_Hani,319,293,63,26,23277,0.823034,0.918495,0.868148,0.997301,2699.228792,0.918495
+cnh_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+cni_Latn,52,52,4,0,23603,0.928571,1.0,0.962963,0.999831,169.441267,1.0
+cnr_Latn,59,1,6,58,23594,0.142857,0.016949,0.030303,0.999746,254.237288,0.016949
+cof_Latn,59,51,0,8,23600,1.0,0.864407,0.927273,1.0,0.0,0.864407
+cos_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+cot_Latn,60,59,0,1,23599,1.0,0.983333,0.991597,1.0,0.0,0.983333
+cpu_Latn,60,57,0,3,23599,1.0,0.95,0.974359,1.0,0.0,0.95
+crh_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+crs_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ctd_Latn,60,32,0,28,23599,1.0,0.533333,0.695652,1.0,0.0,0.533333
+cym_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+dag_Latn,57,56,2,1,23600,0.965517,0.982456,0.973913,0.999915,84.738581,0.982456
+dan_Latn,61,59,0,2,23598,1.0,0.967213,0.983333,1.0,0.0,0.967213
+deu_Latn,67,67,0,0,23592,1.0,1.0,1.0,1.0,0.0,1.0
+dga_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+div_Thaa,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+dje_Latn,54,48,0,6,23605,1.0,0.888889,0.941176,1.0,0.0,0.888889
+dyo_Latn,55,54,0,1,23604,1.0,0.981818,0.990826,1.0,0.0,0.981818
+dyu_Latn,58,18,7,40,23594,0.72,0.310345,0.433735,0.999703,296.597602,0.310345
+dzo_Tibt,59,58,10,1,23590,0.852941,0.983051,0.913386,0.999576,423.728814,0.983051
+ekk_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+ell_Grek,115,115,0,0,23544,1.0,1.0,1.0,1.0,0.0,1.0
+eng_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+epo_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ese_Latn,35,34,0,1,23624,1.0,0.971429,0.985507,1.0,0.0,0.971429
+eus_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+eve_Cyrl,49,39,0,10,23610,1.0,0.795918,0.886364,1.0,0.0,0.795918
+ewe_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fao_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+fas_Arab,114,114,0,0,23545,1.0,1.0,1.0,1.0,0.0,1.0
+fat_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+fij_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fil_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+fin_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+fkv_Latn,58,29,0,29,23601,1.0,0.5,0.666667,1.0,0.0,0.5
+fon_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+fra_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+fry_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+fuf_Latn,58,21,8,37,23593,0.724138,0.362069,0.482759,0.999661,338.968688,0.362069
+fur_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fuv_Latn,108,62,12,46,23539,0.837838,0.574074,0.681319,0.99949,509.532504,0.574074
+gaa_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+gag_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+gaz_Latn,60,59,2,1,23597,0.967213,0.983333,0.975207,0.999915,84.749354,0.983333
+gjn_Latn,60,58,0,2,23599,1.0,0.966667,0.983051,1.0,0.0,0.966667
+gla_Latn,62,60,0,2,23597,1.0,0.967742,0.983607,1.0,0.0,0.967742
+gle_Latn,56,56,2,0,23601,0.965517,1.0,0.982456,0.999915,84.734991,1.0
+glg_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+glv_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gsw_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+guc_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gug_Latn,49,49,0,0,23610,1.0,1.0,1.0,1.0,0.0,1.0
+guj_Gujr,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gyr_Latn,49,48,0,1,23610,1.0,0.979592,0.989691,1.0,0.0,0.979592
+hak_Hani,48,1,0,47,23611,1.0,0.020833,0.040816,1.0,0.0,0.020833
+hat_Latn,117,114,2,3,23540,0.982759,0.974359,0.978541,0.999915,84.954549,0.974359
+hau_Latn,155,155,0,0,23504,1.0,1.0,1.0,1.0,0.0,1.0
+haw_Latn,58,55,0,3,23601,1.0,0.948276,0.973451,1.0,0.0,0.948276
+heb_Hebr,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+hil_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+hin_Deva,59,56,2,3,23598,0.965517,0.949153,0.957265,0.999915,84.745763,0.949153
+hnj_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+hns_Latn,59,52,0,7,23600,1.0,0.881356,0.936937,1.0,0.0,0.881356
+hrv_Latn,58,56,40,2,23561,0.583333,0.965517,0.727273,0.998305,1694.843439,0.965517
+hsb_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+hun_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+hus_Latn,175,170,0,5,23484,1.0,0.971429,0.985507,1.0,0.0,0.971429
+huu_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+hye_Armn,70,70,0,0,23589,1.0,1.0,1.0,1.0,0.0,1.0
+ibo_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ido_Latn,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+idu_Latn,51,40,0,11,23608,1.0,0.784314,0.879121,1.0,0.0,0.784314
+ike_Cans,44,44,2,0,23613,0.956522,1.0,0.977778,0.999915,84.691933,1.0
+ilo_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+ina_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ind_Latn,60,51,2,9,23597,0.962264,0.85,0.902655,0.999915,84.749354,0.85
+isl_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ita_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+jav_Latn,60,59,0,1,23599,1.0,0.983333,0.991597,1.0,0.0,0.983333
+jiv_Latn,60,59,28,1,23571,0.678161,0.983333,0.802721,0.998814,1186.490953,0.983333
+jpn_Jpan,140,140,0,0,23519,1.0,1.0,1.0,1.0,0.0,1.0
+kaa_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kab_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+kal_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kan_Knda,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kat_Geor,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kaz_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kbd_Cyrl,55,55,3,0,23601,0.948276,1.0,0.973451,0.999873,127.097102,1.0
+kbp_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kbr_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+kde_Latn,51,49,1,2,23607,0.98,0.960784,0.970297,0.999958,42.358523,0.960784
+kdh_Latn,59,45,0,14,23600,1.0,0.762712,0.865385,1.0,0.0,0.762712
+kea_Latn,58,58,8,0,23593,0.878788,1.0,0.935484,0.999661,338.968688,1.0
+kek_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+kha_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+khk_Cyrl,57,56,0,1,23602,1.0,0.982456,0.99115,1.0,0.0,0.982456
+khm_Khmr,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kin_Latn,59,47,0,12,23600,1.0,0.79661,0.886792,1.0,0.0,0.79661
+kir_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kjh_Cyrl,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+kmb_Latn,116,116,0,0,23543,1.0,1.0,1.0,1.0,0.0,1.0
+kmr_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+knc_Latn,64,64,0,0,23595,1.0,1.0,1.0,1.0,0.0,1.0
+kng_Latn,115,16,35,99,23509,0.313725,0.13913,0.192771,0.998513,1486.578321,0.13913
+koi_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+koo_Latn,54,50,0,4,23605,1.0,0.925926,0.961538,1.0,0.0,0.925926
+kor_Hang,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kqn_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kri_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+krl_Latn,183,1,0,182,23476,1.0,0.005464,0.01087,1.0,0.0,0.005464
+ktu_Latn,118,83,43,35,23498,0.65873,0.70339,0.680328,0.998173,1826.600399,0.70339
+kwi_Latn,145,114,1,31,23513,0.991304,0.786207,0.876923,0.999957,42.527856,0.786207
+lad_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+lao_Laoo,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+lat_Latn,118,116,0,2,23541,1.0,0.983051,0.991453,1.0,0.0,0.983051
+lia_Latn,45,45,0,0,23614,1.0,1.0,1.0,1.0,0.0,1.0
+lij_Latn,58,58,19,0,23582,0.753247,1.0,0.859259,0.999195,805.050633,1.0
+lin_Latn,110,110,0,0,23549,1.0,1.0,1.0,1.0,0.0,1.0
+lit_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+lld_Latn,59,34,0,25,23600,1.0,0.576271,0.731183,1.0,0.0,0.576271
+loz_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ltz_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+lua_Latn,58,34,0,24,23601,1.0,0.586207,0.73913,1.0,0.0,0.586207
+lue_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+lug_Latn,49,49,0,0,23610,1.0,1.0,1.0,1.0,0.0,1.0
+lun_Latn,56,55,0,1,23603,1.0,0.982143,0.990991,1.0,0.0,0.982143
+lus_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+lvs_Latn,115,115,0,0,23544,1.0,1.0,1.0,1.0,0.0,1.0
+mad_Latn,60,58,1,2,23598,0.983051,0.966667,0.97479,0.999958,42.374677,0.966667
+mag_Deva,53,51,4,2,23602,0.927273,0.962264,0.944444,0.999831,169.448445,0.962264
+mah_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mai_Deva,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mal_Mlym,100,100,0,0,23559,1.0,1.0,1.0,1.0,0.0,1.0
+mam_Latn,58,52,0,6,23601,1.0,0.896552,0.945455,1.0,0.0,0.896552
+mar_Deva,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+maz_Latn,59,54,2,5,23598,0.964286,0.915254,0.93913,0.999915,84.745763,0.915254
+mcd_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+mcf_Latn,62,62,1,0,23596,0.984127,1.0,0.992,0.999958,42.378268,1.0
+men_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+mfq_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mic_Latn,59,16,0,43,23600,1.0,0.271186,0.426667,1.0,0.0,0.271186
+min_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+miq_Latn,51,51,0,0,23608,1.0,1.0,1.0,1.0,0.0,1.0
+mkd_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mlt_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+mnw_Mymr,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+mor_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+mos_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+mri_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+mto_Latn,51,0,2,51,23606,0.0,0.0,0.0,0.999915,84.717045,0.0
+mxv_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+mya_Mymr,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+nan_Hani,48,0,1,48,23610,0.0,0.0,0.0,0.999958,42.35314,0.0
+nav_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+nba_Latn,59,0,0,59,23600,0.0,0.0,0.0,1.0,0.0,0.0
+nbl_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+ndo_Latn,58,57,4,1,23597,0.934426,0.982759,0.957983,0.999831,169.484344,0.982759
+nds_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+niu_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+njo_Latn,64,63,0,1,23595,1.0,0.984375,0.992126,1.0,0.0,0.984375
+nld_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nno_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nob_Latn,62,62,3,0,23594,0.953846,1.0,0.976378,0.999873,127.134805,1.0
+not_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+npi_Deva,55,54,0,1,23604,1.0,0.981818,0.990826,1.0,0.0,0.981818
+nso_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nya_Latn,116,116,0,0,23543,1.0,1.0,1.0,1.0,0.0,1.0
+nyn_Latn,50,48,0,2,23609,1.0,0.96,0.979592,1.0,0.0,0.96
+nzi_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+oci_Latn,398,92,0,306,23261,1.0,0.231156,0.37551,1.0,0.0,0.231156
+ojb_Cans,43,40,0,3,23616,1.0,0.930233,0.963855,1.0,0.0,0.930233
+oss_Cyrl,44,44,0,0,23615,1.0,1.0,1.0,1.0,0.0,1.0
+ote_Latn,59,0,0,59,23600,0.0,0.0,0.0,1.0,0.0,0.0
+pam_Latn,66,66,0,0,23593,1.0,1.0,1.0,1.0,0.0,1.0
+pan_Guru,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+pap_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+pau_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+pbb_Latn,56,31,0,25,23603,1.0,0.553571,0.712644,1.0,0.0,0.553571
+pcd_Latn,58,0,2,58,23599,0.0,0.0,0.0,0.999915,84.742172,0.0
+pcm_Latn,56,55,6,1,23597,0.901639,0.982143,0.940171,0.999746,254.204974,0.982143
+pis_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+plt_Latn,53,53,0,0,23606,1.0,1.0,1.0,1.0,0.0,1.0
+pnb_Arab,61,61,43,0,23555,0.586538,1.0,0.739394,0.998178,1822.188321,1.0
+pol_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+pon_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+por_Latn,115,115,1,0,23543,0.991379,1.0,0.995671,0.999958,42.473666,1.0
+pov_Latn,115,82,0,33,23544,1.0,0.713043,0.832487,1.0,0.0,0.713043
+quc_Latn,58,50,1,8,23600,0.980392,0.862069,0.917431,0.999958,42.371086,0.862069
+qug_Latn,182,0,0,182,23477,0.0,0.0,0.0,1.0,0.0,0.0
+quh_Latn,57,52,2,5,23600,0.962963,0.912281,0.936937,0.999915,84.738581,0.912281
+quy_Latn,60,59,33,1,23566,0.641304,0.983333,0.776316,0.998602,1398.364337,0.983333
+quz_Latn,57,51,6,6,23596,0.894737,0.894737,0.894737,0.999746,254.215744,0.894737
+qva_Latn,59,1,1,58,23599,0.5,0.016949,0.032787,0.999958,42.372881,0.016949
+qvc_Latn,58,58,12,0,23589,0.828571,1.0,0.90625,0.999492,508.453032,1.0
+qvh_Latn,58,5,2,53,23599,0.714286,0.086207,0.153846,0.999915,84.742172,0.086207
+qvm_Latn,60,20,0,40,23599,1.0,0.333333,0.5,1.0,0.0,0.333333
+qvn_Latn,57,17,0,40,23602,1.0,0.298246,0.459459,1.0,0.0,0.298246
+qwh_Latn,59,36,15,23,23585,0.705882,0.610169,0.654545,0.999364,635.59322,0.610169
+qxn_Latn,57,1,0,56,23602,1.0,0.017544,0.034483,1.0,0.0,0.017544
+rar_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+rmn_Latn,116,87,0,29,23543,1.0,0.75,0.857143,1.0,0.0,0.75
+roh_Latn,399,399,1,0,23259,0.9975,1.0,0.998748,0.999957,42.992261,1.0
+ron_Latn,97,97,0,0,23562,1.0,1.0,1.0,1.0,0.0,1.0
+run_Latn,58,58,13,0,23588,0.816901,1.0,0.899225,0.999449,550.824118,1.0
+rup_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+rus_Cyrl,58,58,4,0,23597,0.935484,1.0,0.966667,0.999831,169.484344,1.0
+sag_Latn,59,24,0,35,23600,1.0,0.40678,0.578313,1.0,0.0,0.40678
+sah_Cyrl,57,57,5,0,23597,0.919355,1.0,0.957983,0.999788,211.846454,1.0
+san_Deva,55,54,0,1,23604,1.0,0.981818,0.990826,1.0,0.0,0.981818
+sco_Latn,58,55,0,3,23601,1.0,0.948276,0.973451,1.0,0.0,0.948276
+sey_Latn,61,56,78,5,23520,0.41791,0.918033,0.574359,0.996695,3305.364861,0.918033
+shn_Mymr,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+shp_Latn,62,52,0,10,23597,1.0,0.83871,0.912281,1.0,0.0,0.83871
+sid_Latn,57,57,9,0,23593,0.863636,1.0,0.926829,0.999619,381.323617,1.0
+sin_Sinh,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+skr_Arab,63,21,0,42,23596,1.0,0.333333,0.5,1.0,0.0,0.333333
+slk_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+slv_Latn,59,59,3,0,23597,0.951613,1.0,0.975207,0.999873,127.118644,1.0
+sme_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+smo_Latn,63,63,0,0,23596,1.0,1.0,1.0,1.0,0.0,1.0
+sna_Latn,60,60,1,0,23598,0.983607,1.0,0.991736,0.999958,42.374677,1.0
+snn_Latn,136,47,0,89,23523,1.0,0.345588,0.513661,1.0,0.0,0.345588
+som_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+sot_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+spa_Latn,78,77,1,1,23580,0.987179,0.987179,0.987179,0.999958,42.407023,0.987179
+srp_Cyrl,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+srp_Latn,59,18,3,41,23597,0.857143,0.305085,0.45,0.999873,127.118644,0.305085
+srr_Latn,58,58,2,0,23599,0.966667,1.0,0.983051,0.999915,84.742172,1.0
+ssw_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+suk_Latn,58,57,1,1,23600,0.982759,0.982759,0.982759,0.999958,42.371086,0.982759
+sun_Latn,66,65,0,1,23593,1.0,0.984848,0.992366,1.0,0.0,0.984848
+sus_Latn,58,58,3,0,23598,0.95082,1.0,0.97479,0.999873,127.113258,1.0
+swe_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+swh_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+tah_Latn,57,39,0,18,23602,1.0,0.684211,0.8125,1.0,0.0,0.684211
+taj_Deva,1,1,0,0,23658,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Taml,68,68,0,0,23591,1.0,1.0,1.0,1.0,0.0,1.0
+tat_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+tbz_Latn,60,14,0,46,23599,1.0,0.233333,0.378378,1.0,0.0,0.233333
+tca_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+tdt_Latn,57,48,52,9,23550,0.48,0.842105,0.611465,0.997797,2203.203118,0.842105
+tel_Telu,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tem_Latn,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+tet_Latn,58,6,8,52,23593,0.428571,0.103448,0.166667,0.999661,338.968688,0.103448
+tgk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+tha_Thai,114,114,0,0,23545,1.0,1.0,1.0,1.0,0.0,1.0
+tir_Ethi,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tiv_Latn,67,67,0,0,23592,1.0,1.0,1.0,1.0,0.0,1.0
+tly_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+tob_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+toi_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+toj_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+ton_Latn,60,60,1,0,23598,0.983607,1.0,0.991736,0.999958,42.374677,1.0
+top_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+tpi_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tsn_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+tso_Latn,114,73,0,41,23545,1.0,0.640351,0.780749,1.0,0.0,0.640351
+tsz_Latn,59,56,1,3,23599,0.982456,0.949153,0.965517,0.999958,42.372881,0.949153
+tuk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+tuk_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+tur_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+twi_Latn,116,116,1,0,23542,0.991453,1.0,0.995708,0.999958,42.47547,1.0
+tyv_Cyrl,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+tzh_Latn,25,25,1,0,23633,0.961538,1.0,0.980392,0.999958,42.311924,1.0
+tzm_Tfng,1,1,29,0,23629,0.033333,1.0,0.064516,0.998774,1225.800998,1.0
+tzo_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+udu_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Arab,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Latn,59,59,2,0,23598,0.967213,1.0,0.983333,0.999915,84.745763,1.0
+ukr_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+umb_Latn,107,105,0,2,23552,1.0,0.981308,0.990566,1.0,0.0,0.981308
+ura_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+urd_Arab,108,106,1,2,23550,0.990654,0.981481,0.986047,0.999958,42.461042,0.981481
+uzn_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+vec_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ven_Latn,89,89,0,0,23570,1.0,1.0,1.0,1.0,0.0,1.0
+vep_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+vie_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+vmw_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+war_Latn,60,60,1,0,23598,0.983607,1.0,0.991736,0.999958,42.374677,1.0
+wln_Latn,59,56,56,3,23544,0.5,0.949153,0.654971,0.997627,2372.881356,0.949153
+wol_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+wuu_Hani,48,47,74,1,23537,0.38843,0.979167,0.556213,0.996866,3134.132396,0.979167
+xho_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+xsm_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+yad_Latn,55,53,0,2,23604,1.0,0.963636,0.981481,1.0,0.0,0.963636
+yao_Latn,52,51,0,1,23607,1.0,0.980769,0.990291,1.0,0.0,0.980769
+yap_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ydd_Hebr,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+yor_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+yrk_Cyrl,55,52,0,3,23604,1.0,0.945455,0.971963,1.0,0.0,0.945455
+yua_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+yue_Hani,49,20,0,29,23610,1.0,0.408163,0.57971,1.0,0.0,0.408163
+zam_Latn,60,0,2,60,23597,0.0,0.0,0.0,0.999915,84.749354,0.0
+zdj_Latn,50,48,0,2,23609,1.0,0.96,0.979592,1.0,0.0,0.96
+zgh_Tfng,60,18,0,42,23599,1.0,0.3,0.461538,1.0,0.0,0.3
+zul_Latn,58,57,2,1,23599,0.966102,0.982759,0.974359,0.999915,84.742172,0.982759
+zyb_Latn,57,57,2,0,23600,0.966102,1.0,0.982759,0.999915,84.738581,1.0

reports/udhr/glotlid_summary.json

@@ -0,0 +1,17 @@
+{
+  "top1_accuracy": 0.8598419206221734,
+  "top3_accuracy": 0.9279766684982459,
+  "top5_accuracy": 0.9420516505346802,
+  "passages": 23659,
+  "languages": 358,
+  "macro_precision": 0.9261030959501081,
+  "macro_recall": 0.8825915640670888,
+  "macro_f1": 0.8864649884094992,
+  "macro_specificity": 0.999887104475242,
+  "weighted_f1": 0.8701800337416647,
+  "median_f1": 0.9915248150542268,
+  "languages_f1_at_least_0_9": 287,
+  "languages_f1_below_0_5": 32,
+  "mean_fp_per_million": 112.89552475798357,
+  "micro_f1": 0.8598419206221734
+}

reports/udhr/leaderboard.csv

@@ -0,0 +1,359 @@
+label,language,support,millid_f1,millid_precision,millid_recall,glotlid_f1,glotlid_precision,glotlid_recall,glotlid@millid_f1,glotlid@millid_precision,glotlid@millid_recall,delta,winner
+roh_Latn,Romansh,399,0.9912,0.9975,0.985,0.9987,0.9975,1.0,0.9987,0.9975,1.0,-0.0076,tie
+oci_Latn,Occitan,398,0.3312,1.0,0.1985,0.3755,1.0,0.2312,0.3755,1.0,0.2312,-0.0443,GlotLID
+cmn_Hani,Chinese (Mandarin),319,0.886,0.8209,0.9624,0.8681,0.823,0.9185,0.8681,0.823,0.9185,0.0179,MillID
+krl_Latn,Karelian,183,0.0,0.0,0.0,0.0109,1.0,0.0055,0.0109,1.0,0.0055,-0.0109,GlotLID
+qug_Latn,Chimborazo Highland Quichua,182,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+acu_Latn,Achuar-Shiwiar,180,0.7474,0.9908,0.6,0.8535,1.0,0.7444,0.8535,1.0,0.7444,-0.1061,GlotLID
+hus_Latn,Huastec,175,0.9914,1.0,0.9829,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0058,tie
+hau_Latn,Hausa,155,0.9968,0.9936,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0032,tie
+auc_Latn,Waorani,154,0.0503,0.8,0.026,0.0,0.0,0.0,0.0,0.0,0.0,0.0503,MillID
+kwi_Latn,Awa-Cuaiquer,145,0.775,0.9789,0.6414,0.8769,0.9913,0.7862,0.8769,0.9913,0.7862,-0.1019,GlotLID
+jpn_Jpan,Japanese,140,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+snn_Latn,Siona,136,0.7731,0.902,0.6765,0.5137,1.0,0.3456,0.5137,1.0,0.3456,0.2594,MillID
+ktu_Latn,Kituba (Democratic Republic of Congo),118,0.7687,0.6626,0.9153,0.6803,0.6587,0.7034,0.6803,0.6587,0.7034,0.0884,MillID
+lat_Latn,Latin,118,0.9958,0.9916,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0043,tie
+hat_Latn,Haitian Creole,117,0.9914,1.0,0.9829,0.9785,0.9828,0.9744,0.9785,0.9828,0.9744,0.0128,MillID
+nya_Latn,Nyanja,116,0.9871,0.9829,0.9914,1.0,1.0,1.0,1.0,1.0,1.0,-0.0129,GlotLID
+kmb_Latn,Kimbundu,116,0.9787,0.9664,0.9914,1.0,1.0,1.0,1.0,1.0,1.0,-0.0213,GlotLID
+rmn_Latn,Balkan Romani,116,0.6667,1.0,0.5,0.8571,1.0,0.75,0.8571,1.0,0.75,-0.1905,GlotLID
+twi_Latn,Twi,116,0.9871,0.9829,0.9914,0.9957,0.9915,1.0,0.9957,0.9915,1.0,-0.0086,tie
+chr_Cher,Cherokee,115,0.7151,1.0,0.5565,0.6628,1.0,0.4957,0.6628,1.0,0.4957,0.0523,MillID
+por_Latn,Portuguese,115,0.9957,0.9914,1.0,0.9957,0.9914,1.0,0.9957,0.9914,1.0,0.0,tie
+lvs_Latn,Standard Latvian,115,0.9957,0.9914,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0043,tie
+pov_Latn,Upper Guinea Crioulo,115,0.8384,1.0,0.7217,0.8325,1.0,0.713,0.8325,1.0,0.713,0.0059,tie
+kng_Latn,Koongo,115,0.0469,0.2308,0.0261,0.1928,0.3137,0.1391,0.1928,0.3137,0.1391,-0.1459,GlotLID
+ell_Grek,Greek,115,0.655,1.0,0.487,1.0,1.0,1.0,1.0,1.0,1.0,-0.345,GlotLID
+tha_Thai,Thai,114,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tso_Latn,Tsonga,114,0.8768,1.0,0.7807,0.7807,1.0,0.6404,0.7807,1.0,0.6404,0.0961,MillID
+cjk_Latn,Chokwe,114,0.9493,1.0,0.9035,1.0,1.0,1.0,1.0,1.0,1.0,-0.0507,GlotLID
+fas_Arab,Persian,114,0.9912,1.0,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,-0.0088,tie
+lin_Latn,Lingala,110,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+urd_Arab,Urdu,108,0.9953,1.0,0.9907,0.986,0.9907,0.9815,0.986,0.9907,0.9815,0.0093,tie
+fuv_Latn,Nigerian Fulfulde,108,0.4051,0.64,0.2963,0.6813,0.8378,0.5741,0.6885,0.84,0.5833,-0.2835,GlotLID
+umb_Latn,Umbundu,107,0.8737,1.0,0.7757,0.9906,1.0,0.9813,0.9906,1.0,0.9813,-0.1169,GlotLID
+mal_Mlym,Malayalam,100,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ron_Latn,Romanian,97,0.9949,0.9898,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0051,tie
+ven_Latn,Venda,89,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+spa_Latn,Spanish,78,0.9872,0.9872,0.9872,0.9872,0.9872,0.9872,0.9872,0.9872,0.9872,0.0,tie
+hye_Armn,Armenian,70,0.9928,1.0,0.9857,1.0,1.0,1.0,1.0,1.0,1.0,-0.0072,tie
+tam_Taml,Tamil,68,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tiv_Latn,Tiv,67,0.9926,0.9853,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0074,tie
+deu_Latn,German,67,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+sun_Latn,Sundanese,66,0.9767,1.0,0.9545,0.9924,1.0,0.9848,0.9924,1.0,0.9848,-0.0156,GlotLID
+pam_Latn,Pampanga,66,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+knc_Latn,Central Kanuri,64,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+njo_Latn,Ao Naga,64,0.9922,0.9846,1.0,0.9921,1.0,0.9844,0.9921,1.0,0.9844,0.0001,tie
+skr_Arab,Saraiki,63,0.9231,1.0,0.8571,0.5,1.0,0.3333,0.5,1.0,0.3333,0.4231,MillID
+smo_Latn,Samoan,63,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+nob_Latn,Norwegian Bokmål,62,0.9516,0.9516,0.9516,0.9764,0.9538,1.0,0.9764,0.9538,1.0,-0.0248,GlotLID
+mcf_Latn,Matsés,62,1.0,1.0,1.0,0.992,0.9841,1.0,0.992,0.9841,1.0,0.008,tie
+shp_Latn,Shipibo-Conibo,62,0.4103,1.0,0.2581,0.9123,1.0,0.8387,0.9123,1.0,0.8387,-0.502,GlotLID
+cbi_Latn,Chachi,62,1.0,1.0,1.0,0.9919,1.0,0.9839,0.9919,1.0,0.9839,0.0081,tie
+gla_Latn,Scottish Gaelic,62,0.976,0.9683,0.9839,0.9836,1.0,0.9677,0.9836,1.0,0.9677,-0.0076,tie
+pnb_Arab,Western Panjabi,61,0.9313,0.8714,1.0,0.7394,0.5865,1.0,0.7394,0.5865,1.0,0.1919,MillID
+dan_Latn,Danish,61,0.9587,0.9667,0.9508,0.9833,1.0,0.9672,0.9833,1.0,0.9672,-0.0247,GlotLID
+fin_Latn,Finnish,61,0.9836,0.9836,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,-0.0164,GlotLID
+sey_Latn,Secoya,61,0.5839,0.5263,0.6557,0.5744,0.4179,0.918,0.5888,0.4265,0.9508,-0.0049,tie
+swe_Latn,Swedish,61,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+boa_Latn,Bora,61,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+amr_Latn,Amarakaeri,61,1.0,1.0,1.0,0.976,0.9531,1.0,0.976,0.9531,1.0,0.024,MillID
+ace_Latn,Acehnese,61,0.9833,1.0,0.9672,0.9917,1.0,0.9836,0.9917,1.0,0.9836,-0.0084,tie
+sna_Latn,Shona,60,0.9836,0.9677,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,-0.0081,tie
+bug_Latn,Buginese,60,0.9655,1.0,0.9333,1.0,1.0,1.0,1.0,1.0,1.0,-0.0345,GlotLID
+cab_Latn,Garifuna,60,1.0,1.0,1.0,0.9831,1.0,0.9667,0.9831,1.0,0.9667,0.0169,MillID
+bod_Tibt,Tibetan,60,0.9748,0.9831,0.9667,0.9009,0.9804,0.8333,0.9009,0.9804,0.8333,0.0739,MillID
+cot_Latn,Caquinte,60,0.9831,1.0,0.9667,0.9916,1.0,0.9833,0.9916,1.0,0.9833,-0.0085,tie
+cpu_Latn,Pichis Ashéninka,60,0.5714,1.0,0.4,0.9744,1.0,0.95,0.9744,1.0,0.95,-0.4029,GlotLID
+cbr_Latn,Cashibo-Cacataibo,60,0.9917,0.9836,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0083,tie
+tbz_Latn,Ditammari,60,0.3333,1.0,0.2,0.3784,1.0,0.2333,0.3784,1.0,0.2333,-0.045,GlotLID
+zgh_Tfng,Standard Moroccan Tamazight,60,0.8235,1.0,0.7,0.4615,1.0,0.3,0.4615,1.0,0.3,0.362,MillID
+ton_Latn,Tongan,60,1.0,1.0,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.0083,tie
+tca_Latn,Ticuna,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+zam_Latn,Miahuatlán Zapotec,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+cym_Latn,Welsh,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+qvm_Latn,Margos-Yarowilca-Lauricocha Quechua,60,0.0938,0.75,0.05,0.5,1.0,0.3333,0.5,1.0,0.3333,-0.4062,GlotLID
+quy_Latn,Ayacucho Quechua,60,0.6788,0.5333,0.9333,0.7763,0.6413,0.9833,0.7763,0.6413,0.9833,-0.0975,GlotLID
+fil_Latn,Filipino,60,0.9916,1.0,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+mad_Latn,Madurese,60,0.9655,1.0,0.9333,0.9748,0.9831,0.9667,0.9748,0.9831,0.9667,-0.0093,tie
+mcd_Latn,Sharanahua,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ekk_Latn,Estonian,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ctd_Latn,Tedim Chin,60,0.7879,1.0,0.65,0.6957,1.0,0.5333,0.7234,1.0,0.5667,0.0645,MillID
+gaz_Latn,Oromo (West Central),60,0.9916,1.0,0.9833,0.9752,0.9672,0.9833,0.9752,0.9672,0.9833,0.0164,MillID
+ind_Latn,Indonesian,60,0.6739,0.9688,0.5167,0.9027,0.9623,0.85,0.9027,0.9623,0.85,-0.2287,GlotLID
+jav_Latn,Javanese,60,0.9672,0.9516,0.9833,0.9916,1.0,0.9833,0.9916,1.0,0.9833,-0.0244,GlotLID
+jiv_Latn,Shuar,60,0.7066,0.5514,0.9833,0.8027,0.6782,0.9833,0.8027,0.6782,0.9833,-0.0961,GlotLID
+vie_Latn,Vietnamese,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+wol_Latn,Wolof,60,0.9836,0.9677,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0164,GlotLID
+gjn_Latn,Gonja,60,0.9916,1.0,0.9833,0.9831,1.0,0.9667,0.9831,1.0,0.9667,0.0085,tie
+war_Latn,Waray,60,1.0,1.0,1.0,0.9917,0.9836,1.0,0.9917,0.9836,1.0,0.0083,tie
+ban_Latn,Balinese,60,0.9831,1.0,0.9667,1.0,1.0,1.0,1.0,1.0,1.0,-0.0169,GlotLID
+udu_Latn,Uduk,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+arl_Latn,Arabela,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+afr_Latn,Afrikaans,60,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ada_Latn,Adangme,59,0.9752,0.9516,1.0,0.9365,0.8806,1.0,0.9365,0.8806,1.0,0.0387,MillID
+ceb_Latn,Cebuano,59,0.9833,0.9672,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0167,GlotLID
+als_Latn,Albanian (Tosk),59,0.9828,1.0,0.9661,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID
+ajg_Latn,Aja (Benin),59,0.9593,0.9219,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,-0.0322,GlotLID
+bos_Latn,Bosnian,59,0.2281,0.2364,0.2203,0.3121,0.2368,0.4576,0.3121,0.2368,0.4576,-0.0841,GlotLID
+bre_Latn,Breton,59,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0085,tie
+ssw_Latn,Swati,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+hsb_Latn,Upper Sorbian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+yua_Latn,Yucateco,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+fur_Latn,Friulian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+gaa_Latn,Ga,59,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.9833,0.9672,1.0,0.0083,tie
+gsw_Latn,Swiss German,59,0.8081,1.0,0.678,0.9915,1.0,0.9831,0.9915,1.0,0.9831,-0.1834,GlotLID
+hin_Deva,Hindi,59,0.6067,0.9,0.4576,0.9573,0.9655,0.9492,0.9573,0.9655,0.9492,-0.3505,GlotLID
+hns_Latn,Caribbean Hindustani,59,0.9739,1.0,0.9492,0.9369,1.0,0.8814,0.9369,1.0,0.8814,0.037,MillID
+hun_Latn,Hungarian,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+sin_Sinh,Sinhala,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+srp_Latn,Serbian,59,0.4754,0.4603,0.4915,0.45,0.8571,0.3051,0.45,0.8571,0.3051,0.0254,MillID
+sag_Latn,Sango,59,0.9915,1.0,0.9831,0.5783,1.0,0.4068,0.5783,1.0,0.4068,0.4131,MillID
+srp_Cyrl,Serbian,59,0.9828,1.0,0.9661,0.9915,1.0,0.9831,0.9915,1.0,0.9831,-0.0087,tie
+slv_Latn,Slovenian,59,0.9483,0.9649,0.9322,0.9752,0.9516,1.0,0.9752,0.9516,1.0,-0.0269,GlotLID
+kdh_Latn,Tem,59,1.0,1.0,1.0,0.8654,1.0,0.7627,0.9915,1.0,0.9831,0.0085,tie
+khm_Khmr,Khmer,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kqn_Latn,Kaonde,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+kbr_Latn,Kafa,59,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0085,tie
+kin_Latn,Kinyarwanda,59,0.9412,0.9333,0.9492,0.8868,1.0,0.7966,0.8868,1.0,0.7966,0.0544,MillID
+kbp_Latn,Kabiyè,59,0.9593,0.9219,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0407,GlotLID
+xsm_Latn,Kasem,59,0.9268,0.8906,0.9661,0.9915,1.0,0.9831,0.9915,1.0,0.9831,-0.0646,GlotLID
+gag_Latn,Gagauz,59,0.9828,1.0,0.9661,0.9915,1.0,0.9831,0.9915,1.0,0.9831,-0.0087,tie
+ydd_Hebr,Eastern Yiddish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tly_Latn,Talysh,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie
+bis_Latn,Bislama,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+pol_Latn,Polish,59,0.9655,0.9825,0.9492,1.0,1.0,1.0,1.0,1.0,1.0,-0.0345,GlotLID
+nba_Latn,Nyemba,59,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+nav_Latn,Navajo,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+rar_Latn,Rarotongan,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+qwh_Latn,Huaylas Ancash Quechua,59,0.4955,0.3374,0.9322,0.6545,0.7059,0.6102,0.6545,0.7059,0.6102,-0.159,GlotLID
+dga_Latn,Southern Dagaare,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,1.0,1.0,1.0,-0.0085,tie
+dzo_Tibt,Dzongkha,59,0.9748,0.9667,0.9831,0.9134,0.8529,0.9831,0.9134,0.8529,0.9831,0.0614,MillID
+crh_Latn,Crimean Tatar,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+not_Latn,Nomatsiguenga,59,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0,tie
+ewe_Latn,Ewe,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+fij_Latn,Fijian,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+eus_Latn,Basque,59,0.9672,0.9365,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0328,GlotLID
+lld_Latn,Ladin,59,0.8991,0.98,0.8305,0.7312,1.0,0.5763,0.7312,1.0,0.5763,0.1679,MillID
+uig_Latn,Uyghur,59,0.9916,0.9833,1.0,0.9833,0.9672,1.0,0.9752,0.9516,1.0,0.0164,MillID
+bcl_Latn,Central Bikol,59,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.0,tie
+ayr_Latn,Central Aymara,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+wln_Latn,Walloon,59,0.6667,0.5043,0.9831,0.655,0.5,0.9492,0.655,0.5,0.9492,0.0117,MillID
+cnr_Latn,Serbian (Montenegro),59,0.0,0.0,0.0,0.0303,0.1429,0.0169,0.0303,0.1429,0.0169,-0.0303,GlotLID
+cof_Latn,Colorado,59,1.0,1.0,1.0,0.9273,1.0,0.8644,0.9369,1.0,0.8814,0.0631,MillID
+cos_Latn,Corsican,59,0.9916,0.9833,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0001,tie
+cjs_Cyrl,Shor,59,0.9649,1.0,0.9322,0.9369,1.0,0.8814,0.9369,1.0,0.8814,0.028,MillID
+qva_Latn,Ambo-Pasco Quechua,59,0.0,0.0,0.0,0.0328,0.5,0.0169,0.0328,0.5,0.0169,-0.0328,GlotLID
+ote_Latn,Mezquital Otomi,59,0.0656,1.0,0.0339,0.0,0.0,0.0,0.0,0.0,0.0,0.0656,MillID
+nzi_Latn,Nzima,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tsz_Latn,Purepecha,59,0.9915,1.0,0.9831,0.9655,0.9825,0.9492,0.9744,0.9828,0.9661,0.0171,MillID
+tob_Latn,Toba,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ame_Latn,Yanesha',59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tur_Latn,Turkish,59,0.9833,0.9672,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,-0.0083,tie
+tuk_Latn,Turkmen,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+top_Latn,Papantla Totonac,59,0.9833,0.9672,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,-0.0083,tie
+maz_Latn,Central Mazahua,59,0.7421,0.59,1.0,0.9391,0.9643,0.9153,0.9391,0.9643,0.9153,-0.197,GlotLID
+men_Latn,Mende,59,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.9916,0.9833,1.0,0.0,tie
+mic_Latn,Mi'kmaw,59,1.0,1.0,1.0,0.4267,1.0,0.2712,0.4267,1.0,0.2712,0.5733,MillID
+ltz_Latn,Luxembourgish,59,0.9916,0.9833,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0001,tie
+min_Latn,Minangkabau,59,0.9915,1.0,0.9831,0.9916,0.9833,1.0,0.9916,0.9833,1.0,-0.0001,tie
+mor_Latn,Moro,59,1.0,1.0,1.0,0.9915,1.0,0.9831,0.9915,1.0,0.9831,0.0085,tie
+mlt_Latn,Maltese,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+mar_Deva,Marathi,59,0.9916,0.9833,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0084,tie
+ibo_Latn,Igbo,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+kat_Geor,Georgian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kha_Latn,Khasi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kab_Latn,Kabyle,58,0.9915,0.9831,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.0001,tie
+heb_Hebr,Hebrew,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+sco_Latn,Scots,58,0.9825,1.0,0.9655,0.9735,1.0,0.9483,0.9735,1.0,0.9483,0.009,tie
+srr_Latn,Serer,58,1.0,1.0,1.0,0.9831,0.9667,1.0,0.9831,0.9667,1.0,0.0169,MillID
+kaz_Cyrl,Kazakh,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ces_Latn,Czech,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+bul_Cyrl,Bulgarian,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+suk_Latn,Sukuma,58,0.9825,1.0,0.9655,0.9828,0.9828,0.9828,0.9828,0.9828,0.9828,-0.0003,tie
+zul_Latn,Zulu,58,0.9107,0.9444,0.8793,0.9744,0.9661,0.9828,0.9744,0.9661,0.9828,-0.0636,GlotLID
+chk_Latn,Chuukese,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+guj_Gujr,Gujarati,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+guc_Latn,Wayuu,58,0.9667,0.9355,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0333,GlotLID
+tzo_Latn,Tzotzil,58,0.9735,1.0,0.9483,0.9913,1.0,0.9828,0.9913,1.0,0.9828,-0.0179,GlotLID
+vmw_Latn,Makhuwa,58,0.9825,1.0,0.9655,0.9825,1.0,0.9655,0.9913,1.0,0.9828,-0.0088,tie
+vec_Latn,Venetian,58,0.9828,0.9828,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID
+ukr_Cyrl,Ukrainian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+bci_Latn,Baoulé,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+bba_Latn,Baatonum,58,0.9913,1.0,0.9828,0.9913,1.0,0.9828,1.0,1.0,1.0,-0.0087,tie
+bel_Cyrl,Belarusian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+uig_Arab,Uyghur,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ast_Latn,Asturian,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID
+sus_Latn,Susu,58,0.9643,1.0,0.931,0.9748,0.9508,1.0,0.9748,0.9508,1.0,-0.0105,GlotLID
+uzn_Cyrl,Northern Uzbek,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+uzn_Latn,Northern Uzbek,58,0.928,0.8657,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0635,GlotLID
+ndo_Latn,Ndonga,58,0.9431,0.8923,1.0,0.958,0.9344,0.9828,0.958,0.9344,0.9828,-0.0149,GlotLID
+nds_Latn,Low German,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+qvh_Latn,Huamalíes-Dos de Mayo Huánuco Quechua,58,0.2154,1.0,0.1207,0.1538,0.7143,0.0862,0.1538,0.7143,0.0862,0.0615,MillID
+qvc_Latn,Cajamarca Quechua,58,0.7891,0.6517,1.0,0.9062,0.8286,1.0,0.9062,0.8286,1.0,-0.1171,GlotLID
+dyu_Latn,Dyula,58,0.0,0.0,0.0,0.4337,0.72,0.3103,0.4337,0.72,0.3103,-0.4337,GlotLID
+eng_Latn,English,58,0.9744,0.9661,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0256,GlotLID
+yap_Latn,Yapese,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+kmr_Latn,Northern Kurdish,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID
+kir_Cyrl,Kyrgyz,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+glv_Latn,Manx,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kor_Hang,Korean,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+rus_Cyrl,Russian,58,0.9573,0.9492,0.9655,0.9667,0.9355,1.0,0.9667,0.9355,1.0,-0.0094,tie
+glg_Latn,Galician,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+xho_Latn,Xhosa,58,0.9204,0.9455,0.8966,1.0,1.0,1.0,1.0,1.0,1.0,-0.0796,GlotLID
+kaa_Cyrl,Kara-Kalpak,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+kal_Latn,Kalaallisut,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kea_Latn,Kabuverdianu,58,0.7945,0.6591,1.0,0.9355,0.8788,1.0,0.9355,0.8788,1.0,-0.141,GlotLID
+kan_Knda,Kannada,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ina_Latn,Interlingua,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ilo_Latn,Iloko,58,1.0,1.0,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,0.0087,tie
+bum_Latn,Bulu,58,0.3188,1.0,0.1897,0.0984,1.0,0.0517,0.0984,1.0,0.0517,0.2205,MillID
+cat_Latn,Catalan,58,0.9667,0.9355,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0333,GlotLID
+sme_Latn,Northern Sami,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+haw_Latn,Hawaiian,58,1.0,1.0,1.0,0.9735,1.0,0.9483,0.9735,1.0,0.9483,0.0265,MillID
+hnj_Latn,Hmong Njua,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+hil_Latn,Hiligaynon,58,0.9739,0.9825,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0261,GlotLID
+hrv_Latn,Croatian,58,0.5371,0.4017,0.8103,0.7273,0.5833,0.9655,0.7273,0.5833,0.9655,-0.1901,GlotLID
+huu_Latn,Murui Huitoto,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+kri_Latn,Krio,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+nso_Latn,Northern Sotho,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+nld_Latn,Dutch,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+niu_Latn,Niuean,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+mxv_Latn,Metlatónoc Mixtec,58,0.2154,1.0,0.1207,0.0,0.0,0.0,0.0,0.0,0.0,0.2154,MillID
+lij_Latn,Ligurian,58,0.9587,0.9206,1.0,0.8593,0.7532,1.0,0.8593,0.7532,1.0,0.0994,MillID
+lit_Latn,Lithuanian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+loz_Latn,Lozi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+quc_Latn,Kʼicheʼ,58,1.0,1.0,1.0,0.9174,0.9804,0.8621,0.9174,0.9804,0.8621,0.0826,MillID
+run_Latn,Rundi,58,0.9391,0.9474,0.931,0.8992,0.8169,1.0,0.8992,0.8169,1.0,0.0399,MillID
+crs_Latn,Seselwa Creole French,58,0.9744,0.9661,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0256,GlotLID
+nbl_Latn,South Ndebele,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+lad_Latn,Ladino,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+lue_Latn,Luvale,58,0.9831,0.9667,1.0,0.9913,1.0,0.9828,0.9913,1.0,0.9828,-0.0083,tie
+mah_Latn,Marshallese,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+lus_Latn,Mizo,58,1.0,1.0,1.0,1.0,1.0,1.0,0.9915,0.9831,1.0,0.0085,tie
+epo_Latn,Esperanto,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID
+lua_Latn,Luba-Lulua,58,0.55,1.0,0.3793,0.7391,1.0,0.5862,0.7391,1.0,0.5862,-0.1891,GlotLID
+ita_Latn,Italian,58,0.9825,1.0,0.9655,1.0,1.0,1.0,1.0,1.0,1.0,-0.0175,GlotLID
+mfq_Latn,Moba,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+isl_Latn,Icelandic,58,0.9455,1.0,0.8966,1.0,1.0,1.0,1.0,1.0,1.0,-0.0545,GlotLID
+mam_Latn,Mam,58,1.0,1.0,1.0,0.9455,1.0,0.8966,0.9455,1.0,0.8966,0.0545,MillID
+mai_Deva,Maithili,58,0.8593,0.7532,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.1407,GlotLID
+mkd_Cyrl,Macedonian,58,0.9748,0.9508,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0252,GlotLID
+azj_Latn,North Azerbaijani,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,tie
+ben_Beng,Bangla,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+arb_Arab,Arabic (Modern Standard),58,0.9259,1.0,0.8621,1.0,1.0,1.0,1.0,1.0,1.0,-0.0741,GlotLID
+ami_Latn,Amis,58,0.0339,1.0,0.0172,0.0,0.0,0.0,0.0,0.0,0.0,0.0339,MillID
+arn_Latn,Mapuche,58,0.9744,0.9661,0.9828,0.8952,1.0,0.8103,0.9057,1.0,0.8276,0.0687,MillID
+tel_Telu,Telugu,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+cnh_Latn,Hakha Chin,58,0.9828,0.9828,0.9828,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0087,tie
+tet_Latn,Tetum,58,0.6986,0.5795,0.8793,0.1667,0.4286,0.1034,0.1667,0.4286,0.1034,0.532,MillID
+vep_Latn,Veps,58,0.9913,1.0,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+tpi_Latn,Tok Pisin,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+fuf_Latn,Pular,58,0.8163,1.0,0.6897,0.4828,0.7241,0.3621,0.4828,0.7241,0.3621,0.3336,MillID
+fry_Latn,Western Frisian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+fkv_Latn,Kven Finnish,58,0.6966,1.0,0.5345,0.6667,1.0,0.5,0.6667,1.0,0.5,0.03,MillID
+pcd_Latn,Picard,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+pan_Guru,Punjabi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+pap_Latn,Papiamento,58,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0085,tie
+swh_Latn,Swahili,58,0.9455,1.0,0.8966,0.9825,1.0,0.9655,0.9825,1.0,0.9655,-0.037,GlotLID
+fon_Latn,Fon,58,0.9649,0.9821,0.9483,0.9913,1.0,0.9828,0.9913,1.0,0.9828,-0.0264,GlotLID
+nno_Latn,Norwegian Nynorsk,58,0.9744,0.9661,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,-0.0256,GlotLID
+tir_Ethi,Tigrinya,58,0.9915,0.9831,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0085,tie
+fra_Latn,French,58,0.9655,0.9655,0.9655,0.9915,0.9831,1.0,0.9915,0.9831,1.0,-0.0259,GlotLID
+tsn_Latn,Tswana,58,1.0,1.0,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0085,tie
+tyv_Cyrl,Tuvinian,58,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.9915,0.9831,1.0,0.0,tie
+zyb_Latn,Yongbei Zhuang,57,0.9744,0.95,1.0,0.9828,0.9661,1.0,0.9744,0.95,1.0,0.0,tie
+agr_Latn,Aguaruna,57,0.9655,0.9492,0.9825,0.9739,0.9655,0.9825,0.9739,0.9655,0.9825,-0.0084,tie
+sid_Latn,Sidamo,57,1.0,1.0,1.0,0.9268,0.8636,1.0,0.9268,0.8636,1.0,0.0732,MillID
+aii_Syrc,Assyrian Neo-Aramaic,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+abk_Cyrl,Abkhazian,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+cbt_Latn,Chayahuita,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0087,tie
+cbu_Latn,Candoshi-Shapra,57,0.3714,1.0,0.2281,0.8824,1.0,0.7895,0.8738,0.9783,0.7895,-0.5024,GlotLID
+cfm_Latn,Falam Chin,57,0.9828,0.9661,1.0,0.9821,1.0,0.9649,0.9821,1.0,0.9649,0.0006,tie
+cha_Latn,Chamorro,57,0.9825,0.9825,0.9825,0.9245,1.0,0.8596,0.9245,1.0,0.8596,0.0579,MillID
+kek_Latn,Kekchí,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+khk_Cyrl,Halh Mongolian,57,1.0,1.0,1.0,0.9912,1.0,0.9825,0.9912,1.0,0.9825,0.0088,tie
+kjh_Cyrl,Khakas,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0087,tie
+koi_Cyrl,Komi-Permyak,57,0.8367,1.0,0.7193,1.0,1.0,1.0,1.0,1.0,1.0,-0.1633,GlotLID
+yor_Latn,Yoruba,57,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0,tie
+sah_Cyrl,Yakut,57,0.9913,0.9828,1.0,0.958,0.9194,1.0,0.958,0.9194,1.0,0.0333,MillID
+som_Latn,Somali,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+sot_Latn,Southern Sotho,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+cak_Latn,Kaqchikel,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+lao_Laoo,Lao,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+fao_Latn,Faroese,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+fat_Latn,Fanti,57,0.9744,0.95,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,-0.0169,GlotLID
+mri_Latn,Māori,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+qxn_Latn,Northern Conchucos Ancash Quechua,57,0.0345,1.0,0.0175,0.0345,1.0,0.0175,0.0345,1.0,0.0175,0.0,tie
+dag_Latn,Dagbani,57,0.9825,0.9825,0.9825,0.9739,0.9655,0.9825,0.9739,0.9655,0.9825,0.0085,tie
+div_Thaa,Divehi,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+quh_Latn,South Bolivian Quechua,57,0.9828,0.9661,1.0,0.9369,0.963,0.9123,0.9649,0.9649,0.9649,0.0178,MillID
+pon_Latn,Pohnpeian,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+rup_Latn,Aromanian,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+pis_Latn,Pijin,57,1.0,1.0,1.0,0.9913,0.9828,1.0,0.9913,0.9828,1.0,0.0087,tie
+qvn_Latn,North Junín Quechua,57,0.2188,1.0,0.1228,0.4595,1.0,0.2982,0.4595,1.0,0.2982,-0.2407,GlotLID
+tdt_Latn,Tetun Dili,57,0.4884,0.7241,0.3684,0.6115,0.48,0.8421,0.6115,0.48,0.8421,-0.1231,GlotLID
+pau_Latn,Palauan,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tuk_Cyrl,Turkmen,57,0.973,1.0,0.9474,1.0,1.0,1.0,1.0,1.0,1.0,-0.027,GlotLID
+quz_Latn,Cusco Quechua,57,0.8929,0.9091,0.8772,0.8947,0.8947,0.8947,0.906,0.8833,0.9298,-0.0131,GlotLID
+tat_Cyrl,Tatar,57,0.9912,1.0,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,-0.0088,tie
+tah_Latn,Tahitian,57,0.973,1.0,0.9474,0.8125,1.0,0.6842,0.8125,1.0,0.6842,0.1605,MillID
+toi_Latn,Tonga (Zambia),57,0.9636,1.0,0.9298,1.0,1.0,1.0,1.0,1.0,1.0,-0.0364,GlotLID
+toj_Latn,Tojolabal,57,0.9913,0.9828,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0087,tie
+tgk_Cyrl,Tajik,57,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+bam_Latn,Bambara,57,0.6267,0.5054,0.8246,0.7519,0.6579,0.8772,0.7519,0.6579,0.8772,-0.1252,GlotLID
+bem_Latn,Bemba,57,0.9828,0.9661,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0172,GlotLID
+azj_Cyrl,North Azerbaijani,56,0.9912,0.9825,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0088,tie
+bho_Deva,Bhojpuri,56,0.6429,0.9643,0.4821,0.9333,1.0,0.875,0.9333,1.0,0.875,-0.2905,GlotLID
+pcm_Latn,Nigerian Pidgin,56,0.9825,0.9655,1.0,0.9402,0.9016,0.9821,0.9412,0.8889,1.0,0.0413,MillID
+pbb_Latn,Páez,56,0.8485,0.9767,0.75,0.7126,1.0,0.5536,0.7126,1.0,0.5536,0.1358,MillID
+mya_Mymr,Burmese,56,0.991,1.0,0.9821,1.0,1.0,1.0,1.0,1.0,1.0,-0.009,tie
+ura_Latn,Urarina,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+gle_Latn,Irish,56,0.9912,0.9825,1.0,0.9825,0.9655,1.0,0.9825,0.9655,1.0,0.0087,tie
+ady_Cyrl,Adyghe,56,0.991,1.0,0.9821,0.9818,1.0,0.9643,0.9818,1.0,0.9643,0.0092,tie
+slk_Latn,Slovak,56,0.9821,0.9821,0.9821,1.0,1.0,1.0,1.0,1.0,1.0,-0.0179,GlotLID
+shn_Mymr,Shan,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+mos_Latn,Mossi,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+lun_Latn,Lunda,56,1.0,1.0,1.0,0.991,1.0,0.9821,0.991,1.0,0.9821,0.009,tie
+npi_Deva,Nepali,55,1.0,1.0,1.0,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.0092,tie
+tem_Latn,Timne,55,0.991,0.9821,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.009,tie
+dyo_Latn,Jola-Fonyi,55,0.9815,1.0,0.9636,0.9908,1.0,0.9818,1.0,1.0,1.0,-0.0185,GlotLID
+mnw_Mymr,Mon,55,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+yrk_Cyrl,Nenets,55,0.9815,1.0,0.9636,0.972,1.0,0.9455,0.972,1.0,0.9455,0.0095,tie
+kbd_Cyrl,Kabardian,55,0.991,0.9821,1.0,0.9735,0.9483,1.0,0.9735,0.9483,1.0,0.0175,MillID
+san_Deva,Sanskrit,55,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.9908,1.0,0.9818,0.0,tie
+yad_Latn,Yagua,55,1.0,1.0,1.0,0.9815,1.0,0.9636,0.9815,1.0,0.9636,0.0185,MillID
+ido_Latn,Ido,55,0.9815,1.0,0.9636,1.0,1.0,1.0,1.0,1.0,1.0,-0.0185,GlotLID
+koo_Latn,Konzo,54,0.9714,1.0,0.9444,0.9615,1.0,0.9259,0.9615,1.0,0.9259,0.0099,tie
+dje_Latn,Zarma,54,0.8866,1.0,0.7963,0.9412,1.0,0.8889,0.9515,1.0,0.9074,-0.0649,GlotLID
+plt_Latn,Malagasy (Plateau),53,1.0,1.0,1.0,1.0,1.0,1.0,0.9907,0.9815,1.0,0.0093,tie
+mag_Deva,Magahi,53,0.8037,0.7963,0.8113,0.9444,0.9273,0.9623,0.9444,0.9273,0.9623,-0.1407,GlotLID
+yao_Latn,Yao,52,1.0,1.0,1.0,0.9903,1.0,0.9808,0.9903,1.0,0.9808,0.0097,tie
+cni_Latn,Asháninka,52,0.7075,0.5474,1.0,0.963,0.9286,1.0,0.963,0.9286,1.0,-0.2555,GlotLID
+alt_Cyrl,Southern Altai,51,0.9903,0.9808,1.0,0.9623,0.9273,1.0,0.9623,0.9273,1.0,0.028,MillID
+kde_Latn,Makonde,51,0.9184,0.9574,0.8824,0.9703,0.98,0.9608,0.9703,0.98,0.9608,-0.0519,GlotLID
+mto_Latn,Totontepec Mixe,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+miq_Latn,Mískito,51,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+idu_Latn,Idoma,51,0.9278,0.9783,0.8824,0.8791,1.0,0.7843,0.9375,1.0,0.8824,-0.0097,tie
+amh_Ethi,Amharic,51,0.9901,1.0,0.9804,1.0,1.0,1.0,1.0,1.0,1.0,-0.0099,tie
+zdj_Latn,Ngazidja Comorian,50,1.0,1.0,1.0,0.9796,1.0,0.96,0.9899,1.0,0.98,0.0101,MillID
+nyn_Latn,Nyankole,50,1.0,1.0,1.0,0.9796,1.0,0.96,0.9796,1.0,0.96,0.0204,MillID
+gug_Latn,Paraguayan Guaraní,49,0.9515,0.9074,1.0,1.0,1.0,1.0,1.0,1.0,1.0,-0.0485,GlotLID
+lug_Latn,Ganda,49,0.9897,1.0,0.9796,1.0,1.0,1.0,1.0,1.0,1.0,-0.0103,GlotLID
+eve_Cyrl,Even,49,0.9897,1.0,0.9796,0.8864,1.0,0.7959,0.8864,1.0,0.7959,0.1033,MillID
+yue_Hani,Cantonese,49,0.6522,0.6977,0.6122,0.5797,1.0,0.4082,0.5797,1.0,0.4082,0.0725,MillID
+gyr_Latn,Guarayu,49,0.339,1.0,0.2041,0.9897,1.0,0.9796,0.9897,1.0,0.9796,-0.6507,GlotLID
+wuu_Hani,Wu Chinese,48,0.6277,0.4831,0.8958,0.5562,0.3884,0.9792,0.5529,0.3852,0.9792,0.0748,MillID
+hak_Hani,Hakka Chinese,48,0.0,0.0,0.0,0.0408,1.0,0.0208,0.0408,1.0,0.0208,-0.0408,GlotLID
+nan_Hani,Min Nan Chinese,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,tie
+bin_Latn,Bini,47,0.9892,1.0,0.9787,0.9318,1.0,0.8723,0.9318,1.0,0.8723,0.0574,MillID
+lia_Latn,West-Central Limba,45,0.9888,1.0,0.9778,1.0,1.0,1.0,1.0,1.0,1.0,-0.0112,GlotLID
+oss_Cyrl,Ossetic,44,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+ike_Cans,Eastern Canadian Inuktitut,44,1.0,1.0,1.0,0.9778,0.9565,1.0,0.9778,0.9565,1.0,0.0222,MillID
+ojb_Cans,Northwestern Ojibwa,43,1.0,1.0,1.0,0.9639,1.0,0.9302,0.9639,1.0,0.9302,0.0361,MillID
+cbs_Latn,Cashinahua,43,0.9885,0.9773,1.0,0.9647,0.9762,0.9535,0.9647,0.9762,0.9535,0.0238,MillID
+ese_Latn,Ese Ejja,35,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.9855,1.0,0.9714,0.0,tie
+tzh_Latn,Tzeltal,25,0.9434,0.8929,1.0,0.9804,0.9615,1.0,0.9804,0.9615,1.0,-0.037,GlotLID
+chv_Cyrl,Chuvash,25,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+taj_Deva,Eastern Tamang,1,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.0,tie
+tzm_Tfng,Central Atlas Tamazight,1,0.3333,0.2,1.0,0.0645,0.0333,1.0,0.0645,0.0333,1.0,0.2688,MillID

reports/udhr/millid_per_language.csv

@@ -0,0 +1,359 @@
+label,support,tp,fp,fn,tn,precision,recall,f1,specificity,fp_per_million,sensitivity
+abk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+ace_Latn,61,59,0,2,23598,1.0,0.967213,0.983333,1.0,0.0,0.967213
+acu_Latn,180,108,1,72,23478,0.990826,0.6,0.747405,0.999957,42.591252,0.6
+ada_Latn,59,59,3,0,23597,0.951613,1.0,0.975207,0.999873,127.118644,1.0
+ady_Cyrl,56,55,0,1,23603,1.0,0.982143,0.990991,1.0,0.0,0.982143
+afr_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+agr_Latn,57,56,3,1,23599,0.949153,0.982456,0.965517,0.999873,127.107872,0.982456
+aii_Syrc,57,0,0,57,23602,0.0,0.0,0.0,1.0,0.0,0.0
+ajg_Latn,59,59,5,0,23595,0.921875,1.0,0.95935,0.999788,211.864407,1.0
+als_Latn,59,57,0,2,23600,1.0,0.966102,0.982759,1.0,0.0,0.966102
+alt_Cyrl,51,51,1,0,23607,0.980769,1.0,0.990291,0.999958,42.358523,1.0
+ame_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+amh_Ethi,51,50,0,1,23608,1.0,0.980392,0.990099,1.0,0.0,0.980392
+ami_Latn,58,1,0,57,23601,1.0,0.017241,0.033898,1.0,0.0,0.017241
+amr_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+arb_Arab,58,50,0,8,23601,1.0,0.862069,0.925926,1.0,0.0,0.862069
+arl_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+arn_Latn,58,57,2,1,23599,0.966102,0.982759,0.974359,0.999915,84.742172,0.982759
+ast_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+auc_Latn,154,4,1,150,23504,0.8,0.025974,0.050314,0.999957,42.54414,0.025974
+ayr_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+azj_Cyrl,56,56,1,0,23602,0.982456,1.0,0.99115,0.999958,42.367496,1.0
+azj_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+bam_Latn,57,47,46,10,23556,0.505376,0.824561,0.626667,0.998051,1948.987374,0.824561
+ban_Latn,60,58,0,2,23599,1.0,0.966667,0.983051,1.0,0.0,0.966667
+bba_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+bci_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bcl_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+bel_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bem_Latn,57,57,2,0,23600,0.966102,1.0,0.982759,0.999915,84.738581,1.0
+ben_Beng,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+bho_Deva,56,27,1,29,23602,0.964286,0.482143,0.642857,0.999958,42.367496,0.482143
+bin_Latn,47,46,0,1,23612,1.0,0.978723,0.989247,1.0,0.0,0.978723
+bis_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+boa_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+bod_Tibt,60,58,1,2,23598,0.983051,0.966667,0.97479,0.999958,42.374677,0.966667
+bos_Latn,59,13,42,46,23558,0.236364,0.220339,0.22807,0.99822,1779.661017,0.220339
+bre_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+bug_Latn,60,56,0,4,23599,1.0,0.933333,0.965517,1.0,0.0,0.933333
+bul_Cyrl,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+bum_Latn,58,11,0,47,23601,1.0,0.189655,0.318841,1.0,0.0,0.189655
+cab_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+cak_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+cat_Latn,58,58,4,0,23597,0.935484,1.0,0.966667,0.999831,169.484344,1.0
+cbi_Latn,62,62,0,0,23597,1.0,1.0,1.0,1.0,0.0,1.0
+cbr_Latn,60,60,1,0,23598,0.983607,1.0,0.991736,0.999958,42.374677,1.0
+cbs_Latn,43,43,1,0,23615,0.977273,1.0,0.988506,0.999958,42.344173,1.0
+cbt_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+cbu_Latn,57,13,0,44,23602,1.0,0.22807,0.371429,1.0,0.0,0.22807
+ceb_Latn,59,59,2,0,23598,0.967213,1.0,0.983333,0.999915,84.745763,1.0
+ces_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+cfm_Latn,57,57,2,0,23600,0.966102,1.0,0.982759,0.999915,84.738581,1.0
+cha_Latn,57,56,1,1,23601,0.982456,0.982456,0.982456,0.999958,42.369291,0.982456
+chk_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+chr_Cher,115,64,0,51,23544,1.0,0.556522,0.715084,1.0,0.0,0.556522
+chv_Cyrl,25,25,0,0,23634,1.0,1.0,1.0,1.0,0.0,1.0
+cjk_Latn,114,103,0,11,23545,1.0,0.903509,0.949309,1.0,0.0,0.903509
+cjs_Cyrl,59,55,0,4,23600,1.0,0.932203,0.964912,1.0,0.0,0.932203
+cmn_Hani,319,307,67,12,23273,0.820856,0.962382,0.886003,0.997129,2870.608398,0.962382
+cnh_Latn,58,57,1,1,23600,0.982759,0.982759,0.982759,0.999958,42.371086,0.982759
+cni_Latn,52,52,43,0,23564,0.547368,1.0,0.707483,0.998179,1821.493625,1.0
+cnr_Latn,59,0,1,59,23599,0.0,0.0,0.0,0.999958,42.372881,0.0
+cof_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+cos_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+cot_Latn,60,58,0,2,23599,1.0,0.966667,0.983051,1.0,0.0,0.966667
+cpu_Latn,60,24,0,36,23599,1.0,0.4,0.571429,1.0,0.0,0.4
+crh_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+crs_Latn,58,57,2,1,23599,0.966102,0.982759,0.974359,0.999915,84.742172,0.982759
+ctd_Latn,60,39,0,21,23599,1.0,0.65,0.787879,1.0,0.0,0.65
+cym_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+dag_Latn,57,56,1,1,23601,0.982456,0.982456,0.982456,0.999958,42.369291,0.982456
+dan_Latn,61,58,2,3,23596,0.966667,0.95082,0.958678,0.999915,84.752945,0.95082
+deu_Latn,67,67,0,0,23592,1.0,1.0,1.0,1.0,0.0,1.0
+dga_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+div_Thaa,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+dje_Latn,54,43,0,11,23605,1.0,0.796296,0.886598,1.0,0.0,0.796296
+dyo_Latn,55,53,0,2,23604,1.0,0.963636,0.981481,1.0,0.0,0.963636
+dyu_Latn,58,0,11,58,23590,0.0,0.0,0.0,0.999534,466.081946,0.0
+dzo_Tibt,59,58,2,1,23598,0.966667,0.983051,0.97479,0.999915,84.745763,0.983051
+ekk_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+ell_Grek,115,56,0,59,23544,1.0,0.486957,0.654971,1.0,0.0,0.486957
+eng_Latn,58,57,2,1,23599,0.966102,0.982759,0.974359,0.999915,84.742172,0.982759
+epo_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+ese_Latn,35,34,0,1,23624,1.0,0.971429,0.985507,1.0,0.0,0.971429
+eus_Latn,59,59,4,0,23596,0.936508,1.0,0.967213,0.999831,169.491525,1.0
+eve_Cyrl,49,48,0,1,23610,1.0,0.979592,0.989691,1.0,0.0,0.979592
+ewe_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fao_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+fas_Arab,114,112,0,2,23545,1.0,0.982456,0.99115,1.0,0.0,0.982456
+fat_Latn,57,57,3,0,23599,0.95,1.0,0.974359,0.999873,127.107872,1.0
+fij_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fil_Latn,60,59,0,1,23599,1.0,0.983333,0.991597,1.0,0.0,0.983333
+fin_Latn,61,60,1,1,23597,0.983607,0.983607,0.983607,0.999958,42.376473,0.983607
+fkv_Latn,58,31,0,27,23601,1.0,0.534483,0.696629,1.0,0.0,0.534483
+fon_Latn,58,55,1,3,23600,0.982143,0.948276,0.964912,0.999958,42.371086,0.948276
+fra_Latn,58,56,2,2,23599,0.965517,0.965517,0.965517,0.999915,84.742172,0.965517
+fry_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+fuf_Latn,58,40,0,18,23601,1.0,0.689655,0.816327,1.0,0.0,0.689655
+fur_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+fuv_Latn,108,32,18,76,23533,0.64,0.296296,0.405063,0.999236,764.298756,0.296296
+gaa_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+gag_Latn,59,57,0,2,23600,1.0,0.966102,0.982759,1.0,0.0,0.966102
+gaz_Latn,60,59,0,1,23599,1.0,0.983333,0.991597,1.0,0.0,0.983333
+gjn_Latn,60,59,0,1,23599,1.0,0.983333,0.991597,1.0,0.0,0.983333
+gla_Latn,62,61,2,1,23595,0.968254,0.983871,0.976,0.999915,84.756537,0.983871
+gle_Latn,56,56,1,0,23602,0.982456,1.0,0.99115,0.999958,42.367496,1.0
+glg_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+glv_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gsw_Latn,59,40,0,19,23600,1.0,0.677966,0.808081,1.0,0.0,0.677966
+guc_Latn,58,58,4,0,23597,0.935484,1.0,0.966667,0.999831,169.484344,1.0
+gug_Latn,49,49,5,0,23605,0.907407,1.0,0.951456,0.999788,211.774672,1.0
+guj_Gujr,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+gyr_Latn,49,10,0,39,23610,1.0,0.204082,0.338983,1.0,0.0,0.204082
+hak_Hani,48,0,1,48,23610,0.0,0.0,0.0,0.999958,42.35314,0.0
+hat_Latn,117,115,0,2,23542,1.0,0.982906,0.991379,1.0,0.0,0.982906
+hau_Latn,155,155,1,0,23503,0.99359,1.0,0.996785,0.999957,42.54595,1.0
+haw_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+heb_Hebr,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+hil_Latn,58,56,1,2,23600,0.982456,0.965517,0.973913,0.999958,42.371086,0.965517
+hin_Deva,59,27,3,32,23597,0.9,0.457627,0.606742,0.999873,127.118644,0.457627
+hnj_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+hns_Latn,59,56,0,3,23600,1.0,0.949153,0.973913,1.0,0.0,0.949153
+hrv_Latn,58,47,70,11,23531,0.401709,0.810345,0.537143,0.997034,2965.976018,0.810345
+hsb_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+hun_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+hus_Latn,175,172,0,3,23484,1.0,0.982857,0.991354,1.0,0.0,0.982857
+huu_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+hye_Armn,70,69,0,1,23589,1.0,0.985714,0.992806,1.0,0.0,0.985714
+ibo_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+ido_Latn,55,53,0,2,23604,1.0,0.963636,0.981481,1.0,0.0,0.963636
+idu_Latn,51,45,1,6,23607,0.978261,0.882353,0.927835,0.999958,42.358523,0.882353
+ike_Cans,44,44,0,0,23615,1.0,1.0,1.0,1.0,0.0,1.0
+ilo_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ina_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ind_Latn,60,31,1,29,23598,0.96875,0.516667,0.673913,0.999958,42.374677,0.516667
+isl_Latn,58,52,0,6,23601,1.0,0.896552,0.945455,1.0,0.0,0.896552
+ita_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+jav_Latn,60,59,3,1,23596,0.951613,0.983333,0.967213,0.999873,127.124031,0.983333
+jiv_Latn,60,59,48,1,23551,0.551402,0.983333,0.706587,0.997966,2033.984491,0.983333
+jpn_Jpan,140,140,0,0,23519,1.0,1.0,1.0,1.0,0.0,1.0
+kaa_Cyrl,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+kab_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+kal_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kan_Knda,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kat_Geor,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kaz_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kbd_Cyrl,55,55,1,0,23603,0.982143,1.0,0.990991,0.999958,42.365701,1.0
+kbp_Latn,59,59,5,0,23595,0.921875,1.0,0.95935,0.999788,211.864407,1.0
+kbr_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kde_Latn,51,45,2,6,23606,0.957447,0.882353,0.918367,0.999915,84.717045,0.882353
+kdh_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kea_Latn,58,58,30,0,23571,0.659091,1.0,0.794521,0.998729,1271.132579,1.0
+kek_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+kha_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+khk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+khm_Khmr,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+kin_Latn,59,56,4,3,23596,0.933333,0.949153,0.941176,0.999831,169.491525,0.949153
+kir_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kjh_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+kmb_Latn,116,115,4,1,23539,0.966387,0.991379,0.978723,0.99983,169.901882,0.991379
+kmr_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+knc_Latn,64,64,0,0,23595,1.0,1.0,1.0,1.0,0.0,1.0
+kng_Latn,115,3,10,112,23534,0.230769,0.026087,0.046875,0.999575,424.736663,0.026087
+koi_Cyrl,57,41,0,16,23602,1.0,0.719298,0.836735,1.0,0.0,0.719298
+koo_Latn,54,51,0,3,23605,1.0,0.944444,0.971429,1.0,0.0,0.944444
+kor_Hang,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+kqn_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+kri_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+krl_Latn,183,0,0,183,23476,0.0,0.0,0.0,1.0,0.0,0.0
+ktu_Latn,118,108,55,10,23486,0.662577,0.915254,0.768683,0.997664,2336.349348,0.915254
+kwi_Latn,145,93,2,52,23512,0.978947,0.641379,0.775,0.999915,85.055711,0.641379
+lad_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+lao_Laoo,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+lat_Latn,118,118,1,0,23540,0.991597,1.0,0.995781,0.999958,42.479079,1.0
+lia_Latn,45,44,0,1,23614,1.0,0.977778,0.988764,1.0,0.0,0.977778
+lij_Latn,58,58,5,0,23596,0.920635,1.0,0.958678,0.999788,211.85543,1.0
+lin_Latn,110,110,0,0,23549,1.0,1.0,1.0,1.0,0.0,1.0
+lit_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+lld_Latn,59,49,1,10,23599,0.98,0.830508,0.899083,0.999958,42.372881,0.830508
+loz_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ltz_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+lua_Latn,58,22,0,36,23601,1.0,0.37931,0.55,1.0,0.0,0.37931
+lue_Latn,58,58,2,0,23599,0.966667,1.0,0.983051,0.999915,84.742172,1.0
+lug_Latn,49,48,0,1,23610,1.0,0.979592,0.989691,1.0,0.0,0.979592
+lun_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+lus_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+lvs_Latn,115,115,1,0,23543,0.991379,1.0,0.995671,0.999958,42.473666,1.0
+mad_Latn,60,56,0,4,23599,1.0,0.933333,0.965517,1.0,0.0,0.933333
+mag_Deva,53,43,11,10,23595,0.796296,0.811321,0.803738,0.999534,465.983225,0.811321
+mah_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+mai_Deva,58,58,19,0,23582,0.753247,1.0,0.859259,0.999195,805.050633,1.0
+mal_Mlym,100,100,0,0,23559,1.0,1.0,1.0,1.0,0.0,1.0
+mam_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mar_Deva,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+maz_Latn,59,59,41,0,23559,0.59,1.0,0.742138,0.998263,1737.288136,1.0
+mcd_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+mcf_Latn,62,62,0,0,23597,1.0,1.0,1.0,1.0,0.0,1.0
+men_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+mfq_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+mic_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+min_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+miq_Latn,51,51,0,0,23608,1.0,1.0,1.0,1.0,0.0,1.0
+mkd_Cyrl,58,58,3,0,23598,0.95082,1.0,0.97479,0.999873,127.113258,1.0
+mlt_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+mnw_Mymr,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+mor_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+mos_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+mri_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+mto_Latn,51,0,0,51,23608,0.0,0.0,0.0,1.0,0.0,0.0
+mxv_Latn,58,7,0,51,23601,1.0,0.12069,0.215385,1.0,0.0,0.12069
+mya_Mymr,56,55,0,1,23603,1.0,0.982143,0.990991,1.0,0.0,0.982143
+nan_Hani,48,0,1,48,23610,0.0,0.0,0.0,0.999958,42.35314,0.0
+nav_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+nba_Latn,59,0,2,59,23598,0.0,0.0,0.0,0.999915,84.745763,0.0
+nbl_Latn,58,0,1,58,23600,0.0,0.0,0.0,0.999958,42.371086,0.0
+ndo_Latn,58,58,7,0,23594,0.892308,1.0,0.943089,0.999703,296.597602,1.0
+nds_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+niu_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+njo_Latn,64,64,1,0,23594,0.984615,1.0,0.992248,0.999958,42.381861,1.0
+nld_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nno_Latn,58,57,2,1,23599,0.966102,0.982759,0.974359,0.999915,84.742172,0.982759
+nob_Latn,62,59,3,3,23594,0.951613,0.951613,0.951613,0.999873,127.134805,0.951613
+not_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+npi_Deva,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+nso_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+nya_Latn,116,115,2,1,23541,0.982906,0.991379,0.987124,0.999915,84.950941,0.991379
+nyn_Latn,50,50,0,0,23609,1.0,1.0,1.0,1.0,0.0,1.0
+nzi_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+oci_Latn,398,79,0,319,23261,1.0,0.198492,0.331237,1.0,0.0,0.198492
+ojb_Cans,43,43,0,0,23616,1.0,1.0,1.0,1.0,0.0,1.0
+oss_Cyrl,44,44,0,0,23615,1.0,1.0,1.0,1.0,0.0,1.0
+ote_Latn,59,2,0,57,23600,1.0,0.033898,0.065574,1.0,0.0,0.033898
+pam_Latn,66,66,0,0,23593,1.0,1.0,1.0,1.0,0.0,1.0
+pan_Guru,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+pap_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+pau_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+pbb_Latn,56,42,1,14,23602,0.976744,0.75,0.848485,0.999958,42.367496,0.75
+pcd_Latn,58,0,0,58,23601,0.0,0.0,0.0,1.0,0.0,0.0
+pcm_Latn,56,56,2,0,23601,0.965517,1.0,0.982456,0.999915,84.734991,1.0
+pis_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+plt_Latn,53,53,0,0,23606,1.0,1.0,1.0,1.0,0.0,1.0
+pnb_Arab,61,61,9,0,23589,0.871429,1.0,0.931298,0.999619,381.388253,1.0
+pol_Latn,59,56,1,3,23599,0.982456,0.949153,0.965517,0.999958,42.372881,0.949153
+pon_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+por_Latn,115,115,1,0,23543,0.991379,1.0,0.995671,0.999958,42.473666,1.0
+pov_Latn,115,83,0,32,23544,1.0,0.721739,0.838384,1.0,0.0,0.721739
+quc_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+qug_Latn,182,0,0,182,23477,0.0,0.0,0.0,1.0,0.0,0.0
+quh_Latn,57,57,2,0,23600,0.966102,1.0,0.982759,0.999915,84.738581,1.0
+quy_Latn,60,56,49,4,23550,0.533333,0.933333,0.678788,0.997924,2076.359168,0.933333
+quz_Latn,57,50,5,7,23597,0.909091,0.877193,0.892857,0.999788,211.846454,0.877193
+qva_Latn,59,0,1,59,23599,0.0,0.0,0.0,0.999958,42.372881,0.0
+qvc_Latn,58,58,31,0,23570,0.651685,1.0,0.789116,0.998686,1313.503665,1.0
+qvh_Latn,58,7,0,51,23601,1.0,0.12069,0.215385,1.0,0.0,0.12069
+qvm_Latn,60,3,1,57,23598,0.75,0.05,0.09375,0.999958,42.374677,0.05
+qvn_Latn,57,7,0,50,23602,1.0,0.122807,0.21875,1.0,0.0,0.122807
+qwh_Latn,59,55,108,4,23492,0.337423,0.932203,0.495495,0.995424,4576.271186,0.932203
+qxn_Latn,57,1,0,56,23602,1.0,0.017544,0.034483,1.0,0.0,0.017544
+rar_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+rmn_Latn,116,58,0,58,23543,1.0,0.5,0.666667,1.0,0.0,0.5
+roh_Latn,399,393,1,6,23259,0.997462,0.984962,0.991173,0.999957,42.992261,0.984962
+ron_Latn,97,97,1,0,23561,0.989796,1.0,0.994872,0.999958,42.441219,1.0
+run_Latn,58,54,3,4,23598,0.947368,0.931034,0.93913,0.999873,127.113258,0.931034
+rup_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+rus_Cyrl,58,56,3,2,23598,0.949153,0.965517,0.957265,0.999873,127.113258,0.965517
+sag_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+sah_Cyrl,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+san_Deva,55,54,0,1,23604,1.0,0.981818,0.990826,1.0,0.0,0.981818
+sco_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+sey_Latn,61,40,36,21,23562,0.526316,0.655738,0.583942,0.998474,1525.553013,0.655738
+shn_Mymr,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+shp_Latn,62,16,0,46,23597,1.0,0.258065,0.410256,1.0,0.0,0.258065
+sid_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+sin_Sinh,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+skr_Arab,63,54,0,9,23596,1.0,0.857143,0.923077,1.0,0.0,0.857143
+slk_Latn,56,55,1,1,23602,0.982143,0.982143,0.982143,0.999958,42.367496,0.982143
+slv_Latn,59,55,2,4,23598,0.964912,0.932203,0.948276,0.999915,84.745763,0.932203
+sme_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+smo_Latn,63,63,0,0,23596,1.0,1.0,1.0,1.0,0.0,1.0
+sna_Latn,60,60,2,0,23597,0.967742,1.0,0.983607,0.999915,84.749354,1.0
+snn_Latn,136,92,10,44,23513,0.901961,0.676471,0.773109,0.999575,425.115844,0.676471
+som_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+sot_Latn,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+spa_Latn,78,77,1,1,23580,0.987179,0.987179,0.987179,0.999958,42.407023,0.987179
+srp_Cyrl,59,57,0,2,23600,1.0,0.966102,0.982759,1.0,0.0,0.966102
+srp_Latn,59,29,34,30,23566,0.460317,0.491525,0.47541,0.998559,1440.677966,0.491525
+srr_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+ssw_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+suk_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+sun_Latn,66,63,0,3,23593,1.0,0.954545,0.976744,1.0,0.0,0.954545
+sus_Latn,58,54,0,4,23601,1.0,0.931034,0.964286,1.0,0.0,0.931034
+swe_Latn,61,61,0,0,23598,1.0,1.0,1.0,1.0,0.0,1.0
+swh_Latn,58,52,0,6,23601,1.0,0.896552,0.945455,1.0,0.0,0.896552
+tah_Latn,57,54,0,3,23602,1.0,0.947368,0.972973,1.0,0.0,0.947368
+taj_Deva,1,1,0,0,23658,1.0,1.0,1.0,1.0,0.0,1.0
+tam_Taml,68,68,0,0,23591,1.0,1.0,1.0,1.0,0.0,1.0
+tat_Cyrl,57,56,0,1,23602,1.0,0.982456,0.99115,1.0,0.0,0.982456
+tbz_Latn,60,12,0,48,23599,1.0,0.2,0.333333,1.0,0.0,0.2
+tca_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+tdt_Latn,57,21,8,36,23594,0.724138,0.368421,0.488372,0.999661,338.954326,0.368421
+tel_Telu,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tem_Latn,55,55,1,0,23603,0.982143,1.0,0.990991,0.999958,42.365701,1.0
+tet_Latn,58,51,37,7,23564,0.579545,0.87931,0.69863,0.998432,1567.730181,0.87931
+tgk_Cyrl,57,57,0,0,23602,1.0,1.0,1.0,1.0,0.0,1.0
+tha_Thai,114,114,0,0,23545,1.0,1.0,1.0,1.0,0.0,1.0
+tir_Ethi,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+tiv_Latn,67,67,1,0,23591,0.985294,1.0,0.992593,0.999958,42.38725,1.0
+tly_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+tob_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+toi_Latn,57,53,0,4,23602,1.0,0.929825,0.963636,1.0,0.0,0.929825
+toj_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+ton_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+top_Latn,59,59,2,0,23598,0.967213,1.0,0.983333,0.999915,84.745763,1.0
+tpi_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tsn_Latn,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+tso_Latn,114,89,0,25,23545,1.0,0.780702,0.876847,1.0,0.0,0.780702
+tsz_Latn,59,58,0,1,23600,1.0,0.983051,0.991453,1.0,0.0,0.983051
+tuk_Cyrl,57,54,0,3,23602,1.0,0.947368,0.972973,1.0,0.0,0.947368
+tuk_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+tur_Latn,59,59,2,0,23598,0.967213,1.0,0.983333,0.999915,84.745763,1.0
+twi_Latn,116,115,2,1,23541,0.982906,0.991379,0.987124,0.999915,84.950941,0.991379
+tyv_Cyrl,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+tzh_Latn,25,25,3,0,23631,0.892857,1.0,0.943396,0.999873,126.935771,1.0
+tzm_Tfng,1,1,4,0,23654,0.2,1.0,0.333333,0.999831,169.076,1.0
+tzo_Latn,58,55,0,3,23601,1.0,0.948276,0.973451,1.0,0.0,0.948276
+udu_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Arab,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+uig_Latn,59,59,1,0,23599,0.983333,1.0,0.991597,0.999958,42.372881,1.0
+ukr_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+umb_Latn,107,83,0,24,23552,1.0,0.775701,0.873684,1.0,0.0,0.775701
+ura_Latn,56,56,0,0,23603,1.0,1.0,1.0,1.0,0.0,1.0
+urd_Arab,108,107,0,1,23551,1.0,0.990741,0.995349,1.0,0.0,0.990741
+uzn_Cyrl,58,58,0,0,23601,1.0,1.0,1.0,1.0,0.0,1.0
+uzn_Latn,58,58,9,0,23592,0.865672,1.0,0.928,0.999619,381.339774,1.0
+vec_Latn,58,57,1,1,23600,0.982759,0.982759,0.982759,0.999958,42.371086,0.982759
+ven_Latn,89,89,0,0,23570,1.0,1.0,1.0,1.0,0.0,1.0
+vep_Latn,58,57,0,1,23601,1.0,0.982759,0.991304,1.0,0.0,0.982759
+vie_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+vmw_Latn,58,56,0,2,23601,1.0,0.965517,0.982456,1.0,0.0,0.965517
+war_Latn,60,60,0,0,23599,1.0,1.0,1.0,1.0,0.0,1.0
+wln_Latn,59,58,57,1,23543,0.504348,0.983051,0.666667,0.997585,2415.254237,0.983051
+wol_Latn,60,60,2,0,23597,0.967742,1.0,0.983607,0.999915,84.749354,1.0
+wuu_Hani,48,43,46,5,23565,0.483146,0.895833,0.627737,0.998052,1948.244462,0.895833
+xho_Latn,58,52,3,6,23598,0.945455,0.896552,0.920354,0.999873,127.113258,0.896552
+xsm_Latn,59,57,7,2,23593,0.890625,0.966102,0.926829,0.999703,296.610169,0.966102
+yad_Latn,55,55,0,0,23604,1.0,1.0,1.0,1.0,0.0,1.0
+yao_Latn,52,52,0,0,23607,1.0,1.0,1.0,1.0,0.0,1.0
+yap_Latn,58,58,1,0,23600,0.983051,1.0,0.991453,0.999958,42.371086,1.0
+ydd_Hebr,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+yor_Latn,57,57,1,0,23601,0.982759,1.0,0.991304,0.999958,42.369291,1.0
+yrk_Cyrl,55,53,0,2,23604,1.0,0.963636,0.981481,1.0,0.0,0.963636
+yua_Latn,59,59,0,0,23600,1.0,1.0,1.0,1.0,0.0,1.0
+yue_Hani,49,30,13,19,23597,0.697674,0.612245,0.652174,0.999449,550.614147,0.612245
+zam_Latn,60,0,1,60,23598,0.0,0.0,0.0,0.999958,42.374677,0.0
+zdj_Latn,50,50,0,0,23609,1.0,1.0,1.0,1.0,0.0,1.0
+zgh_Tfng,60,42,0,18,23599,1.0,0.7,0.823529,1.0,0.0,0.7
+zul_Latn,58,51,3,7,23598,0.944444,0.87931,0.910714,0.999873,127.113258,0.87931
+zyb_Latn,57,57,3,0,23599,0.95,1.0,0.974359,0.999873,127.107872,1.0

reports/udhr/millid_summary.json

@@ -0,0 +1,17 @@
+{
+  "top1_accuracy": 0.8524451582907139,
+  "top3_accuracy": 0.9193964241937529,
+  "top5_accuracy": 0.9341054144300266,
+  "passages": 23659,
+  "languages": 358,
+  "macro_precision": 0.9187139434241347,
+  "macro_recall": 0.876978867900983,
+  "macro_f1": 0.8780555118719876,
+  "macro_specificity": 0.9998610487675311,
+  "weighted_f1": 0.8598690614077213,
+  "median_f1": 0.9909909909909909,
+  "languages_f1_at_least_0_9": 282,
+  "languages_f1_below_0_5": 35,
+  "mean_fp_per_million": 138.95123246877017,
+  "micro_f1": 0.8524451582907139
+}

reports/validation/millid_summary.json

@@ -0,0 +1,22 @@
+{
+  "top1_accuracy": 0.9612766841404254,
+  "top3_accuracy": 0.9909250502014166,
+  "top5_accuracy": 0.9949330172578825,
+  "passages": 245511,
+  "languages": 1626,
+  "macro_precision": 0.9572524686749759,
+  "macro_recall": 0.9621461129267935,
+  "macro_f1": 0.9583443278968644,
+  "macro_specificity": 0.9999761949645174,
+  "weighted_f1": 0.9613285508140816,
+  "median_f1": 0.9849924924924924,
+  "languages_f1_at_least_0_9": 1462,
+  "languages_f1_below_0_5": 7,
+  "mean_fp_per_million": 23.80503548271208,
+  "micro_f1": 0.9612766841404254,
+  "top1_by_size": {
+    "paragraph": 0.985777175753471,
+    "sentence": 0.981756099992523,
+    "short": 0.936305012862407
+  }
+}

training_log.jsonl

@@ -0,0 +1,30 @@
+{"step": 2000, "loss": 1.86789, "macro_f1": 0.79235, "top1_accuracy": 0.79797, "top3_accuracy": 0.92062}
+{"step": 4000, "loss": 1.50355, "macro_f1": 0.8932, "top1_accuracy": 0.89507, "top3_accuracy": 0.96682}
+{"step": 6000, "loss": 1.37135, "macro_f1": 0.91384, "top1_accuracy": 0.91522, "top3_accuracy": 0.97436}
+{"step": 8000, "loss": 1.28554, "macro_f1": 0.92505, "top1_accuracy": 0.92703, "top3_accuracy": 0.97825}
+{"step": 10000, "loss": 1.27827, "macro_f1": 0.92703, "top1_accuracy": 0.92841, "top3_accuracy": 0.97841}
+{"step": 12000, "loss": 1.20079, "macro_f1": 0.93424, "top1_accuracy": 0.93555, "top3_accuracy": 0.98061}
+{"step": 14000, "loss": 1.21474, "macro_f1": 0.93586, "top1_accuracy": 0.93728, "top3_accuracy": 0.98181}
+{"step": 16000, "loss": 1.16406, "macro_f1": 0.94008, "top1_accuracy": 0.94114, "top3_accuracy": 0.98294}
+{"step": 18000, "loss": 1.18302, "macro_f1": 0.9409, "top1_accuracy": 0.94234, "top3_accuracy": 0.98426}
+{"step": 20000, "loss": 1.19716, "macro_f1": 0.94238, "top1_accuracy": 0.94378, "top3_accuracy": 0.98297}
+{"step": 22000, "loss": 1.15475, "macro_f1": 0.94574, "top1_accuracy": 0.94695, "top3_accuracy": 0.98413}
+{"step": 24000, "loss": 1.13328, "macro_f1": 0.94524, "top1_accuracy": 0.94642, "top3_accuracy": 0.98517}
+{"step": 26000, "loss": 1.14454, "macro_f1": 0.94883, "top1_accuracy": 0.95016, "top3_accuracy": 0.98542}
+{"step": 28000, "loss": 1.13161, "macro_f1": 0.94798, "top1_accuracy": 0.94893, "top3_accuracy": 0.98564}
+{"step": 30000, "loss": 1.13735, "macro_f1": 0.94964, "top1_accuracy": 0.95098, "top3_accuracy": 0.98633}
+{"step": 32000, "loss": 1.13146, "macro_f1": 0.95158, "top1_accuracy": 0.95267, "top3_accuracy": 0.98668}
+{"step": 34000, "loss": 1.11926, "macro_f1": 0.95274, "top1_accuracy": 0.95403, "top3_accuracy": 0.98686}
+{"step": 36000, "loss": 1.15683, "macro_f1": 0.95348, "top1_accuracy": 0.95478, "top3_accuracy": 0.98781}
+{"step": 38000, "loss": 1.14514, "macro_f1": 0.95557, "top1_accuracy": 0.95676, "top3_accuracy": 0.98749}
+{"step": 40000, "loss": 1.12537, "macro_f1": 0.95683, "top1_accuracy": 0.95814, "top3_accuracy": 0.98844}
+{"step": 42000, "loss": 1.16073, "macro_f1": 0.95802, "top1_accuracy": 0.95912, "top3_accuracy": 0.98913}
+{"step": 44000, "loss": 1.11823, "macro_f1": 0.95665, "top1_accuracy": 0.9578, "top3_accuracy": 0.98906}
+{"step": 46000, "loss": 1.13981, "macro_f1": 0.95912, "top1_accuracy": 0.96037, "top3_accuracy": 0.98919}
+{"step": 48000, "loss": 1.10609, "macro_f1": 0.96015, "top1_accuracy": 0.96128, "top3_accuracy": 0.98976}
+{"step": 50000, "loss": 1.09781, "macro_f1": 0.96095, "top1_accuracy": 0.96207, "top3_accuracy": 0.99029}
+{"step": 52000, "loss": 1.09539, "macro_f1": 0.96094, "top1_accuracy": 0.96223, "top3_accuracy": 0.99042}
+{"step": 54000, "loss": 1.11826, "macro_f1": 0.96193, "top1_accuracy": 0.96308, "top3_accuracy": 0.99035}
+{"step": 56000, "loss": 1.08251, "macro_f1": 0.96248, "top1_accuracy": 0.96377, "top3_accuracy": 0.99038}
+{"step": 58000, "loss": 1.10651, "macro_f1": 0.96167, "top1_accuracy": 0.96279, "top3_accuracy": 0.99086}
+{"step": 60000, "loss": 1.09734, "macro_f1": 0.96245, "top1_accuracy": 0.96352, "top3_accuracy": 0.99117}