clarin-pl/combo-nlp-models

COMBO vs Trankit vs Stanza — UD Evaluation Report

87 treebanks · F1 scores · COMBO on UD 2.17 · Trankit on UD 2.5 · Stanza on UD 2.12 · highest lowest

Treebank	System	Tokens	Sents	Words	UPOS	XPOS	UFeats	AllTags	Lemmas	UAS	LAS	CLAS	MLAS	BLEX
Afrikaans AFRIBOOMS	COMBO[base]	99.80	100.00	99.78	98.66	95.95	98.18	95.60	98.31	90.15	86.89	81.57	77.37	79.45
	Trankit[large]	99.84	100.00	99.84	98.87	96.63	98.68	96.54	97.47	91.61	89.35	85.30	82.64	81.65
	Trankit[base]	99.72	100.00	99.72	98.55	96.10	98.26	95.89	97.39	91.03	88.79	84.46	81.31	80.91
	Stanza	99.99	99.65	99.99	98.60	95.77	98.41	95.66	98.29	89.54	86.14	80.10	76.71	77.53
Ancient Hebrew PTNK	COMBO[base]	100.00	95.43	97.86	95.76	96.01	93.61	92.70	96.30	90.09	87.38	81.32	75.07	79.34
	Stanza	100.00	98.18	93.60	90.20	90.53	85.40	84.63	92.14	76.12	72.72	63.10	54.54	61.98
Arabic PADT	COMBO[base]	99.98	76.72	97.52	94.86	92.69	92.74	92.18	93.07	84.11	80.96	78.99	73.10	74.89
	Trankit[large]	99.95	96.79	99.39	96.80	94.93	94.99	94.61	94.92	89.74	85.98	83.92	78.47	79.96
	Trankit[base]	99.93	96.59	99.22	96.31	94.08	94.28	93.69	94.65	88.39	84.68	82.35	76.46	78.46
	Stanza	99.98	83.56	98.03	95.18	92.40	92.52	92.18	93.54	83.99	79.77	76.72	71.10	73.25
Armenian ARMTDP	COMBO[base]	99.62	90.05	98.19	96.46	98.19	90.43	89.90	95.77	88.84	85.32	82.71	72.94	80.47
	Trankit[large]	98.52	99.46	97.26	95.03	97.26	90.42	89.56	93.45	86.47	83.01	80.91	72.45	77.07
	Trankit[base]	98.41	98.92	97.23	94.36	97.23	88.89	87.84	93.28	84.22	80.14	77.47	67.92	73.94
	Stanza	99.92	99.46	99.48	83.05	99.48	66.22	64.30	91.35	74.04	61.80	52.52	29.58	49.05
Basque BDT	COMBO[base]	99.95	99.92	99.92	96.38	99.92	89.11	87.44	96.87	89.01	85.80	83.84	70.60	80.88
	Trankit[large]	99.89	100.00	99.89	96.95	99.89	93.96	92.30	96.69	90.22	87.47	86.54	78.10	83.21
	Trankit[base]	99.81	99.92	99.81	96.23	99.81	92.35	90.40	96.46	88.24	85.25	84.29	74.20	80.92
	Stanza	99.98	100.00	99.98	96.07	99.98	92.95	91.16	96.38	86.65	83.20	80.80	73.42	77.71
Bulgarian BTB	COMBO[base]	99.89	99.01	99.92	99.45	97.80	98.24	97.31	98.51	96.30	94.07	91.76	88.87	89.75
	Trankit[large]	99.78	98.79	99.78	99.29	97.75	98.30	97.29	97.37	96.30	94.21	92.19	89.64	88.79
	Trankit[base]	99.84	98.25	99.84	99.18	97.42	98.10	96.91	97.36	95.81	93.47	91.23	88.28	87.80
	Stanza	99.96	96.50	99.96	99.16	96.97	97.84	96.62	97.28	93.98	91.09	88.00	84.88	84.59
Catalan ANCORA	COMBO[base]	99.98	99.81	99.72	98.90	96.99	98.34	96.60	99.28	94.56	93.19	90.01	87.57	89.50
	Trankit[large]	99.94	99.76	99.94	99.11	99.07	98.66	98.24	98.49	95.15	93.83	91.41	89.31	90.27
	Trankit[base]	99.94	100.00	99.93	99.02	98.97	98.57	98.09	98.46	94.61	93.01	90.09	87.89	88.99
	Stanza	99.97	99.57	99.95	98.70	95.93	98.27	95.67	99.06	93.55	91.66	87.24	84.72	86.41
Chinese Chinese GSD	COMBO[base]	98.32	99.40	98.33	95.58	95.61	97.77	95.01	97.58	86.20	83.38	81.38	77.35	80.51
	Trankit[large]	97.75	99.40	97.75	95.13	94.94	97.28	94.45	97.75	87.38	84.82	83.44	79.82	83.44
	Trankit[base]	97.01	99.70	97.01	94.21	94.02	96.59	93.56	97.01	85.19	82.54	80.91	77.42	80.91
	Stanza	92.79	99.10	92.79	89.06	88.80	92.01	88.07	92.70	72.94	69.98	66.65	62.60	66.62
Croatian SET	COMBO[base]	99.96	99.34	99.95	98.67	96.33	96.71	95.87	98.00	93.64	90.76	88.89	83.33	86.35
	Trankit[large]	99.93	99.08	99.93	98.58	96.55	96.85	95.99	96.71	93.86	89.74	87.77	82.19	83.56
	Trankit[base]	99.92	99.16	99.92	98.38	96.08	96.52	95.44	96.60	93.34	89.36	87.16	81.12	82.91
	Stanza	99.96	97.08	99.96	98.21	94.89	95.27	94.60	96.60	90.29	86.95	84.14	78.19	80.25
Czech CAC	COMBO[base]	99.99	100.00	99.88	99.51	97.72	96.73	96.33	98.85	95.32	93.94	92.86	88.21	91.52
	Trankit[large]	99.99	100.00	99.98	99.64	98.17	98.01	97.65	98.30	95.48	93.97	93.06	90.13	90.92
	Trankit[base]	99.96	100.00	99.95	99.42	97.40	97.12	96.68	98.13	94.97	93.27	92.08	88.13	89.85
	Stanza	99.82	100.00	99.57	98.52	94.59	93.64	92.92	97.46	91.09	88.71	86.78	80.27	84.87
Czech CLTT	COMBO[base]	99.10	95.34	98.35	97.16	87.33	87.36	85.35	93.21	82.18	79.97	77.08	64.76	72.66
	Trankit[large]	99.89	98.89	99.85	99.17	93.80	94.02	93.53	97.81	92.53	90.76	88.90	81.07	86.35
	Trankit[base]	99.82	100.00	99.76	98.93	93.36	93.68	93.21	97.66	90.20	88.01	85.13	77.66	82.80
	Stanza	99.23	98.23	99.23	97.38	88.25	88.22	87.42	95.78	83.53	79.71	76.52	66.32	74.12
Czech FICTREE	COMBO[base]	99.97	99.88	99.89	98.95	96.90	97.38	96.31	98.98	95.00	93.55	92.07	87.80	90.82
	Trankit[large]	99.98	99.50	99.98	99.11	97.26	97.99	97.06	98.64	96.50	94.85	93.44	89.79	91.46
	Trankit[base]	99.97	99.38	99.97	98.94	96.47	97.09	96.12	98.61	95.85	93.86	92.10	87.13	90.16
	Stanza	99.98	99.07	99.97	98.45	95.15	96.00	94.77	98.32	93.28	90.80	88.55	82.85	86.53
Danish DDT	COMBO[base]	99.90	97.52	99.92	98.64	99.92	97.23	96.81	98.21	90.14	88.39	86.34	81.19	84.22
	Trankit[large]	99.81	95.46	99.81	98.71	99.81	98.33	97.87	97.35	91.75	90.33	88.81	85.66	85.42
	Trankit[base]	99.79	95.19	99.79	98.35	99.79	97.79	97.19	97.18	90.41	88.78	86.94	82.58	83.38
	Stanza	99.97	91.81	99.97	98.30	99.97	97.87	97.14	97.88	88.61	86.61	83.80	80.06	81.27
Dutch ALPINO	COMBO[base]	99.92	92.22	99.92	97.98	96.92	97.76	96.35	95.45	94.35	92.68	89.98	85.89	83.29
	Trankit[large]	99.43	90.65	99.43	96.67	95.01	96.55	94.75	96.39	94.41	92.49	89.56	84.22	85.29
	Trankit[base]	99.22	89.88	99.22	96.55	94.92	96.22	94.56	96.23	93.28	91.28	87.88	82.58	83.86
	Stanza	99.87	90.08	99.87	96.75	95.50	97.00	94.97	95.33	91.42	88.67	83.94	79.65	78.12
Dutch LASSYSMALL	COMBO[base]	99.97	93.77	99.97	98.13	97.33	97.93	96.86	96.21	94.45	92.60	89.69	85.84	84.03
	Trankit[large]	99.36	92.60	99.36	96.52	95.57	96.63	94.99	97.37	92.25	89.68	86.51	82.56	84.19
	Trankit[base]	99.21	91.09	99.21	96.20	95.18	96.25	94.53	97.19	91.09	88.18	84.63	80.47	82.44
	Stanza	99.87	78.61	99.87	96.67	95.92	96.83	95.20	95.86	88.25	85.32	80.00	76.72	75.15
English EWT	COMBO[base]	99.72	84.23	99.69	97.76	97.25	97.86	96.44	97.88	92.79	91.12	88.59	85.82	86.62
	Trankit[large]	98.67	90.49	98.67	96.65	96.47	96.75	95.49	97.25	91.29	89.40	87.41	83.45	85.73
	Trankit[base]	98.48	88.35	98.48	95.95	95.71	96.26	94.62	96.84	90.14	87.96	85.75	81.02	83.83
	Stanza	99.17	89.16	98.92	96.20	95.75	96.39	94.64	96.63	88.90	86.77	84.11	80.27	81.54
Estonian EDT	COMBO[base]	99.89	96.62	99.97	98.08	98.52	96.95	96.09	96.98	91.82	89.72	88.89	84.84	85.49
	Trankit[large]	99.75	96.58	99.75	97.87	98.35	97.10	96.04	96.09	91.71	89.52	88.57	84.68	84.10
	Trankit[base]	99.72	96.55	99.72	97.53	98.13	96.56	95.37	95.98	90.65	88.31	87.15	82.82	82.81
	Stanza	99.97	92.88	99.97	97.19	97.94	95.64	94.39	95.93	86.60	83.81	82.23	77.02	78.05
Estonian EWT	COMBO[base]	99.23	89.48	99.16	95.35	96.15	93.04	90.99	92.81	85.68	82.13	80.23	72.19	73.33
	Trankit[large]	97.76	82.58	97.76	94.26	94.93	91.49	89.91	85.71	82.18	78.49	76.41	69.32	64.00
	Trankit[base]	96.96	83.72	96.96	92.07	93.16	89.17	86.89	84.65	78.21	73.79	71.59	62.91	59.90
	Stanza	98.79	79.57	98.79	93.14	95.02	92.11	89.35	90.77	77.27	72.94	70.34	63.87	63.75
Faroese FARPAHC	COMBO[base]	99.66	94.44	99.52	96.94	92.57	92.31	90.58	99.52	83.03	79.38	72.16	62.12	72.16
	Stanza	99.65	93.94	99.64	96.51	91.56	92.92	90.86	99.64	84.39	80.07	72.28	64.48	72.28
Finnish FTB	COMBO[base]	100.00	95.81	99.97	98.01	97.01	97.79	96.32	97.77	94.34	92.59	91.18	87.96	89.25
	Trankit[large]	99.84	97.36	99.83	98.32	97.29	98.09	96.87	96.94	95.84	94.53	93.54	90.68	90.39
	Trankit[base]	99.75	95.83	99.74	97.46	96.23	97.22	95.61	96.58	94.17	92.43	90.84	87.09	87.79
	Stanza	100.00	90.13	99.98	96.88	96.09	97.12	95.29	97.10	90.99	88.63	86.24	82.60	84.20
Finnish TDT	COMBO[base]	99.72	97.62	99.65	98.16	98.63	96.73	96.10	96.11	93.93	92.34	91.25	87.14	87.12
	Trankit[large]	99.71	97.22	99.72	98.48	98.78	96.84	96.33	95.59	94.98	93.77	92.92	88.97	88.02
	Trankit[base]	99.62	95.98	99.62	97.99	98.44	96.52	95.76	95.39	93.47	91.94	90.78	86.55	86.00
	Stanza	99.73	90.70	99.70	97.51	98.09	96.13	95.39	95.98	90.37	88.31	87.15	83.01	83.42
French GSD	COMBO[base]	99.85	96.74	99.82	98.57	99.82	98.12	97.81	98.80	95.15	93.63	90.65	88.03	89.32
	Trankit[large]	99.77	98.80	99.72	97.89	99.72	97.34	96.66	97.90	94.97	93.37	90.17	86.35	87.73
	Trankit[base]	99.70	96.63	99.66	97.85	99.66	97.16	96.60	97.80	94.00	92.34	88.66	84.76	86.08
	Stanza	99.71	95.03	99.50	97.63	99.50	97.74	97.05	98.20	93.27	91.28	87.44	84.45	85.78
Galician CTG	COMBO[base]	99.75	98.61	97.32	94.88	94.52	97.13	94.00	95.98	79.47	76.89	69.46	63.31	68.24
	Trankit[large]	99.76	98.44	99.31	97.30	97.05	99.17	96.77	98.07	85.70	83.14	78.24	72.41	76.90
	Trankit[base]	99.76	98.09	99.38	97.17	96.83	99.23	96.54	98.06	85.51	82.81	77.50	71.49	76.20
	Stanza	99.91	99.30	99.37	97.11	96.90	99.19	96.53	98.01	84.58	81.95	75.72	69.72	74.39
German GSD	COMBO[base]	99.82	92.52	99.78	97.15	97.75	91.85	89.51	97.74	88.84	85.91	82.31	69.89	79.50
	Trankit[large]	99.71	89.72	99.72	95.23	97.68	91.68	87.21	96.58	89.01	85.20	81.49	65.82	77.20
	Trankit[base]	99.75	92.72	99.75	95.04	97.57	91.51	86.86	96.60	88.73	84.77	80.78	64.76	76.58
	Stanza	99.62	83.84	99.60	95.61	97.36	89.78	87.19	97.23	85.80	81.80	77.08	62.81	74.04
German HDT	COMBO[base]	100.00	99.56	100.00	98.60	98.54	93.89	93.56	98.53	97.80	97.10	95.37	85.48	93.06
	Trankit[large]	99.92	99.67	99.92	98.44	98.41	94.05	93.70	97.36	97.63	96.86	95.14	85.73	91.67
	Trankit[base]	99.90	99.50	99.90	98.42	98.37	93.95	93.52	97.35	97.38	96.51	94.63	85.02	91.18
	Stanza	100.00	97.36	100.00	98.30	98.20	92.57	92.17	98.04	95.59	93.56	89.88	78.81	87.18
Greek GDT	COMBO[base]	99.89	94.93	99.68	98.14	98.12	94.94	94.43	96.72	93.52	92.04	89.00	81.08	84.41
	Trankit[large]	99.85	93.50	99.85	98.41	98.41	96.34	95.84	96.73	95.25	93.87	91.74	85.40	86.54
	Trankit[base]	99.75	93.57	99.75	98.04	98.04	95.41	94.73	96.55	94.16	92.80	89.84	82.39	84.83
	Stanza	99.90	93.66	99.90	97.71	97.71	94.72	94.01	96.05	91.22	88.87	84.19	77.99	79.08
Hebrew HTB	COMBO[base]	100.00	100.00	93.25	91.18	91.23	89.10	88.65	90.89	85.07	82.73	77.69	70.83	74.69
	Trankit[large]	99.81	99.69	96.31	94.32	94.32	93.03	92.39	93.48	88.41	86.04	82.23	74.92	78.35
	Trankit[base]	99.79	100.00	96.03	93.75	93.75	91.96	91.24	93.21	87.02	84.55	80.34	72.38	76.52
	Stanza	99.98	100.00	92.29	89.99	89.99	88.68	88.03	89.71	79.38	77.18	71.95	65.35	68.81
Hebrew IAHLTWIKI	COMBO[base]	98.53	86.54	91.84	88.84	88.82	83.83	82.74	89.92	80.44	78.75	74.13	61.85	71.82
	Stanza	99.64	96.78	94.61	91.69	91.69	86.88	86.14	92.51	83.23	81.19	75.58	64.88	73.14
Hindi HDTB	COMBO[base]	99.99	99.20	98.45	96.62	96.28	92.68	91.13	97.43	93.18	90.28	86.76	77.03	85.52
	Trankit[large]	99.88	99.91	99.88	98.01	97.70	93.91	92.38	96.54	95.95	92.96	89.79	79.69	88.47
	Trankit[base]	99.89	99.64	99.89	97.77	97.38	94.03	92.33	96.54	95.68	92.70	89.59	79.60	88.28
	Stanza	100.00	99.52	100.00	97.95	97.53	94.41	92.74	96.88	95.26	92.46	89.38	80.26	88.12
Icelandic GC	COMBO[base]	99.66	97.59	99.73	95.37	83.19	85.18	80.35	93.01	84.25	79.75	76.17	59.69	69.48
	Stanza	99.70	95.80	99.70	92.68	76.46	81.10	74.89	91.06	80.41	75.45	71.17	52.55	63.45
Icelandic ICEPAHC	COMBO[base]	99.93	95.01	99.87	97.14	93.91	90.74	86.64	96.69	88.88	85.49	80.76	67.82	77.65
	Stanza	99.90	93.07	99.84	96.36	92.27	90.42	85.48	95.78	86.79	82.85	77.27	64.78	73.63
Icelandic MODERN	COMBO[base]	99.23	96.22	99.06	97.42	95.34	86.21	84.28	96.01	85.02	82.27	77.70	61.61	74.41
	Stanza	99.24	94.40	99.24	96.65	93.95	85.87	83.03	95.34	82.70	79.40	73.76	58.26	69.99
Indonesian GSD	COMBO[base]	99.80	93.20	99.66	94.36	93.27	95.47	87.92	97.84	87.45	80.95	77.27	70.90	75.54
	Trankit[large]	99.89	95.54	99.89	93.39	95.06	96.11	89.22	99.53	86.33	79.81	77.99	69.08	77.60
	Trankit[base]	99.86	95.37	99.86	93.57	94.18	95.67	88.65	99.49	86.55	80.28	78.64	69.42	78.26
	Stanza	99.88	93.04	99.64	94.16	94.69	95.58	89.38	98.28	87.05	80.83	76.98	71.78	76.03
Irish IDT	COMBO[base]	99.75	97.24	99.81	96.10	94.64	85.52	82.50	95.48	87.31	81.88	77.00	59.32	72.48
	Trankit[large]	99.47	98.24	99.47	94.72	93.74	80.90	77.94	92.64	83.47	76.86	70.64	48.55	64.06
	Trankit[base]	99.32	97.25	99.32	93.88	92.46	80.36	76.72	92.34	82.52	74.91	67.96	46.29	61.34
	Stanza	99.75	97.24	99.75	96.01	94.55	89.41	86.52	95.32	86.81	81.51	76.34	63.38	71.94
Italian ISDT	COMBO[base]	99.95	99.07	99.13	97.95	97.85	97.37	96.95	97.89	94.73	93.41	91.39	86.79	89.50
	Trankit[large]	99.88	99.07	99.86	98.72	98.63	98.32	97.79	98.33	95.73	94.45	91.97	89.08	89.45
	Trankit[base]	99.88	98.76	99.87	98.58	98.46	98.20	97.60	98.23	95.31	93.87	90.93	87.81	88.45
	Stanza	99.93	99.07	99.79	98.41	98.32	98.14	97.69	98.23	93.29	91.61	87.32	85.05	85.17
Italian MARKIT	COMBO[base]	99.98	99.12	98.26	95.25	95.27	90.92	89.11	85.26	83.44	79.68	74.77	60.57	70.12
	Stanza	100.00	99.12	99.67	96.29	96.34	94.28	92.34	87.08	85.58	80.63	74.48	65.35	70.41
Italian OLD	COMBO[base]	99.97	99.55	98.61	95.87	86.64	89.90	81.90	96.13	85.16	81.14	76.14	62.86	73.25
Italian PARTUT	COMBO[base]	99.72	99.02	98.64	97.46	97.24	96.17	95.51	97.05	93.75	91.55	88.13	82.06	86.18
	Trankit[large]	99.81	100.00	99.79	98.58	98.42	98.15	97.54	97.84	96.19	94.11	90.65	87.75	87.86
	Trankit[base]	99.82	100.00	99.81	98.63	98.41	98.16	97.47	97.94	95.38	93.32	89.28	86.22	86.55
	Stanza	99.81	100.00	99.82	98.42	98.37	98.04	97.51	97.71	93.53	91.47	86.62	84.28	84.06
Italian TWITTIRO	COMBO[base]	99.22	64.63	98.51	94.68	94.18	91.02	89.14	92.87	81.79	76.62	70.34	59.38	63.60
	Trankit[large]	99.15	65.72	98.89	95.47	94.90	94.09	91.98	93.12	84.73	79.86	73.94	66.46	66.58
	Trankit[base]	99.22	56.00	99.01	95.31	94.74	93.83	91.68	92.96	83.44	78.30	70.79	63.25	63.81
	Stanza	99.18	57.78	98.91	94.70	94.22	93.82	91.73	92.91	79.21	73.55	65.15	59.58	59.88
Italian VIT	COMBO[base]	99.98	96.04	99.24	97.52	96.74	96.43	95.06	98.14	91.92	89.23	85.62	79.68	84.30
	Trankit[large]	99.97	98.18	99.84	98.07	97.29	97.76	96.16	98.42	93.02	90.44	86.85	82.53	84.91
	Trankit[base]	99.99	96.52	99.81	97.82	97.02	97.39	95.74	98.31	92.39	89.60	85.59	80.70	83.64
	Stanza	99.94	95.93	99.61	97.82	97.00	97.61	96.06	98.35	90.40	87.40	82.33	78.73	80.70
Japanese GSD	COMBO[base]	98.21	96.27	98.29	97.24	96.40	98.28	96.08	97.08	91.66	90.62	86.45	84.60	84.87
	Trankit[large]	95.25	95.88	95.25	93.66	93.47	95.23	93.44	94.68	86.67	85.56	78.00	76.02	77.62
	Trankit[base]	94.57	95.49	94.57	92.86	92.44	94.56	92.42	93.99	84.58	83.38	75.60	73.67	75.14
	Stanza	97.37	99.72	97.37	96.38	95.72	97.36	95.45	96.02	90.01	89.29	84.99	83.86	83.34
Korean GSD	COMBO[base]	99.86	98.28	99.88	96.91	91.29	99.62	89.24	93.24	88.88	85.78	84.61	82.77	78.21
	Trankit[large]	98.57	98.08	98.57	95.71	90.88	98.35	88.90	91.93	89.87	87.22	85.97	83.63	79.65
	Trankit[base]	98.63	97.67	98.63	95.63	90.32	98.43	88.26	91.96	88.48	85.77	84.26	81.98	78.08
	Stanza	99.90	96.29	99.90	95.98	90.42	99.72	88.16	93.55	86.56	82.48	80.79	79.07	75.39
Korean KAIST	COMBO[base]	99.96	99.93	99.97	96.64	89.31	99.97	89.11	93.21	90.25	88.32	87.07	84.59	80.75
	Trankit[large]	98.70	99.87	98.70	95.13	88.07	98.70	88.07	92.36	90.00	88.22	86.37	83.56	80.16
	Trankit[base]	98.79	99.14	98.79	94.99	87.62	98.79	87.62	92.44	88.72	86.96	84.99	81.84	78.90
	Stanza	100.00	99.93	100.00	95.74	85.81	100.00	85.81	94.10	87.63	85.50	83.65	80.93	78.78
Korean KSL	COMBO[base]	99.91	99.54	99.83	96.68	92.31	99.83	91.55	95.18	90.77	88.12	86.65	83.79	82.29
Latin ITTB	COMBO[base]	99.99	95.32	99.99	99.26	97.12	97.86	96.32	99.42	92.10	90.50	88.88	85.40	88.49
	Trankit[large]	100.00	94.54	100.00	98.97	97.29	97.98	96.41	99.13	93.25	91.87	90.75	87.86	90.00
	Trankit[base]	100.00	94.57	100.00	98.76	96.74	97.54	95.68	99.07	92.42	90.91	89.45	86.12	88.71
	Stanza	99.99	80.66	99.99	98.76	95.72	96.69	94.63	99.09	88.82	86.80	85.71	81.47	85.31
Latin LLCT	COMBO[base]	100.00	99.49	99.99	99.76	97.17	96.98	96.56	98.34	96.23	95.43	94.33	90.04	92.12
	Stanza	99.99	99.32	99.99	99.57	96.65	96.79	96.47	98.09	96.13	94.88	93.53	89.49	91.50
Latin UDANTE	COMBO[base]	99.57	99.17	99.27	91.24	70.77	76.80	64.48	86.72	74.44	67.20	58.63	39.70	49.62
	Stanza	99.66	98.22	99.30	90.08	74.55	81.64	73.07	86.95	68.00	58.84	48.74	37.46	42.52
Latvian LVTB	COMBO[base]	99.86	97.83	99.86	98.45	93.40	96.12	92.67	97.91	92.98	90.50	88.85	83.58	86.83
	Trankit[large]	99.73	98.69	99.73	97.61	91.22	95.18	90.72	95.83	93.63	91.25	89.78	82.69	85.58
	Trankit[base]	99.71	99.10	99.71	97.16	90.24	94.47	89.62	95.61	92.05	89.44	87.73	79.78	83.52
	Stanza	99.81	98.15	99.81	96.70	89.72	94.73	89.29	96.12	88.91	85.77	83.37	76.71	80.17
Lithuanian ALKSNIS	COMBO[base]	99.60	96.07	99.63	97.02	92.80	93.40	91.30	94.75	87.61	84.07	82.85	75.47	77.84
	Trankit[large]	99.84	95.72	99.84	97.45	93.98	94.46	93.30	94.30	90.48	87.67	86.66	79.86	80.20
	Trankit[base]	99.82	95.10	99.82	97.03	92.35	93.00	91.54	94.05	88.30	84.96	83.59	75.11	77.35
	Stanza	99.94	89.93	99.94	93.71	86.48	88.16	85.54	92.95	77.82	72.75	70.23	60.53	65.21
Maltese MUDT	COMBO[base]	99.65	84.35	99.71	92.90	92.88	99.71	91.83	99.71	74.24	67.02	56.51	49.92	56.51
	Stanza	99.85	85.35	99.85	95.72	95.61	99.85	95.35	99.85	83.62	78.22	70.76	67.20	70.76
Marathi UFAL	COMBO[base]	99.60	84.78	82.91	75.52	82.91	58.66	57.04	72.06	54.97	47.81	48.19	26.10	39.76
	Trankit[large]	99.20	69.31	97.22	87.79	97.22	70.62	67.47	81.50	72.79	63.36	59.67	36.63	46.50
	Trankit[base]	99.20	60.87	95.25	82.83	95.25	69.43	66.02	79.17	60.90	54.08	52.19	28.81	40.50
	Stanza	97.99	89.36	92.89	85.78	92.89	73.53	71.57	82.84	68.87	59.56	54.73	37.04	46.09
Naija NSC	COMBO[base]	100.00	100.00	100.00	98.36	100.00	98.92	97.70	99.36	93.26	90.63	88.19	84.44	87.48
	Stanza	99.99	100.00	99.99	97.55	99.99	98.84	97.03	99.14	92.39	89.56	88.60	86.43	88.21
Norwegian BOKMAAL	COMBO[base]	99.89	99.04	99.90	98.73	99.23	96.72	96.23	98.89	95.09	94.04	92.17	87.42	90.90
	Trankit[large]	99.88	98.89	99.88	98.85	99.88	98.07	97.61	98.40	95.54	94.33	92.82	90.15	90.84
	Trankit[base]	99.88	99.20	99.88	98.66	99.88	97.60	97.02	98.34	94.78	93.47	91.77	88.29	89.72
	Stanza	99.88	97.70	99.88	98.38	99.04	97.09	96.38	98.61	93.26	91.85	89.11	85.13	87.53
Norwegian NYNORSK	COMBO[base]	99.96	97.74	99.96	98.70	99.26	96.65	96.04	98.73	94.85	93.61	91.56	86.42	89.89
	Trankit[large]	99.84	98.97	99.84	98.52	99.84	97.79	97.13	98.01	95.23	93.82	92.35	89.01	89.79
	Trankit[base]	99.81	98.71	99.81	98.20	99.81	97.20	96.48	97.89	94.15	92.58	90.70	86.61	88.15
	Stanza	99.97	95.48	99.97	98.13	98.91	96.87	95.93	97.87	91.63	89.94	86.84	82.33	84.30
Old East Slavic RNC	COMBO[base]	99.69	93.88	99.70	97.80	93.48	88.49	82.84	93.51	86.08	82.77	77.76	62.94	70.51
	Stanza	99.14	89.29	99.14	91.04	87.53	72.39	64.40	81.04	68.10	60.81	51.90	33.25	40.36
Old East Slavic RUTHENIAN	COMBO[base]	99.91	96.35	99.91	96.19	89.32	85.95	79.19	90.67	80.81	76.74	69.37	53.67	60.49
Persian PERDT	COMBO[base]	99.85	99.82	99.25	97.26	97.24	97.36	95.50	98.73	94.18	92.26	90.59	87.17	90.00
	Stanza	99.96	99.73	99.46	97.17	97.14	97.31	95.35	98.55	92.90	90.80	88.87	85.48	87.83
Polish PDB	COMBO[base]	99.94	98.91	99.91	99.24	96.78	96.84	96.14	98.53	95.97	92.98	91.06	86.84	89.32
	Trankit[large]	99.93	98.71	99.92	99.16	96.92	97.11	96.54	97.56	96.43	94.88	93.77	89.78	90.53
	Trankit[base]	99.91	98.53	99.89	99.06	96.29	96.44	95.77	97.52	95.52	93.86	92.50	87.67	89.34
	Stanza	99.85	98.19	99.83	98.63	94.59	94.78	93.89	97.47	93.73	91.73	89.82	83.50	86.95
Pomak PHILOTIS	COMBO[base]	99.81	92.10	99.45	93.91	99.45	77.14	76.27	92.21	82.94	75.21	69.08	44.65	62.76
	Stanza	100.00	95.05	100.00	98.76	100.00	95.37	95.13	97.90	87.88	82.87	77.20	70.29	74.96
Portuguese BOSQUE	COMBO[base]	99.84	97.30	98.36	96.55	98.36	95.69	94.71	97.20	90.86	88.69	85.77	79.20	84.24
	Trankit[large]	99.75	97.18	99.67	97.52	99.67	96.50	95.17	97.97	93.31	90.91	87.75	81.09	85.36
	Trankit[base]	99.70	97.48	99.65	97.27	99.65	96.50	94.95	97.89	92.76	90.25	86.96	80.03	84.52
	Stanza	99.85	93.10	99.76	97.45	99.76	96.44	95.33	98.04	90.59	87.75	82.66	77.07	80.59
Portuguese DANTESTOCKS	COMBO[base]	99.65	79.03	99.03	97.06	99.01	96.12	95.28	96.74	90.48	88.41	85.97	81.97	83.52
Portuguese PETROGOLD	COMBO[base]	99.72	96.76	98.44	97.61	98.44	97.14	96.70	97.87	92.75	91.64	88.98	85.25	88.35
	Stanza	99.71	95.83	99.66	98.59	99.66	98.51	97.94	99.02	94.48	93.28	90.26	88.10	89.57
Portuguese PORTTINARI	COMBO[base]	99.93	99.91	98.99	98.41	98.99	97.79	97.56	98.61	95.39	94.45	92.59	89.22	92.15
Romanian NONSTANDARD	COMBO[base]	98.77	98.00	98.70	96.30	91.86	90.34	88.84	95.04	90.31	86.90	83.57	70.40	79.57
	Trankit[large]	98.74	98.00	98.74	96.23	91.64	90.51	89.07	94.66	90.68	86.89	83.13	70.10	78.50
	Trankit[base]	98.68	98.57	98.68	96.04	91.48	90.33	88.89	94.57	90.14	86.40	82.40	69.46	77.93
	Stanza	98.96	97.53	98.96	95.60	90.85	89.71	88.32	94.96	88.97	84.88	80.51	67.17	76.58
Romanian RRT	COMBO[base]	99.75	97.46	99.74	98.08	97.48	97.31	97.00	98.21	93.73	90.72	88.33	84.47	86.59
	Trankit[large]	99.60	98.49	99.60	97.90	97.35	97.43	97.11	97.98	93.60	89.50	86.61	82.78	84.60
	Trankit[base]	99.72	97.67	99.72	97.87	97.25	97.44	97.01	98.05	93.14	89.04	85.93	82.02	84.01
	Stanza	99.73	95.72	99.73	97.50	96.80	97.10	96.74	97.42	90.70	86.86	82.99	79.90	80.83
Romanian SIMONERO	COMBO[base]	99.63	100.00	99.57	98.27	97.73	97.25	96.97	98.72	92.67	90.61	87.41	83.64	86.47
	Stanza	99.77	100.00	99.77	97.98	97.55	97.19	96.99	98.69	93.45	91.44	88.50	84.36	87.34
Russian GSD	COMBO[base]	99.69	99.25	99.75	98.11	97.90	94.92	94.05	96.77	91.81	88.52	87.60	80.94	84.26
	Trankit[large]	99.79	99.25	99.79	98.25	97.89	95.78	94.73	95.75	92.70	89.75	88.71	82.92	83.66
	Trankit[base]	99.63	98.25	99.63	97.96	97.65	94.86	93.83	95.50	91.86	88.62	87.41	80.83	82.36
	Stanza	99.58	97.33	99.58	97.63	97.41	93.63	92.76	95.51	89.56	85.89	83.91	77.00	79.48
Russian POETRY	COMBO[base]	99.79	89.06	99.66	97.89	99.66	93.19	92.81	95.69	88.11	85.46	82.68	74.43	78.27
Russian TAIGA	COMBO[base]	99.20	80.19	99.21	97.73	99.21	95.96	95.44	97.28	88.95	86.82	85.52	81.15	83.49
	Trankit[large]	98.90	92.32	98.90	96.16	96.62	91.02	87.69	91.90	85.25	81.73	80.06	68.48	71.59
	Trankit[base]	98.77	92.60	98.77	95.50	97.27	89.42	86.58	91.46	83.08	79.15	76.91	64.25	68.53
	Stanza	99.21	89.67	99.21	96.34	99.21	93.28	92.20	94.41	82.36	78.53	75.91	69.20	71.30
Serbian SET	COMBO[base]	100.00	97.78	100.00	99.10	96.19	96.37	95.62	98.33	95.18	92.81	91.51	85.41	89.39
	Trankit[large]	99.91	100.00	99.91	99.06	96.22	96.40	95.84	96.90	95.57	93.13	91.92	85.76	87.71
	Trankit[base]	99.91	99.71	99.91	98.97	95.82	95.96	95.32	96.90	95.24	92.94	91.53	84.84	87.46
	Stanza	99.99	98.46	99.99	98.44	94.16	94.31	93.76	96.30	91.44	88.36	85.92	78.82	81.74
Slovak SNK	COMBO[base]	99.59	95.52	99.60	97.93	91.43	94.76	90.52	96.33	95.14	93.83	93.13	86.53	89.24
	Trankit[large]	99.94	98.49	99.94	97.90	90.82	95.22	90.20	94.79	96.97	95.60	95.04	87.64	88.39
	Trankit[base]	99.93	98.07	99.93	97.80	89.02	94.00	88.38	94.66	95.72	93.97	93.19	84.33	86.63
	Stanza	99.96	84.31	99.96	96.34	88.19	90.95	87.35	94.08	89.13	86.58	84.43	74.72	78.62
Slovenian SSJ	COMBO[base]	99.94	97.48	99.95	99.01	97.71	97.56	97.07	98.90	95.68	94.51	92.86	89.46	91.62
	Trankit[large]	99.97	100.00	99.97	99.24	97.83	97.99	97.60	97.55	96.91	96.06	94.88	91.78	91.37
	Trankit[base]	99.93	99.81	99.93	99.03	96.70	96.97	96.38	97.49	95.94	94.99	93.53	89.09	90.12
	Stanza	99.93	99.26	99.93	98.41	95.88	96.09	95.37	97.69	92.45	90.80	88.28	83.80	85.67
Spanish ANCORA	COMBO[base]	99.99	99.19	99.93	99.06	96.23	98.66	95.70	99.48	94.02	92.46	89.74	87.31	89.28
	Trankit[large]	99.91	99.39	99.91	99.06	99.00	98.85	98.36	99.15	94.77	93.29	91.10	89.23	90.14
	Trankit[base]	99.94	99.13	99.93	99.02	98.94	98.80	98.27	99.17	94.11	92.41	89.66	87.60	88.71
	Stanza	99.97	98.49	99.96	98.96	96.10	98.54	95.65	99.24	93.09	91.30	87.80	85.49	86.94
Spanish GSD	COMBO[base]	99.62	98.71	98.93	96.52	98.93	95.49	93.97	97.69	92.28	90.25	86.34	78.24	84.58
	Trankit[large]	99.93	99.30	99.88	97.38	99.88	96.96	95.23	98.59	93.47	91.56	88.58	80.91	86.50
	Trankit[base]	99.91	98.94	99.88	97.41	99.88	96.88	95.23	98.62	92.66	90.50	87.01	79.83	85.04
	Stanza	99.94	95.60	99.80	97.07	99.80	96.42	94.77	98.42	92.01	89.57	84.56	76.86	82.66
Swedish LINES	COMBO[base]	99.95	91.01	99.94	98.33	95.41	92.57	89.78	97.95	92.48	89.59	87.29	76.53	84.97
	Trankit[large]	99.89	90.64	99.89	98.05	95.77	90.98	88.52	96.94	91.74	88.73	87.89	74.52	83.97
	Trankit[base]	99.73	90.57	99.73	97.60	95.23	90.50	87.93	96.72	90.45	87.36	86.11	72.78	82.24
	Stanza	99.94	87.91	99.94	97.34	95.07	90.68	87.95	97.19	89.02	85.25	82.28	69.82	79.13
Swedish TALBANKEN	COMBO[base]	99.62	99.34	99.62	98.74	97.48	97.07	96.23	98.26	93.80	91.94	90.62	86.00	88.86
	Trankit[large]	99.91	99.26	99.91	99.06	98.09	98.04	97.43	97.87	94.41	92.97	92.08	88.67	89.28
	Trankit[base]	99.87	99.38	99.87	98.76	97.77	97.73	97.03	97.82	93.61	91.87	90.72	86.97	88.03
	Stanza	99.97	97.49	99.97	98.28	97.13	97.29	96.24	97.92	90.32	87.85	85.91	81.88	83.42
Tamil TTB	COMBO[base]	98.79	100.00	80.69	69.73	65.13	65.49	57.95	74.90	44.35	38.98	38.79	28.61	35.95
	Trankit[large]	98.33	100.00	94.44	87.64	83.92	87.19	82.56	88.85	72.34	67.66	66.19	58.16	61.43
	Trankit[base]	98.02	100.00	93.64	86.18	82.09	86.43	80.27	88.09	68.37	63.67	61.78	52.73	57.32
	Stanza	99.27	98.74	89.61	78.51	77.53	79.63	73.03	82.55	58.39	50.97	48.82	41.40	43.87
Telugu MTG	COMBO[base]	99.79	97.58	99.79	94.80	94.80	98.96	94.53	99.79	90.64	83.16	79.43	76.19	79.43
	Trankit[large]	98.89	98.62	98.89	94.31	94.31	98.33	94.31	98.89	93.19	87.08	84.46	80.65	84.46
	Trankit[base]	98.89	98.62	98.89	94.32	94.32	97.92	94.32	98.89	91.97	84.35	81.10	78.44	81.10
	Stanza	99.79	98.62	99.79	93.97	93.97	99.10	93.97	99.79	90.09	81.64	78.13	74.50	78.13
Turkish ATIS	COMBO[base]	100.00	89.83	100.00	98.34	100.00	97.69	97.53	98.96	89.72	88.02	87.53	85.02	86.71
	Stanza	100.00	86.93	100.00	98.77	100.00	98.57	98.34	98.98	89.03	86.91	86.31	84.60	85.56
Turkish BOUN	COMBO[base]	99.56	91.60	96.55	89.77	85.46	80.25	70.88	91.37	74.41	68.02	67.39	49.45	62.91
	Stanza	99.58	90.08	96.32	89.92	85.74	81.66	73.03	90.37	71.53	65.17	63.79	48.49	58.96
Turkish IMST	COMBO[base]	99.81	97.50	98.57	93.90	93.62	89.62	87.19	95.52	78.81	71.24	68.25	58.22	65.81
	Trankit[large]	99.84	98.32	98.91	96.20	95.33	92.78	91.19	96.21	78.94	73.14	71.15	63.81	69.11
	Trankit[base]	99.86	98.18	98.68	95.15	94.35	92.02	89.94	95.80	76.59	70.75	68.28	60.61	66.24
	Stanza	99.86	98.16	97.75	93.44	93.27	91.06	89.07	95.55	73.39	64.07	60.96	54.70	59.51
Turkish TOURISM	COMBO[base]	100.00	100.00	100.00	98.70	100.00	95.21	94.95	98.95	96.30	90.74	87.89	81.63	86.82
	Stanza	100.00	100.00	100.00	99.08	100.00	94.90	94.64	98.90	96.99	91.31	88.74	81.60	87.58
Ukrainian IU	COMBO[base]	99.86	97.43	99.78	98.31	95.35	94.91	93.72	98.17	93.05	91.31	89.49	82.43	87.50
	Trankit[large]	99.77	97.55	99.76	98.50	96.32	96.09	95.35	96.99	94.63	93.16	91.78	86.22	88.03
	Trankit[base]	99.78	97.72	99.76	98.33	94.96	94.94	93.86	96.98	93.44	91.69	89.89	83.20	86.33
	Stanza	99.79	97.21	99.76	97.52	93.01	93.11	92.07	96.72	88.60	85.87	82.77	75.63	79.55
Ukrainian PARLAMINT	COMBO[base]	99.95	95.98	99.95	98.54	98.32	93.95	92.68	99.12	94.03	91.78	89.79	81.29	88.78
Urdu UDTB	COMBO[base]	99.99	98.60	99.99	94.85	93.26	83.42	79.67	97.33	88.08	83.15	78.00	58.16	75.60
	Trankit[large]	99.75	97.67	99.75	94.43	92.77	81.91	78.35	95.44	88.52	83.26	78.30	57.41	75.87
	Trankit[base]	99.66	98.32	99.66	94.15	92.66	83.04	79.29	95.33	87.81	82.51	77.31	57.57	74.83
	Stanza	100.00	98.88	100.00	94.78	92.98	84.06	80.49	95.58	87.96	82.76	77.13	59.12	74.79
Uyghur UDT	COMBO[base]	99.45	88.19	99.30	89.78	92.20	82.20	75.25	96.31	78.90	68.69	65.57	47.47	62.94
	Trankit[large]	97.95	88.95	97.95	88.50	91.34	86.56	79.14	94.45	80.19	70.14	66.06	51.63	62.99
	Trankit[base]	97.63	88.51	97.63	87.47	90.37	85.31	77.28	94.26	78.36	68.24	63.89	48.42	60.70
	Stanza	99.42	84.69	99.42	89.26	91.19	87.58	80.06	95.30	74.80	63.42	58.96	48.01	55.81
Western Armenian ARMTDP	COMBO[base]	99.81	96.80	98.44	95.50	98.44	88.24	87.44	95.75	88.91	84.77	80.75	66.65	77.79
	Stanza	99.95	99.56	99.91	96.42	99.91	92.70	92.04	96.70	87.73	82.83	77.33	68.89	74.38