end-to-end corrector run
Browse files
verifier-qwen3.5-2b-v2/end-to-end-20260930/corrected-full.jsonl.scores.md
ADDED
|
@@ -0,0 +1,24 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# End-to-end corrector: outputs/edit/e2e/corrected-full.jsonl
|
| 2 |
+
|
| 3 |
+
1978 transcripts scored; 9365 candidates; 74 rewrites skipped for stopping early.
|
| 4 |
+
|
| 5 |
+
| slice | method | WER | WER (clitic) | fixed | broken | net | broken/100 | entity fix | applied |
|
| 6 |
+
|---|---|---|---|---|---|---|---|---|---|
|
| 7 |
+
| main | whisper | 0.1929 | 0.1840 | 0 | 0 | 0 | 0.00 | 0.000 | 0 |
|
| 8 |
+
| main | rules only | 0.1862 | 0.1767 | 3594 | 123 | 3471 | 0.04 | 0.010 | 0 |
|
| 9 |
+
| main | accept all | 0.1836 | 0.1751 | 8143 | 3784 | 4359 | 1.26 | 0.119 | 9365 |
|
| 10 |
+
| main | verifier@0.5 | 0.1860 | 0.1765 | 4648 | 1115 | 3533 | 0.37 | 0.062 | 2568 |
|
| 11 |
+
| main | verifier@0.7 | 0.1859 | 0.1764 | 4127 | 596 | 3531 | 0.20 | 0.043 | 1346 |
|
| 12 |
+
| main | verifier@0.8 | 0.1860 | 0.1764 | 3913 | 403 | 3510 | 0.13 | 0.028 | 813 |
|
| 13 |
+
| entity | whisper | 0.1866 | 0.1776 | 0 | 0 | 0 | 0.00 | 0.000 | 0 |
|
| 14 |
+
| entity | rules only | 0.1800 | 0.1703 | 1833 | 49 | 1784 | 0.03 | 0.010 | 0 |
|
| 15 |
+
| entity | accept all | 0.1772 | 0.1685 | 4189 | 1889 | 2300 | 1.21 | 0.119 | 4737 |
|
| 16 |
+
| entity | verifier@0.5 | 0.1797 | 0.1700 | 2361 | 529 | 1832 | 0.34 | 0.062 | 1278 |
|
| 17 |
+
| entity | verifier@0.7 | 0.1797 | 0.1700 | 2095 | 279 | 1816 | 0.18 | 0.043 | 670 |
|
| 18 |
+
| entity | verifier@0.8 | 0.1799 | 0.1702 | 1979 | 198 | 1781 | 0.13 | 0.028 | 398 |
|
| 19 |
+
| typo | whisper | 0.1412 | 0.1316 | 0 | 0 | 0 | 0.00 | 0.000 | 0 |
|
| 20 |
+
| typo | rules only | 0.1348 | 0.1248 | 345 | 4 | 341 | 0.01 | 0.011 | 0 |
|
| 21 |
+
| typo | accept all | 0.1348 | 0.1255 | 752 | 383 | 369 | 1.12 | 0.189 | 877 |
|
| 22 |
+
| typo | verifier@0.5 | 0.1350 | 0.1250 | 426 | 89 | 337 | 0.26 | 0.111 | 203 |
|
| 23 |
+
| typo | verifier@0.7 | 0.1351 | 0.1251 | 383 | 53 | 330 | 0.16 | 0.067 | 111 |
|
| 24 |
+
| typo | verifier@0.8 | 0.1351 | 0.1250 | 361 | 34 | 327 | 0.10 | 0.033 | 66 |
|
verifier-qwen3.5-2b-v2/end-to-end-20260930/predictions-threshold0.7.jsonl
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
verifier-qwen3.5-2b-v2/end-to-end-20260930/predictions-threshold0.8.jsonl
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|