diff --git "a/index.html" "b/index.html" deleted file mode 100644--- "a/index.html" +++ /dev/null @@ -1,27691 +0,0 @@ - - -
- - -- Comparison of all metrics across engine/condition combinations. Green = better, Red = worse. WIP is inverted (higher is better). -
- - - -- Analyze performance distribution and resilience across different groupings. -
- -| Engine | -Degradation | -Enhancement | -Audio Norm | -Text Norm | - -WER | - -CER | - -MER | - -WIL | - -WIP | - -Time (s) | -
|---|---|---|---|---|---|---|---|---|---|---|
| whisper-base | -None | -- | -Broadcast_standard | -Brut | - - -- - 0.0606 - - | - - -- - 0.0235 - - | - - -- - 0.0603 - - | - - -- - 0.1132 - - | - - -- - 0.8868 - - | - -16.06 | -
| whisper-base | -None | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0087 - - | - - -- - 0.0008 - - | - - -- - 0.0086 - - | - - -- - 0.0129 - - | - - -- - 0.9871 - - | - -16.06 | -
| whisper-base | -None | -- | -No_normalization | -Brut | - - -- - 0.0736 - - | - - -- - 0.0463 - - | - - -- - 0.0733 - - | - - -- - 0.1375 - - | - - -- - 0.8625 - - | - -17.34 | -
| whisper-base | -None | -- | -No_normalization | -Normalisé | - - -- - 0.0216 - - | - - -- - 0.0226 - - | - - -- - 0.0216 - - | - - -- - 0.0385 - - | - - -- - 0.9615 - - | - -17.34 | -
| whisper-base | -Cathedral | -- | -Broadcast_standard | -Brut | - - -- - 0.2814 - - | - - -- - 0.1436 - - | - - -- - 0.2720 - - | - - -- - 0.4446 - - | - - -- - 0.5554 - - | - -28.10 | -
| whisper-base | -Cathedral | -- | -Broadcast_standard | -Normalisé | - - -- - 0.2165 - - | - - -- - 0.1168 - - | - - -- - 0.2092 - - | - - -- - 0.3448 - - | - - -- - 0.6552 - - | - -28.10 | -
| whisper-base | -Cathedral | -- | -No_normalization | -Brut | - - -- - 0.2857 - - | - - -- - 0.1460 - - | - - -- - 0.2762 - - | - - -- - 0.4487 - - | - - -- - 0.5513 - - | - -26.38 | -
| whisper-base | -Cathedral | -- | -No_normalization | -Normalisé | - - -- - 0.2208 - - | - - -- - 0.1201 - - | - - -- - 0.2134 - - | - - -- - 0.3489 - - | - - -- - 0.6511 - - | - -26.38 | -
| whisper-base | -Megaphone, outdoor | -- | -Broadcast_standard | -Brut | - - -- - 0.1472 - - | - - -- - 0.0856 - - | - - -- - 0.1466 - - | - - -- - 0.2621 - - | - - -- - 0.7379 - - | - -38.58 | -
| whisper-base | -Megaphone, outdoor | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0952 - - | - - -- - 0.0620 - - | - - -- - 0.0948 - - | - - -- - 0.1700 - - | - - -- - 0.8300 - - | - -38.58 | -
| whisper-base | -Megaphone, outdoor | -- | -No_normalization | -Brut | - - -- - 0.1515 - - | - - -- - 0.0848 - - | - - -- - 0.1509 - - | - - -- - 0.2695 - - | - - -- - 0.7305 - - | - -26.74 | -
| whisper-base | -Megaphone, outdoor | -- | -No_normalization | -Normalisé | - - -- - 0.0952 - - | - - -- - 0.0604 - - | - - -- - 0.0948 - - | - - -- - 0.1700 - - | - - -- - 0.8300 - - | - -26.74 | -
| whisper-base | -None | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.0563 - - | - - -- - 0.0228 - - | - - -- - 0.0560 - - | - - -- - 0.1051 - - | - - -- - 0.8949 - - | - -28.59 | -
| whisper-base | -None | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.0087 - - | - - -- - 0.0008 - - | - - -- - 0.0086 - - | - - -- - 0.0129 - - | - - -- - 0.9871 - - | - -28.59 | -
| whisper-base | -None | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.0606 - - | - - -- - 0.0243 - - | - - -- - 0.0603 - - | - - -- - 0.1132 - - | - - -- - 0.8868 - - | - -27.50 | -
| whisper-base | -None | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.0130 - - | - - -- - 0.0024 - - | - - -- - 0.0129 - - | - - -- - 0.0215 - - | - - -- - 0.9785 - - | - -27.50 | -
| whisper-base | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.7792 - - | - - -- - 0.4655 - - | - - -- - 0.6818 - - | - - -- - 0.8825 - - | - - -- - 0.1175 - - | - -27.04 | -
| whisper-base | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.7576 - - | - - -- - 0.4496 - - | - - -- - 0.6629 - - | - - -- - 0.8681 - - | - - -- - 0.1319 - - | - -27.04 | -
| whisper-base | -Cathedral | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.7186 - - | - - -- - 0.4372 - - | - - -- - 0.6561 - - | - - -- - 0.8657 - - | - - -- - 0.1343 - - | - -26.98 | -
| whisper-base | -Cathedral | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.6710 - - | - - -- - 0.4150 - - | - - -- - 0.6126 - - | - - -- - 0.8296 - - | - - -- - 0.1704 - - | - -26.98 | -
| whisper-base | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.1688 - - | - - -- - 0.0981 - - | - - -- - 0.1674 - - | - - -- - 0.2885 - - | - - -- - 0.7115 - - | - -23.60 | -
| whisper-base | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.1212 - - | - - -- - 0.0741 - - | - - -- - 0.1202 - - | - - -- - 0.2056 - - | - - -- - 0.7944 - - | - -23.60 | -
| whisper-base | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.1558 - - | - - -- - 0.0926 - - | - - -- - 0.1552 - - | - - -- - 0.2706 - - | - - -- - 0.7294 - - | - -34.77 | -
| whisper-base | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.1126 - - | - - -- - 0.0701 - - | - - -- - 0.1121 - - | - - -- - 0.1943 - - | - - -- - 0.8057 - - | - -34.77 | -
| large-v3-turbo | -None | -- | -Broadcast_standard | -Brut | - - -- - 0.0433 - - | - - -- - 0.0196 - - | - - -- - 0.0431 - - | - - -- - 0.0804 - - | - - -- - 0.9196 - - | - -151.70 | -
| large-v3-turbo | -None | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0087 - - | - - -- - 0.0008 - - | - - -- - 0.0086 - - | - - -- - 0.0129 - - | - - -- - 0.9871 - - | - -151.70 | -
| large-v3-turbo | -None | -- | -No_normalization | -Brut | - - -- - 0.0433 - - | - - -- - 0.0196 - - | - - -- - 0.0431 - - | - - -- - 0.0804 - - | - - -- - 0.9196 - - | - -124.07 | -
| large-v3-turbo | -None | -- | -No_normalization | -Normalisé | - - -- - 0.0087 - - | - - -- - 0.0008 - - | - - -- - 0.0086 - - | - - -- - 0.0129 - - | - - -- - 0.9871 - - | - -124.07 | -
| large-v3-turbo | -Cathedral | -- | -Broadcast_standard | -Brut | - - -- - 0.7186 - - | - - -- - 0.7057 - - | - - -- - 0.4346 - - | - - -- - 0.4713 - - | - - -- - 0.5287 - - | - -56.51 | -
| large-v3-turbo | -Cathedral | -- | -Broadcast_standard | -Normalisé | - - -- - 0.6753 - - | - - -- - 0.6785 - - | - - -- - 0.4084 - - | - - -- - 0.4212 - - | - - -- - 0.5788 - - | - -56.51 | -
| large-v3-turbo | -Cathedral | -- | -No_normalization | -Brut | - - -- - 0.0693 - - | - - -- - 0.0345 - - | - - -- - 0.0690 - - | - - -- - 0.1294 - - | - - -- - 0.8706 - - | - -41.33 | -
| large-v3-turbo | -Cathedral | -- | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0137 - - | - - -- - 0.0259 - - | - - -- - 0.0469 - - | - - -- - 0.9531 - - | - -41.33 | -
| large-v3-turbo | -Megaphone, outdoor | -- | -Broadcast_standard | -Brut | - - -- - 0.7186 - - | - - -- - 0.6962 - - | - - -- - 0.4346 - - | - - -- - 0.4713 - - | - - -- - 0.5287 - - | - -55.70 | -
| large-v3-turbo | -Megaphone, outdoor | -- | -Broadcast_standard | -Normalisé | - - -- - 0.6753 - - | - - -- - 0.6696 - - | - - -- - 0.4084 - - | - - -- - 0.4212 - - | - - -- - 0.5788 - - | - -55.70 | -
| large-v3-turbo | -Megaphone, outdoor | -- | -No_normalization | -Brut | - - -- - 0.6364 - - | - - -- - 0.6185 - - | - - -- - 0.4061 - - | - - -- - 0.4472 - - | - - -- - 0.5528 - - | - -55.50 | -
| large-v3-turbo | -Megaphone, outdoor | -- | -No_normalization | -Normalisé | - - -- - 0.5887 - - | - - -- - 0.5915 - - | - - -- - 0.3757 - - | - - -- - 0.3892 - - | - - -- - 0.6108 - - | - -55.50 | -
| large-v3-turbo | -None | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.6926 - - | - - -- - 0.6939 - - | - - -- - 0.4188 - - | - - -- - 0.4415 - - | - - -- - 0.5585 - - | - -55.66 | -
| large-v3-turbo | -None | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.6580 - - | - - -- - 0.6688 - - | - - -- - 0.3979 - - | - - -- - 0.4005 - - | - - -- - 0.5995 - - | - -55.66 | -
| large-v3-turbo | -None | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.5195 - - | - - -- - 0.5165 - - | - - -- - 0.3509 - - | - - -- - 0.3762 - - | - - -- - 0.6238 - - | - -45.61 | -
| large-v3-turbo | -None | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.4848 - - | - - -- - 0.4940 - - | - - -- - 0.3275 - - | - - -- - 0.3304 - - | - - -- - 0.6696 - - | - -45.61 | -
| large-v3-turbo | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.7792 - - | - - -- - 0.6327 - - | - - -- - 0.4959 - - | - - -- - 0.5984 - - | - - -- - 0.4016 - - | - -62.49 | -
| large-v3-turbo | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.7403 - - | - - -- - 0.6156 - - | - - -- - 0.4711 - - | - - -- - 0.5579 - - | - - -- - 0.4421 - - | - -62.49 | -
| large-v3-turbo | -Cathedral | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.7013 - - | - - -- - 0.6044 - - | - - -- - 0.4696 - - | - - -- - 0.5773 - - | - - -- - 0.4227 - - | - -53.65 | -
| large-v3-turbo | -Cathedral | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.6710 - - | - - -- - 0.5834 - - | - - -- - 0.4493 - - | - - -- - 0.5444 - - | - - -- - 0.4556 - - | - -53.65 | -
| large-v3-turbo | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.7316 - - | - - -- - 0.6986 - - | - - -- - 0.4424 - - | - - -- - 0.4859 - - | - - -- - 0.5141 - - | - -55.41 | -
| large-v3-turbo | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.6753 - - | - - -- - 0.6696 - - | - - -- - 0.4084 - - | - - -- - 0.4212 - - | - - -- - 0.5788 - - | - -55.41 | -
| large-v3-turbo | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.7316 - - | - - -- - 0.6986 - - | - - -- - 0.4424 - - | - - -- - 0.4859 - - | - - -- - 0.5141 - - | - -55.93 | -
| large-v3-turbo | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.6753 - - | - - -- - 0.6696 - - | - - -- - 0.4084 - - | - - -- - 0.4212 - - | - - -- - 0.5788 - - | - -55.93 | -
| wav2vec2-english | -None | -- | -Broadcast_standard | -Brut | - - -- - 0.3117 - - | - - -- - 0.0808 - - | - - -- - 0.3077 - - | - - -- - 0.5124 - - | - - -- - 0.4876 - - | - -8.58 | -
| wav2vec2-english | -None | -- | -Broadcast_standard | -Normalisé | - - -- - 0.1385 - - | - - -- - 0.0242 - - | - - -- - 0.1368 - - | - - -- - 0.2419 - - | - - -- - 0.7581 - - | - -8.58 | -
| wav2vec2-english | -None | -- | -No_normalization | -Brut | - - -- - 0.3117 - - | - - -- - 0.0801 - - | - - -- - 0.3077 - - | - - -- - 0.5145 - - | - - -- - 0.4855 - - | - -7.34 | -
| wav2vec2-english | -None | -- | -No_normalization | -Normalisé | - - -- - 0.1299 - - | - - -- - 0.0234 - - | - - -- - 0.1282 - - | - - -- - 0.2301 - - | - - -- - 0.7699 - - | - -7.34 | -
| wav2vec2-english | -Cathedral | -- | -Broadcast_standard | -Brut | - - -- - 0.9307 - - | - - -- - 0.7206 - - | - - -- - 0.9267 - - | - - -- - 0.9895 - - | - - -- - 0.0105 - - | - -7.46 | -
| wav2vec2-english | -Cathedral | -- | -Broadcast_standard | -Normalisé | - - -- - 0.9177 - - | - - -- - 0.7075 - - | - - -- - 0.9138 - - | - - -- - 0.9854 - - | - - -- - 0.0146 - - | - -7.46 | -
| wav2vec2-english | -Cathedral | -- | -No_normalization | -Brut | - - -- - 0.9307 - - | - - -- - 0.7206 - - | - - -- - 0.9267 - - | - - -- - 0.9895 - - | - - -- - 0.0105 - - | - -7.09 | -
| wav2vec2-english | -Cathedral | -- | -No_normalization | -Normalisé | - - -- - 0.9177 - - | - - -- - 0.7075 - - | - - -- - 0.9138 - - | - - -- - 0.9854 - - | - - -- - 0.0146 - - | - -7.09 | -
| wav2vec2-english | -Megaphone, outdoor | -- | -Broadcast_standard | -Brut | - - -- - 0.6450 - - | - - -- - 0.2512 - - | - - -- - 0.6032 - - | - - -- - 0.8296 - - | - - -- - 0.1704 - - | - -7.35 | -
| wav2vec2-english | -Megaphone, outdoor | -- | -Broadcast_standard | -Normalisé | - - -- - 0.5281 - - | - - -- - 0.2047 - - | - - -- - 0.4939 - - | - - -- - 0.7228 - - | - - -- - 0.2772 - - | - -7.35 | -
| wav2vec2-english | -Megaphone, outdoor | -- | -No_normalization | -Brut | - - -- - 0.6450 - - | - - -- - 0.2512 - - | - - -- - 0.6032 - - | - - -- - 0.8296 - - | - - -- - 0.1704 - - | - -7.19 | -
| wav2vec2-english | -Megaphone, outdoor | -- | -No_normalization | -Normalisé | - - -- - 0.5281 - - | - - -- - 0.2047 - - | - - -- - 0.4939 - - | - - -- - 0.7228 - - | - - -- - 0.2772 - - | - -7.19 | -
| wav2vec2-english | -None | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.3117 - - | - - -- - 0.0793 - - | - - -- - 0.3077 - - | - - -- - 0.5145 - - | - - -- - 0.4855 - - | - -7.12 | -
| wav2vec2-english | -None | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.1299 - - | - - -- - 0.0226 - - | - - -- - 0.1282 - - | - - -- - 0.2301 - - | - - -- - 0.7699 - - | - -7.12 | -
| wav2vec2-english | -None | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.3117 - - | - - -- - 0.0793 - - | - - -- - 0.3077 - - | - - -- - 0.5145 - - | - - -- - 0.4855 - - | - -7.24 | -
| wav2vec2-english | -None | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.1299 - - | - - -- - 0.0226 - - | - - -- - 0.1282 - - | - - -- - 0.2301 - - | - - -- - 0.7699 - - | - -7.24 | -
| wav2vec2-english | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.9264 - - | - - -- - 0.7763 - - | - - -- - 0.9264 - - | - - -- - 0.9884 - - | - - -- - 0.0116 - - | - -7.03 | -
| wav2vec2-english | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.9177 - - | - - -- - 0.7687 - - | - - -- - 0.9177 - - | - - -- - 0.9855 - - | - - -- - 0.0145 - - | - -7.03 | -
| wav2vec2-english | -Cathedral | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.9264 - - | - - -- - 0.7739 - - | - - -- - 0.9264 - - | - - -- - 0.9886 - - | - - -- - 0.0114 - - | - -7.03 | -
| wav2vec2-english | -Cathedral | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.9177 - - | - - -- - 0.7663 - - | - - -- - 0.9177 - - | - - -- - 0.9858 - - | - - -- - 0.0142 - - | - -7.03 | -
| wav2vec2-english | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.6234 - - | - - -- - 0.2480 - - | - - -- - 0.6000 - - | - - -- - 0.8273 - - | - - -- - 0.1727 - - | - -7.12 | -
| wav2vec2-english | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.4978 - - | - - -- - 0.2015 - - | - - -- - 0.4792 - - | - - -- - 0.7072 - - | - - -- - 0.2928 - - | - -7.12 | -
| wav2vec2-english | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.6234 - - | - - -- - 0.2480 - - | - - -- - 0.6000 - - | - - -- - 0.8273 - - | - - -- - 0.1727 - - | - -7.18 | -
| wav2vec2-english | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.4978 - - | - - -- - 0.2015 - - | - - -- - 0.4792 - - | - - -- - 0.7072 - - | - - -- - 0.2928 - - | - -7.18 | -
| seamless-m4t-v2-large | -None | -- | -Broadcast_standard | -Brut | - - -- - 1.0000 - - | - - -- - 0.8085 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -55.74 | -
| seamless-m4t-v2-large | -None | -- | -Broadcast_standard | -Normalisé | - - -- - 1.0000 - - | - - -- - 0.8002 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -55.74 | -
| seamless-m4t-v2-large | -None | -- | -No_normalization | -Brut | - - -- - 1.0000 - - | - - -- - 0.8085 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -51.72 | -
| seamless-m4t-v2-large | -None | -- | -No_normalization | -Normalisé | - - -- - 1.0000 - - | - - -- - 0.8002 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -51.72 | -
| seamless-m4t-v2-large | -Cathedral | -- | -Broadcast_standard | -Brut | - - -- - 0.9913 - - | - - -- - 0.9490 - - | - - -- - 0.9913 - - | - - -- - 0.9989 - - | - - -- - 0.0011 - - | - -31.18 | -
| seamless-m4t-v2-large | -Cathedral | -- | -Broadcast_standard | -Normalisé | - - -- - 0.9913 - - | - - -- - 0.9476 - - | - - -- - 0.9913 - - | - - -- - 0.9989 - - | - - -- - 0.0011 - - | - -31.18 | -
| seamless-m4t-v2-large | -Cathedral | -- | -No_normalization | -Brut | - - -- - 0.9913 - - | - - -- - 0.9490 - - | - - -- - 0.9913 - - | - - -- - 0.9989 - - | - - -- - 0.0011 - - | - -31.36 | -
| seamless-m4t-v2-large | -Cathedral | -- | -No_normalization | -Normalisé | - - -- - 0.9913 - - | - - -- - 0.9476 - - | - - -- - 0.9913 - - | - - -- - 0.9989 - - | - - -- - 0.0011 - - | - -31.36 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -- | -Broadcast_standard | -Brut | - - -- - 0.9091 - - | - - -- - 0.8571 - - | - - -- - 0.9091 - - | - - -- - 0.9610 - - | - - -- - 0.0390 - - | - -33.76 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -- | -Broadcast_standard | -Normalisé | - - -- - 0.9004 - - | - - -- - 0.8517 - - | - - -- - 0.9004 - - | - - -- - 0.9533 - - | - - -- - 0.0467 - - | - -33.76 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -- | -No_normalization | -Brut | - - -- - 0.9091 - - | - - -- - 0.8642 - - | - - -- - 0.9091 - - | - - -- - 0.9585 - - | - - -- - 0.0415 - - | - -33.39 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -- | -No_normalization | -Normalisé | - - -- - 0.9048 - - | - - -- - 0.8590 - - | - - -- - 0.9048 - - | - - -- - 0.9545 - - | - - -- - 0.0455 - - | - -33.39 | -
| seamless-m4t-v2-large | -None | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 1.0000 - - | - - -- - 0.8776 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -38.58 | -
| seamless-m4t-v2-large | -None | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 1.0000 - - | - - -- - 0.8687 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -38.58 | -
| seamless-m4t-v2-large | -None | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 1.0000 - - | - - -- - 0.8776 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -37.88 | -
| seamless-m4t-v2-large | -None | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 1.0000 - - | - - -- - 0.8687 - - | - - -- - 1.0000 - - | - - -- - 1.0000 - - | - - -- - - | - -37.88 | -
| seamless-m4t-v2-large | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.9957 - - | - - -- - 0.8681 - - | - - -- - 0.9957 - - | - - -- - 0.9999 - - | - - -- - 0.0001 - - | - -35.77 | -
| seamless-m4t-v2-large | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.9957 - - | - - -- - 0.8654 - - | - - -- - 0.9957 - - | - - -- - 0.9999 - - | - - -- - 0.0001 - - | - -35.77 | -
| seamless-m4t-v2-large | -Cathedral | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.9870 - - | - - -- - 0.8909 - - | - - -- - 0.9870 - - | - - -- - 0.9990 - - | - - -- - 0.0010 - - | - -34.87 | -
| seamless-m4t-v2-large | -Cathedral | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.9870 - - | - - -- - 0.8880 - - | - - -- - 0.9870 - - | - - -- - 0.9990 - - | - - -- - 0.0010 - - | - -34.87 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.9957 - - | - - -- - 0.8030 - - | - - -- - 0.9829 - - | - - -- - 0.9997 - - | - - -- - 0.0003 - - | - -52.55 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.9177 - - | - - -- - 0.9089 - - | - - -- - 0.9177 - - | - - -- - 0.9589 - - | - - -- - 0.0411 - - | - -52.55 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.9957 - - | - - -- - 0.8030 - - | - - -- - 0.9829 - - | - - -- - 0.9997 - - | - - -- - 0.0003 - - | - -53.86 | -
| seamless-m4t-v2-large | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.9177 - - | - - -- - 0.9106 - - | - - -- - 0.9177 - - | - - -- - 0.9578 - - | - - -- - 0.0422 - - | - -53.86 | -
| parakeet-ctc-1.1b | -None | -- | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -11.03 | -
| parakeet-ctc-1.1b | -None | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -11.03 | -
| parakeet-ctc-1.1b | -None | -- | -No_normalization | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -11.74 | -
| parakeet-ctc-1.1b | -None | -- | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -11.74 | -
| parakeet-ctc-1.1b | -Cathedral | -- | -Broadcast_standard | -Brut | - - -- - 0.2424 - - | - - -- - 0.0651 - - | - - -- - 0.2393 - - | - - -- - 0.4138 - - | - - -- - 0.5862 - - | - -11.15 | -
| parakeet-ctc-1.1b | -Cathedral | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0433 - - | - - -- - 0.0089 - - | - - -- - 0.0427 - - | - - -- - 0.0717 - - | - - -- - 0.9283 - - | - -11.15 | -
| parakeet-ctc-1.1b | -Cathedral | -- | -No_normalization | -Brut | - - -- - 0.2424 - - | - - -- - 0.0651 - - | - - -- - 0.2393 - - | - - -- - 0.4138 - - | - - -- - 0.5862 - - | - -11.23 | -
| parakeet-ctc-1.1b | -Cathedral | -- | -No_normalization | -Normalisé | - - -- - 0.0433 - - | - - -- - 0.0089 - - | - - -- - 0.0427 - - | - - -- - 0.0717 - - | - - -- - 0.9283 - - | - -11.23 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -- | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -11.13 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -11.13 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -- | -No_normalization | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -11.04 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -- | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -11.04 | -
| parakeet-ctc-1.1b | -None | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -11.09 | -
| parakeet-ctc-1.1b | -None | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -11.09 | -
| parakeet-ctc-1.1b | -None | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -11.27 | -
| parakeet-ctc-1.1b | -None | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -11.27 | -
| parakeet-ctc-1.1b | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.3160 - - | - - -- - 0.1217 - - | - - -- - 0.3120 - - | - - -- - 0.5142 - - | - - -- - 0.4858 - - | - -11.58 | -
| parakeet-ctc-1.1b | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.1429 - - | - - -- - 0.0709 - - | - - -- - 0.1410 - - | - - -- - 0.2429 - - | - - -- - 0.7571 - - | - -11.58 | -
| parakeet-ctc-1.1b | -Cathedral | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.3160 - - | - - -- - 0.1232 - - | - - -- - 0.3133 - - | - - -- - 0.5182 - - | - - -- - 0.4818 - - | - -12.16 | -
| parakeet-ctc-1.1b | -Cathedral | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.1429 - - | - - -- - 0.0725 - - | - - -- - 0.1416 - - | - - -- - 0.2471 - - | - - -- - 0.7529 - - | - -12.16 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -11.44 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -11.44 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.2294 - - | - - -- - 0.0612 - - | - - -- - 0.2265 - - | - - -- - 0.3939 - - | - - -- - 0.6061 - - | - -11.12 | -
| parakeet-ctc-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.0303 - - | - - -- - 0.0048 - - | - - -- - 0.0299 - - | - - -- - 0.0467 - - | - - -- - 0.9533 - - | - -11.12 | -
| parakeet-tdt-1.1b | -None | -- | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -17.43 | -
| parakeet-tdt-1.1b | -None | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -17.43 | -
| parakeet-tdt-1.1b | -None | -- | -No_normalization | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -16.74 | -
| parakeet-tdt-1.1b | -None | -- | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -16.74 | -
| parakeet-tdt-1.1b | -Cathedral | -- | -Broadcast_standard | -Brut | - - -- - 0.2381 - - | - - -- - 0.0651 - - | - - -- - 0.2340 - - | - - -- - 0.4032 - - | - - -- - 0.5968 - - | - -16.83 | -
| parakeet-tdt-1.1b | -Cathedral | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0390 - - | - - -- - 0.0089 - - | - - -- - 0.0383 - - | - - -- - 0.0591 - - | - - -- - 0.9409 - - | - -16.83 | -
| parakeet-tdt-1.1b | -Cathedral | -- | -No_normalization | -Brut | - - -- - 0.2338 - - | - - -- - 0.0636 - - | - - -- - 0.2298 - - | - - -- - 0.3965 - - | - - -- - 0.6035 - - | - -16.86 | -
| parakeet-tdt-1.1b | -Cathedral | -- | -No_normalization | -Normalisé | - - -- - 0.0346 - - | - - -- - 0.0073 - - | - - -- - 0.0340 - - | - - -- - 0.0508 - - | - - -- - 0.9492 - - | - -16.86 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -- | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -19.21 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -19.21 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -- | -No_normalization | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -16.66 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -- | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -16.66 | -
| parakeet-tdt-1.1b | -None | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -17.01 | -
| parakeet-tdt-1.1b | -None | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -17.01 | -
| parakeet-tdt-1.1b | -None | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -16.54 | -
| parakeet-tdt-1.1b | -None | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -16.54 | -
| parakeet-tdt-1.1b | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.2424 - - | - - -- - 0.0777 - - | - - -- - 0.2383 - - | - - -- - 0.4072 - - | - - -- - 0.5928 - - | - -16.86 | -
| parakeet-tdt-1.1b | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.0563 - - | - - -- - 0.0218 - - | - - -- - 0.0553 - - | - - -- - 0.0882 - - | - - -- - 0.9118 - - | - -16.86 | -
| parakeet-tdt-1.1b | -Cathedral | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.2511 - - | - - -- - 0.0808 - - | - - -- - 0.2468 - - | - - -- - 0.4204 - - | - - -- - 0.5796 - - | - -16.88 | -
| parakeet-tdt-1.1b | -Cathedral | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.0649 - - | - - -- - 0.0250 - - | - - -- - 0.0638 - - | - - -- - 0.1046 - - | - - -- - 0.8954 - - | - -16.88 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -16.56 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -16.56 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.2251 - - | - - -- - 0.0589 - - | - - -- - 0.2222 - - | - - -- - 0.3872 - - | - - -- - 0.6128 - - | - -16.84 | -
| parakeet-tdt-1.1b | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.0260 - - | - - -- - 0.0024 - - | - - -- - 0.0256 - - | - - -- - 0.0383 - - | - - -- - 0.9617 - - | - -16.84 | -
| vosk-en | -None | -- | -Broadcast_standard | -Brut | - - -- - 0.2381 - - | - - -- - 0.0636 - - | - - -- - 0.2340 - - | - - -- - 0.4032 - - | - - -- - 0.5968 - - | - -34.79 | -
| vosk-en | -None | -- | -Broadcast_standard | -Normalisé | - - -- - 0.0390 - - | - - -- - 0.0081 - - | - - -- - 0.0383 - - | - - -- - 0.0591 - - | - - -- - 0.9409 - - | - -34.79 | -
| vosk-en | -None | -- | -No_normalization | -Brut | - - -- - 0.2381 - - | - - -- - 0.0636 - - | - - -- - 0.2340 - - | - - -- - 0.4032 - - | - - -- - 0.5968 - - | - -31.26 | -
| vosk-en | -None | -- | -No_normalization | -Normalisé | - - -- - 0.0390 - - | - - -- - 0.0081 - - | - - -- - 0.0383 - - | - - -- - 0.0591 - - | - - -- - 0.9409 - - | - -31.26 | -
| vosk-en | -Cathedral | -- | -Broadcast_standard | -Brut | - - -- - 0.8831 - - | - - -- - 0.8689 - - | - - -- - 0.8831 - - | - - -- - 0.9266 - - | - - -- - 0.0734 - - | - -103.32 | -
| vosk-en | -Cathedral | -- | -Broadcast_standard | -Normalisé | - - -- - 0.8485 - - | - - -- - 0.8574 - - | - - -- - 0.8485 - - | - - -- - 0.8767 - - | - - -- - 0.1233 - - | - -103.32 | -
| vosk-en | -Cathedral | -- | -No_normalization | -Brut | - - -- - 0.8961 - - | - - -- - 0.8862 - - | - - -- - 0.8961 - - | - - -- - 0.9344 - - | - - -- - 0.0656 - - | - -114.96 | -
| vosk-en | -Cathedral | -- | -No_normalization | -Normalisé | - - -- - 0.8615 - - | - - -- - 0.8783 - - | - - -- - 0.8615 - - | - - -- - 0.8833 - - | - - -- - 0.1167 - - | - -114.96 | -
| vosk-en | -Megaphone, outdoor | -- | -Broadcast_standard | -Brut | - - -- - 0.4069 - - | - - -- - 0.1923 - - | - - -- - 0.4034 - - | - - -- - 0.6055 - - | - - -- - 0.3945 - - | - -79.24 | -
| vosk-en | -Megaphone, outdoor | -- | -Broadcast_standard | -Normalisé | - - -- - 0.2468 - - | - - -- - 0.1418 - - | - - -- - 0.2446 - - | - - -- - 0.3675 - - | - - -- - 0.6325 - - | - -79.24 | -
| vosk-en | -Megaphone, outdoor | -- | -No_normalization | -Brut | - - -- - 0.4069 - - | - - -- - 0.1947 - - | - - -- - 0.4034 - - | - - -- - 0.6036 - - | - - -- - 0.3964 - - | - -80.29 | -
| vosk-en | -Megaphone, outdoor | -- | -No_normalization | -Normalisé | - - -- - 0.2468 - - | - - -- - 0.1442 - - | - - -- - 0.2446 - - | - - -- - 0.3645 - - | - - -- - 0.6355 - - | - -80.29 | -
| vosk-en | -None | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.2381 - - | - - -- - 0.0636 - - | - - -- - 0.2340 - - | - - -- - 0.4032 - - | - - -- - 0.5968 - - | - -40.07 | -
| vosk-en | -None | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.0390 - - | - - -- - 0.0081 - - | - - -- - 0.0383 - - | - - -- - 0.0591 - - | - - -- - 0.9409 - - | - -40.07 | -
| vosk-en | -None | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.2381 - - | - - -- - 0.0636 - - | - - -- - 0.2340 - - | - - -- - 0.4032 - - | - - -- - 0.5968 - - | - -34.23 | -
| vosk-en | -None | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.0390 - - | - - -- - 0.0081 - - | - - -- - 0.0383 - - | - - -- - 0.0591 - - | - - -- - 0.9409 - - | - -34.23 | -
| vosk-en | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.9610 - - | - - -- - 0.9710 - - | - - -- - 0.9610 - - | - - -- - 0.9649 - - | - - -- - 0.0351 - - | - -102.08 | -
| vosk-en | -Cathedral | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.9610 - - | - - -- - 0.9702 - - | - - -- - 0.9610 - - | - - -- - 0.9649 - - | - - -- - 0.0351 - - | - -102.08 | -
| vosk-en | -Cathedral | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.9610 - - | - - -- - 0.9694 - - | - - -- - 0.9610 - - | - - -- - 0.9649 - - | - - -- - 0.0351 - - | - -96.86 | -
| vosk-en | -Cathedral | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.9610 - - | - - -- - 0.9686 - - | - - -- - 0.9610 - - | - - -- - 0.9649 - - | - - -- - 0.0351 - - | - -96.86 | -
| vosk-en | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Brut | - - -- - 0.4416 - - | - - -- - 0.2292 - - | - - -- - 0.4378 - - | - - -- - 0.6358 - - | - - -- - 0.3642 - - | - -87.38 | -
| vosk-en | -Megaphone, outdoor | -Demucs_hybrid | -Broadcast_standard | -Normalisé | - - -- - 0.2987 - - | - - -- - 0.1813 - - | - - -- - 0.2961 - - | - - -- - 0.4293 - - | - - -- - 0.5707 - - | - -87.38 | -
| vosk-en | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Brut | - - -- - 0.4329 - - | - - -- - 0.2253 - - | - - -- - 0.4292 - - | - - -- - 0.6265 - - | - - -- - 0.3735 - - | - -80.37 | -
| vosk-en | -Megaphone, outdoor | -Demucs_hybrid | -No_normalization | -Normalisé | - - -- - 0.2944 - - | - - -- - 0.1797 - - | - - -- - 0.2918 - - | - - -- - 0.4251 - - | - - -- - 0.5749 - - | - -80.37 | -
- This section explains the metrics used to evaluate ASR (Automatic Speech Recognition) performance. - All metrics are computed by comparing the reference (ground truth) text with the hypothesis (transcription) text. -
- -Range: 0 to ∞ (typically 0 to 1) | Lower is better
-The most common ASR metric. Measures the edit distance at word level.
-WER = (Substitutions + Deletions + Insertions) / Total Reference Words
-Example: If reference is "the cat sat" and hypothesis is "a cat sits", WER = 2/3 = 0.667
-Range: 0 to ∞ (typically 0 to 1) | Lower is better
-Like WER but computed at character level. More granular, useful for languages without clear word boundaries.
-CER = (Char Substitutions + Char Deletions + Char Insertions) / Total Reference Characters
-Note: CER is often lower than WER since partial word matches are credited.
-Range: 0 to 1 | Lower is better
-Proportion of words that were not correctly matched between reference and hypothesis.
-MER = (Substitutions + Deletions + Insertions) / (Hits + Substitutions + Deletions + Insertions)
-Key difference from WER: MER is bounded at 1.0 and accounts for hypothesis length.
-Range: 0 to 1 | Lower is better
-Measures the proportion of word information that was lost in transcription.
-WIL = 1 - (Hits² / (Reference Length × Hypothesis Length))
-Interpretation: Combines precision and recall into a single information-theoretic measure.
-Range: 0 to 1 | Higher is better
-The complement of WIL - measures how much word information was correctly preserved.
-WIP = Hits² / (Reference Length × Hypothesis Length) = 1 - WIL
-Note: This is the only metric where higher values indicate better performance.
-Interactive scatter plot showing the trade-off between processing time (X-axis) and error rate (Y-axis). - Points closer to the bottom-left corner represent faster and more accurate transcriptions.
-Color-coded matrix comparing all metrics across configurations. Green indicates good performance, - red indicates poor performance. WIP column is inverted since higher values are better.
-Shows the distribution of metric values grouped by engine, degradation type, or other factors. - Useful for identifying which engines are most resilient to audio degradation.
-Side-by-side comparison of reference and hypothesis texts with diff highlighting:
-Use the dropdown filters at the top to focus on specific subsets of results. - All tabs respect the current filter selection. Click "Reset" to restore all filters to default.
-The normalization checkboxes control how metrics (WER, CER, MER, WIL, WIP) are computed:
-- Note: Text normalization is now a grid search dimension - each combination produces separate results with normalized text shown in the diff view. -
-