Group EN and ZH metrics and add Emilia SOTA statement
Browse files
README.md
CHANGED
|
@@ -55,25 +55,63 @@ CFG 0, inference bottleneck dropout 0, waveform temperature 1, **initial Mel
|
|
| 55 |
temperature 0**, and seed 0. It uses the same original test prompts and
|
| 56 |
FP32-weight/BF16-inference precision. Prompt states interpolate from their
|
| 57 |
initial noise toward the reference at each step; the initial Mel noise is
|
| 58 |
-
scaled by the Mel temperature. The Flash
|
| 59 |
temperature 0. WER/CER and UTMOS are truncated to two decimal places,
|
| 60 |
and SIM to three decimal places (not rounded).
|
| 61 |
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
|
| 72 |
-
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
|
| 76 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 77 |
|
| 78 |
WER is reported for English and CER for Chinese. Error rates are percentages;
|
| 79 |
all metrics are macro-averaged over utterances. The Safetensors exports preserve
|
|
|
|
| 55 |
temperature 0**, and seed 0. It uses the same original test prompts and
|
| 56 |
FP32-weight/BF16-inference precision. Prompt states interpolate from their
|
| 57 |
initial noise toward the reference at each step; the initial Mel noise is
|
| 58 |
+
scaled by the Mel temperature. The Flash results below use the new default
|
| 59 |
temperature 0. WER/CER and UTMOS are truncated to two decimal places,
|
| 60 |
and SIM to three decimal places (not rounded).
|
| 61 |
|
| 62 |
+
The complete test sets contain 1,088 English and 2,020 Chinese utterances.
|
| 63 |
+
|
| 64 |
+
<table>
|
| 65 |
+
<colgroup span="1"></colgroup>
|
| 66 |
+
<colgroup span="3"></colgroup>
|
| 67 |
+
<colgroup span="3"></colgroup>
|
| 68 |
+
<thead>
|
| 69 |
+
<tr>
|
| 70 |
+
<th rowspan="2" scope="col" align="left">Model</th>
|
| 71 |
+
<th colspan="3" scope="colgroup" align="center">EN</th>
|
| 72 |
+
<th colspan="3" scope="colgroup" align="center">ZH</th>
|
| 73 |
+
</tr>
|
| 74 |
+
<tr>
|
| 75 |
+
<th scope="col" align="center">WER (%) ↓</th>
|
| 76 |
+
<th scope="col" align="center">SIM ↑</th>
|
| 77 |
+
<th scope="col" align="center">UTMOS ↑</th>
|
| 78 |
+
<th scope="col" align="center">CER (%) ↓</th>
|
| 79 |
+
<th scope="col" align="center">SIM ↑</th>
|
| 80 |
+
<th scope="col" align="center">UTMOS ↑</th>
|
| 81 |
+
</tr>
|
| 82 |
+
</thead>
|
| 83 |
+
<tbody>
|
| 84 |
+
<tr>
|
| 85 |
+
<th scope="row" align="left"><strong>WaveGen</strong><br><sub>Pre-trained · 1300k EMA</sub></th>
|
| 86 |
+
<td align="center">1.47</td>
|
| 87 |
+
<td align="center">0.755</td>
|
| 88 |
+
<td align="center">3.68</td>
|
| 89 |
+
<td align="center">1.75</td>
|
| 90 |
+
<td align="center">0.805</td>
|
| 91 |
+
<td align="center">2.87</td>
|
| 92 |
+
</tr>
|
| 93 |
+
<tr>
|
| 94 |
+
<th scope="row" align="left"><strong>WaveGen V-Spec</strong><br><sub>1400k EMA · Recommended</sub></th>
|
| 95 |
+
<td align="center">1.39</td>
|
| 96 |
+
<td align="center">0.743</td>
|
| 97 |
+
<td align="center">3.59</td>
|
| 98 |
+
<td align="center">1.65</td>
|
| 99 |
+
<td align="center">0.783</td>
|
| 100 |
+
<td align="center">2.79</td>
|
| 101 |
+
</tr>
|
| 102 |
+
<tr>
|
| 103 |
+
<th scope="row" align="left"><strong>WaveGen-Flash</strong><br><sub>48k EMA · 4 steps</sub></th>
|
| 104 |
+
<td align="center">1.49</td>
|
| 105 |
+
<td align="center">0.727</td>
|
| 106 |
+
<td align="center">3.53</td>
|
| 107 |
+
<td align="center">1.59</td>
|
| 108 |
+
<td align="center">0.768</td>
|
| 109 |
+
<td align="center">2.74</td>
|
| 110 |
+
</tr>
|
| 111 |
+
</tbody>
|
| 112 |
+
</table>
|
| 113 |
+
|
| 114 |
+
**WaveGen achieves state-of-the-art performance among TTS models trained on the Emilia dataset.**
|
| 115 |
|
| 116 |
WER is reported for English and CER for Chinese. Error rates are percentages;
|
| 117 |
all metrics are macro-averaged over utterances. The Safetensors exports preserve
|