alexwengg commited on
Commit
bb38cf3
·
verified ·
1 Parent(s): b0cbdfc

README: misaki T/t output form, FluidAudio benchmark

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -52,7 +52,8 @@ ParadeeAcoustic en, asr, noise -> audio [1,600F] float32, 24 kHz
52
  - `noise` is the harmonic source's Gaussian noise, passed in so the graph is deterministic. It is equivalent to the
53
  upstream in-graph noise (9 per-harmonic channels mixed by a linear layer = one scaled channel).
54
  - Phonemes must be written the way [misaki](https://github.com/hexgrad/misaki) writes them (Kokoro's G2P); that is
55
- all Paradee saw in training.
 
56
  - Use `CPU_ONLY` or `CPU_AND_NE`. **Do not use `ALL` / `CPU_AND_GPU`**: the LSTMs abort in MPSGraph
57
  (`GPURNNOps … JIT not supported`), the same failure Kokoro's prosody stage has.
58
 
@@ -68,6 +69,9 @@ paragraph, and one sentence at speed 0.8 and 1.3.
68
  - int8: log-mel L1 to fp32 ONNX 0.18–0.20 vs 0.21–0.31 for upstream `paradee_int8.onnx`; WER 3.81 % vs 2.97 %
69
  (one word of ~236).
70
 
 
 
 
71
  Conversion notes: the 1024-point phase-lock STFT is a gather + matmul + overlap-add instead of strided convolutions
72
  (the conv form ran ~40× slower on the Core ML CPU), and kokoro's random harmonic start phases are omitted because the
73
  upstream graph never reads them.
 
52
  - `noise` is the harmonic source's Gaussian noise, passed in so the graph is deterministic. It is equivalent to the
53
  upstream in-graph noise (9 per-harmonic channels mixed by a linear layer = one scaled channel).
54
  - Phonemes must be written the way [misaki](https://github.com/hexgrad/misaki) writes them (Kokoro's G2P); that is
55
+ all Paradee saw in training. That includes misaki's last step, flap `ɾ` → `T` and glottal stop `ʔ` → `t`:
56
+ lexicon-only frontends that skip it garble words like "kittens" and "satellite".
57
  - Use `CPU_ONLY` or `CPU_AND_NE`. **Do not use `ALL` / `CPU_AND_GPU`**: the LSTMs abort in MPSGraph
58
  (`GPURNNOps … JIT not supported`), the same failure Kokoro's prosody stage has.
59
 
 
69
  - int8: log-mel L1 to fp32 ONNX 0.18–0.20 vs 0.21–0.31 for upstream `paradee_int8.onnx`; WER 3.81 % vs 2.97 %
70
  (one word of ~236).
71
 
72
+ FluidAudio `tts-benchmark --corpus minimax-english` (100 phrases, Parakeet TDT round trip, Swift, CPU, includes the
73
+ English G2P frontend): WER 1.20 % / CER 0.14 % for both int8 and fp32, RTFx ~100, 77 ms median per phrase.
74
+
75
  Conversion notes: the 1024-point phase-lock STFT is a gather + matmul + overlap-add instead of strided convolutions
76
  (the conv form ran ~40× slower on the Core ML CPU), and kokoro's random harmonic start phases are omitted because the
77
  upstream graph never reads them.