Update README.md
Browse files
README.md
CHANGED
|
@@ -57,14 +57,11 @@ disorders.
|
|
| 57 |
|
| 58 |
- **Not a medical device.** No diagnostic or treatment decision should rest on its output.
|
| 59 |
- Not a replacement for assessment by a licensed speech-language pathologist.
|
| 60 |
-
- Not validated for populations outside the training corpus — it was adapted to children aged
|
| 61 |
-
5–12 with a Central Scottish accent, and the phonemizer default (`en-gb`) reflects that.
|
| 62 |
-
- Not a general-purpose voice cloning system.
|
| 63 |
|
| 64 |
## Training data
|
| 65 |
|
| 66 |
Child speech from UltraSuite/CLP-derived recordings, obtained under their own data use
|
| 67 |
-
agreements.
|
| 68 |
child clinical speech. To fine-tune your own model,
|
| 69 |
<https://huggingface.co/datasets/changelinglab/ultrasuite-benchmark> is a suitable starting
|
| 70 |
point; see `DATA.md` in the code repository.
|
|
@@ -105,22 +102,10 @@ Two presets ship with the code:
|
|
| 105 |
`alpha` is high on purpose. A low `alpha` leans on the reference acoustics, which is exactly
|
| 106 |
where the disordered articulation lives.
|
| 107 |
|
| 108 |
-
|
| 109 |
but the ADPM2 sampler is ancestral and adds fresh noise at every step, so repeated calls
|
| 110 |
differ in waveform and in duration. Pass a `seed` for reproducible output.
|
| 111 |
|
| 112 |
-
## Evaluation
|
| 113 |
-
|
| 114 |
-
See the paper.
|
| 115 |
-
|
| 116 |
-
## Ethical considerations
|
| 117 |
-
|
| 118 |
-
This model is trained on identifiable clinical recordings of children and is designed to
|
| 119 |
-
reproduce a speaker's vocal identity accurately. High speaker similarity is the method's goal
|
| 120 |
-
and therefore also its misuse vector: the same property that makes feedback usable in a
|
| 121 |
-
child's own voice makes the model a voice-cloning tool for a minor. Use it only with
|
| 122 |
-
appropriate consent and ethical oversight.
|
| 123 |
-
|
| 124 |
## Usage
|
| 125 |
|
| 126 |
```python
|
|
@@ -147,13 +132,6 @@ the `module.` prefix that DataParallel added to ten of the thirteen submodules,
|
|
| 147 |
every tensor detached, CPU-resident and contiguous. Precision is unchanged (float32; no fp16
|
| 148 |
cast, which would alter outputs).
|
| 149 |
|
| 150 |
-
- 2258 MB → 767 MB; the 1491 MB removed is optimizer state, which inference never reads
|
| 151 |
-
- `sha256` of `model.pth`: `6c5faf5b4967b4d26cb4c58d4517dcc477729a579039316741bd88b9bd0f16e0`
|
| 152 |
-
- Verified bit-exact against the training checkpoint it was stripped from: under a fixed seed,
|
| 153 |
-
the two produce an identical 256-d style vector and identical waveform samples
|
| 154 |
-
|
| 155 |
-
Full details in `manifest.json`.
|
| 156 |
-
|
| 157 |
## Citation
|
| 158 |
|
| 159 |
Rosero, Yeo, Mortensen, Van't Slot, Hallac, and Busso. *Generative Reconstruction of Pediatric
|
|
|
|
| 57 |
|
| 58 |
- **Not a medical device.** No diagnostic or treatment decision should rest on its output.
|
| 59 |
- Not a replacement for assessment by a licensed speech-language pathologist.
|
|
|
|
|
|
|
|
|
|
| 60 |
|
| 61 |
## Training data
|
| 62 |
|
| 63 |
Child speech from UltraSuite/CLP-derived recordings, obtained under their own data use
|
| 64 |
+
agreements. The corpus is not released here and is not redistributable: it is identifiable
|
| 65 |
child clinical speech. To fine-tune your own model,
|
| 66 |
<https://huggingface.co/datasets/changelinglab/ultrasuite-benchmark> is a suitable starting
|
| 67 |
point; see `DATA.md` in the code repository.
|
|
|
|
| 102 |
`alpha` is high on purpose. A low `alpha` leans on the reference acoustics, which is exactly
|
| 103 |
where the disordered articulation lives.
|
| 104 |
|
| 105 |
+
Synthesis is stochastic. The initial style latent is zeros rather than a Gaussian draw,
|
| 106 |
but the ADPM2 sampler is ancestral and adds fresh noise at every step, so repeated calls
|
| 107 |
differ in waveform and in duration. Pass a `seed` for reproducible output.
|
| 108 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 109 |
## Usage
|
| 110 |
|
| 111 |
```python
|
|
|
|
| 132 |
every tensor detached, CPU-resident and contiguous. Precision is unchanged (float32; no fp16
|
| 133 |
cast, which would alter outputs).
|
| 134 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 135 |
## Citation
|
| 136 |
|
| 137 |
Rosero, Yeo, Mortensen, Van't Slot, Hallac, and Busso. *Generative Reconstruction of Pediatric
|