mcPear commited on
Commit
0fe5065
·
verified ·
1 Parent(s): 9374474

Renamed from Matcha-TTS-PL-v2 to Matcha-TTS-PL; base model is Matcha-TTS-PL-Pretrain

Browse files
Files changed (3) hide show
  1. ATTRIBUTION.md +4 -4
  2. README.md +7 -5
  3. samples/README.md +2 -2
ATTRIBUTION.md CHANGED
@@ -1,8 +1,8 @@
1
- # Attribution — Matcha-TTS-PL v2
2
 
3
- Every voice of v2 was fine-tuned from Matcha-TTS-PL (v1) on its own recordings of the same texts (dataset below, one subset per voice). Both are credited.
4
 
5
- Note: the training data of male_voxcpm_1 (the first v2 voice) also included one KPWr 1.3 passage whose document record has no licence field (`kpwr-r20009`, popular-science subcorpus, source file badania.net.0.163.xml); KPWr 1.3 as a corpus is CC BY-SA 4.0. It is credited here and is not in the published dataset or the later voices.
6
 
7
  ## Training data (machinekind/polish-synthetic-speech-voxcpm2, all voices)
8
 
@@ -936,7 +936,7 @@ Original text written for this dataset (no third-party source).
936
 
937
  ---
938
 
939
- ## Base model (Matcha-TTS-PL v1): Atrybucja danych treningowych — Matcha-TTS-PL (v3)
940
 
941
  Wagi modelu: **CC BY-SA 4.0** (`LICENSE-MODEL`). Poniżej źródła nagrań, ich licencje i wprowadzone zmiany.
942
  Głos modelu jest syntezą (interpolacja embeddingów wielu mówców) i nie odtwarza głosu żadnej konkretnej osoby.
 
1
+ # Attribution — Matcha-TTS-PL
2
 
3
+ Every voice was fine-tuned from Matcha-TTS-PL-Pretrain (formerly Matcha-TTS-PL) on its own recordings of the same texts (dataset below, one subset per voice). Both are credited.
4
 
5
+ Note: the training data of male_voxcpm_1 (the first voice) also included one KPWr 1.3 passage whose document record has no licence field (`kpwr-r20009`, popular-science subcorpus, source file badania.net.0.163.xml); KPWr 1.3 as a corpus is CC BY-SA 4.0. It is credited here and is not in the published dataset or the later voices.
6
 
7
  ## Training data (machinekind/polish-synthetic-speech-voxcpm2, all voices)
8
 
 
936
 
937
  ---
938
 
939
+ ## Base model (Matcha-TTS-PL-Pretrain): Atrybucja danych treningowych — Matcha-TTS-PL (v3)
940
 
941
  Wagi modelu: **CC BY-SA 4.0** (`LICENSE-MODEL`). Poniżej źródła nagrań, ich licencje i wprowadzone zmiany.
942
  Głos modelu jest syntezą (interpolacja embeddingów wielu mówców) i nie odtwarza głosu żadnej konkretnej osoby.
README.md CHANGED
@@ -3,13 +3,15 @@ language: pl
3
  license: cc-by-sa-4.0
4
  library_name: matcha-tts
5
  pipeline_tag: text-to-speech
6
- base_model: machinekind/Matcha-TTS-PL
7
  tags: [tts, polish, matcha-tts, flow-matching, hifigan, distillation, voxcpm2, code-switching, robot, onnx, multi-voice]
8
  ---
9
 
10
- # Matcha-TTS-PL v2 — four synthetic voices, modern Polish, English words
11
 
12
- Second version of [Matcha-TTS-PL](https://huggingface.co/machinekind/Matcha-TTS-PL): the same small, fast,
 
 
13
  non-autoregressive Matcha-TTS (20.9 M parameters, real-time on a small GPU or in a browser) **distilled from VoxCPM2**,
14
  a 2B-parameter TTS, onto synthetic voices. **One model per voice** (each with its own fine-tuned HiFi-GAN vocoder), all in
15
  this repo:
@@ -33,7 +35,7 @@ description with VoxCPM2 (OpenBMB, Apache-2.0) and frozen as prompt caches; not
33
  English words are detected automatically and phonemized by espeak-ng en-us, the rest by espeak-ng pl (`english/`).
34
  - **A HiFi-GAN fine-tuned on each voice**, with real ground truth (the teacher's audio).
35
 
36
- Try it in the browser (voice selector): [spaces/machinekind/matcha-tts-pl-v2](https://huggingface.co/spaces/machinekind/matcha-tts-pl-v2) ·
37
  training data: [datasets/machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2).
38
  Defaults: **temperature 1.0**, the voice's **tempo** above (`length_scale`; at 1.0 the models speak 10–19 % slower than the teacher), style token 8 = neutral.
39
 
@@ -83,7 +85,7 @@ VoxCPM2's question intonation (wh-questions fall, yes/no questions rise); a spac
83
 
84
  ## Training
85
 
86
- - Base: Matcha-TTS-PL v1 (target model), new speaker row initialised from the closest real reader; same mel statistics,
87
  style tokens and phoneme table (all en-us phones were already in the symbol table, now trained).
88
  - Data: [machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2) — about 8 000 clips (≈ 15 h) per voice, generated by VoxCPM2 with each frozen voice (anchor + continuation, 10 diffusion
89
  steps), every clip gated by Whisper (text match), UTMOS ≥ 3.2, speaker similarity ≥ 0.80 and pitch, up to 3 takes per
 
3
  license: cc-by-sa-4.0
4
  library_name: matcha-tts
5
  pipeline_tag: text-to-speech
6
+ base_model: machinekind/Matcha-TTS-PL-Pretrain
7
  tags: [tts, polish, matcha-tts, flow-matching, hifigan, distillation, voxcpm2, code-switching, robot, onnx, multi-voice]
8
  ---
9
 
10
+ # Matcha-TTS-PL — four synthetic voices, modern Polish, English words
11
 
12
+ *Formerly published as `machinekind/Matcha-TTS-PL-v2` (old links redirect here).*
13
+
14
+ Fine-tuned from [Matcha-TTS-PL-Pretrain](https://huggingface.co/machinekind/Matcha-TTS-PL-Pretrain) (pretraining on Polish audiobooks: Wolne Lektury + AZON): a small, fast,
15
  non-autoregressive Matcha-TTS (20.9 M parameters, real-time on a small GPU or in a browser) **distilled from VoxCPM2**,
16
  a 2B-parameter TTS, onto synthetic voices. **One model per voice** (each with its own fine-tuned HiFi-GAN vocoder), all in
17
  this repo:
 
35
  English words are detected automatically and phonemized by espeak-ng en-us, the rest by espeak-ng pl (`english/`).
36
  - **A HiFi-GAN fine-tuned on each voice**, with real ground truth (the teacher's audio).
37
 
38
+ Try it in the browser (voice selector): [spaces/machinekind/matcha-tts-pl](https://huggingface.co/spaces/machinekind/matcha-tts-pl) ·
39
  training data: [datasets/machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2).
40
  Defaults: **temperature 1.0**, the voice's **tempo** above (`length_scale`; at 1.0 the models speak 10–19 % slower than the teacher), style token 8 = neutral.
41
 
 
85
 
86
  ## Training
87
 
88
+ - Base: [Matcha-TTS-PL-Pretrain](https://huggingface.co/machinekind/Matcha-TTS-PL-Pretrain) (its target model), new speaker row initialised from the closest real reader; same mel statistics,
89
  style tokens and phoneme table (all en-us phones were already in the symbol table, now trained).
90
  - Data: [machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2) — about 8 000 clips (≈ 15 h) per voice, generated by VoxCPM2 with each frozen voice (anchor + continuation, 10 diffusion
91
  steps), every clip gated by Whisper (text match), UTMOS ≥ 3.2, speaker similarity ≥ 0.80 and pitch, up to 3 takes per
samples/README.md CHANGED
@@ -1,6 +1,6 @@
1
- Held-out test sentences (not in the training set). v2 at tempo 0.8, temperature 0.8, 4 ODE steps (the Space default temperature is now 1.0); teacher = VoxCPM2 with the frozen male_voxcpm_1 voice.
2
 
3
- | # | text | v2 | VoxCPM2 teacher |
4
  |---|---|---|---|
5
  | e01 | Dzień dobry! W czym mogę dziś pomóc? | [v2](samples/e01_v2.wav) | [teacher](samples/e01_teacher.wav) |
6
  | e02 | Proszę zamknąć okno, robi się zimno. | [v2](samples/e02_v2.wav) | [teacher](samples/e02_teacher.wav) |
 
1
+ Held-out test sentences (not in the training set). male_voxcpm_1 at tempo 0.8, temperature 0.8, 4 ODE steps (the Space default temperature is now 1.0); teacher = VoxCPM2 with the frozen male_voxcpm_1 voice.
2
 
3
+ | # | text | model | VoxCPM2 teacher |
4
  |---|---|---|---|
5
  | e01 | Dzień dobry! W czym mogę dziś pomóc? | [v2](samples/e01_v2.wav) | [teacher](samples/e01_teacher.wav) |
6
  | e02 | Proszę zamknąć okno, robi się zimno. | [v2](samples/e02_v2.wav) | [teacher](samples/e02_teacher.wav) |