Renamed from Matcha-TTS-PL-v2 to Matcha-TTS-PL; base model is Matcha-TTS-PL-Pretrain
Browse files- ATTRIBUTION.md +4 -4
- README.md +7 -5
- samples/README.md +2 -2
ATTRIBUTION.md
CHANGED
|
@@ -1,8 +1,8 @@
|
|
| 1 |
-
# Attribution — Matcha-TTS-PL
|
| 2 |
|
| 3 |
-
Every voice
|
| 4 |
|
| 5 |
-
Note: the training data of male_voxcpm_1 (the first
|
| 6 |
|
| 7 |
## Training data (machinekind/polish-synthetic-speech-voxcpm2, all voices)
|
| 8 |
|
|
@@ -936,7 +936,7 @@ Original text written for this dataset (no third-party source).
|
|
| 936 |
|
| 937 |
---
|
| 938 |
|
| 939 |
-
## Base model (Matcha-TTS-PL
|
| 940 |
|
| 941 |
Wagi modelu: **CC BY-SA 4.0** (`LICENSE-MODEL`). Poniżej źródła nagrań, ich licencje i wprowadzone zmiany.
|
| 942 |
Głos modelu jest syntezą (interpolacja embeddingów wielu mówców) i nie odtwarza głosu żadnej konkretnej osoby.
|
|
|
|
| 1 |
+
# Attribution — Matcha-TTS-PL
|
| 2 |
|
| 3 |
+
Every voice was fine-tuned from Matcha-TTS-PL-Pretrain (formerly Matcha-TTS-PL) on its own recordings of the same texts (dataset below, one subset per voice). Both are credited.
|
| 4 |
|
| 5 |
+
Note: the training data of male_voxcpm_1 (the first voice) also included one KPWr 1.3 passage whose document record has no licence field (`kpwr-r20009`, popular-science subcorpus, source file badania.net.0.163.xml); KPWr 1.3 as a corpus is CC BY-SA 4.0. It is credited here and is not in the published dataset or the later voices.
|
| 6 |
|
| 7 |
## Training data (machinekind/polish-synthetic-speech-voxcpm2, all voices)
|
| 8 |
|
|
|
|
| 936 |
|
| 937 |
---
|
| 938 |
|
| 939 |
+
## Base model (Matcha-TTS-PL-Pretrain): Atrybucja danych treningowych — Matcha-TTS-PL (v3)
|
| 940 |
|
| 941 |
Wagi modelu: **CC BY-SA 4.0** (`LICENSE-MODEL`). Poniżej źródła nagrań, ich licencje i wprowadzone zmiany.
|
| 942 |
Głos modelu jest syntezą (interpolacja embeddingów wielu mówców) i nie odtwarza głosu żadnej konkretnej osoby.
|
README.md
CHANGED
|
@@ -3,13 +3,15 @@ language: pl
|
|
| 3 |
license: cc-by-sa-4.0
|
| 4 |
library_name: matcha-tts
|
| 5 |
pipeline_tag: text-to-speech
|
| 6 |
-
base_model: machinekind/Matcha-TTS-PL
|
| 7 |
tags: [tts, polish, matcha-tts, flow-matching, hifigan, distillation, voxcpm2, code-switching, robot, onnx, multi-voice]
|
| 8 |
---
|
| 9 |
|
| 10 |
-
# Matcha-TTS-PL
|
| 11 |
|
| 12 |
-
|
|
|
|
|
|
|
| 13 |
non-autoregressive Matcha-TTS (20.9 M parameters, real-time on a small GPU or in a browser) **distilled from VoxCPM2**,
|
| 14 |
a 2B-parameter TTS, onto synthetic voices. **One model per voice** (each with its own fine-tuned HiFi-GAN vocoder), all in
|
| 15 |
this repo:
|
|
@@ -33,7 +35,7 @@ description with VoxCPM2 (OpenBMB, Apache-2.0) and frozen as prompt caches; not
|
|
| 33 |
English words are detected automatically and phonemized by espeak-ng en-us, the rest by espeak-ng pl (`english/`).
|
| 34 |
- **A HiFi-GAN fine-tuned on each voice**, with real ground truth (the teacher's audio).
|
| 35 |
|
| 36 |
-
Try it in the browser (voice selector): [spaces/machinekind/matcha-tts-pl
|
| 37 |
training data: [datasets/machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2).
|
| 38 |
Defaults: **temperature 1.0**, the voice's **tempo** above (`length_scale`; at 1.0 the models speak 10–19 % slower than the teacher), style token 8 = neutral.
|
| 39 |
|
|
@@ -83,7 +85,7 @@ VoxCPM2's question intonation (wh-questions fall, yes/no questions rise); a spac
|
|
| 83 |
|
| 84 |
## Training
|
| 85 |
|
| 86 |
-
- Base: Matcha-TTS-PL
|
| 87 |
style tokens and phoneme table (all en-us phones were already in the symbol table, now trained).
|
| 88 |
- Data: [machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2) — about 8 000 clips (≈ 15 h) per voice, generated by VoxCPM2 with each frozen voice (anchor + continuation, 10 diffusion
|
| 89 |
steps), every clip gated by Whisper (text match), UTMOS ≥ 3.2, speaker similarity ≥ 0.80 and pitch, up to 3 takes per
|
|
|
|
| 3 |
license: cc-by-sa-4.0
|
| 4 |
library_name: matcha-tts
|
| 5 |
pipeline_tag: text-to-speech
|
| 6 |
+
base_model: machinekind/Matcha-TTS-PL-Pretrain
|
| 7 |
tags: [tts, polish, matcha-tts, flow-matching, hifigan, distillation, voxcpm2, code-switching, robot, onnx, multi-voice]
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# Matcha-TTS-PL — four synthetic voices, modern Polish, English words
|
| 11 |
|
| 12 |
+
*Formerly published as `machinekind/Matcha-TTS-PL-v2` (old links redirect here).*
|
| 13 |
+
|
| 14 |
+
Fine-tuned from [Matcha-TTS-PL-Pretrain](https://huggingface.co/machinekind/Matcha-TTS-PL-Pretrain) (pretraining on Polish audiobooks: Wolne Lektury + AZON): a small, fast,
|
| 15 |
non-autoregressive Matcha-TTS (20.9 M parameters, real-time on a small GPU or in a browser) **distilled from VoxCPM2**,
|
| 16 |
a 2B-parameter TTS, onto synthetic voices. **One model per voice** (each with its own fine-tuned HiFi-GAN vocoder), all in
|
| 17 |
this repo:
|
|
|
|
| 35 |
English words are detected automatically and phonemized by espeak-ng en-us, the rest by espeak-ng pl (`english/`).
|
| 36 |
- **A HiFi-GAN fine-tuned on each voice**, with real ground truth (the teacher's audio).
|
| 37 |
|
| 38 |
+
Try it in the browser (voice selector): [spaces/machinekind/matcha-tts-pl](https://huggingface.co/spaces/machinekind/matcha-tts-pl) ·
|
| 39 |
training data: [datasets/machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2).
|
| 40 |
Defaults: **temperature 1.0**, the voice's **tempo** above (`length_scale`; at 1.0 the models speak 10–19 % slower than the teacher), style token 8 = neutral.
|
| 41 |
|
|
|
|
| 85 |
|
| 86 |
## Training
|
| 87 |
|
| 88 |
+
- Base: [Matcha-TTS-PL-Pretrain](https://huggingface.co/machinekind/Matcha-TTS-PL-Pretrain) (its target model), new speaker row initialised from the closest real reader; same mel statistics,
|
| 89 |
style tokens and phoneme table (all en-us phones were already in the symbol table, now trained).
|
| 90 |
- Data: [machinekind/polish-synthetic-speech-voxcpm2](https://huggingface.co/datasets/machinekind/polish-synthetic-speech-voxcpm2) — about 8 000 clips (≈ 15 h) per voice, generated by VoxCPM2 with each frozen voice (anchor + continuation, 10 diffusion
|
| 91 |
steps), every clip gated by Whisper (text match), UTMOS ≥ 3.2, speaker similarity ≥ 0.80 and pitch, up to 3 takes per
|
samples/README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
-
Held-out test sentences (not in the training set).
|
| 2 |
|
| 3 |
-
| # | text |
|
| 4 |
|---|---|---|---|
|
| 5 |
| e01 | Dzień dobry! W czym mogę dziś pomóc? | [v2](samples/e01_v2.wav) | [teacher](samples/e01_teacher.wav) |
|
| 6 |
| e02 | Proszę zamknąć okno, robi się zimno. | [v2](samples/e02_v2.wav) | [teacher](samples/e02_teacher.wav) |
|
|
|
|
| 1 |
+
Held-out test sentences (not in the training set). male_voxcpm_1 at tempo 0.8, temperature 0.8, 4 ODE steps (the Space default temperature is now 1.0); teacher = VoxCPM2 with the frozen male_voxcpm_1 voice.
|
| 2 |
|
| 3 |
+
| # | text | model | VoxCPM2 teacher |
|
| 4 |
|---|---|---|---|
|
| 5 |
| e01 | Dzień dobry! W czym mogę dziś pomóc? | [v2](samples/e01_v2.wav) | [teacher](samples/e01_teacher.wav) |
|
| 6 |
| e02 | Proszę zamknąć okno, robi się zimno. | [v2](samples/e02_v2.wav) | [teacher](samples/e02_teacher.wav) |
|