Add Listen table: 8 lines x 2 voices (female waxal_ibo_5, male anchor), Flash-DPO
Browse files- README.md +19 -0
- samples/listen/tts_01_igbo_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_01_igbo_flash_default_male.mp3 +0 -0
- samples/listen/tts_02_yoruba_tones_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_02_yoruba_tones_flash_default_male.mp3 +0 -0
- samples/listen/tts_03_hausa_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_03_hausa_flash_default_male.mp3 +0 -0
- samples/listen/tts_04_pidgin_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_04_pidgin_flash_default_male.mp3 +0 -0
- samples/listen/tts_05_english_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_05_english_flash_default_male.mp3 +0 -0
- samples/listen/tts_06_cs_igbo_english_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_06_cs_igbo_english_flash_default_male.mp3 +0 -0
- samples/listen/tts_07_cs_yoruba_english_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_07_cs_yoruba_english_flash_default_male.mp3 +0 -0
- samples/listen/tts_08_cs_pidgin_english_hausa_female_waxal_ibo5.mp3 +0 -0
- samples/listen/tts_08_cs_pidgin_english_hausa_flash_default_male.mp3 +0 -0
README.md
CHANGED
|
@@ -36,6 +36,8 @@ datasets:
|
|
| 36 |
|
| 37 |
**Experimental prompt-controlled Nigerian TTS and code-switching technology** by Modular. English, Nigerian Pidgin, Igbo, Yoruba and Hausa, mixed inside one sentence and spoken by one consistent voice, with a plain-English **style instruction** (`--instruct`) that steers pace and pausing.
|
| 38 |
|
|
|
|
|
|
|
| 39 |
Pro v1.1 is a research release, not a production system. It is the Flash recipe (CosyVoice3 LM fine-tuned on licensed Nigerian-language speech, then DPO) with a new instruction layer on top. Read **What works and what does not** before using it.
|
| 40 |
|
| 41 |
## What works and what does not
|
|
@@ -121,6 +123,23 @@ Text: wrap each language span in `<eng>`, `<pcm>`, `<yor>`, `<ibo>` or `<hau>`;
|
|
| 121 |
|
| 122 |
## Samples
|
| 123 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 124 |
`samples/` holds MP3 renders for all five languages and a code-switched sentence, both main voices, with the default prompt and the slow / fast / few-pauses / many-pauses instructions, plus a Flash-DPO render of the same text and seed for A/B (`samples/meta.json` lists text, voice and instruction per file). `samples/codeswitch_frontend/` shows the experimental Qwen3-32B step: input text, request, the tagged text it produced, and the audio. The Igbo and Yoruba demo sentences have **not yet been checked by a native speaker**.
|
| 125 |
|
| 126 |
## Results
|
|
|
|
| 36 |
|
| 37 |
**Experimental prompt-controlled Nigerian TTS and code-switching technology** by Modular. English, Nigerian Pidgin, Igbo, Yoruba and Hausa, mixed inside one sentence and spoken by one consistent voice, with a plain-English **style instruction** (`--instruct`) that steers pace and pausing.
|
| 38 |
|
| 39 |
+
**[Listen to samples](#listen)** (both voices, all five languages and code-switching).
|
| 40 |
+
|
| 41 |
Pro v1.1 is a research release, not a production system. It is the Flash recipe (CosyVoice3 LM fine-tuned on licensed Nigerian-language speech, then DPO) with a new instruction layer on top. Read **What works and what does not** before using it.
|
| 42 |
|
| 43 |
## What works and what does not
|
|
|
|
| 123 |
|
| 124 |
## Samples
|
| 125 |
|
| 126 |
+
### Listen
|
| 127 |
+
|
| 128 |
+
The same eight lines in the two main voices, rendered with **Flash-DPO** (the default `--version flash`, default prompt): the female voice (`waxal_ibo_5`, WAXAL Igbo speaker 5) and the default male anchor. Text is shown with the language tags it was synthesised from. Mono MP3, CC-BY-SA-4.0. The Igbo and Yoruba lines have not yet been checked by a native speaker.
|
| 129 |
+
|
| 130 |
+
| language | text | female (`waxal_ibo_5`) | male (anchor) |
|
| 131 |
+
|---|---|---|---|
|
| 132 |
+
| Igbo | <ibo>Ndewo, kedụ ka ị mere? Anyị ga-aga ahịa echi n'ụtụtụ.</ibo> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_01_igbo_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_01_igbo_flash_default_male.mp3"></audio> |
|
| 133 |
+
| Yoruba | <yor>Ẹ káàárọ̀! Ṣé dáadáa ni ẹ wà? Mo fẹ́ lọ sí ọjà lọ́la.</yor> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_02_yoruba_tones_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_02_yoruba_tones_flash_default_male.mp3"></audio> |
|
| 134 |
+
| Hausa | <hau>Sannu da zuwa. Yaya aiki? Zan tafi Kano gobe da safe.</hau> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_03_hausa_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_03_hausa_flash_default_male.mp3"></audio> |
|
| 135 |
+
| Pidgin | <pcm>How far, my guy? Abeg make we see for evening, I dey come.</pcm> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_04_pidgin_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_04_pidgin_flash_default_male.mp3"></audio> |
|
| 136 |
+
| English | <eng>Good morning. The meeting has moved to three o'clock this afternoon.</eng> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_05_english_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_05_english_flash_default_male.mp3"></audio> |
|
| 137 |
+
| Code-switch: Igbo + English | <ibo>Biko,</ibo> <eng>can you send me the report before Friday?</eng> <ibo>Daalụ.</ibo> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_06_cs_igbo_english_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_06_cs_igbo_english_flash_default_male.mp3"></audio> |
|
| 138 |
+
| Code-switch: Yoruba + English | <yor>Ẹ ṣé gan-an,</yor> <eng>I will call you when I get to the office.</eng> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_07_cs_yoruba_english_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_07_cs_yoruba_english_flash_default_male.mp3"></audio> |
|
| 139 |
+
| Code-switch: Pidgin + English + Hausa | <pcm>Na today we go finish am,</pcm> <eng>so please be on time.</eng> <hau>Na gode.</hau> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_08_cs_pidgin_english_hausa_female_waxal_ibo5.mp3"></audio> | <audio controls src="https://huggingface.co/Modularcomputing/dynamic-accent-pro-v1.1/resolve/main/samples/listen/tts_08_cs_pidgin_english_hausa_flash_default_male.mp3"></audio> |
|
| 140 |
+
|
| 141 |
+
### All samples
|
| 142 |
+
|
| 143 |
`samples/` holds MP3 renders for all five languages and a code-switched sentence, both main voices, with the default prompt and the slow / fast / few-pauses / many-pauses instructions, plus a Flash-DPO render of the same text and seed for A/B (`samples/meta.json` lists text, voice and instruction per file). `samples/codeswitch_frontend/` shows the experimental Qwen3-32B step: input text, request, the tagged text it produced, and the audio. The Igbo and Yoruba demo sentences have **not yet been checked by a native speaker**.
|
| 144 |
|
| 145 |
## Results
|
samples/listen/tts_01_igbo_female_waxal_ibo5.mp3
ADDED
|
Binary file (38.8 kB). View file
|
|
|
samples/listen/tts_01_igbo_flash_default_male.mp3
ADDED
|
Binary file (45.5 kB). View file
|
|
|
samples/listen/tts_02_yoruba_tones_female_waxal_ibo5.mp3
ADDED
|
Binary file (41.7 kB). View file
|
|
|
samples/listen/tts_02_yoruba_tones_flash_default_male.mp3
ADDED
|
Binary file (43.2 kB). View file
|
|
|
samples/listen/tts_03_hausa_female_waxal_ibo5.mp3
ADDED
|
Binary file (36.5 kB). View file
|
|
|
samples/listen/tts_03_hausa_flash_default_male.mp3
ADDED
|
Binary file (37.1 kB). View file
|
|
|
samples/listen/tts_04_pidgin_female_waxal_ibo5.mp3
ADDED
|
Binary file (36.5 kB). View file
|
|
|
samples/listen/tts_04_pidgin_flash_default_male.mp3
ADDED
|
Binary file (51.3 kB). View file
|
|
|
samples/listen/tts_05_english_female_waxal_ibo5.mp3
ADDED
|
Binary file (32.1 kB). View file
|
|
|
samples/listen/tts_05_english_flash_default_male.mp3
ADDED
|
Binary file (33.1 kB). View file
|
|
|
samples/listen/tts_06_cs_igbo_english_female_waxal_ibo5.mp3
ADDED
|
Binary file (34 kB). View file
|
|
|
samples/listen/tts_06_cs_igbo_english_flash_default_male.mp3
ADDED
|
Binary file (35.6 kB). View file
|
|
|
samples/listen/tts_07_cs_yoruba_english_female_waxal_ibo5.mp3
ADDED
|
Binary file (30.8 kB). View file
|
|
|
samples/listen/tts_07_cs_yoruba_english_flash_default_male.mp3
ADDED
|
Binary file (30.4 kB). View file
|
|
|
samples/listen/tts_08_cs_pidgin_english_hausa_female_waxal_ibo5.mp3
ADDED
|
Binary file (35.6 kB). View file
|
|
|
samples/listen/tts_08_cs_pidgin_english_hausa_flash_default_male.mp3
ADDED
|
Binary file (36.5 kB). View file
|
|
|