Text-to-Speech
AudioSeal
Safetensors
English
zero-shot
voice-cloning
english
flow-matching
diffusion-transformer
dacvae
Instructions to use VoiceHub/DACFlow-EN-10k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- AudioSeal
How to use VoiceHub/DACFlow-EN-10k with AudioSeal:
# Watermark Generator from audioseal import AudioSeal model = AudioSeal.load_generator("VoiceHub/DACFlow-EN-10k") # pass a tensor (tensor_wav) of shape (batch, channels, samples) and a sample rate wav, sr = tensor_wav, 16000 watermark = model.get_watermark(wav, sr) watermarked_audio = wav + watermark# Watermark Detector from audioseal import AudioSeal detector = AudioSeal.load_detector("VoiceHub/DACFlow-EN-10k") result, message = detector.detect_watermark(watermarked_audio, sr) - Notebooks
- Google Colab
- Kaggle
showcase: step 70k: 5 listening samples (AudioSeal-watermarked)
Browse files- README.md +16 -2
- samples/step_0070000/01-short.wav +3 -0
- samples/step_0070000/02-question.wav +3 -0
- samples/step_0070000/03-numbers.wav +3 -0
- samples/step_0070000/04-conversational.wav +3 -0
- samples/step_0070000/05-long.wav +3 -0
- showcase.json +70 -1
README.md
CHANGED
|
@@ -81,7 +81,7 @@ and seed); the players hold this page's own takes, which can differ slightly.
|
|
| 81 |
|
| 82 |
### Earlier and later checkpoints (training history)
|
| 83 |
|
| 84 |
-
The other checkpoints of the same training run (
|
| 85 |
and voices, made with the default bandwidth condition. Click one to open it.
|
| 86 |
|
| 87 |
<details>
|
|
@@ -238,6 +238,20 @@ and voices, made with the default bandwidth condition. Click one to open it.
|
|
| 238 |
|
| 239 |
</details>
|
| 240 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 241 |
## Results
|
| 242 |
|
| 243 |
### The model: step 100k
|
|
@@ -271,7 +285,7 @@ Every checkpoint of the training run, scored with the default bandwidth conditio
|
|
| 271 |
| **step 100k** (the model) | 0.69 % | 0.787 | 3.85 | 1.54 % | 0.499 | 3.78 | [listen](#listen) | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0100000) |
|
| 272 |
| step 90k | 0.74 % | 0.782 | 3.78 | - | - | - | [listen](#listen) | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0090000) |
|
| 273 |
| step 80k | 0.78 % | 0.776 | 3.73 | 1.58 % | 0.507 | 3.68 | [listen](#listen) | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0080000) |
|
| 274 |
-
| step 70k | 0.67 % | 0.766 | 3.69 | - | - | - |
|
| 275 |
| step 60k | 0.69 % | 0.759 | 3.62 | 1.61 % | 0.537 | 3.56 | pending | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0060000) |
|
| 276 |
| step 50k | 0.74 % | 0.754 | 3.56 | - | - | - | pending | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0050000) |
|
| 277 |
| step 40k | 0.74 % | 0.748 | 3.50 | 1.85 % | 0.536 | 3.48 | pending | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0040000) |
|
|
|
|
| 81 |
|
| 82 |
### Earlier and later checkpoints (training history)
|
| 83 |
|
| 84 |
+
The other checkpoints of the same training run (12), kept for comparison; they are not the release. The same five texts
|
| 85 |
and voices, made with the default bandwidth condition. Click one to open it.
|
| 86 |
|
| 87 |
<details>
|
|
|
|
| 238 |
|
| 239 |
</details>
|
| 240 |
|
| 241 |
+
<details>
|
| 242 |
+
<summary><b>Step 70k</b>: echo-dev WER 0.67 % · UTMOS 3.69</summary>
|
| 243 |
+
|
| 244 |
+
<table>
|
| 245 |
+
<tr><th>What the model reads</th><th>Model output, step 70k</th></tr>
|
| 246 |
+
<tr><td><b>Short sentence</b></td><td><audio controls src="https://huggingface.co/VoiceHub/DACFlow-EN-10k/resolve/main/samples/step_0070000/01-short.wav"></audio></td></tr>
|
| 247 |
+
<tr><td><b>Question</b></td><td><audio controls src="https://huggingface.co/VoiceHub/DACFlow-EN-10k/resolve/main/samples/step_0070000/02-question.wav"></audio></td></tr>
|
| 248 |
+
<tr><td><b>Numbers, dates, abbreviations</b></td><td><audio controls src="https://huggingface.co/VoiceHub/DACFlow-EN-10k/resolve/main/samples/step_0070000/03-numbers.wav"></audio></td></tr>
|
| 249 |
+
<tr><td><b>Conversation (~10 s)</b></td><td><audio controls src="https://huggingface.co/VoiceHub/DACFlow-EN-10k/resolve/main/samples/step_0070000/04-conversational.wav"></audio></td></tr>
|
| 250 |
+
<tr><td><b>Long passage (~20 s)</b></td><td><audio controls src="https://huggingface.co/VoiceHub/DACFlow-EN-10k/resolve/main/samples/step_0070000/05-long.wav"></audio></td></tr>
|
| 251 |
+
</table>
|
| 252 |
+
|
| 253 |
+
</details>
|
| 254 |
+
|
| 255 |
## Results
|
| 256 |
|
| 257 |
### The model: step 100k
|
|
|
|
| 285 |
| **step 100k** (the model) | 0.69 % | 0.787 | 3.85 | 1.54 % | 0.499 | 3.78 | [listen](#listen) | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0100000) |
|
| 286 |
| step 90k | 0.74 % | 0.782 | 3.78 | - | - | - | [listen](#listen) | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0090000) |
|
| 287 |
| step 80k | 0.78 % | 0.776 | 3.73 | 1.58 % | 0.507 | 3.68 | [listen](#listen) | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0080000) |
|
| 288 |
+
| step 70k | 0.67 % | 0.766 | 3.69 | - | - | - | [listen](#listen) | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0070000) |
|
| 289 |
| step 60k | 0.69 % | 0.759 | 3.62 | 1.61 % | 0.537 | 3.56 | pending | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0060000) |
|
| 290 |
| step 50k | 0.74 % | 0.754 | 3.56 | - | - | - | pending | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0050000) |
|
| 291 |
| step 40k | 0.74 % | 0.748 | 3.50 | 1.85 % | 0.536 | 3.48 | pending | [files](https://huggingface.co/VoiceHub/DACFlow-EN-10k/tree/main/checkpoints/step_0040000) |
|
samples/step_0070000/01-short.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9ed39424d3ae6c304f4ea17cd030ea1d14f1d5d6d27054d568eb1f7f91526ac9
|
| 3 |
+
size 491564
|
samples/step_0070000/02-question.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2423de3a01bf49c2fae25107743f34f1e0748ebcac0cf4d7485536dd1fa56e04
|
| 3 |
+
size 583724
|
samples/step_0070000/03-numbers.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:88f1cd4c87255168d01730933d13675aa15a1ca9002d97316abdc0e822d43861
|
| 3 |
+
size 841004
|
samples/step_0070000/04-conversational.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6437479879b21c243c6360a6270f7eb662d593315c8ebe79e07ad31190889435
|
| 3 |
+
size 1129004
|
samples/step_0070000/05-long.wav
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:25cbcaf5e77186d73573e2e53d15199306a6ea50ae9fde6f07cacea959f52f6f
|
| 3 |
+
size 1691564
|
showcase.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"card_sha": "
|
| 3 |
"checkpoints": {
|
| 4 |
"en_base/step_0020000": {
|
| 5 |
"added": "2026-10-03T02:01:41Z",
|
|
@@ -329,6 +329,75 @@
|
|
| 329 |
"provenance": "catalog echo_en_v1 (data-4255c6734a7d5b5e): echo_en",
|
| 330 |
"recipe_arm": false,
|
| 331 |
"run": "en_base",
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 332 |
"source": "en_base/export/model_step_00070000.pt",
|
| 333 |
"step": 70000,
|
| 334 |
"train_sources": [
|
|
|
|
| 1 |
{
|
| 2 |
+
"card_sha": "349838f6b8ca447b",
|
| 3 |
"checkpoints": {
|
| 4 |
"en_base/step_0020000": {
|
| 5 |
"added": "2026-10-03T02:01:41Z",
|
|
|
|
| 329 |
"provenance": "catalog echo_en_v1 (data-4255c6734a7d5b5e): echo_en",
|
| 330 |
"recipe_arm": false,
|
| 331 |
"run": "en_base",
|
| 332 |
+
"samples": {
|
| 333 |
+
"added": "2026-10-05T01:16:12Z",
|
| 334 |
+
"code_commit": "029dec6",
|
| 335 |
+
"folder": "samples/step_0070000",
|
| 336 |
+
"items_sha": "8fcd29112a5e183c",
|
| 337 |
+
"rows": [
|
| 338 |
+
{
|
| 339 |
+
"file": "samples/step_0070000/01-short.wav",
|
| 340 |
+
"gen_seconds": 0.92,
|
| 341 |
+
"item": "01-short",
|
| 342 |
+
"seconds": 5.12,
|
| 343 |
+
"watermark": "audioseal_wm_16bits",
|
| 344 |
+
"watermark_bits": "0100110101010100",
|
| 345 |
+
"watermark_score": 1.0
|
| 346 |
+
},
|
| 347 |
+
{
|
| 348 |
+
"file": "samples/step_0070000/02-question.wav",
|
| 349 |
+
"gen_seconds": 0.83,
|
| 350 |
+
"item": "02-question",
|
| 351 |
+
"seconds": 6.08,
|
| 352 |
+
"watermark": "audioseal_wm_16bits",
|
| 353 |
+
"watermark_bits": "0100110101010100",
|
| 354 |
+
"watermark_score": 1.0
|
| 355 |
+
},
|
| 356 |
+
{
|
| 357 |
+
"file": "samples/step_0070000/03-numbers.wav",
|
| 358 |
+
"gen_seconds": 0.87,
|
| 359 |
+
"item": "03-numbers",
|
| 360 |
+
"seconds": 8.76,
|
| 361 |
+
"watermark": "audioseal_wm_16bits",
|
| 362 |
+
"watermark_bits": "0100110101010100",
|
| 363 |
+
"watermark_score": 1.0
|
| 364 |
+
},
|
| 365 |
+
{
|
| 366 |
+
"file": "samples/step_0070000/04-conversational.wav",
|
| 367 |
+
"gen_seconds": 0.87,
|
| 368 |
+
"item": "04-conversational",
|
| 369 |
+
"seconds": 11.76,
|
| 370 |
+
"watermark": "audioseal_wm_16bits",
|
| 371 |
+
"watermark_bits": "0100110101010100",
|
| 372 |
+
"watermark_score": 1.0
|
| 373 |
+
},
|
| 374 |
+
{
|
| 375 |
+
"file": "samples/step_0070000/05-long.wav",
|
| 376 |
+
"gen_seconds": 1.68,
|
| 377 |
+
"item": "05-long",
|
| 378 |
+
"seconds": 17.62,
|
| 379 |
+
"watermark": "audioseal_wm_16bits",
|
| 380 |
+
"watermark_bits": "0100110101010100",
|
| 381 |
+
"watermark_score": 1.0
|
| 382 |
+
}
|
| 383 |
+
],
|
| 384 |
+
"sampler": {
|
| 385 |
+
"cfg_mode": "joint",
|
| 386 |
+
"cfg_rescale": 0.0,
|
| 387 |
+
"cfg_t_max": 1.0,
|
| 388 |
+
"cfg_t_min": 0.0,
|
| 389 |
+
"cfg_w": 4.0,
|
| 390 |
+
"gpu_peak_gb": 4.14,
|
| 391 |
+
"noise_scale": 0.9,
|
| 392 |
+
"out_lufs": -16.0,
|
| 393 |
+
"schedule": "sway",
|
| 394 |
+
"source": "eval_args.json",
|
| 395 |
+
"steps": 32,
|
| 396 |
+
"sway": -1.0,
|
| 397 |
+
"w_speaker": 3.5,
|
| 398 |
+
"w_text": 2.5
|
| 399 |
+
}
|
| 400 |
+
},
|
| 401 |
"source": "en_base/export/model_step_00070000.pt",
|
| 402 |
"step": 70000,
|
| 403 |
"train_sources": [
|