Lead the model page with the two playable stereo results and expandable XML
Browse files
README.md
CHANGED
|
@@ -30,6 +30,89 @@ model weights, the deterministic XML interleaver, the audio codec, voice
|
|
| 30 |
presets, and inference code. It does not require an external transcript-generating
|
| 31 |
language model, training caches, or a separate adapter/base checkpoint.
|
| 32 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 33 |
## Download and run
|
| 34 |
|
| 35 |
Use Python 3.12 and a CUDA-capable NVIDIA GPU. Install matching PyTorch and
|
|
@@ -126,80 +209,6 @@ by example and channel, without inferring demographic characteristics.
|
|
| 126 |
The released API accepts these preset IDs; arbitrary uploaded voice cloning is
|
| 127 |
not part of this version.
|
| 128 |
|
| 129 |
-
## Featured examples and complete input XML
|
| 130 |
-
|
| 131 |
-
The following outputs are the requested checkpoint-8565 recordings. They use
|
| 132 |
-
the same normalization as the inference API. Both channels have their original shared
|
| 133 |
-
origin; neither lane is trimmed or shifted.
|
| 134 |
-
|
| 135 |
-
### V01_S0192_I00000307-0000-student
|
| 136 |
-
|
| 137 |
-
<audio controls src="https://huggingface.co/penguinfish1688/duplexdataengine/resolve/main/examples/V01_S0192_I00000307-0000-student.wav"></audio>
|
| 138 |
-
|
| 139 |
-
[Download stereo audio](examples/V01_S0192_I00000307-0000-student.wav) 路 [Input XML](examples/V01_S0192_I00000307-0000.xml) 路 Voices: `voice_1` / `voice_2`
|
| 140 |
-
|
| 141 |
-
```xml
|
| 142 |
-
<duplex>
|
| 143 |
-
<B>So, <e1/></B>
|
| 144 |
-
<B start="e1">if you had a chance to <e2/></B>
|
| 145 |
-
<B start="e2">send a message back to <e3/> the future, or the past, <e4/></B>
|
| 146 |
-
<A start="e3"><sneeze/> <cough/></A>
|
| 147 |
-
<B start="e4">or reverse, or whatever, however, what would you do? <e5/> Well, if I had a chance, I probably</B>
|
| 148 |
-
<A start="e5">Well, if I had a chance, I'd probably. <e6/></A>
|
| 149 |
-
<A start="e6"><e7/> Where can I do both, or I have to do one or the other? <e8/></A>
|
| 150 |
-
<B start="e7">would do both. Probably,</B>
|
| 151 |
-
<B start="e8">no, you probably will do both regardless. <e9/></B>
|
| 152 |
-
<A start="e9">Well, most <e10/> likely, I'd send a message back to the past and be like, "Yo, <e11/> watch out! Don't go around that corner." <cough/> <e12/></A>
|
| 153 |
-
<B start="e10">I most likely would</B>
|
| 154 |
-
<B start="e11"><cough/></B>
|
| 155 |
-
<B start="e12">who? <e13/> <laugh/></B>
|
| 156 |
-
<A start="e13">I would send a message to myself. <e14/></A>
|
| 157 |
-
<B start="e14">Oh, cool. <e15/></B>
|
| 158 |
-
<A start="e15">I mean, who else would I contact in the past? <e16/></A>
|
| 159 |
-
<B start="e16">Would you like yourself back then? <e17/></B>
|
| 160 |
-
<A start="e17"><e18/> I don't listen. I have no fucking clue. <cough/> <e19/></A>
|
| 161 |
-
<B start="e18"><cough/></B>
|
| 162 |
-
<B start="e19">Okay. That far. Oh, great. <e20/> great! <e21/></B>
|
| 163 |
-
<A start="e20">I don't have a clue.</A>
|
| 164 |
-
<B start="e21"><gasp/> <sigh/> <sneeze/> Bye.</B>
|
| 165 |
-
</duplex>
|
| 166 |
-
```
|
| 167 |
-
|
| 168 |
-
### V01_S0220_I00000126-0000-student
|
| 169 |
-
|
| 170 |
-
<audio controls src="https://huggingface.co/penguinfish1688/duplexdataengine/resolve/main/examples/V01_S0220_I00000126-0000-student.wav"></audio>
|
| 171 |
-
|
| 172 |
-
[Download stereo audio](examples/V01_S0220_I00000126-0000-student.wav) 路 [Input XML](examples/V01_S0220_I00000126-0000.xml) 路 Voices: `voice_3` / `voice_4`
|
| 173 |
-
|
| 174 |
-
```xml
|
| 175 |
-
<duplex>
|
| 176 |
-
<B>If we're to organize a fitness challenge, which <e1/></B>
|
| 177 |
-
<B start="e1">I know you love, <e2/></B>
|
| 178 |
-
<B start="e2">what would we include <e3/></B>
|
| 179 |
-
<B start="e3">for activities? <e4/></B>
|
| 180 |
-
<B start="e4">How would we make it engaging? <e5/></B>
|
| 181 |
-
<B start="e5">What <e6/> do you think?</B>
|
| 182 |
-
<A start="e6">The activities number one has got to be yoga, <e7/> probably.</A>
|
| 183 |
-
<B start="e7">Yoga. I'm on <e8/> board. <e9/></B>
|
| 184 |
-
<A start="e8">Stretching and</A>
|
| 185 |
-
<A start="e9">you know, relaxing and feeling good. <e10/></A>
|
| 186 |
-
<A start="e10">I I think weights are good too. I mean, just a little everything. <e11/></A>
|
| 187 |
-
<A start="e11">I think one extreme to the other, maybe. <e12/></A>
|
| 188 |
-
<B start="e12">Yeah, I mean, I'm definitely on board with yoga. I like mobility exercises. I <e13/></B>
|
| 189 |
-
<A start="e13">Yeah, I think if you <e14/> do,</A>
|
| 190 |
-
<B start="e14">don't know if I like the word extreme, but <e15/> you know.</B>
|
| 191 |
-
<A start="e15">yeah. <e16/></A>
|
| 192 |
-
<A start="e16">So the only thing missing would be so you have yoga, weights, and we need some kind of cardio. <e17/></A>
|
| 193 |
-
<A start="e17"><e18/> Any suggestions? <e19/></A>
|
| 194 |
-
<B start="e18">Yeah.</B>
|
| 195 |
-
<B start="e19">Like speed walking, I guess. <e20/></B>
|
| 196 |
-
<A start="e20">Maybe a treadmill. <e21/></A>
|
| 197 |
-
<B start="e21">Yeah. Yeah, I like <e22/> the treadmill.</B>
|
| 198 |
-
<A start="e22">Yeah, I think that would cover everything.</A>
|
| 199 |
-
</duplex>
|
| 200 |
-
```
|
| 201 |
-
|
| 202 |
-
|
| 203 |
## Model and evaluation
|
| 204 |
|
| 205 |
The shared model derives from Qwen3-TTS-12Hz-1.7B-CustomVoice. Stage III trained
|
|
|
|
| 30 |
presets, and inference code. It does not require an external transcript-generating
|
| 31 |
language model, training caches, or a separate adapter/base checkpoint.
|
| 32 |
|
| 33 |
+
## Featured examples and complete input XML
|
| 34 |
+
|
| 35 |
+
These are the requested checkpoint-8565 recordings, normalized for listening.
|
| 36 |
+
Both channels preserve their shared origin; neither lane is trimmed or shifted.
|
| 37 |
+
|
| 38 |
+
### V01_S0192_I00000307-0000-student
|
| 39 |
+
|
| 40 |
+
<audio controls src="https://huggingface.co/penguinfish1688/duplexdataengine/resolve/main/examples/V01_S0192_I00000307-0000-student.wav"></audio>
|
| 41 |
+
|
| 42 |
+
[Download stereo audio](examples/V01_S0192_I00000307-0000-student.wav) 路 [Input XML](examples/V01_S0192_I00000307-0000.xml) 路 Voices: `voice_1` / `voice_2`
|
| 43 |
+
|
| 44 |
+
<details>
|
| 45 |
+
<summary>Show complete input XML</summary>
|
| 46 |
+
|
| 47 |
+
```xml
|
| 48 |
+
<duplex>
|
| 49 |
+
<B>So, <e1/></B>
|
| 50 |
+
<B start="e1">if you had a chance to <e2/></B>
|
| 51 |
+
<B start="e2">send a message back to <e3/> the future, or the past, <e4/></B>
|
| 52 |
+
<A start="e3"><sneeze/> <cough/></A>
|
| 53 |
+
<B start="e4">or reverse, or whatever, however, what would you do? <e5/> Well, if I had a chance, I probably</B>
|
| 54 |
+
<A start="e5">Well, if I had a chance, I'd probably. <e6/></A>
|
| 55 |
+
<A start="e6"><e7/> Where can I do both, or I have to do one or the other? <e8/></A>
|
| 56 |
+
<B start="e7">would do both. Probably,</B>
|
| 57 |
+
<B start="e8">no, you probably will do both regardless. <e9/></B>
|
| 58 |
+
<A start="e9">Well, most <e10/> likely, I'd send a message back to the past and be like, "Yo, <e11/> watch out! Don't go around that corner." <cough/> <e12/></A>
|
| 59 |
+
<B start="e10">I most likely would</B>
|
| 60 |
+
<B start="e11"><cough/></B>
|
| 61 |
+
<B start="e12">who? <e13/> <laugh/></B>
|
| 62 |
+
<A start="e13">I would send a message to myself. <e14/></A>
|
| 63 |
+
<B start="e14">Oh, cool. <e15/></B>
|
| 64 |
+
<A start="e15">I mean, who else would I contact in the past? <e16/></A>
|
| 65 |
+
<B start="e16">Would you like yourself back then? <e17/></B>
|
| 66 |
+
<A start="e17"><e18/> I don't listen. I have no fucking clue. <cough/> <e19/></A>
|
| 67 |
+
<B start="e18"><cough/></B>
|
| 68 |
+
<B start="e19">Okay. That far. Oh, great. <e20/> great! <e21/></B>
|
| 69 |
+
<A start="e20">I don't have a clue.</A>
|
| 70 |
+
<B start="e21"><gasp/> <sigh/> <sneeze/> Bye.</B>
|
| 71 |
+
</duplex>
|
| 72 |
+
```
|
| 73 |
+
|
| 74 |
+
</details>
|
| 75 |
+
|
| 76 |
+
### V01_S0220_I00000126-0000-student
|
| 77 |
+
|
| 78 |
+
<audio controls src="https://huggingface.co/penguinfish1688/duplexdataengine/resolve/main/examples/V01_S0220_I00000126-0000-student.wav"></audio>
|
| 79 |
+
|
| 80 |
+
[Download stereo audio](examples/V01_S0220_I00000126-0000-student.wav) 路 [Input XML](examples/V01_S0220_I00000126-0000.xml) 路 Voices: `voice_3` / `voice_4`
|
| 81 |
+
|
| 82 |
+
<details>
|
| 83 |
+
<summary>Show complete input XML</summary>
|
| 84 |
+
|
| 85 |
+
```xml
|
| 86 |
+
<duplex>
|
| 87 |
+
<B>If we're to organize a fitness challenge, which <e1/></B>
|
| 88 |
+
<B start="e1">I know you love, <e2/></B>
|
| 89 |
+
<B start="e2">what would we include <e3/></B>
|
| 90 |
+
<B start="e3">for activities? <e4/></B>
|
| 91 |
+
<B start="e4">How would we make it engaging? <e5/></B>
|
| 92 |
+
<B start="e5">What <e6/> do you think?</B>
|
| 93 |
+
<A start="e6">The activities number one has got to be yoga, <e7/> probably.</A>
|
| 94 |
+
<B start="e7">Yoga. I'm on <e8/> board. <e9/></B>
|
| 95 |
+
<A start="e8">Stretching and</A>
|
| 96 |
+
<A start="e9">you know, relaxing and feeling good. <e10/></A>
|
| 97 |
+
<A start="e10">I I think weights are good too. I mean, just a little everything. <e11/></A>
|
| 98 |
+
<A start="e11">I think one extreme to the other, maybe. <e12/></A>
|
| 99 |
+
<B start="e12">Yeah, I mean, I'm definitely on board with yoga. I like mobility exercises. I <e13/></B>
|
| 100 |
+
<A start="e13">Yeah, I think if you <e14/> do,</A>
|
| 101 |
+
<B start="e14">don't know if I like the word extreme, but <e15/> you know.</B>
|
| 102 |
+
<A start="e15">yeah. <e16/></A>
|
| 103 |
+
<A start="e16">So the only thing missing would be so you have yoga, weights, and we need some kind of cardio. <e17/></A>
|
| 104 |
+
<A start="e17"><e18/> Any suggestions? <e19/></A>
|
| 105 |
+
<B start="e18">Yeah.</B>
|
| 106 |
+
<B start="e19">Like speed walking, I guess. <e20/></B>
|
| 107 |
+
<A start="e20">Maybe a treadmill. <e21/></A>
|
| 108 |
+
<B start="e21">Yeah. Yeah, I like <e22/> the treadmill.</B>
|
| 109 |
+
<A start="e22">Yeah, I think that would cover everything.</A>
|
| 110 |
+
</duplex>
|
| 111 |
+
```
|
| 112 |
+
|
| 113 |
+
</details>
|
| 114 |
+
|
| 115 |
+
|
| 116 |
## Download and run
|
| 117 |
|
| 118 |
Use Python 3.12 and a CUDA-capable NVIDIA GPU. Install matching PyTorch and
|
|
|
|
| 209 |
The released API accepts these preset IDs; arbitrary uploaded voice cloning is
|
| 210 |
not part of this version.
|
| 211 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 212 |
## Model and evaluation
|
| 213 |
|
| 214 |
The shared model derives from Qwen3-TTS-12Hz-1.7B-CustomVoice. Stage III trained
|