Gatozu35 commited on
Commit
6a39fba
·
verified ·
1 Parent(s): d78708d

Model card: cite the release post (no technical report yet); ZONOS3 naming

Browse files
Files changed (1) hide show
  1. README.md +16 -14
README.md CHANGED
@@ -42,8 +42,8 @@ under Apache 2.0.
42
  ZONOS3-Mini runs entirely on your own GPU through WebGPU: no install and no server. The first visit downloads the model, and
43
  the browser keeps it cached for later visits. You need a browser with WebGPU support.
44
 
45
- - [Zonos Voice Studio](https://zyphra.com/zonos3mini/localplayground#cast): the full studio.
46
- - [Lite](https://zyphra.com/zonos3mini/localplayground/lite): quick voice cloning. Pick, upload or record a voice and
47
  speak with it.
48
 
49
  ### With SGLang
@@ -67,7 +67,7 @@ curl -X POST http://localhost:8000/v1/audio/speech \
67
  ```
68
 
69
  Add `"references": [{"audio_path": "<reference clip>"}]` to clone a voice, or `"stream": true, "response_format": "pcm"` to
70
- stream 44.1 kHz audio as it is generated. The [Zonos3 cookbook](https://github.com/sgl-project/sglang-omni/blob/main/docs/cookbook/zonos3.md)
71
  covers voice cloning, streaming and the sampling options.
72
 
73
  ### Native runtimes
@@ -84,13 +84,13 @@ dual-codec frames (10 codebooks of 4,096 entries each: one semantic codebook dis
84
  acoustic codebooks), conditioned on the text, a speaker prompt and three bucketed acoustic controls. A causal multi-resolution
85
  iSTFT head renders the frames to 44.1 kHz audio as they are produced.
86
 
87
- ![Zonos 3 Mini inference pipeline](assets/zonos3_mini_arloop_animated.gif)
88
 
89
  *Inference pipeline. Speaker conditioning (raw reference codes or a speaker-embedding row), control rows and SuperBPE text enter
90
  the hybrid GDN/attention MoE backbone, which predicts all ten codebooks of the next frame under the delay pattern (four drawn);
91
  as soon as a frame's last codebook is generated, the codec's causal iSTFT head renders that frame to audio.*
92
 
93
- | | Zonos 3 Mini |
94
  |---|---|
95
  | Backbone | 11 layers, model dim 1,024; 800M parameters total, about 100M active per token (latent MoE: 64 experts, top-2 routing, from layer 1) |
96
  | Sequence mixer | pattern `gdn3_global1`: 9 Gated DeltaNet (GDN) layers + 2 global attention layers (16 heads x 32 dims, 4 KV heads), attention residuals (`full_attnres`); context 32,768 positions |
@@ -111,18 +111,20 @@ Full results and the ZTTS2 capability index are in the [blog post](https://www.z
111
 
112
  Quality against speed on one H100 80GB. Quality combines macro speaker similarity and macro WER over the 55 language subsets of
113
  [ZTTS2-Eval](https://zyphra.github.io/ZTTS2-Eval/) (benchmark version 2: FLEURS-R read speech in 35 languages and VoxBlink2 in-the-wild recordings in 20 languages) as
114
- ½ z(similarity) − ½ z(WER) across the systems shown; Zonos 3 Mini is measured with the speaker-embedding prompt. Left: median
115
- time to first audio with 8 concurrent requests (80 ms for Zonos 3 Mini). Right: peak throughput at each model's best concurrency
116
- (457 seconds of audio per second for Zonos 3 Mini).
117
 
118
- ![Zonos 3 Mini quality versus time to first audio and throughput](assets/eval_pareto.png)
119
 
120
  ## Citation
121
- If you find this model useful in an academic context please cite as:
122
  ```
123
- @misc{zyphra2026zonos3-mini,
124
- title = {Zonos3-Mini Technical Report},
125
- author = {Gabriel Clark, Sofian Mejjoute, George Close, Beren Millidge},
126
- year = {2026},
 
 
127
  }
128
  ```
 
42
  ZONOS3-Mini runs entirely on your own GPU through WebGPU: no install and no server. The first visit downloads the model, and
43
  the browser keeps it cached for later visits. You need a browser with WebGPU support.
44
 
45
+ - [Zonos Voice Studio](https://zyphra.com/zonos3-mini/localplayground#cast): the full studio.
46
+ - [Lite](https://zyphra.com/zonos3-mini/localplayground/lite): quick voice cloning. Pick, upload or record a voice and
47
  speak with it.
48
 
49
  ### With SGLang
 
67
  ```
68
 
69
  Add `"references": [{"audio_path": "<reference clip>"}]` to clone a voice, or `"stream": true, "response_format": "pcm"` to
70
+ stream 44.1 kHz audio as it is generated. The [ZONOS3 cookbook](https://github.com/sgl-project/sglang-omni/blob/main/docs/cookbook/zonos3.md)
71
  covers voice cloning, streaming and the sampling options.
72
 
73
  ### Native runtimes
 
84
  acoustic codebooks), conditioned on the text, a speaker prompt and three bucketed acoustic controls. A causal multi-resolution
85
  iSTFT head renders the frames to 44.1 kHz audio as they are produced.
86
 
87
+ ![ZONOS3-Mini inference pipeline](assets/zonos3_mini_arloop_animated.gif)
88
 
89
  *Inference pipeline. Speaker conditioning (raw reference codes or a speaker-embedding row), control rows and SuperBPE text enter
90
  the hybrid GDN/attention MoE backbone, which predicts all ten codebooks of the next frame under the delay pattern (four drawn);
91
  as soon as a frame's last codebook is generated, the codec's causal iSTFT head renders that frame to audio.*
92
 
93
+ | | ZONOS3-Mini |
94
  |---|---|
95
  | Backbone | 11 layers, model dim 1,024; 800M parameters total, about 100M active per token (latent MoE: 64 experts, top-2 routing, from layer 1) |
96
  | Sequence mixer | pattern `gdn3_global1`: 9 Gated DeltaNet (GDN) layers + 2 global attention layers (16 heads x 32 dims, 4 KV heads), attention residuals (`full_attnres`); context 32,768 positions |
 
111
 
112
  Quality against speed on one H100 80GB. Quality combines macro speaker similarity and macro WER over the 55 language subsets of
113
  [ZTTS2-Eval](https://zyphra.github.io/ZTTS2-Eval/) (benchmark version 2: FLEURS-R read speech in 35 languages and VoxBlink2 in-the-wild recordings in 20 languages) as
114
+ ½ z(similarity) − ½ z(WER) across the systems shown; ZONOS3-Mini is measured with the speaker-embedding prompt. Left: median
115
+ time to first audio with 8 concurrent requests (80 ms for ZONOS3-Mini). Right: peak throughput at each model's best concurrency
116
+ (457 seconds of audio per second for ZONOS3-Mini).
117
 
118
+ ![ZONOS3-Mini quality versus time to first audio and throughput](assets/eval_pareto.png)
119
 
120
  ## Citation
121
+ If you find this model useful in an academic context, please cite the release post:
122
  ```
123
+ @misc{zyphra2026zonos3mini,
124
+ title = {{ZONOS3-Mini}},
125
+ author = {Gabriel Clark and Sofian Mejjoute and George Close and Beren Millidge},
126
+ year = {2026},
127
+ month = nov,
128
+ howpublished = {\url{https://www.zyphra.com/our-work/zonos3-mini}},
129
  }
130
  ```