Instructions to use Zyphra/ZONOS3-Mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Zonos
How to use Zyphra/ZONOS3-Mini with Zonos:
# pip install git+https://github.com/Zyphra/Zonos.git import torchaudio from zonos.model import Zonos from zonos.conditioning import make_cond_dict model = Zonos.from_pretrained("Zyphra/ZONOS3-Mini", device="cuda") wav, sr = torchaudio.load("speaker.wav") # 5-10s reference clip speaker = model.make_speaker_embedding(wav, sr) cond = make_cond_dict(text="Hello, world!", speaker=speaker, language="en-us") codes = model.generate(model.prepare_conditioning(cond)) audio = model.autoencoder.decode(codes)[0].cpu() torchaudio.save("sample.wav", audio, model.autoencoder.sampling_rate) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Zyphra/ZONOS3-Mini with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Zyphra/ZONOS3-Mini # Run inference directly in the terminal: llama cli -hf Zyphra/ZONOS3-Mini
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Zyphra/ZONOS3-Mini # Run inference directly in the terminal: llama cli -hf Zyphra/ZONOS3-Mini
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Zyphra/ZONOS3-Mini # Run inference directly in the terminal: ./build/bin/llama cli -hf Zyphra/ZONOS3-Mini
Use Docker
docker model run hf.co/Zyphra/ZONOS3-Mini
- Llama new
- LM Studio
- Jan
- Ollama
How to use Zyphra/ZONOS3-Mini with Ollama:
ollama run hf.co/Zyphra/ZONOS3-Mini
- Unsloth Desktop
- Docker Model Runner
How to use Zyphra/ZONOS3-Mini with Docker Model Runner:
docker model run hf.co/Zyphra/ZONOS3-Mini
- Lemonade
How to use Zyphra/ZONOS3-Mini with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Zyphra/ZONOS3-Mini
Run and chat with the model
lemonade run user.ZONOS3-Mini-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
lm/zonos3_mini/text_rows: phoneme, start and pause rows (zonos-text-extra/1, 143 rows)
Browse files
lm/zonos3_mini/text_rows/pause_tokens_s5000.json
ADDED
|
@@ -0,0 +1,195 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"format": "zonos-text-extra/1",
|
| 3 |
+
"text_vocab": 8196,
|
| 4 |
+
"text_extra_tokens": 143,
|
| 5 |
+
"base": "/data/groups/audio/sofian/runs/z3m_rate30_r2grpo_phonemes/init_r2grpo_s587",
|
| 6 |
+
"run": "/data/groups/audio/sofian/runs/z3m_rate30_r2grpo_pause/tokens_win05/checkpoints/0000005000",
|
| 7 |
+
"config": "z3m_rate30_r2grpo_pause_tokens_win05",
|
| 8 |
+
"verified_base_tensors": 187,
|
| 9 |
+
"phonemes": {
|
| 10 |
+
"open_id": 8197,
|
| 11 |
+
"close_id": 8198,
|
| 12 |
+
"symbols": [
|
| 13 |
+
"a",
|
| 14 |
+
"b",
|
| 15 |
+
"c",
|
| 16 |
+
"d",
|
| 17 |
+
"e",
|
| 18 |
+
"f",
|
| 19 |
+
"h",
|
| 20 |
+
"i",
|
| 21 |
+
"j",
|
| 22 |
+
"k",
|
| 23 |
+
"l",
|
| 24 |
+
"m",
|
| 25 |
+
"n",
|
| 26 |
+
"o",
|
| 27 |
+
"p",
|
| 28 |
+
"q",
|
| 29 |
+
"r",
|
| 30 |
+
"s",
|
| 31 |
+
"t",
|
| 32 |
+
"u",
|
| 33 |
+
"v",
|
| 34 |
+
"w",
|
| 35 |
+
"x",
|
| 36 |
+
"y",
|
| 37 |
+
"z",
|
| 38 |
+
"²",
|
| 39 |
+
"³",
|
| 40 |
+
"¹",
|
| 41 |
+
"ã",
|
| 42 |
+
"ä",
|
| 43 |
+
"æ",
|
| 44 |
+
"ç",
|
| 45 |
+
"ï",
|
| 46 |
+
"ð",
|
| 47 |
+
"õ",
|
| 48 |
+
"ø",
|
| 49 |
+
"ħ",
|
| 50 |
+
"ĩ",
|
| 51 |
+
"ŋ",
|
| 52 |
+
"œ",
|
| 53 |
+
"ũ",
|
| 54 |
+
"ɐ",
|
| 55 |
+
"ɑ",
|
| 56 |
+
"ɒ",
|
| 57 |
+
"ɓ",
|
| 58 |
+
"ɔ",
|
| 59 |
+
"ɕ",
|
| 60 |
+
"ɖ",
|
| 61 |
+
"ɗ",
|
| 62 |
+
"ɘ",
|
| 63 |
+
"ə",
|
| 64 |
+
"ɚ",
|
| 65 |
+
"ɛ",
|
| 66 |
+
"ɜ",
|
| 67 |
+
"ɝ",
|
| 68 |
+
"ɟ",
|
| 69 |
+
"ɡ",
|
| 70 |
+
"ɣ",
|
| 71 |
+
"ɤ",
|
| 72 |
+
"ɥ",
|
| 73 |
+
"ɦ",
|
| 74 |
+
"ɧ",
|
| 75 |
+
"ɨ",
|
| 76 |
+
"ɪ",
|
| 77 |
+
"ɫ",
|
| 78 |
+
"ɭ",
|
| 79 |
+
"ɯ",
|
| 80 |
+
"ɰ",
|
| 81 |
+
"ɱ",
|
| 82 |
+
"ɲ",
|
| 83 |
+
"ɳ",
|
| 84 |
+
"ɴ",
|
| 85 |
+
"ɵ",
|
| 86 |
+
"ɸ",
|
| 87 |
+
"ɹ",
|
| 88 |
+
"ɻ",
|
| 89 |
+
"ɽ",
|
| 90 |
+
"ɾ",
|
| 91 |
+
"ʀ",
|
| 92 |
+
"ʁ",
|
| 93 |
+
"ʂ",
|
| 94 |
+
"ʃ",
|
| 95 |
+
"ʈ",
|
| 96 |
+
"ʉ",
|
| 97 |
+
"ʊ",
|
| 98 |
+
"ʋ",
|
| 99 |
+
"ʌ",
|
| 100 |
+
"ʍ",
|
| 101 |
+
"ʎ",
|
| 102 |
+
"ʏ",
|
| 103 |
+
"ʐ",
|
| 104 |
+
"ʑ",
|
| 105 |
+
"ʒ",
|
| 106 |
+
"ʔ",
|
| 107 |
+
"ʕ",
|
| 108 |
+
"ʝ",
|
| 109 |
+
"ʰ",
|
| 110 |
+
"ʱ",
|
| 111 |
+
"ʲ",
|
| 112 |
+
"ʷ",
|
| 113 |
+
"ʼ",
|
| 114 |
+
"ˀ",
|
| 115 |
+
"ː",
|
| 116 |
+
"ˣ",
|
| 117 |
+
"ˤ",
|
| 118 |
+
"˥",
|
| 119 |
+
"˦",
|
| 120 |
+
"˧",
|
| 121 |
+
"˨",
|
| 122 |
+
"˩",
|
| 123 |
+
"̃",
|
| 124 |
+
"̊",
|
| 125 |
+
"̍",
|
| 126 |
+
"̚",
|
| 127 |
+
"̝",
|
| 128 |
+
"̞",
|
| 129 |
+
"̟",
|
| 130 |
+
"̠",
|
| 131 |
+
"̥",
|
| 132 |
+
"̩",
|
| 133 |
+
"̪",
|
| 134 |
+
"̯",
|
| 135 |
+
"̹",
|
| 136 |
+
"͈",
|
| 137 |
+
"͡",
|
| 138 |
+
"β",
|
| 139 |
+
"θ",
|
| 140 |
+
"χ",
|
| 141 |
+
"ᵝ",
|
| 142 |
+
"ẽ",
|
| 143 |
+
"ỹ",
|
| 144 |
+
"⁴",
|
| 145 |
+
"⁵",
|
| 146 |
+
"⁻",
|
| 147 |
+
"⁽",
|
| 148 |
+
"⁾"
|
| 149 |
+
],
|
| 150 |
+
"inventory_sha256": "2e19015cac41d5a417f7faa3b3b5d63f96c2c1bebcb3d8986fb3048d77ee7a50",
|
| 151 |
+
"open_marker": "",
|
| 152 |
+
"close_marker": ""
|
| 153 |
+
},
|
| 154 |
+
"start": {
|
| 155 |
+
"id": 8335,
|
| 156 |
+
"marker": ""
|
| 157 |
+
},
|
| 158 |
+
"pauses": {
|
| 159 |
+
"ids": [
|
| 160 |
+
8336,
|
| 161 |
+
8337,
|
| 162 |
+
8338,
|
| 163 |
+
8339
|
| 164 |
+
],
|
| 165 |
+
"markers": [
|
| 166 |
+
"",
|
| 167 |
+
"",
|
| 168 |
+
"",
|
| 169 |
+
""
|
| 170 |
+
],
|
| 171 |
+
"seconds": [
|
| 172 |
+
0.2475,
|
| 173 |
+
0.495,
|
| 174 |
+
0.9899,
|
| 175 |
+
1.9799
|
| 176 |
+
],
|
| 177 |
+
"edges_seconds": [
|
| 178 |
+
0.175,
|
| 179 |
+
0.35,
|
| 180 |
+
0.7,
|
| 181 |
+
1.4,
|
| 182 |
+
2.8
|
| 183 |
+
]
|
| 184 |
+
},
|
| 185 |
+
"frozen_rows": {
|
| 186 |
+
"count": 139,
|
| 187 |
+
"from": "/data/groups/audio/sofian/runs/z3m_rate30_r2grpo_start/tokens_v8/adapter/start_token_s5000.pt",
|
| 188 |
+
"sha256": "7c572f94ada43562054e37a72b066b903e92a9384def72b6ffbeaf53050740a0"
|
| 189 |
+
},
|
| 190 |
+
"sha256": "35868b0ff855081f3340a1c96644cfe9bf21b42935d9ed991ddd59ea0375e621",
|
| 191 |
+
"rows_shape": [
|
| 192 |
+
143,
|
| 193 |
+
1024
|
| 194 |
+
]
|
| 195 |
+
}
|
lm/zonos3_mini/text_rows/pause_tokens_s5000.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:35868b0ff855081f3340a1c96644cfe9bf21b42935d9ed991ddd59ea0375e621
|
| 3 |
+
size 589771
|