euclidstellar commited on
Commit
08ec770
·
verified ·
1 Parent(s): 8f0de32

voice + int8 onnx weights for the in-browser storyteller

Browse files
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ tags:
6
+ - text-to-speech
7
+ - onnx
8
+ - browser
9
+ - webassembly
10
+ library_name: onnx
11
+ ---
12
+
13
+ # pocket-tts-voice
14
+
15
+ Weights for a text-to-speech demo that runs entirely in a browser tab, with no
16
+ server: https://gaurav.bar/things/storyteller
17
+
18
+ Two things live here.
19
+
20
+ ## 1. A voice
21
+
22
+ `onnx/english_2026-04/voices.bin` is **my own voice** — Gaurav Singh — encoded
23
+ once, offline, from about twenty seconds of me speaking. I am publishing it
24
+ knowingly, so that the demo works for anyone who opens the page.
25
+
26
+ The file is not audio. It is the speech model's key–value cache after it has
27
+ listened to that recording: 12,288 floats for every 80 ms, across six layers and
28
+ sixteen attention heads. Encoding offline means the browser never needs the
29
+ voice encoder (19.8 MB) or the gated cloning weights — it loads a state file, as
30
+ the upstream built-in voices do.
31
+
32
+ **If you use this voice, please say that it is synthetic.** The demo page it was
33
+ built for discloses that in its first sentence.
34
+
35
+ ## 2. Redistributed model weights
36
+
37
+ `flow_lm_*`, `mimi_decoder`, `text_conditioner`, `tokenizer.model` and
38
+ `bos_before_voice.npy` are the int8 ONNX exports of
39
+ [Pocket TTS](https://github.com/kyutai-labs/pocket-tts) (Kyutai, MIT),
40
+ mirrored from
41
+ [KevinAHM/pocket-tts-onnx](https://huggingface.co/KevinAHM/pocket-tts-onnx)
42
+ so one origin serves the whole demo.
43
+
44
+ `mimi_encoder` is deliberately **not** mirrored — it is only needed to encode a
45
+ new voice, which this demo does not do.
46
+
47
+ ### Local change
48
+
49
+ `bundle.json` lists `predefined_voices: ["gaurav"]` rather than the upstream
50
+ eight. The runtime defaults to `alba` whenever it sees that name in the list and
51
+ then fails against a pack that does not contain it.
52
+
53
+ ## Layout
54
+
55
+ ```
56
+ onnx/english_2026-04/
57
+ flow_lm_main_int8.onnx 72.8 MB
58
+ mimi_decoder_int8.onnx 21.6 MB
59
+ text_conditioner_int8.onnx 15.6 MB
60
+ flow_lm_flow_int8.onnx 9.5 MB
61
+ voices.bin 11.8 MB <- the voice
62
+ bundle.json, tokenizer.model, bos_before_voice.npy
63
+ ```
64
+
65
+ About 133 MB in total, fetched once and then cached by the browser.
onnx/english_2026-04/bos_before_voice.npy ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f46edf4f7007b7ba4ea58831f49d003e59e167b4641c44bb3addfe9231a780b1
3
+ size 4224
onnx/english_2026-04/bundle.json ADDED
@@ -0,0 +1,1074 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_before_voice_file": "bos_before_voice.npy",
3
+ "bundle_name": "english_2026-04",
4
+ "conditioning_dim": 1024,
5
+ "flow_lm_state_manifest": [
6
+ {
7
+ "dtype": "float32",
8
+ "fill": "nan",
9
+ "index": 0,
10
+ "input_name": "state_0",
11
+ "key": "cache",
12
+ "module": "transformer.layers.0.self_attn",
13
+ "output_name": "out_state_0",
14
+ "path": "transformer.layers.0.self_attn/cache",
15
+ "shape": [
16
+ 2,
17
+ 1,
18
+ 1000,
19
+ 16,
20
+ 64
21
+ ]
22
+ },
23
+ {
24
+ "dtype": "float32",
25
+ "fill": "empty",
26
+ "index": 1,
27
+ "input_name": "state_1",
28
+ "key": "current_end",
29
+ "module": "transformer.layers.0.self_attn",
30
+ "output_name": "out_state_1",
31
+ "path": "transformer.layers.0.self_attn/current_end",
32
+ "shape": [
33
+ 0
34
+ ]
35
+ },
36
+ {
37
+ "dtype": "int64",
38
+ "fill": "zeros",
39
+ "index": 2,
40
+ "input_name": "state_2",
41
+ "key": "step",
42
+ "module": "transformer.layers.0.self_attn",
43
+ "output_name": "out_state_2",
44
+ "path": "transformer.layers.0.self_attn/step",
45
+ "shape": [
46
+ 1
47
+ ]
48
+ },
49
+ {
50
+ "dtype": "float32",
51
+ "fill": "nan",
52
+ "index": 3,
53
+ "input_name": "state_3",
54
+ "key": "cache",
55
+ "module": "transformer.layers.1.self_attn",
56
+ "output_name": "out_state_3",
57
+ "path": "transformer.layers.1.self_attn/cache",
58
+ "shape": [
59
+ 2,
60
+ 1,
61
+ 1000,
62
+ 16,
63
+ 64
64
+ ]
65
+ },
66
+ {
67
+ "dtype": "float32",
68
+ "fill": "empty",
69
+ "index": 4,
70
+ "input_name": "state_4",
71
+ "key": "current_end",
72
+ "module": "transformer.layers.1.self_attn",
73
+ "output_name": "out_state_4",
74
+ "path": "transformer.layers.1.self_attn/current_end",
75
+ "shape": [
76
+ 0
77
+ ]
78
+ },
79
+ {
80
+ "dtype": "int64",
81
+ "fill": "zeros",
82
+ "index": 5,
83
+ "input_name": "state_5",
84
+ "key": "step",
85
+ "module": "transformer.layers.1.self_attn",
86
+ "output_name": "out_state_5",
87
+ "path": "transformer.layers.1.self_attn/step",
88
+ "shape": [
89
+ 1
90
+ ]
91
+ },
92
+ {
93
+ "dtype": "float32",
94
+ "fill": "nan",
95
+ "index": 6,
96
+ "input_name": "state_6",
97
+ "key": "cache",
98
+ "module": "transformer.layers.2.self_attn",
99
+ "output_name": "out_state_6",
100
+ "path": "transformer.layers.2.self_attn/cache",
101
+ "shape": [
102
+ 2,
103
+ 1,
104
+ 1000,
105
+ 16,
106
+ 64
107
+ ]
108
+ },
109
+ {
110
+ "dtype": "float32",
111
+ "fill": "empty",
112
+ "index": 7,
113
+ "input_name": "state_7",
114
+ "key": "current_end",
115
+ "module": "transformer.layers.2.self_attn",
116
+ "output_name": "out_state_7",
117
+ "path": "transformer.layers.2.self_attn/current_end",
118
+ "shape": [
119
+ 0
120
+ ]
121
+ },
122
+ {
123
+ "dtype": "int64",
124
+ "fill": "zeros",
125
+ "index": 8,
126
+ "input_name": "state_8",
127
+ "key": "step",
128
+ "module": "transformer.layers.2.self_attn",
129
+ "output_name": "out_state_8",
130
+ "path": "transformer.layers.2.self_attn/step",
131
+ "shape": [
132
+ 1
133
+ ]
134
+ },
135
+ {
136
+ "dtype": "float32",
137
+ "fill": "nan",
138
+ "index": 9,
139
+ "input_name": "state_9",
140
+ "key": "cache",
141
+ "module": "transformer.layers.3.self_attn",
142
+ "output_name": "out_state_9",
143
+ "path": "transformer.layers.3.self_attn/cache",
144
+ "shape": [
145
+ 2,
146
+ 1,
147
+ 1000,
148
+ 16,
149
+ 64
150
+ ]
151
+ },
152
+ {
153
+ "dtype": "float32",
154
+ "fill": "empty",
155
+ "index": 10,
156
+ "input_name": "state_10",
157
+ "key": "current_end",
158
+ "module": "transformer.layers.3.self_attn",
159
+ "output_name": "out_state_10",
160
+ "path": "transformer.layers.3.self_attn/current_end",
161
+ "shape": [
162
+ 0
163
+ ]
164
+ },
165
+ {
166
+ "dtype": "int64",
167
+ "fill": "zeros",
168
+ "index": 11,
169
+ "input_name": "state_11",
170
+ "key": "step",
171
+ "module": "transformer.layers.3.self_attn",
172
+ "output_name": "out_state_11",
173
+ "path": "transformer.layers.3.self_attn/step",
174
+ "shape": [
175
+ 1
176
+ ]
177
+ },
178
+ {
179
+ "dtype": "float32",
180
+ "fill": "nan",
181
+ "index": 12,
182
+ "input_name": "state_12",
183
+ "key": "cache",
184
+ "module": "transformer.layers.4.self_attn",
185
+ "output_name": "out_state_12",
186
+ "path": "transformer.layers.4.self_attn/cache",
187
+ "shape": [
188
+ 2,
189
+ 1,
190
+ 1000,
191
+ 16,
192
+ 64
193
+ ]
194
+ },
195
+ {
196
+ "dtype": "float32",
197
+ "fill": "empty",
198
+ "index": 13,
199
+ "input_name": "state_13",
200
+ "key": "current_end",
201
+ "module": "transformer.layers.4.self_attn",
202
+ "output_name": "out_state_13",
203
+ "path": "transformer.layers.4.self_attn/current_end",
204
+ "shape": [
205
+ 0
206
+ ]
207
+ },
208
+ {
209
+ "dtype": "int64",
210
+ "fill": "zeros",
211
+ "index": 14,
212
+ "input_name": "state_14",
213
+ "key": "step",
214
+ "module": "transformer.layers.4.self_attn",
215
+ "output_name": "out_state_14",
216
+ "path": "transformer.layers.4.self_attn/step",
217
+ "shape": [
218
+ 1
219
+ ]
220
+ },
221
+ {
222
+ "dtype": "float32",
223
+ "fill": "nan",
224
+ "index": 15,
225
+ "input_name": "state_15",
226
+ "key": "cache",
227
+ "module": "transformer.layers.5.self_attn",
228
+ "output_name": "out_state_15",
229
+ "path": "transformer.layers.5.self_attn/cache",
230
+ "shape": [
231
+ 2,
232
+ 1,
233
+ 1000,
234
+ 16,
235
+ 64
236
+ ]
237
+ },
238
+ {
239
+ "dtype": "float32",
240
+ "fill": "empty",
241
+ "index": 16,
242
+ "input_name": "state_16",
243
+ "key": "current_end",
244
+ "module": "transformer.layers.5.self_attn",
245
+ "output_name": "out_state_16",
246
+ "path": "transformer.layers.5.self_attn/current_end",
247
+ "shape": [
248
+ 0
249
+ ]
250
+ },
251
+ {
252
+ "dtype": "int64",
253
+ "fill": "zeros",
254
+ "index": 17,
255
+ "input_name": "state_17",
256
+ "key": "step",
257
+ "module": "transformer.layers.5.self_attn",
258
+ "output_name": "out_state_17",
259
+ "path": "transformer.layers.5.self_attn/step",
260
+ "shape": [
261
+ 1
262
+ ]
263
+ }
264
+ ],
265
+ "frame_rate": 12.5,
266
+ "insert_bos_before_voice": true,
267
+ "language": "english_2026-04",
268
+ "latent_dim": 32,
269
+ "max_token_per_chunk": 50,
270
+ "mimi_state_manifest": [
271
+ {
272
+ "dtype": "bool",
273
+ "fill": "ones",
274
+ "index": 0,
275
+ "input_name": "state_0",
276
+ "key": "first",
277
+ "module": "decoder.model.0",
278
+ "output_name": "out_state_0",
279
+ "path": "decoder.model.0/first",
280
+ "shape": [
281
+ 1
282
+ ]
283
+ },
284
+ {
285
+ "dtype": "float32",
286
+ "fill": "zeros",
287
+ "index": 1,
288
+ "input_name": "state_1",
289
+ "key": "previous",
290
+ "module": "decoder.model.0",
291
+ "output_name": "out_state_1",
292
+ "path": "decoder.model.0/previous",
293
+ "shape": [
294
+ 1,
295
+ 512,
296
+ 6
297
+ ]
298
+ },
299
+ {
300
+ "dtype": "bool",
301
+ "fill": "ones",
302
+ "index": 2,
303
+ "input_name": "state_2",
304
+ "key": "first",
305
+ "module": "decoder.model.11",
306
+ "output_name": "out_state_2",
307
+ "path": "decoder.model.11/first",
308
+ "shape": [
309
+ 1
310
+ ]
311
+ },
312
+ {
313
+ "dtype": "float32",
314
+ "fill": "zeros",
315
+ "index": 3,
316
+ "input_name": "state_3",
317
+ "key": "previous",
318
+ "module": "decoder.model.11",
319
+ "output_name": "out_state_3",
320
+ "path": "decoder.model.11/previous",
321
+ "shape": [
322
+ 1,
323
+ 64,
324
+ 2
325
+ ]
326
+ },
327
+ {
328
+ "dtype": "float32",
329
+ "fill": "zeros",
330
+ "index": 4,
331
+ "input_name": "state_4",
332
+ "key": "partial",
333
+ "module": "decoder.model.2",
334
+ "output_name": "out_state_4",
335
+ "path": "decoder.model.2/partial",
336
+ "shape": [
337
+ 1,
338
+ 256,
339
+ 6
340
+ ]
341
+ },
342
+ {
343
+ "dtype": "bool",
344
+ "fill": "ones",
345
+ "index": 5,
346
+ "input_name": "state_5",
347
+ "key": "first",
348
+ "module": "decoder.model.3.block.1",
349
+ "output_name": "out_state_5",
350
+ "path": "decoder.model.3.block.1/first",
351
+ "shape": [
352
+ 1
353
+ ]
354
+ },
355
+ {
356
+ "dtype": "float32",
357
+ "fill": "zeros",
358
+ "index": 6,
359
+ "input_name": "state_6",
360
+ "key": "previous",
361
+ "module": "decoder.model.3.block.1",
362
+ "output_name": "out_state_6",
363
+ "path": "decoder.model.3.block.1/previous",
364
+ "shape": [
365
+ 1,
366
+ 256,
367
+ 2
368
+ ]
369
+ },
370
+ {
371
+ "dtype": "bool",
372
+ "fill": "ones",
373
+ "index": 7,
374
+ "input_name": "state_7",
375
+ "key": "first",
376
+ "module": "decoder.model.3.block.3",
377
+ "output_name": "out_state_7",
378
+ "path": "decoder.model.3.block.3/first",
379
+ "shape": [
380
+ 1
381
+ ]
382
+ },
383
+ {
384
+ "dtype": "float32",
385
+ "fill": "empty",
386
+ "index": 8,
387
+ "input_name": "state_8",
388
+ "key": "previous",
389
+ "module": "decoder.model.3.block.3",
390
+ "output_name": "out_state_8",
391
+ "path": "decoder.model.3.block.3/previous",
392
+ "shape": [
393
+ 1,
394
+ 128,
395
+ 0
396
+ ]
397
+ },
398
+ {
399
+ "dtype": "float32",
400
+ "fill": "zeros",
401
+ "index": 9,
402
+ "input_name": "state_9",
403
+ "key": "partial",
404
+ "module": "decoder.model.5",
405
+ "output_name": "out_state_9",
406
+ "path": "decoder.model.5/partial",
407
+ "shape": [
408
+ 1,
409
+ 128,
410
+ 5
411
+ ]
412
+ },
413
+ {
414
+ "dtype": "bool",
415
+ "fill": "ones",
416
+ "index": 10,
417
+ "input_name": "state_10",
418
+ "key": "first",
419
+ "module": "decoder.model.6.block.1",
420
+ "output_name": "out_state_10",
421
+ "path": "decoder.model.6.block.1/first",
422
+ "shape": [
423
+ 1
424
+ ]
425
+ },
426
+ {
427
+ "dtype": "float32",
428
+ "fill": "zeros",
429
+ "index": 11,
430
+ "input_name": "state_11",
431
+ "key": "previous",
432
+ "module": "decoder.model.6.block.1",
433
+ "output_name": "out_state_11",
434
+ "path": "decoder.model.6.block.1/previous",
435
+ "shape": [
436
+ 1,
437
+ 128,
438
+ 2
439
+ ]
440
+ },
441
+ {
442
+ "dtype": "bool",
443
+ "fill": "ones",
444
+ "index": 12,
445
+ "input_name": "state_12",
446
+ "key": "first",
447
+ "module": "decoder.model.6.block.3",
448
+ "output_name": "out_state_12",
449
+ "path": "decoder.model.6.block.3/first",
450
+ "shape": [
451
+ 1
452
+ ]
453
+ },
454
+ {
455
+ "dtype": "float32",
456
+ "fill": "empty",
457
+ "index": 13,
458
+ "input_name": "state_13",
459
+ "key": "previous",
460
+ "module": "decoder.model.6.block.3",
461
+ "output_name": "out_state_13",
462
+ "path": "decoder.model.6.block.3/previous",
463
+ "shape": [
464
+ 1,
465
+ 64,
466
+ 0
467
+ ]
468
+ },
469
+ {
470
+ "dtype": "float32",
471
+ "fill": "zeros",
472
+ "index": 14,
473
+ "input_name": "state_14",
474
+ "key": "partial",
475
+ "module": "decoder.model.8",
476
+ "output_name": "out_state_14",
477
+ "path": "decoder.model.8/partial",
478
+ "shape": [
479
+ 1,
480
+ 64,
481
+ 4
482
+ ]
483
+ },
484
+ {
485
+ "dtype": "bool",
486
+ "fill": "ones",
487
+ "index": 15,
488
+ "input_name": "state_15",
489
+ "key": "first",
490
+ "module": "decoder.model.9.block.1",
491
+ "output_name": "out_state_15",
492
+ "path": "decoder.model.9.block.1/first",
493
+ "shape": [
494
+ 1
495
+ ]
496
+ },
497
+ {
498
+ "dtype": "float32",
499
+ "fill": "zeros",
500
+ "index": 16,
501
+ "input_name": "state_16",
502
+ "key": "previous",
503
+ "module": "decoder.model.9.block.1",
504
+ "output_name": "out_state_16",
505
+ "path": "decoder.model.9.block.1/previous",
506
+ "shape": [
507
+ 1,
508
+ 64,
509
+ 2
510
+ ]
511
+ },
512
+ {
513
+ "dtype": "bool",
514
+ "fill": "ones",
515
+ "index": 17,
516
+ "input_name": "state_17",
517
+ "key": "first",
518
+ "module": "decoder.model.9.block.3",
519
+ "output_name": "out_state_17",
520
+ "path": "decoder.model.9.block.3/first",
521
+ "shape": [
522
+ 1
523
+ ]
524
+ },
525
+ {
526
+ "dtype": "float32",
527
+ "fill": "empty",
528
+ "index": 18,
529
+ "input_name": "state_18",
530
+ "key": "previous",
531
+ "module": "decoder.model.9.block.3",
532
+ "output_name": "out_state_18",
533
+ "path": "decoder.model.9.block.3/previous",
534
+ "shape": [
535
+ 1,
536
+ 32,
537
+ 0
538
+ ]
539
+ },
540
+ {
541
+ "dtype": "float32",
542
+ "fill": "zeros",
543
+ "index": 19,
544
+ "input_name": "state_19",
545
+ "key": "cache",
546
+ "module": "decoder_transformer.transformer.layers.0.self_attn",
547
+ "output_name": "out_state_19",
548
+ "path": "decoder_transformer.transformer.layers.0.self_attn/cache",
549
+ "shape": [
550
+ 2,
551
+ 1,
552
+ 8,
553
+ 1000,
554
+ 64
555
+ ]
556
+ },
557
+ {
558
+ "dtype": "int64",
559
+ "fill": "zeros",
560
+ "index": 20,
561
+ "input_name": "state_20",
562
+ "key": "end_offset",
563
+ "module": "decoder_transformer.transformer.layers.0.self_attn",
564
+ "output_name": "out_state_20",
565
+ "path": "decoder_transformer.transformer.layers.0.self_attn/end_offset",
566
+ "shape": [
567
+ 1
568
+ ]
569
+ },
570
+ {
571
+ "dtype": "int64",
572
+ "fill": "zeros",
573
+ "index": 21,
574
+ "input_name": "state_21",
575
+ "key": "offset",
576
+ "module": "decoder_transformer.transformer.layers.0.self_attn",
577
+ "output_name": "out_state_21",
578
+ "path": "decoder_transformer.transformer.layers.0.self_attn/offset",
579
+ "shape": [
580
+ 1
581
+ ]
582
+ },
583
+ {
584
+ "dtype": "float32",
585
+ "fill": "zeros",
586
+ "index": 22,
587
+ "input_name": "state_22",
588
+ "key": "cache",
589
+ "module": "decoder_transformer.transformer.layers.1.self_attn",
590
+ "output_name": "out_state_22",
591
+ "path": "decoder_transformer.transformer.layers.1.self_attn/cache",
592
+ "shape": [
593
+ 2,
594
+ 1,
595
+ 8,
596
+ 1000,
597
+ 64
598
+ ]
599
+ },
600
+ {
601
+ "dtype": "int64",
602
+ "fill": "zeros",
603
+ "index": 23,
604
+ "input_name": "state_23",
605
+ "key": "end_offset",
606
+ "module": "decoder_transformer.transformer.layers.1.self_attn",
607
+ "output_name": "out_state_23",
608
+ "path": "decoder_transformer.transformer.layers.1.self_attn/end_offset",
609
+ "shape": [
610
+ 1
611
+ ]
612
+ },
613
+ {
614
+ "dtype": "int64",
615
+ "fill": "zeros",
616
+ "index": 24,
617
+ "input_name": "state_24",
618
+ "key": "offset",
619
+ "module": "decoder_transformer.transformer.layers.1.self_attn",
620
+ "output_name": "out_state_24",
621
+ "path": "decoder_transformer.transformer.layers.1.self_attn/offset",
622
+ "shape": [
623
+ 1
624
+ ]
625
+ },
626
+ {
627
+ "dtype": "bool",
628
+ "fill": "ones",
629
+ "index": 25,
630
+ "input_name": "state_25",
631
+ "key": "first",
632
+ "module": "downsample.conv",
633
+ "output_name": "out_state_25",
634
+ "path": "downsample.conv/first",
635
+ "shape": [
636
+ 1
637
+ ]
638
+ },
639
+ {
640
+ "dtype": "float32",
641
+ "fill": "zeros",
642
+ "index": 26,
643
+ "input_name": "state_26",
644
+ "key": "previous",
645
+ "module": "downsample.conv",
646
+ "output_name": "out_state_26",
647
+ "path": "downsample.conv/previous",
648
+ "shape": [
649
+ 1,
650
+ 512,
651
+ 16
652
+ ]
653
+ },
654
+ {
655
+ "dtype": "bool",
656
+ "fill": "ones",
657
+ "index": 27,
658
+ "input_name": "state_27",
659
+ "key": "first",
660
+ "module": "encoder.model.0",
661
+ "output_name": "out_state_27",
662
+ "path": "encoder.model.0/first",
663
+ "shape": [
664
+ 1
665
+ ]
666
+ },
667
+ {
668
+ "dtype": "float32",
669
+ "fill": "zeros",
670
+ "index": 28,
671
+ "input_name": "state_28",
672
+ "key": "previous",
673
+ "module": "encoder.model.0",
674
+ "output_name": "out_state_28",
675
+ "path": "encoder.model.0/previous",
676
+ "shape": [
677
+ 1,
678
+ 1,
679
+ 6
680
+ ]
681
+ },
682
+ {
683
+ "dtype": "bool",
684
+ "fill": "ones",
685
+ "index": 29,
686
+ "input_name": "state_29",
687
+ "key": "first",
688
+ "module": "encoder.model.1.block.1",
689
+ "output_name": "out_state_29",
690
+ "path": "encoder.model.1.block.1/first",
691
+ "shape": [
692
+ 1
693
+ ]
694
+ },
695
+ {
696
+ "dtype": "float32",
697
+ "fill": "zeros",
698
+ "index": 30,
699
+ "input_name": "state_30",
700
+ "key": "previous",
701
+ "module": "encoder.model.1.block.1",
702
+ "output_name": "out_state_30",
703
+ "path": "encoder.model.1.block.1/previous",
704
+ "shape": [
705
+ 1,
706
+ 64,
707
+ 2
708
+ ]
709
+ },
710
+ {
711
+ "dtype": "bool",
712
+ "fill": "ones",
713
+ "index": 31,
714
+ "input_name": "state_31",
715
+ "key": "first",
716
+ "module": "encoder.model.1.block.3",
717
+ "output_name": "out_state_31",
718
+ "path": "encoder.model.1.block.3/first",
719
+ "shape": [
720
+ 1
721
+ ]
722
+ },
723
+ {
724
+ "dtype": "float32",
725
+ "fill": "empty",
726
+ "index": 32,
727
+ "input_name": "state_32",
728
+ "key": "previous",
729
+ "module": "encoder.model.1.block.3",
730
+ "output_name": "out_state_32",
731
+ "path": "encoder.model.1.block.3/previous",
732
+ "shape": [
733
+ 1,
734
+ 32,
735
+ 0
736
+ ]
737
+ },
738
+ {
739
+ "dtype": "bool",
740
+ "fill": "ones",
741
+ "index": 33,
742
+ "input_name": "state_33",
743
+ "key": "first",
744
+ "module": "encoder.model.11",
745
+ "output_name": "out_state_33",
746
+ "path": "encoder.model.11/first",
747
+ "shape": [
748
+ 1
749
+ ]
750
+ },
751
+ {
752
+ "dtype": "float32",
753
+ "fill": "zeros",
754
+ "index": 34,
755
+ "input_name": "state_34",
756
+ "key": "previous",
757
+ "module": "encoder.model.11",
758
+ "output_name": "out_state_34",
759
+ "path": "encoder.model.11/previous",
760
+ "shape": [
761
+ 1,
762
+ 512,
763
+ 2
764
+ ]
765
+ },
766
+ {
767
+ "dtype": "bool",
768
+ "fill": "ones",
769
+ "index": 35,
770
+ "input_name": "state_35",
771
+ "key": "first",
772
+ "module": "encoder.model.3",
773
+ "output_name": "out_state_35",
774
+ "path": "encoder.model.3/first",
775
+ "shape": [
776
+ 1
777
+ ]
778
+ },
779
+ {
780
+ "dtype": "float32",
781
+ "fill": "zeros",
782
+ "index": 36,
783
+ "input_name": "state_36",
784
+ "key": "previous",
785
+ "module": "encoder.model.3",
786
+ "output_name": "out_state_36",
787
+ "path": "encoder.model.3/previous",
788
+ "shape": [
789
+ 1,
790
+ 64,
791
+ 4
792
+ ]
793
+ },
794
+ {
795
+ "dtype": "bool",
796
+ "fill": "ones",
797
+ "index": 37,
798
+ "input_name": "state_37",
799
+ "key": "first",
800
+ "module": "encoder.model.4.block.1",
801
+ "output_name": "out_state_37",
802
+ "path": "encoder.model.4.block.1/first",
803
+ "shape": [
804
+ 1
805
+ ]
806
+ },
807
+ {
808
+ "dtype": "float32",
809
+ "fill": "zeros",
810
+ "index": 38,
811
+ "input_name": "state_38",
812
+ "key": "previous",
813
+ "module": "encoder.model.4.block.1",
814
+ "output_name": "out_state_38",
815
+ "path": "encoder.model.4.block.1/previous",
816
+ "shape": [
817
+ 1,
818
+ 128,
819
+ 2
820
+ ]
821
+ },
822
+ {
823
+ "dtype": "bool",
824
+ "fill": "ones",
825
+ "index": 39,
826
+ "input_name": "state_39",
827
+ "key": "first",
828
+ "module": "encoder.model.4.block.3",
829
+ "output_name": "out_state_39",
830
+ "path": "encoder.model.4.block.3/first",
831
+ "shape": [
832
+ 1
833
+ ]
834
+ },
835
+ {
836
+ "dtype": "float32",
837
+ "fill": "empty",
838
+ "index": 40,
839
+ "input_name": "state_40",
840
+ "key": "previous",
841
+ "module": "encoder.model.4.block.3",
842
+ "output_name": "out_state_40",
843
+ "path": "encoder.model.4.block.3/previous",
844
+ "shape": [
845
+ 1,
846
+ 64,
847
+ 0
848
+ ]
849
+ },
850
+ {
851
+ "dtype": "bool",
852
+ "fill": "ones",
853
+ "index": 41,
854
+ "input_name": "state_41",
855
+ "key": "first",
856
+ "module": "encoder.model.6",
857
+ "output_name": "out_state_41",
858
+ "path": "encoder.model.6/first",
859
+ "shape": [
860
+ 1
861
+ ]
862
+ },
863
+ {
864
+ "dtype": "float32",
865
+ "fill": "zeros",
866
+ "index": 42,
867
+ "input_name": "state_42",
868
+ "key": "previous",
869
+ "module": "encoder.model.6",
870
+ "output_name": "out_state_42",
871
+ "path": "encoder.model.6/previous",
872
+ "shape": [
873
+ 1,
874
+ 128,
875
+ 5
876
+ ]
877
+ },
878
+ {
879
+ "dtype": "bool",
880
+ "fill": "ones",
881
+ "index": 43,
882
+ "input_name": "state_43",
883
+ "key": "first",
884
+ "module": "encoder.model.7.block.1",
885
+ "output_name": "out_state_43",
886
+ "path": "encoder.model.7.block.1/first",
887
+ "shape": [
888
+ 1
889
+ ]
890
+ },
891
+ {
892
+ "dtype": "float32",
893
+ "fill": "zeros",
894
+ "index": 44,
895
+ "input_name": "state_44",
896
+ "key": "previous",
897
+ "module": "encoder.model.7.block.1",
898
+ "output_name": "out_state_44",
899
+ "path": "encoder.model.7.block.1/previous",
900
+ "shape": [
901
+ 1,
902
+ 256,
903
+ 2
904
+ ]
905
+ },
906
+ {
907
+ "dtype": "bool",
908
+ "fill": "ones",
909
+ "index": 45,
910
+ "input_name": "state_45",
911
+ "key": "first",
912
+ "module": "encoder.model.7.block.3",
913
+ "output_name": "out_state_45",
914
+ "path": "encoder.model.7.block.3/first",
915
+ "shape": [
916
+ 1
917
+ ]
918
+ },
919
+ {
920
+ "dtype": "float32",
921
+ "fill": "empty",
922
+ "index": 46,
923
+ "input_name": "state_46",
924
+ "key": "previous",
925
+ "module": "encoder.model.7.block.3",
926
+ "output_name": "out_state_46",
927
+ "path": "encoder.model.7.block.3/previous",
928
+ "shape": [
929
+ 1,
930
+ 128,
931
+ 0
932
+ ]
933
+ },
934
+ {
935
+ "dtype": "bool",
936
+ "fill": "ones",
937
+ "index": 47,
938
+ "input_name": "state_47",
939
+ "key": "first",
940
+ "module": "encoder.model.9",
941
+ "output_name": "out_state_47",
942
+ "path": "encoder.model.9/first",
943
+ "shape": [
944
+ 1
945
+ ]
946
+ },
947
+ {
948
+ "dtype": "float32",
949
+ "fill": "zeros",
950
+ "index": 48,
951
+ "input_name": "state_48",
952
+ "key": "previous",
953
+ "module": "encoder.model.9",
954
+ "output_name": "out_state_48",
955
+ "path": "encoder.model.9/previous",
956
+ "shape": [
957
+ 1,
958
+ 256,
959
+ 6
960
+ ]
961
+ },
962
+ {
963
+ "dtype": "float32",
964
+ "fill": "zeros",
965
+ "index": 49,
966
+ "input_name": "state_49",
967
+ "key": "cache",
968
+ "module": "encoder_transformer.transformer.layers.0.self_attn",
969
+ "output_name": "out_state_49",
970
+ "path": "encoder_transformer.transformer.layers.0.self_attn/cache",
971
+ "shape": [
972
+ 2,
973
+ 1,
974
+ 8,
975
+ 1000,
976
+ 64
977
+ ]
978
+ },
979
+ {
980
+ "dtype": "int64",
981
+ "fill": "zeros",
982
+ "index": 50,
983
+ "input_name": "state_50",
984
+ "key": "end_offset",
985
+ "module": "encoder_transformer.transformer.layers.0.self_attn",
986
+ "output_name": "out_state_50",
987
+ "path": "encoder_transformer.transformer.layers.0.self_attn/end_offset",
988
+ "shape": [
989
+ 1
990
+ ]
991
+ },
992
+ {
993
+ "dtype": "int64",
994
+ "fill": "zeros",
995
+ "index": 51,
996
+ "input_name": "state_51",
997
+ "key": "offset",
998
+ "module": "encoder_transformer.transformer.layers.0.self_attn",
999
+ "output_name": "out_state_51",
1000
+ "path": "encoder_transformer.transformer.layers.0.self_attn/offset",
1001
+ "shape": [
1002
+ 1
1003
+ ]
1004
+ },
1005
+ {
1006
+ "dtype": "float32",
1007
+ "fill": "zeros",
1008
+ "index": 52,
1009
+ "input_name": "state_52",
1010
+ "key": "cache",
1011
+ "module": "encoder_transformer.transformer.layers.1.self_attn",
1012
+ "output_name": "out_state_52",
1013
+ "path": "encoder_transformer.transformer.layers.1.self_attn/cache",
1014
+ "shape": [
1015
+ 2,
1016
+ 1,
1017
+ 8,
1018
+ 1000,
1019
+ 64
1020
+ ]
1021
+ },
1022
+ {
1023
+ "dtype": "int64",
1024
+ "fill": "zeros",
1025
+ "index": 53,
1026
+ "input_name": "state_53",
1027
+ "key": "end_offset",
1028
+ "module": "encoder_transformer.transformer.layers.1.self_attn",
1029
+ "output_name": "out_state_53",
1030
+ "path": "encoder_transformer.transformer.layers.1.self_attn/end_offset",
1031
+ "shape": [
1032
+ 1
1033
+ ]
1034
+ },
1035
+ {
1036
+ "dtype": "int64",
1037
+ "fill": "zeros",
1038
+ "index": 54,
1039
+ "input_name": "state_54",
1040
+ "key": "offset",
1041
+ "module": "encoder_transformer.transformer.layers.1.self_attn",
1042
+ "output_name": "out_state_54",
1043
+ "path": "encoder_transformer.transformer.layers.1.self_attn/offset",
1044
+ "shape": [
1045
+ 1
1046
+ ]
1047
+ },
1048
+ {
1049
+ "dtype": "float32",
1050
+ "fill": "zeros",
1051
+ "index": 55,
1052
+ "input_name": "state_55",
1053
+ "key": "partial",
1054
+ "module": "upsample.convtr",
1055
+ "output_name": "out_state_55",
1056
+ "path": "upsample.convtr/partial",
1057
+ "shape": [
1058
+ 1,
1059
+ 512,
1060
+ 16
1061
+ ]
1062
+ }
1063
+ ],
1064
+ "model_recommended_frames_after_eos": null,
1065
+ "pad_with_spaces_for_short_inputs": false,
1066
+ "predefined_voices": [
1067
+ "gaurav"
1068
+ ],
1069
+ "remove_semicolons": false,
1070
+ "sample_rate": 24000,
1071
+ "samples_per_frame": 1920,
1072
+ "schema_version": 2,
1073
+ "tokenizer_file": "tokenizer.model"
1074
+ }
onnx/english_2026-04/flow_lm_flow_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dd781ee5abee9e195320bf0106bebd6372a852b3b36352524ee78b40554635d
3
+ size 9962530
onnx/english_2026-04/flow_lm_main_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9bd8106b79a0192c1c43399ab938fb24900a95c1c599870d75a884e99000116
3
+ size 76341079
onnx/english_2026-04/mimi_decoder_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3630450a3297a101792a6ac66619ebc70ab916b265e6220c2afaef8b1673f925
3
+ size 22684077
onnx/english_2026-04/text_conditioner_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24c0642bff11a4e1435c004d0c2aa6c68e093fadfa35f0f0dba849ac67f25ac3
3
+ size 16388384
onnx/english_2026-04/tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d461765ae179566678c93091c5fa6f2984c31bbe990bf1aa62d92c64d91bc3f6
3
+ size 59339
onnx/english_2026-04/voices.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4cbd37676d63f0c1ba80ead7b81711e1a9a516f0b85b2ff4c957b4864396801b
3
+ size 12337885