zipvoice / README.md
BreezeWu's picture
add ascend_310b deployment (README.md)
702150c verified
|
Raw History Blame Contribute Delete
2.52 kB
---
license: apache-2.0
pipeline_tag: text-to-speech
tags:
- zipvoice
- tts
- speech-synthesis
- robotics
- IB-Robot
- ascend
- onnx
- edge-deployment
---
# Model Card for ZipVoice-Distill (IB-Robot)
ZipVoice-Distill text-to-speech (flow-matching decoder + Vocos vocoder)
packaged for the [IB-Robot](https://atomgit.com/openeuler/IB_Robot) framework
with two deployments sharing one contract.
## Deployments
| deployment | backend | artifacts | notes |
|---|---|---|---|
| `ascend_310p` | Ascend ACL (Ascend310P1) | text_encoder + flow_decoder OM | fixed buckets (t256 / f1537), CFG-distilled 4-step |
| `ascend_310b` | Ascend ACL (Ascend310B1) | text_encoder + flow_decoder OM (`*_310b_origin.om`) | 310B board-side synthesis |
| `ubuntu_onnx` | ONNX Runtime CPU (torch profile) | dynamic-shape ONNX pair | host-side synthesis, 8-step default |
Shared contract: `tensor_model/zipvoice/synthesize`
(`tts.text/prompt_audio/prompt_sample_rate/prompt_text -> tts.audio`),
preprocessing `emilia-zh-cn2an-jieba-pypinyin-fixed-golden-prompt-v1`, output
`mono-float32-pcm-24000hz-vocos-cpu`.
## Provenance note
- ONNX weights re-exported from the official k2-fsa/ZipVoice ModelScope
release (`zipvoice_distill`), sha256 pinned in the manifest artifacts.
- The 310P OM pair was converted from the same model with fixed shapes
(`text_capacity=256`, `flow_frames=1537`, original logical revision
`zipvoice-distill-310p1-bucket-2026-08-03`).
- Shared assets (`tokens.txt`, `vocos/pytorch_model.bin`,
`prompts/default.npz`) are byte-identical across both deployments.
- Inference hyperparameters differ by design: 310P uses 4 diffusion steps,
the host ONNX path defaults to 8 (see `assets/zipvoice_310p.json` vs
`assets/zipvoice_onnx.json`).
## Repository Structure
- `inference_manifest.json` β€” deployment routing (schema v3, iterative request contract)
- `assets/zipvoice_310p.json` / `assets/zipvoice_onnx.json` β€” per-deployment runtime config
- `assets/tokens.txt`, `assets/vocos/`, `assets/prompts/` β€” shared assets
- `artifacts/ascend/ascend_310p/*.om` β€” compiled fixed-shape modules (310P)
- `artifacts/ascend_310b/*.om` β€” compiled fixed-shape modules (310B)
- `artifacts/onnx/*.onnx` β€” dynamic-shape ONNX exports
## Usage
Host: `voice_tts_service` with `bundle_path: models/zipvoice`,
`deployment: ubuntu_onnx`. Board: select `ascend_310p` through the unified
inference runtime.
## License
Code and packaging: Apache-2.0. ZipVoice model weights follow the k2-fsa/ZipVoice
upstream license.