inoryQwQ commited on
Commit Β·
6badca1
1
Parent(s): 6e03c95
docs: add inline audio players for samples
Browse files
README.md
CHANGED
|
@@ -8,40 +8,45 @@ tags:
|
|
| 8 |
- ax650
|
| 9 |
- npu
|
| 10 |
- onnx
|
| 11 |
-
datasets:
|
| 12 |
-
- custom
|
| 13 |
pipeline_tag: text-to-speech
|
| 14 |
---
|
| 15 |
|
| 16 |
# Inflect-Micro-v2 for AX650 NPU
|
| 17 |
|
| 18 |
-
High-quality English TTS (VITS architecture) optimized for AX650 NPU3.
|
| 19 |
|
| 20 |
-
- **Encoder+Decoder**: AX650 NPU (
|
| 21 |
-
- **Duration Predictor**: ONNX (onnxruntime)
|
| 22 |
-
- **Embedding**: NumPy lookup
|
| 23 |
-
- **
|
| 24 |
|
| 25 |
-
## Audio Samples
|
| 26 |
|
| 27 |
-
All samples generated on AX650 NPU, 24kHz
|
| 28 |
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
| [en_hello.wav](samples/en_hello.wav) | "Hello and welcome to Inflect Micro V2 text to speech." | 3.6s | 0.05x |
|
| 32 |
-
| [en_weather.wav](samples/en_weather.wav) | "The weather today is sunny with a gentle breeze." | 2.6s | 0.06x |
|
| 33 |
-
| [en_story.wav](samples/en_story.wav) | "Once upon a time, there lived a curious robot who loved to sing." | 3.9s | 0.05x |
|
| 34 |
-
| [en_tech.wav](samples/en_tech.wav) | "Neural voice synthesis is the next frontier of artificial intelligence." | 4.1s | 0.04x |
|
| 35 |
-
| [en_intro.wav](samples/en_intro.wav) | "This audio was generated entirely on the AX650 NPU chip." | 4.7s | 0.04x |
|
| 36 |
|
| 37 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 38 |
|
| 39 |
```bash
|
| 40 |
bash setup.sh
|
| 41 |
bash run.sh "Hello world." output.wav
|
| 42 |
```
|
| 43 |
|
| 44 |
-
## API
|
| 45 |
|
| 46 |
```bash
|
| 47 |
# CLI
|
|
@@ -51,8 +56,10 @@ python -m inflect_tts_sdk --text "Hello" --output out.wav
|
|
| 51 |
python -m inflect_tts_sdk.server --port 8000
|
| 52 |
```
|
| 53 |
|
| 54 |
-
## File Structure
|
| 55 |
|
| 56 |
-
- `models/` β
|
| 57 |
-
- `python/inflect_tts_sdk/` β Python SDK
|
|
|
|
| 58 |
- `samples/` β audio samples
|
|
|
|
|
|
| 8 |
- ax650
|
| 9 |
- npu
|
| 10 |
- onnx
|
|
|
|
|
|
|
| 11 |
pipeline_tag: text-to-speech
|
| 12 |
---
|
| 13 |
|
| 14 |
# Inflect-Micro-v2 for AX650 NPU
|
| 15 |
|
| 16 |
+
High-quality English TTS (VITS architecture) optimized for **AX650 NPU3**, running entirely on-chip with zero PyTorch dependency at inference time.
|
| 17 |
|
| 18 |
+
- **Encoder + Decoder**: AX650 NPU (AXMODEL, U16 precision)
|
| 19 |
+
- **Duration Predictor**: ONNX Runtime (onnxruntime)
|
| 20 |
+
- **Embedding**: NumPy lookup
|
| 21 |
+
- **Real-time Factor**: ~0.05x (20Γ faster than real-time)
|
| 22 |
|
| 23 |
+
## π§ Audio Samples
|
| 24 |
|
| 25 |
+
*All samples generated on AX650 NPU, 24kHz.*
|
| 26 |
|
| 27 |
+
**"Hello and welcome to Inflect Micro V2 text to speech."** (3.6s, RTF 0.05x)
|
| 28 |
+
<audio controls src="https://huggingface.co/AXERA-TECH/inflect_micro_v2/resolve/main/samples/en_hello.wav"></audio>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
+
**"The weather today is sunny with a gentle breeze."** (2.6s, RTF 0.06x)
|
| 31 |
+
<audio controls src="https://huggingface.co/AXERA-TECH/inflect_micro_v2/resolve/main/samples/en_weather.wav"></audio>
|
| 32 |
+
|
| 33 |
+
**"Once upon a time, there lived a curious robot who loved to sing."** (3.9s, RTF 0.05x)
|
| 34 |
+
<audio controls src="https://huggingface.co/AXERA-TECH/inflect_micro_v2/resolve/main/samples/en_story.wav"></audio>
|
| 35 |
+
|
| 36 |
+
**"Neural voice synthesis is the next frontier of artificial intelligence."** (4.1s, RTF 0.04x)
|
| 37 |
+
<audio controls src="https://huggingface.co/AXERA-TECH/inflect_micro_v2/resolve/main/samples/en_tech.wav"></audio>
|
| 38 |
+
|
| 39 |
+
**"This audio was generated entirely on the AX650 NPU chip."** (4.7s, RTF 0.04x)
|
| 40 |
+
<audio controls src="https://huggingface.co/AXERA-TECH/inflect_micro_v2/resolve/main/samples/en_intro.wav"></audio>
|
| 41 |
+
|
| 42 |
+
## π Quick Start
|
| 43 |
|
| 44 |
```bash
|
| 45 |
bash setup.sh
|
| 46 |
bash run.sh "Hello world." output.wav
|
| 47 |
```
|
| 48 |
|
| 49 |
+
## π‘ API
|
| 50 |
|
| 51 |
```bash
|
| 52 |
# CLI
|
|
|
|
| 56 |
python -m inflect_tts_sdk.server --port 8000
|
| 57 |
```
|
| 58 |
|
| 59 |
+
## π File Structure
|
| 60 |
|
| 61 |
+
- `models/` β AXMODEL, dp.onnx, emb.npy
|
| 62 |
+
- `python/inflect_tts_sdk/` β Python SDK (CLI + OpenAI Server)
|
| 63 |
+
- `cpp/inflect_tts_sdk/` β C++ SDK (CLI + Server)
|
| 64 |
- `samples/` β audio samples
|
| 65 |
+
|