docs: restore HF model card metadata
Browse files
README.md
CHANGED
|
@@ -1,10 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# FlowHigh.AXERA
|
| 2 |
|
| 3 |
**8/16 kHz 语音 → 48 kHz 超分 · AX650 NPU3 · Python RTF 0.24（20–60 s 音频）· 2 个 axmodel 共 58 MB · 不做降噪**
|
| 4 |
|
| 5 |
-
  [![
|
| 6 |
|
| 7 |
-
- HuggingFace: https://huggingface.co/HY-2012/FlowHigh.AXERA
|
| 8 |
- GitHub: https://github.com/ZY-2012/FlowHigh.AXERA
|
| 9 |
- 上游: https://github.com/jjunak-yun/FLowHigh_code
|
| 10 |
|
|
@@ -13,7 +31,6 @@
|
|
| 13 |
- 快速开始
|
| 14 |
- 结果
|
| 15 |
- 推理速度
|
| 16 |
-
- 模型转换
|
| 17 |
- 数据来源
|
| 18 |
- License
|
| 19 |
|
|
@@ -39,25 +56,25 @@ bash run_ax650.sh samples/listen/8k/OSR_us_000_0010_input_8k.wav output.wav
|
|
| 39 |
|
| 40 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 41 |
|---|---|---|
|
| 42 |
-
| 8k |
|
| 43 |
|
| 44 |
**OSR_us_000_0013**
|
| 45 |
|
| 46 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 47 |
|---|---|---|
|
| 48 |
-
| 8k |
|
| 49 |
|
| 50 |
**OSR_us_000_0057**
|
| 51 |
|
| 52 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 53 |
|---|---|---|
|
| 54 |
-
| 8k |
|
| 55 |
|
| 56 |
**OSR_us_000_0059**
|
| 57 |
|
| 58 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 59 |
|---|---|---|
|
| 60 |
-
| 8k |
|
| 61 |
|
| 62 |
#### Chinese
|
| 63 |
|
|
@@ -65,25 +82,25 @@ bash run_ax650.sh samples/listen/8k/OSR_us_000_0010_input_8k.wav output.wav
|
|
| 65 |
|
| 66 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 67 |
|---|---|---|
|
| 68 |
-
| 8k |
|
| 69 |
|
| 70 |
**OSR_cn_000_0073**
|
| 71 |
|
| 72 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 73 |
|---|---|---|
|
| 74 |
-
| 8k |
|
| 75 |
|
| 76 |
**OSR_cn_000_0074**
|
| 77 |
|
| 78 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 79 |
|---|---|---|
|
| 80 |
-
| 8k |
|
| 81 |
|
| 82 |
**OSR_cn_000_0075**
|
| 83 |
|
| 84 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 85 |
|---|---|---|
|
| 86 |
-
| 8k |
|
| 87 |
|
| 88 |
#### Samplelib（1 分钟，频谱图为前 10 s）
|
| 89 |
|
|
@@ -91,7 +108,7 @@ bash run_ax650.sh samples/listen/8k/OSR_us_000_0010_input_8k.wav output.wav
|
|
| 91 |
|
| 92 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 93 |
|---|---|---|
|
| 94 |
-
| 8k |
|
| 95 |
|
| 96 |
### 16 kHz 参照（人声）
|
| 97 |
|
|
@@ -101,15 +118,15 @@ bash run_ax650.sh samples/listen/8k/OSR_us_000_0010_input_8k.wav output.wav
|
|
| 101 |
|
| 102 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 103 |
|---|---|---|
|
| 104 |
-
| 8k |
|
| 105 |
-
| 16k |
|
| 106 |
|
| 107 |
**speech_3**
|
| 108 |
|
| 109 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 110 |
|---|---|---|
|
| 111 |
-
| 8k |
|
| 112 |
-
| 16k |
|
| 113 |
|
| 114 |
## 推理速度：RTF
|
| 115 |
|
|
@@ -119,19 +136,6 @@ bash run_ax650.sh samples/listen/8k/OSR_us_000_0010_input_8k.wav output.wav
|
|
| 119 |
|
| 120 |
20–60 s 音频，1-step flow，BigVGAN 1 s 分块、0.2 s overlap。5 s 短音频因分块/启动开销会略高；C++ 运行时尚未提供。
|
| 121 |
|
| 122 |
-
## 模型转换
|
| 123 |
-
|
| 124 |
-
```bash
|
| 125 |
-
python model_convert/export_flowhigh.py --frames 500 --skip-vocoder --out-dir models
|
| 126 |
-
python model_convert/export_flowhigh.py --frames 100 --skip-flow --out-dir models
|
| 127 |
-
python model_convert/make_calib.py --out-dir build/calib --clips 50
|
| 128 |
-
python model_convert/prepare_compile.py
|
| 129 |
-
PULSAR2_IMAGE=docker-registry.aitsw.axera-tech.com/pulsar2:8.0 \
|
| 130 |
-
bash model_convert/compile.sh flowhigh_nct bigvgan_T100
|
| 131 |
-
```
|
| 132 |
-
|
| 133 |
-
Flow NPU 输入为 `[1,256,500]`（channel-first），图内转置到 `[1,500,256]`；BigVGAN 按 1 s 编译，运行时 overlap 交叉淡化。详见 `model_convert/README.md`。
|
| 134 |
-
|
| 135 |
## 数据来源
|
| 136 |
|
| 137 |
- Open Speech Repository（English / Chinese 8k）：http://voiptroubleshooter.com/open_speech/index.html
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: axera
|
| 3 |
+
pipeline_tag: audio-to-audio
|
| 4 |
+
base_model: kiriyamaX/FLowHigh_indep_adaptive_400k
|
| 5 |
+
language:
|
| 6 |
+
- en
|
| 7 |
+
- zh
|
| 8 |
+
tags:
|
| 9 |
+
- axera
|
| 10 |
+
- ax650
|
| 11 |
+
- npu3
|
| 12 |
+
- flowhigh
|
| 13 |
+
- speech-super-resolution
|
| 14 |
+
- audio-super-resolution
|
| 15 |
+
- bandwidth-extension
|
| 16 |
+
- real-time
|
| 17 |
+
- python
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
# FlowHigh.AXERA
|
| 21 |
|
| 22 |
**8/16 kHz 语音 → 48 kHz 超分 · AX650 NPU3 · Python RTF 0.24（20–60 s 音频）· 2 个 axmodel 共 58 MB · 不做降噪**
|
| 23 |
|
| 24 |
+
  [](https://github.com/ZY-2012/FlowHigh.AXERA)
|
| 25 |
|
|
|
|
| 26 |
- GitHub: https://github.com/ZY-2012/FlowHigh.AXERA
|
| 27 |
- 上游: https://github.com/jjunak-yun/FLowHigh_code
|
| 28 |
|
|
|
|
| 31 |
- 快速开始
|
| 32 |
- 结果
|
| 33 |
- 推理速度
|
|
|
|
| 34 |
- 数据来源
|
| 35 |
- License
|
| 36 |
|
|
|
|
| 56 |
|
| 57 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 58 |
|---|---|---|
|
| 59 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0010_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0010_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0010_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0010_output_48k_spec.png" width="360"> |
|
| 60 |
|
| 61 |
**OSR_us_000_0013**
|
| 62 |
|
| 63 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 64 |
|---|---|---|
|
| 65 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0013_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0013_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0013_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0013_output_48k_spec.png" width="360"> |
|
| 66 |
|
| 67 |
**OSR_us_000_0057**
|
| 68 |
|
| 69 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 70 |
|---|---|---|
|
| 71 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0057_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0057_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0057_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0057_output_48k_spec.png" width="360"> |
|
| 72 |
|
| 73 |
**OSR_us_000_0059**
|
| 74 |
|
| 75 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 76 |
|---|---|---|
|
| 77 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_us_000_0059_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0059_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_us_000_0059_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_us_000_0059_output_48k_spec.png" width="360"> |
|
| 78 |
|
| 79 |
#### Chinese
|
| 80 |
|
|
|
|
| 82 |
|
| 83 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 84 |
|---|---|---|
|
| 85 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0072_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0072_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0072_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0072_output_48k_spec.png" width="360"> |
|
| 86 |
|
| 87 |
**OSR_cn_000_0073**
|
| 88 |
|
| 89 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 90 |
|---|---|---|
|
| 91 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0073_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0073_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0073_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0073_output_48k_spec.png" width="360"> |
|
| 92 |
|
| 93 |
**OSR_cn_000_0074**
|
| 94 |
|
| 95 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 96 |
|---|---|---|
|
| 97 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0074_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0074_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0074_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0074_output_48k_spec.png" width="360"> |
|
| 98 |
|
| 99 |
**OSR_cn_000_0075**
|
| 100 |
|
| 101 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 102 |
|---|---|---|
|
| 103 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/OSR_cn_000_0075_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0075_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/OSR_cn_000_0075_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/OSR_cn_000_0075_output_48k_spec.png" width="360"> |
|
| 104 |
|
| 105 |
#### Samplelib（1 分钟，频谱图为前 10 s）
|
| 106 |
|
|
|
|
| 108 |
|
| 109 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 110 |
|---|---|---|
|
| 111 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/samplelib_speech_1m_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/samplelib_speech_1m_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/samplelib_speech_1m_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/samplelib_speech_1m_output_48k_spec.png" width="360"> |
|
| 112 |
|
| 113 |
### 16 kHz 参照（人声）
|
| 114 |
|
|
|
|
| 118 |
|
| 119 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 120 |
|---|---|---|
|
| 121 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/speech_2_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/speech_2_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_output_8k_48k_spec.png" width="360"> |
|
| 122 |
+
| 16k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/16k/speech_2_input_16k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_input_16k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from16k/speech_2_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_2_output_16k_48k_spec.png" width="360"> |
|
| 123 |
|
| 124 |
**speech_3**
|
| 125 |
|
| 126 |
| 版本 | 输入 | FlowHigh 输出 |
|
| 127 |
|---|---|---|
|
| 128 |
+
| 8k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/8k/speech_3_input_8k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_input_8k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from8k/speech_3_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_output_8k_48k_spec.png" width="360"> |
|
| 129 |
+
| 16k | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/16k/speech_3_input_16k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_input_16k_spec.png" width="360"> | <audio controls style="width:220px" src="https://huggingface.co/HY-2012/FlowHigh.AXERA/resolve/main/samples/listen/48k_from16k/speech_3_output_48k.wav"></audio><br><img src="samples/listen/spectrograms/speech_3_output_16k_48k_spec.png" width="360"> |
|
| 130 |
|
| 131 |
## 推理速度：RTF
|
| 132 |
|
|
|
|
| 136 |
|
| 137 |
20–60 s 音频，1-step flow，BigVGAN 1 s 分块、0.2 s overlap。5 s 短音频因分块/启动开销会略高；C++ 运行时尚未提供。
|
| 138 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 139 |
## 数据来源
|
| 140 |
|
| 141 |
- Open Speech Repository（English / Chinese 8k）：http://voiptroubleshooter.com/open_speech/index.html
|