|
Download reports/performance.md from AXERA-TECH/LavaSR.AXERA: direct link, hf CLI and curl.
- Browser
- Download file 3.84 kB
-
https://huggingface.co/AXERA-TECH/LavaSR.AXERA/resolve/main/reports/performance.md
- Command line
-
hf download hf://AXERA-TECH/LavaSR.AXERA/reports/performance.md
-
curl -L -o performance.md https://huggingface.co/AXERA-TECH/LavaSR.AXERA/resolve/main/reports/performance.md
3.84 kB
| # LavaSR v2 AX650 performance | |
| Board: AX650N, NPU3, BSP `V3.10.2_20260323224507`, AX Engine `2.12.0s`. | |
| `RTF = total enhance() wall time / input audio duration`; lower is better. | |
| No NPU simulation was used; all numbers are from the board. | |
| ## Models | |
| | axmodel | size | NPU latency | | |
| |---|---:|---:| | |
| | `den_encoder.axmodel` | 11.32 MB | ~17.7 ms / 4.8 s chunk | | |
| | `den_decoder.axmodel` | 11.80 MB | ~16.4 ms / 4.8 s chunk | | |
| | `enhancer.axmodel` | 15.07 MB | ~5.7 ms / 4.8 s chunk | | |
| | **total** | **38.2 MB** | | | |
| NPU latency is per 4.8 s chunk, measured by wrapping the three sessions in the | |
| Python SDK. Host DSP (STFT/mel/iSTFT/DPGRNN/LR merge) dominates the wall time. | |
| ## Python SDK | |
| | input | duration | denoise | time | RTF | | |
| |---|---:|---|---:|---:| | |
| | LibriSpeech 16 kHz | 17.75 s | yes | 4.93 s | **0.278** | | |
| | LibriSpeech 16 kHz | 17.75 s | no | 1.82 s | **0.103** | | |
| | LibriSpeech 16 kHz | 30.86 s | yes | 8.73 s | 0.283 | | |
| | LibriSpeech 16 kHz | 30.86 s | no | 3.21 s | 0.104 | | |
| | LibriSpeech 16 kHz | 3.0 s | yes | 0.95 s | 0.315 | | |
| | LibriSpeech 16 kHz | 3.0 s | no | 0.32 s | 0.108 | | |
| | noisy 48 kHz | 10.0 s | yes | 2.86 s | 0.286 | | |
| | noisy 48 kHz | 10.0 s | no | 1.05 s | 0.105 | | |
| | LibriSpeech 8 kHz | 17.75 s | yes | 4.87 s | 0.274 | | |
| | LibriSpeech 24 kHz | 17.75 s | yes | 5.01 s | 0.283 | | |
| | LibriSpeech 48 kHz | 17.75 s | yes | 5.01 s | 0.282 | | |
| Host breakdown for the 17.75 s / denoise case: denoiser DSP + DPGRNN 3.07 s, | |
| BWE mel/iSTFT 1.35 s, LR merge 0.45 s, resampling 0.10 s; NPU calls 0.24 s total. | |
| ## C++ SDK | |
| `bin/lavasr_ax650` (cross-compiled, AX650 aarch64) uses the same axmodels and | |
| embedded assets: | |
| | input | duration | denoise | time | RTF | | |
| |---|---:|---|---:|---:| | |
| | LibriSpeech 16 kHz | 17.75 s | yes | 1.08 s | **0.061** | | |
| | LibriSpeech 16 kHz | 17.75 s | no | 0.70 s | **0.039** | | |
| C++ host breakdown (8 threads, warmed up): denoiser 0.39 s, BWE mel/iSTFT | |
| 0.31 s, LR merge 0.35 s, resampling 0.04 s. The full-length LR merge FFT is now | |
| the largest single stage. | |
| ### 为什么最初的 C++ 反而比 Python 慢? | |
| NPU 部分两者完全相同且只占 ~0.24 s;RTF 由主机 DSP 决定。最初的 C++ 实现是 | |
| 逐标量循环:`std::exp/cos/sin/abs` 经常走 double 版本、mel 矩阵乘没有 BLAS、 | |
| FFT 使用未优化的 radix-2;而 Python/numpy 的 pocketfft 和 BLAS 都是高度优化 | |
| 的 C/Fortran 实现。因此“C++ 语言更快”并不自动成立。 | |
| 优化过程: | |
| 1. `expf/cosf/sinf/logf` + 直接复数模 + `-O3 -ffast-math`; | |
| 2. KissFFT 替换 mel/iSTFT/LR merge 的 radix-2; | |
| 3. mel 滤波器转置,改善 cache; | |
| 4. OpenMP 并行:mel/iSTFT/STFT/ERB/spec/DPGRNN 按帧或 batch 分工 | |
| (Cortex-A55 8 核),并加 `-mcpu=cortex-a55`。 | |
| 5. AX Engine I/O 改为 `AX_SYS_MemAllocCached` + `CreateHandleV2/RunSyncV2`; | |
| 6. LR merge 使用 5-smooth FFT 长度 874800(而非 1M power-of-two),两个 | |
| forward FFT 并行,mask/mix 并行。 | |
| 优化后 C++ 全链路 RTF **0.061**,约为 Python 0.278 的 4.6 倍速;仅 BWE | |
| RTF **0.039**,约为 Python 0.103 的 2.6 倍速。精度与优化前完全一致。 | |
| ### 为什么最初的 C++ 反而比 Python 慢? | |
| NPU 部分两者完全相同且只占 ~0.24 s;RTF 由主机 DSP 决定。最初的 C++ 实现是 | |
| 逐标量循环:`std::exp/cos/sin/abs` 经常走 double 版本、mel 矩阵乘没有 BLAS、 | |
| FFT 使用未优化的 radix-2;而 Python/numpy 的 pocketfft 和 BLAS 都是高度优化 | |
| 的 C/Fortran 实现。因此“C++ 语言更快”并不自动成立。做完上述优化后 C++ 才 | |
| 真正快于 Python。 | |
| ## Runtime requirements | |
| - Board runtime: AX650 BSP with `ax_engine` / `ax_sys` (tested with 3.10.2). | |
| - Python SDK: `numpy`, `pyaxengine` (`axengine`), optional `soundfile`. | |
| - C++ SDK: prebuilt `bin/lavasr_ax650`; runtime libs in `/soc/lib`. | |
| - No onnxruntime / torch on the board. | |