|
Download reports/precision_analysis.md from HY-2012/FastWave.AXERA: direct link, hf CLI and curl.
- Browser
- Download file 897 Bytes
-
https://huggingface.co/HY-2012/FastWave.AXERA/resolve/main/reports/precision_analysis.md
- Command line
-
hf download hf://HY-2012/FastWave.AXERA/reports/precision_analysis.md
-
curl -L -o precision_analysis.md https://huggingface.co/HY-2012/FastWave.AXERA/resolve/main/reports/precision_analysis.md
897 Bytes
量化精度分析(Pulsar2 EndToEnd,量化工件内)
配置:U16 激活 / S8 权重 / U16 输出,MinMax,64 个真实样本,compiler.check=2。
- 统计算子数:2245
- 输出
ycosine(量化 vs 浮点):0.99982(MSE 0.00000) - 逐算子 cosine:min 0.90369,mean 0.99962
| cosine 区间 | 算子数 |
|---|---|
| >=0.999 | 2196 |
| <0.999 | 35 |
| <0.99 | 12 |
| <0.95 | 2 |
最差 6 个算子(FFT 的 twiddle/矩阵乘,位于 STFT 分支内部,量级很小):
| 算子 | 类型 | 输出 shape | dtype | cosine |
|---|---|---|---|---|
| /resid… | AxMul | /residu… | FP32 | 0.90369 |
| /resid… | AxMul | /residu… | FP32 | 0.94242 |
| /resid… | AxMul | /residu… | FP32 | 0.95310 |
| /resid… | AxMul | /residu… | FP32 | 0.95744 |
| /resid… | AxMul | /residu… | FP32 | 0.97668 |
| /resid… | AxMul | /residu… | FP32 | 0.98177 |