Retrieve0 commited on
Commit
d8b3309
·
verified ·
1 Parent(s): 777f600

Remove INT8 encoder files

Browse files
README.md CHANGED
@@ -9,7 +9,6 @@ tags:
9
  - onnx
10
  - bf16
11
  - fp16
12
- - int8
13
  ---
14
 
15
  <p align="center">
@@ -29,13 +28,12 @@ ONNX exports of the audio encoder from [Qwen/Qwen3-ASR-1.7B-hf](https://huggingf
29
  | --- | --- | --- |
30
  | BF16 | `encoder-window.bf16.onnx`, `encoder-window.bf16.onnx.data` | Reference export for GPUs with BF16 support |
31
  | FP16 | `encoder-window.fp16.onnx`, `encoder-window.fp16.onnx.data` | Compatibility export for older NVIDIA GPUs |
32
- | INT8 Q/DQ | `encoder-window.int8.onnx`, `encoder-window.int8.onnx_data` | Calibrated quantized export |
33
 
34
  TensorRT `.engine` files are not included because they depend on the target GPU architecture and TensorRT build environment. Build an engine locally with this project.
35
 
36
  ### Precision and calibration
37
 
38
- BF16 is the project reference precision. FP16 supports NVIDIA GPUs without BF16. INT8 applies symmetric Q/DQ quantization to Conv and MatMul operations; remaining operations use floating-point precision. Calibration used 32 audio files and produced 52 encoder windows.
39
 
40
  ### Requirements
41
 
@@ -53,8 +51,6 @@ uv sync --extra quantization
53
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
54
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
55
 
56
- uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf quantize-encoder .\calibration-audio --max-audio-files 32
57
- uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision int8
58
  ```
59
 
60
  ### License and citation
@@ -71,13 +67,12 @@ This export is derived from `Qwen/Qwen3-ASR-1.7B-hf` and is published under Apac
71
  | --- | --- | --- |
72
  | BF16 | `encoder-window.bf16.onnx`、`encoder-window.bf16.onnx.data` | 支持 BF16 的 GPU 上的基准导出 |
73
  | FP16 | `encoder-window.fp16.onnx`、`encoder-window.fp16.onnx.data` | 兼容不支持 BF16 的较旧 NVIDIA GPU |
74
- | INT8 Q/DQ | `encoder-window.int8.onnx`、`encoder-window.int8.onnx_data` | 经校准的量化导出 |
75
 
76
  本仓库不提供 TensorRT `.engine` 文件,因为它们依赖目标 GPU 架构和 TensorRT 构建环境。请在目标设备上使用本项目构建 engine。
77
 
78
  ### 精度与校准
79
 
80
- BF16 是本项目的基准精度。FP16 用于不支持 BF16 的 NVIDIA GPU。INT8 对 Conv 和 MatMul 运算应用对称 Q/DQ 量化,其余运算保留浮点精度。校准使用了 32 个音频文件,生成 52 个 encoder window。
81
 
82
  ### 运行要求
83
 
@@ -95,8 +90,6 @@ uv sync --extra quantization
95
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
96
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
97
 
98
- uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf quantize-encoder .\calibration-audio --max-audio-files 32
99
- uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision int8
100
  ```
101
 
102
  ### 许可证与引用
 
9
  - onnx
10
  - bf16
11
  - fp16
 
12
  ---
13
 
14
  <p align="center">
 
28
  | --- | --- | --- |
29
  | BF16 | `encoder-window.bf16.onnx`, `encoder-window.bf16.onnx.data` | Reference export for GPUs with BF16 support |
30
  | FP16 | `encoder-window.fp16.onnx`, `encoder-window.fp16.onnx.data` | Compatibility export for older NVIDIA GPUs |
 
31
 
32
  TensorRT `.engine` files are not included because they depend on the target GPU architecture and TensorRT build environment. Build an engine locally with this project.
33
 
34
  ### Precision and calibration
35
 
36
+ BF16 is the project reference precision. FP16 supports NVIDIA GPUs without BF16. This repository publishes the BF16 and FP16 encoder exports.
37
 
38
  ### Requirements
39
 
 
51
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
52
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
53
 
 
 
54
  ```
55
 
56
  ### License and citation
 
67
  | --- | --- | --- |
68
  | BF16 | `encoder-window.bf16.onnx`、`encoder-window.bf16.onnx.data` | 支持 BF16 的 GPU 上的基准导出 |
69
  | FP16 | `encoder-window.fp16.onnx`、`encoder-window.fp16.onnx.data` | 兼容不支持 BF16 的较旧 NVIDIA GPU |
 
70
 
71
  本仓库不提供 TensorRT `.engine` 文件,因为它们依赖目标 GPU 架构和 TensorRT 构建环境。请在目标设备上使用本项目构建 engine。
72
 
73
  ### 精度与校准
74
 
75
+ BF16 是本项目的基准精度,FP16 用于不支持 BF16 的 NVIDIA GPU。本仓库发布 BF16 和 FP16 encoder 导出文件。
76
 
77
  ### 运行要求
78
 
 
90
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
91
  uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
92
 
 
 
93
  ```
94
 
95
  ### 许可证与引用
encoder-window.int8.onnx DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:6cc2b80f21dd5036919e8a67abc4d90452500f17eaa24f74e530c248b225f585
3
- size 1893394
 
 
 
 
encoder-window.int8.onnx_data DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c92889d879e992d617a5c1070bf206fb08acf96c056c62657a6a094ed95aaef
3
- size 634978752