Instructions to use Retrieve0/Qwen3-ASR-1.7B-TensorRT-Encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- TensorRT
How to use Retrieve0/Qwen3-ASR-1.7B-TensorRT-Encoder with TensorRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Remove INT8 encoder files
Browse files- README.md +2 -9
- encoder-window.int8.onnx +0 -3
- encoder-window.int8.onnx_data +0 -3
README.md
CHANGED
|
@@ -9,7 +9,6 @@ tags:
|
|
| 9 |
- onnx
|
| 10 |
- bf16
|
| 11 |
- fp16
|
| 12 |
-
- int8
|
| 13 |
---
|
| 14 |
|
| 15 |
<p align="center">
|
|
@@ -29,13 +28,12 @@ ONNX exports of the audio encoder from [Qwen/Qwen3-ASR-1.7B-hf](https://huggingf
|
|
| 29 |
| --- | --- | --- |
|
| 30 |
| BF16 | `encoder-window.bf16.onnx`, `encoder-window.bf16.onnx.data` | Reference export for GPUs with BF16 support |
|
| 31 |
| FP16 | `encoder-window.fp16.onnx`, `encoder-window.fp16.onnx.data` | Compatibility export for older NVIDIA GPUs |
|
| 32 |
-
| INT8 Q/DQ | `encoder-window.int8.onnx`, `encoder-window.int8.onnx_data` | Calibrated quantized export |
|
| 33 |
|
| 34 |
TensorRT `.engine` files are not included because they depend on the target GPU architecture and TensorRT build environment. Build an engine locally with this project.
|
| 35 |
|
| 36 |
### Precision and calibration
|
| 37 |
|
| 38 |
-
BF16 is the project reference precision. FP16 supports NVIDIA GPUs without BF16.
|
| 39 |
|
| 40 |
### Requirements
|
| 41 |
|
|
@@ -53,8 +51,6 @@ uv sync --extra quantization
|
|
| 53 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
|
| 54 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
|
| 55 |
|
| 56 |
-
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf quantize-encoder .\calibration-audio --max-audio-files 32
|
| 57 |
-
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision int8
|
| 58 |
```
|
| 59 |
|
| 60 |
### License and citation
|
|
@@ -71,13 +67,12 @@ This export is derived from `Qwen/Qwen3-ASR-1.7B-hf` and is published under Apac
|
|
| 71 |
| --- | --- | --- |
|
| 72 |
| BF16 | `encoder-window.bf16.onnx`、`encoder-window.bf16.onnx.data` | 支持 BF16 的 GPU 上的基准导出 |
|
| 73 |
| FP16 | `encoder-window.fp16.onnx`、`encoder-window.fp16.onnx.data` | 兼容不支持 BF16 的较旧 NVIDIA GPU |
|
| 74 |
-
| INT8 Q/DQ | `encoder-window.int8.onnx`、`encoder-window.int8.onnx_data` | 经校准的量化导出 |
|
| 75 |
|
| 76 |
本仓库不提供 TensorRT `.engine` 文件,因为它们依赖目标 GPU 架构和 TensorRT 构建环境。请在目标设备上使用本项目构建 engine。
|
| 77 |
|
| 78 |
### 精度与校准
|
| 79 |
|
| 80 |
-
BF16 是本项目的基准精度
|
| 81 |
|
| 82 |
### 运行要求
|
| 83 |
|
|
@@ -95,8 +90,6 @@ uv sync --extra quantization
|
|
| 95 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
|
| 96 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
|
| 97 |
|
| 98 |
-
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf quantize-encoder .\calibration-audio --max-audio-files 32
|
| 99 |
-
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision int8
|
| 100 |
```
|
| 101 |
|
| 102 |
### 许可证与引用
|
|
|
|
| 9 |
- onnx
|
| 10 |
- bf16
|
| 11 |
- fp16
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
<p align="center">
|
|
|
|
| 28 |
| --- | --- | --- |
|
| 29 |
| BF16 | `encoder-window.bf16.onnx`, `encoder-window.bf16.onnx.data` | Reference export for GPUs with BF16 support |
|
| 30 |
| FP16 | `encoder-window.fp16.onnx`, `encoder-window.fp16.onnx.data` | Compatibility export for older NVIDIA GPUs |
|
|
|
|
| 31 |
|
| 32 |
TensorRT `.engine` files are not included because they depend on the target GPU architecture and TensorRT build environment. Build an engine locally with this project.
|
| 33 |
|
| 34 |
### Precision and calibration
|
| 35 |
|
| 36 |
+
BF16 is the project reference precision. FP16 supports NVIDIA GPUs without BF16. This repository publishes the BF16 and FP16 encoder exports.
|
| 37 |
|
| 38 |
### Requirements
|
| 39 |
|
|
|
|
| 51 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
|
| 52 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
|
| 53 |
|
|
|
|
|
|
|
| 54 |
```
|
| 55 |
|
| 56 |
### License and citation
|
|
|
|
| 67 |
| --- | --- | --- |
|
| 68 |
| BF16 | `encoder-window.bf16.onnx`、`encoder-window.bf16.onnx.data` | 支持 BF16 的 GPU 上的基准导出 |
|
| 69 |
| FP16 | `encoder-window.fp16.onnx`、`encoder-window.fp16.onnx.data` | 兼容不支持 BF16 的较旧 NVIDIA GPU |
|
|
|
|
| 70 |
|
| 71 |
本仓库不提供 TensorRT `.engine` 文件,因为它们依赖目标 GPU 架构和 TensorRT 构建环境。请在目标设备上使用本项目构建 engine。
|
| 72 |
|
| 73 |
### 精度与校准
|
| 74 |
|
| 75 |
+
BF16 是本项目的基准精度,FP16 用于不支持 BF16 的 NVIDIA GPU。本仓库发布 BF16 和 FP16 encoder 导出文件。
|
| 76 |
|
| 77 |
### 运行要求
|
| 78 |
|
|
|
|
| 90 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision bf16
|
| 91 |
uv run qwen3-asr --model Qwen/Qwen3-ASR-1.7B-hf build --encoder-precision fp16
|
| 92 |
|
|
|
|
|
|
|
| 93 |
```
|
| 94 |
|
| 95 |
### 许可证与引用
|
encoder-window.int8.onnx
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:6cc2b80f21dd5036919e8a67abc4d90452500f17eaa24f74e530c248b225f585
|
| 3 |
-
size 1893394
|
|
|
|
|
|
|
|
|
|
|
|
encoder-window.int8.onnx_data
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:6c92889d879e992d617a5c1070bf206fb08acf96c056c62657a6a094ed95aaef
|
| 3 |
-
size 634978752
|
|
|
|
|
|
|
|
|
|
|
|