v0.62.0
Browse filesSee https://github.com/qualcomm/ai-hub-models/releases/v0.62.0 for changelog.
- README.md +24 -21
- release_assets.json +1 -1
README.md
CHANGED
|
@@ -17,7 +17,7 @@ pipeline_tag: text-generation
|
|
| 17 |
Qwen3-VL is a vision-language model from Alibaba Cloud capable of understanding both text and images for multimodal reasoning tasks such as visual question answering and image captioning.
|
| 18 |
|
| 19 |
This is based on the implementation of Qwen3-VL-2B-Instruct found [here](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct).
|
| 20 |
-
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.
|
| 21 |
|
| 22 |
Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
|
| 23 |
|
|
@@ -41,14 +41,14 @@ For more device-specific assets and performance metrics, visit **[Qwen3-VL-2B-In
|
|
| 41 |
|
| 42 |
### Option 2: Export with Custom Configurations
|
| 43 |
|
| 44 |
-
Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.
|
| 45 |
- Custom weights (e.g., fine-tuned checkpoints)
|
| 46 |
- Custom input shapes
|
| 47 |
- Target device and runtime configurations
|
| 48 |
|
| 49 |
This option is ideal if you need to customize the model beyond the default configuration provided here.
|
| 50 |
|
| 51 |
-
See our repository for [Qwen3-VL-2B-Instruct on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.
|
| 52 |
|
| 53 |
## Model Details
|
| 54 |
|
|
@@ -63,33 +63,36 @@ See our repository for [Qwen3-VL-2B-Instruct on GitHub](https://github.com/qualc
|
|
| 63 |
## Performance Summary
|
| 64 |
| Model | Runtime | Precision | Chipset | Context Length | Response Rate (tokens per second) | Time To First Token (range, seconds)
|
| 65 |
|---|---|---|---|---|---|---
|
| 66 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® 8 Elite Mobile | 512 |
|
| 67 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® 8 Elite Mobile | 512 |
|
| 68 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® 8 Elite Mobile | 512 |
|
| 69 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 512 | 62.900994 | 0.1141745 - 0.456698
|
| 70 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 512 | 64.127228 | 0.112751 - 0.451004
|
| 71 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 512 | 23.365032 | 0.07905475 - 0.316219
|
| 72 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 4096 | 30.033638 | 0.23735575 - 7.595384
|
| 73 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 4096 | 26.100461 | 0.23745440625 - 7.598541
|
| 74 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 4096 | 20.902282 | 0.108134125 - 3.460292
|
| 75 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 512 |
|
| 76 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 512 |
|
| 77 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 512 |
|
| 78 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 4096 |
|
| 79 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 4096 | 15.
|
| 80 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 4096 | 11.
|
|
|
|
|
|
|
|
|
|
| 81 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-9075 | 512 | 1.882364 | 1.1826937499999999 - 4.7307749999999995
|
| 82 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-9075 | 512 | 1.878065 | 1.18503875 - 4.740155
|
| 83 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-9075 | 512 | 19.881743 | 0.18957975 - 0.758319
|
| 84 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 512 |
|
| 85 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 512 |
|
| 86 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 512 |
|
| 87 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ Q-8750 | 512 |
|
| 88 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ Q-8750 | 512 |
|
| 89 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ Q-8750 | 512 |
|
| 90 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 4096 |
|
| 91 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 4096 | 15.
|
| 92 |
-
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 4096 | 11.
|
| 93 |
|
| 94 |
## License
|
| 95 |
* The license for the original implementation of Qwen3-VL-2B-Instruct can be found
|
|
|
|
| 17 |
Qwen3-VL is a vision-language model from Alibaba Cloud capable of understanding both text and images for multimodal reasoning tasks such as visual question answering and image captioning.
|
| 18 |
|
| 19 |
This is based on the implementation of Qwen3-VL-2B-Instruct found [here](https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct).
|
| 20 |
+
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/qwen3_vl_2b_instruct) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
|
| 21 |
|
| 22 |
Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
|
| 23 |
|
|
|
|
| 41 |
|
| 42 |
### Option 2: Export with Custom Configurations
|
| 43 |
|
| 44 |
+
Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/qwen3_vl_2b_instruct) Python library to compile and export the model with your own:
|
| 45 |
- Custom weights (e.g., fine-tuned checkpoints)
|
| 46 |
- Custom input shapes
|
| 47 |
- Target device and runtime configurations
|
| 48 |
|
| 49 |
This option is ideal if you need to customize the model beyond the default configuration provided here.
|
| 50 |
|
| 51 |
+
See our repository for [Qwen3-VL-2B-Instruct on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.62.0/src/qai_hub_models/models/qwen3_vl_2b_instruct) for usage instructions.
|
| 52 |
|
| 53 |
## Model Details
|
| 54 |
|
|
|
|
| 63 |
## Performance Summary
|
| 64 |
| Model | Runtime | Precision | Chipset | Context Length | Response Rate (tokens per second) | Time To First Token (range, seconds)
|
| 65 |
|---|---|---|---|---|---|---
|
| 66 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® 8 Elite Mobile | 512 | 47.430332 | 0.3327866666666666 - 1.3311466666666665
|
| 67 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® 8 Elite Mobile | 512 | 32.88392 | 0.217985 - 0.87194
|
| 68 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® 8 Elite Mobile | 512 | 29.964567 | 0.069595 - 0.27838
|
| 69 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 512 | 62.900994 | 0.1141745 - 0.456698
|
| 70 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 512 | 64.127228 | 0.112751 - 0.451004
|
| 71 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 512 | 23.365032 | 0.07905475 - 0.316219
|
| 72 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 4096 | 30.033638 | 0.23735575 - 7.595384
|
| 73 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 4096 | 26.100461 | 0.23745440625 - 7.598541
|
| 74 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X2 Elite | 4096 | 20.902282 | 0.108134125 - 3.460292
|
| 75 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 512 | 32.439446 | 0.2918443333333333 - 1.1673773333333333
|
| 76 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 512 | 32.311222 | 0.21815833333333334 - 0.8726333333333334
|
| 77 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 512 | 26.440463 | 0.13286633333333334 - 0.5314653333333333
|
| 78 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 4096 | 24.39174 | 0.4940118387096774 - 15.808378838709677
|
| 79 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 4096 | 15.302921 | 0.49661099999999997 - 15.891551999999999
|
| 80 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Snapdragon® X Elite | 4096 | 11.823476 | 0.16016632258064517 - 5.1253223225806455
|
| 81 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-8275 | 512 | 10.77804 | 1.622459 - 6.489836
|
| 82 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-8275 | 512 | 4.418073 | 2.3404373333333335 - 9.361749333333334
|
| 83 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-8275 | 512 | 3.523704 | 0.2616836666666667 - 1.0467346666666668
|
| 84 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-9075 | 512 | 1.882364 | 1.1826937499999999 - 4.7307749999999995
|
| 85 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-9075 | 512 | 1.878065 | 1.18503875 - 4.740155
|
| 86 |
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-9075 | 512 | 19.881743 | 0.18957975 - 0.758319
|
| 87 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 512 | 32.439446 | 0.2918443333333333 - 1.1673773333333333
|
| 88 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 512 | 32.311222 | 0.21815833333333334 - 0.8726333333333334
|
| 89 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 512 | 26.440463 | 0.13286633333333334 - 0.5314653333333333
|
| 90 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ Q-8750 | 512 | 47.430332 | 0.3327866666666666 - 1.3311466666666665
|
| 91 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ Q-8750 | 512 | 32.88392 | 0.217985 - 0.87194
|
| 92 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ Q-8750 | 512 | 29.964567 | 0.069595 - 0.27838
|
| 93 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 4096 | 24.39174 | 0.4940118387096774 - 15.808378838709677
|
| 94 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 4096 | 15.302921 | 0.49661099999999997 - 15.891551999999999
|
| 95 |
+
| Qwen3-VL-2B-Instruct | GENIEX_LLAMACPP | q4_0 | Qualcomm® Dragonwing™ IQ-X7181 | 4096 | 11.823476 | 0.16016632258064517 - 5.1253223225806455
|
| 96 |
|
| 97 |
## License
|
| 98 |
* The license for the original implementation of Qwen3-VL-2B-Instruct can be found
|
release_assets.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"version": "0.
|
| 3 |
"precisions": {
|
| 4 |
"q4_0": {
|
| 5 |
"universal_assets": {
|
|
|
|
| 1 |
{
|
| 2 |
+
"version": "0.62.0",
|
| 3 |
"precisions": {
|
| 4 |
"q4_0": {
|
| 5 |
"universal_assets": {
|