v0.58.0
Browse filesSee https://github.com/qualcomm/ai-hub-models/releases/v0.58.0 for changelog.
README.md
CHANGED
|
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
|
|
| 16 |
The Qwen2-7B-Instruct is a state-of-the-art multilingual language model with 7.07 billion parameters, excelling in language understanding, generation, coding, and mathematics.
|
| 17 |
|
| 18 |
This is based on the implementation of Qwen2-7B-Instruct found [here](https://github.com/QwenLM/Qwen2.5).
|
| 19 |
-
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.
|
| 20 |
|
| 21 |
Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
|
| 22 |
|
|
@@ -47,7 +47,7 @@ Download pre-exported model assets from **[Qwen2-7B-Instruct on Qualcomm® AI Hu
|
|
| 47 |
| Model | Runtime | Precision | Chipset | Context Length | Response Rate (tokens per second) | Time To First Token (range, seconds)
|
| 48 |
|---|---|---|---|---|---|---
|
| 49 |
| Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Snapdragon® 8 Elite Mobile | 4096 | 13.65 | 0.170593 - 5.458976
|
| 50 |
-
| Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Qualcomm®
|
| 51 |
|
| 52 |
## License
|
| 53 |
* The license for the original implementation of Qwen2-7B-Instruct can be found
|
|
|
|
| 16 |
The Qwen2-7B-Instruct is a state-of-the-art multilingual language model with 7.07 billion parameters, excelling in language understanding, generation, coding, and mathematics.
|
| 17 |
|
| 18 |
This is based on the implementation of Qwen2-7B-Instruct found [here](https://github.com/QwenLM/Qwen2.5).
|
| 19 |
+
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.58.0/src/qai_hub_models/models/qwen2_7b_instruct) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
|
| 20 |
|
| 21 |
Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
|
| 22 |
|
|
|
|
| 47 |
| Model | Runtime | Precision | Chipset | Context Length | Response Rate (tokens per second) | Time To First Token (range, seconds)
|
| 48 |
|---|---|---|---|---|---|---
|
| 49 |
| Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Snapdragon® 8 Elite Mobile | 4096 | 13.65 | 0.170593 - 5.458976
|
| 50 |
+
| Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Qualcomm® Dragonwing™ Q-8750 | 4096 | 13.65 | 0.170593 - 5.458976
|
| 51 |
|
| 52 |
## License
|
| 53 |
* The license for the original implementation of Qwen2-7B-Instruct can be found
|