qaihm-bot commited on
Commit
a3cd9c0
·
verified ·
1 Parent(s): 38b1ac3

See https://github.com/qualcomm/ai-hub-models/releases/v0.58.0 for changelog.

Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
16
  The Qwen2-7B-Instruct is a state-of-the-art multilingual language model with 7.07 billion parameters, excelling in language understanding, generation, coding, and mathematics.
17
 
18
  This is based on the implementation of Qwen2-7B-Instruct found [here](https://github.com/QwenLM/Qwen2.5).
19
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.57.3/src/qai_hub_models/models/qwen2_7b_instruct) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
@@ -47,7 +47,7 @@ Download pre-exported model assets from **[Qwen2-7B-Instruct on Qualcomm® AI Hu
47
  | Model | Runtime | Precision | Chipset | Context Length | Response Rate (tokens per second) | Time To First Token (range, seconds)
48
  |---|---|---|---|---|---|---
49
  | Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Snapdragon® 8 Elite Mobile | 4096 | 13.65 | 0.170593 - 5.458976
50
- | Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Qualcomm® QCS8750 | 4096 | 13.65 | 0.170593 - 5.458976
51
 
52
  ## License
53
  * The license for the original implementation of Qwen2-7B-Instruct can be found
 
16
  The Qwen2-7B-Instruct is a state-of-the-art multilingual language model with 7.07 billion parameters, excelling in language understanding, generation, coding, and mathematics.
17
 
18
  This is based on the implementation of Qwen2-7B-Instruct found [here](https://github.com/QwenLM/Qwen2.5).
19
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.58.0/src/qai_hub_models/models/qwen2_7b_instruct) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
 
47
  | Model | Runtime | Precision | Chipset | Context Length | Response Rate (tokens per second) | Time To First Token (range, seconds)
48
  |---|---|---|---|---|---|---
49
  | Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Snapdragon® 8 Elite Mobile | 4096 | 13.65 | 0.170593 - 5.458976
50
+ | Qwen2-7B-Instruct | QNN_CONTEXT_BINARY | w4a16 | Qualcomm® Dragonwing™ Q-8750 | 4096 | 13.65 | 0.170593 - 5.458976
51
 
52
  ## License
53
  * The license for the original implementation of Qwen2-7B-Instruct can be found