v0.66.0
Browse filesSee https://github.com/qualcomm/ai-hub-models/releases/v0.66.0 for changelog.
- README.md +6 -44
- release_assets.json +4 -21
README.md
CHANGED
|
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
|
|
| 16 |
All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
|
| 17 |
|
| 18 |
This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
|
| 19 |
-
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.
|
| 20 |
|
| 21 |
Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
|
| 22 |
|
|
@@ -29,25 +29,23 @@ Below are pre-exported model assets ready for deployment.
|
|
| 29 |
|
| 30 |
| Runtime | Precision | Chipset | SDK Versions | Download |
|
| 31 |
|---|---|---|---|---|
|
| 32 |
-
| ONNX | float | Universal | QAIRT 2.50, ONNX Runtime 1.30.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.
|
| 33 |
-
|
|
| 34 |
-
|
|
| 35 |
-
| QNN_DLC | w8a8 | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-qnn_dlc-w8a8.zip)
|
| 36 |
-
| TFLITE | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-tflite-float.zip)
|
| 37 |
|
| 38 |
For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
|
| 39 |
|
| 40 |
|
| 41 |
### Option 2: Export with Custom Configurations
|
| 42 |
|
| 43 |
-
Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.
|
| 44 |
- Custom weights (e.g., fine-tuned checkpoints)
|
| 45 |
- Custom input shapes
|
| 46 |
- Target device and runtime configurations
|
| 47 |
|
| 48 |
This option is ideal if you need to customize the model beyond the default configuration provided here.
|
| 49 |
|
| 50 |
-
See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.
|
| 51 |
|
| 52 |
## Model Details
|
| 53 |
|
|
@@ -77,23 +75,6 @@ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-
|
|
| 77 |
| MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.504 ms | 0 - 65 MB | NPU
|
| 78 |
| MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.336 ms | 0 - 64 MB | NPU
|
| 79 |
| MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.443 ms | 0 - 65 MB | NPU
|
| 80 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.667 ms | 0 - 63 MB | NPU
|
| 81 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.845 ms | 0 - 61 MB | NPU
|
| 82 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.668 ms | 1 - 1 MB | NPU
|
| 83 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.797 ms | 22 - 22 MB | NPU
|
| 84 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.94 ms | 0 - 89 MB | NPU
|
| 85 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.455 ms | 0 - 3 MB | NPU
|
| 86 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.691 ms | 0 - 4 MB | NPU
|
| 87 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.719 ms | 0 - 2 MB | NPU
|
| 88 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.94 ms | 0 - 89 MB | NPU
|
| 89 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.834 ms | 0 - 3 MB | NPU
|
| 90 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.797 ms | 22 - 22 MB | NPU
|
| 91 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.44 ms | 0 - 64 MB | NPU
|
| 92 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.784 ms | 0 - 56 MB | NPU
|
| 93 |
-
| MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.845 ms | 0 - 61 MB | NPU
|
| 94 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.784 ms | 0 - 56 MB | NPU
|
| 95 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.436 ms | 0 - 63 MB | NPU
|
| 96 |
-
| MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 6 Mobile | 0.686 ms | 0 - 64 MB | NPU
|
| 97 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.407 ms | 0 - 62 MB | NPU
|
| 98 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.506 ms | 0 - 62 MB | NPU
|
| 99 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.604 ms | 1 - 1 MB | NPU
|
|
@@ -112,25 +93,6 @@ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-
|
|
| 112 |
| MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.077 ms | 0 - 60 MB | NPU
|
| 113 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.323 ms | 0 - 64 MB | NPU
|
| 114 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.44 ms | 0 - 65 MB | NPU
|
| 115 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.688 ms | 0 - 56 MB | NPU
|
| 116 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.854 ms | 0 - 58 MB | NPU
|
| 117 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.813 ms | 0 - 0 MB | NPU
|
| 118 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.963 ms | 1 - 1 MB | NPU
|
| 119 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.963 ms | 0 - 79 MB | NPU
|
| 120 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 3.818 ms | 2 - 4 MB | NPU
|
| 121 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.68 ms | 0 - 3 MB | NPU
|
| 122 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.747 ms | 0 - 2 MB | NPU
|
| 123 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.963 ms | 0 - 79 MB | NPU
|
| 124 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.851 ms | 0 - 2 MB | NPU
|
| 125 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.963 ms | 1 - 1 MB | NPU
|
| 126 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.238 ms | 0 - 55 MB | NPU
|
| 127 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.733 ms | 0 - 52 MB | NPU
|
| 128 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.854 ms | 0 - 58 MB | NPU
|
| 129 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.419 ms | 0 - 54 MB | NPU
|
| 130 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.312 ms | 0 - 52 MB | NPU
|
| 131 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.733 ms | 0 - 52 MB | NPU
|
| 132 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.445 ms | 0 - 60 MB | NPU
|
| 133 |
-
| MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 6 Mobile | 0.692 ms | 0 - 59 MB | NPU
|
| 134 |
| MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.436 ms | 0 - 59 MB | NPU
|
| 135 |
| MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.537 ms | 0 - 66 MB | NPU
|
| 136 |
| MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.772 ms | 0 - 107 MB | NPU
|
|
|
|
| 16 |
All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
|
| 17 |
|
| 18 |
This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
|
| 19 |
+
This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.66.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
|
| 20 |
|
| 21 |
Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
|
| 22 |
|
|
|
|
| 29 |
|
| 30 |
| Runtime | Precision | Chipset | SDK Versions | Download |
|
| 31 |
|---|---|---|---|---|
|
| 32 |
+
| ONNX | float | Universal | QAIRT 2.50, ONNX Runtime 1.30.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-onnx-float.zip)
|
| 33 |
+
| QNN_DLC | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-qnn_dlc-float.zip)
|
| 34 |
+
| TFLITE | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-tflite-float.zip)
|
|
|
|
|
|
|
| 35 |
|
| 36 |
For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
|
| 37 |
|
| 38 |
|
| 39 |
### Option 2: Export with Custom Configurations
|
| 40 |
|
| 41 |
+
Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.66.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
|
| 42 |
- Custom weights (e.g., fine-tuned checkpoints)
|
| 43 |
- Custom input shapes
|
| 44 |
- Target device and runtime configurations
|
| 45 |
|
| 46 |
This option is ideal if you need to customize the model beyond the default configuration provided here.
|
| 47 |
|
| 48 |
+
See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.66.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
|
| 49 |
|
| 50 |
## Model Details
|
| 51 |
|
|
|
|
| 75 |
| MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.504 ms | 0 - 65 MB | NPU
|
| 76 |
| MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.336 ms | 0 - 64 MB | NPU
|
| 77 |
| MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.443 ms | 0 - 65 MB | NPU
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 78 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.407 ms | 0 - 62 MB | NPU
|
| 79 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.506 ms | 0 - 62 MB | NPU
|
| 80 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.604 ms | 1 - 1 MB | NPU
|
|
|
|
| 93 |
| MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.077 ms | 0 - 60 MB | NPU
|
| 94 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.323 ms | 0 - 64 MB | NPU
|
| 95 |
| MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.44 ms | 0 - 65 MB | NPU
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 96 |
| MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.436 ms | 0 - 59 MB | NPU
|
| 97 |
| MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.537 ms | 0 - 66 MB | NPU
|
| 98 |
| MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.772 ms | 0 - 107 MB | NPU
|
release_assets.json
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
{
|
| 2 |
-
"version": "0.
|
| 3 |
"precisions": {
|
| 4 |
"float": {
|
| 5 |
"universal_assets": {
|
|
@@ -8,37 +8,20 @@
|
|
| 8 |
"qairt": "2.50.0.260828221209",
|
| 9 |
"onnx_runtime": "1.30.0"
|
| 10 |
},
|
| 11 |
-
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.
|
| 12 |
},
|
| 13 |
"qnn_dlc": {
|
| 14 |
"tool_versions": {
|
| 15 |
"qairt": "2.50.0.260828221209"
|
| 16 |
},
|
| 17 |
-
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.
|
| 18 |
},
|
| 19 |
"tflite": {
|
| 20 |
"tool_versions": {
|
| 21 |
"qairt": "2.50.0.260828221209",
|
| 22 |
"litert": "1.4.2"
|
| 23 |
},
|
| 24 |
-
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.
|
| 25 |
-
}
|
| 26 |
-
}
|
| 27 |
-
},
|
| 28 |
-
"w8a8": {
|
| 29 |
-
"universal_assets": {
|
| 30 |
-
"onnx": {
|
| 31 |
-
"tool_versions": {
|
| 32 |
-
"qairt": "2.50.0.260828221209",
|
| 33 |
-
"onnx_runtime": "1.30.0"
|
| 34 |
-
},
|
| 35 |
-
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-onnx-w8a8.zip"
|
| 36 |
-
},
|
| 37 |
-
"qnn_dlc": {
|
| 38 |
-
"tool_versions": {
|
| 39 |
-
"qairt": "2.50.0.260828221209"
|
| 40 |
-
},
|
| 41 |
-
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-qnn_dlc-w8a8.zip"
|
| 42 |
}
|
| 43 |
}
|
| 44 |
}
|
|
|
|
| 1 |
{
|
| 2 |
+
"version": "0.66.0",
|
| 3 |
"precisions": {
|
| 4 |
"float": {
|
| 5 |
"universal_assets": {
|
|
|
|
| 8 |
"qairt": "2.50.0.260828221209",
|
| 9 |
"onnx_runtime": "1.30.0"
|
| 10 |
},
|
| 11 |
+
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-onnx-float.zip"
|
| 12 |
},
|
| 13 |
"qnn_dlc": {
|
| 14 |
"tool_versions": {
|
| 15 |
"qairt": "2.50.0.260828221209"
|
| 16 |
},
|
| 17 |
+
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-qnn_dlc-float.zip"
|
| 18 |
},
|
| 19 |
"tflite": {
|
| 20 |
"tool_versions": {
|
| 21 |
"qairt": "2.50.0.260828221209",
|
| 22 |
"litert": "1.4.2"
|
| 23 |
},
|
| 24 |
+
"download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-tflite-float.zip"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
}
|
| 26 |
}
|
| 27 |
}
|