qaihm-bot commited on
Commit
28d2976
·
verified ·
1 Parent(s): 5fe6fba

See https://github.com/qualcomm/ai-hub-models/releases/v0.66.0 for changelog.

Files changed (2) hide show
  1. README.md +6 -44
  2. release_assets.json +4 -21
README.md CHANGED
@@ -16,7 +16,7 @@ pipeline_tag: text-generation
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.65.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
@@ -29,25 +29,23 @@ Below are pre-exported model assets ready for deployment.
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
- | ONNX | float | Universal | QAIRT 2.50, ONNX Runtime 1.30.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-onnx-float.zip)
33
- | ONNX | w8a8 | Universal | QAIRT 2.50, ONNX Runtime 1.30.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-onnx-w8a8.zip)
34
- | QNN_DLC | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-qnn_dlc-float.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-qnn_dlc-w8a8.zip)
36
- | TFLITE | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-tflite-float.zip)
37
 
38
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
39
 
40
 
41
  ### Option 2: Export with Custom Configurations
42
 
43
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.65.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
44
  - Custom weights (e.g., fine-tuned checkpoints)
45
  - Custom input shapes
46
  - Target device and runtime configurations
47
 
48
  This option is ideal if you need to customize the model beyond the default configuration provided here.
49
 
50
- See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.65.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
51
 
52
  ## Model Details
53
 
@@ -77,23 +75,6 @@ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-
77
  | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.504 ms | 0 - 65 MB | NPU
78
  | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.336 ms | 0 - 64 MB | NPU
79
  | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.443 ms | 0 - 65 MB | NPU
80
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.667 ms | 0 - 63 MB | NPU
81
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.845 ms | 0 - 61 MB | NPU
82
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X2 Elite | 0.668 ms | 1 - 1 MB | NPU
83
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® X Elite | 1.797 ms | 22 - 22 MB | NPU
84
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.94 ms | 0 - 89 MB | NPU
85
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 4.455 ms | 0 - 3 MB | NPU
86
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.691 ms | 0 - 4 MB | NPU
87
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.719 ms | 0 - 2 MB | NPU
88
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® QCS8450 | 1.94 ms | 0 - 89 MB | NPU
89
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.834 ms | 0 - 3 MB | NPU
90
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.797 ms | 22 - 22 MB | NPU
91
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.44 ms | 0 - 64 MB | NPU
92
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.784 ms | 0 - 56 MB | NPU
93
- | MiniLM-v2 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.845 ms | 0 - 61 MB | NPU
94
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.784 ms | 0 - 56 MB | NPU
95
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.436 ms | 0 - 63 MB | NPU
96
- | MiniLM-v2 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 6 Mobile | 0.686 ms | 0 - 64 MB | NPU
97
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.407 ms | 0 - 62 MB | NPU
98
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.506 ms | 0 - 62 MB | NPU
99
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.604 ms | 1 - 1 MB | NPU
@@ -112,25 +93,6 @@ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-
112
  | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.077 ms | 0 - 60 MB | NPU
113
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.323 ms | 0 - 64 MB | NPU
114
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.44 ms | 0 - 65 MB | NPU
115
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.688 ms | 0 - 56 MB | NPU
116
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 0.854 ms | 0 - 58 MB | NPU
117
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.813 ms | 0 - 0 MB | NPU
118
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® X Elite | 1.963 ms | 1 - 1 MB | NPU
119
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 1.963 ms | 0 - 79 MB | NPU
120
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 3.818 ms | 2 - 4 MB | NPU
121
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 1.68 ms | 0 - 3 MB | NPU
122
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 1.747 ms | 0 - 2 MB | NPU
123
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 1.963 ms | 0 - 79 MB | NPU
124
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 1.851 ms | 0 - 2 MB | NPU
125
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 1.963 ms | 1 - 1 MB | NPU
126
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 6.238 ms | 0 - 55 MB | NPU
127
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 1.733 ms | 0 - 52 MB | NPU
128
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 0.854 ms | 0 - 58 MB | NPU
129
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.419 ms | 0 - 54 MB | NPU
130
- | MiniLM-v2 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.312 ms | 0 - 52 MB | NPU
131
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1.733 ms | 0 - 52 MB | NPU
132
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.445 ms | 0 - 60 MB | NPU
133
- | MiniLM-v2 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 6 Mobile | 0.692 ms | 0 - 59 MB | NPU
134
  | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.436 ms | 0 - 59 MB | NPU
135
  | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.537 ms | 0 - 66 MB | NPU
136
  | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.772 ms | 0 - 107 MB | NPU
 
16
  All-MiniLM-L6-v2 maps sentences to a 384-dimensional dense vector space. Trained on 1B+ sentence pairs, it excels at semantic search, clustering, and sentence similarity tasks while being small enough to run on mobile devices.
17
 
18
  This is based on the implementation of MiniLM-v2 found [here](https://github.com/UKPLab/sentence-transformers).
19
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.66.0/src/qai_hub_models/models/minilm_v2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
20
 
21
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
22
 
 
29
 
30
  | Runtime | Precision | Chipset | SDK Versions | Download |
31
  |---|---|---|---|---|
32
+ | ONNX | float | Universal | QAIRT 2.50, ONNX Runtime 1.30.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-onnx-float.zip)
33
+ | QNN_DLC | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-qnn_dlc-float.zip)
34
+ | TFLITE | float | Universal | QAIRT 2.50 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-tflite-float.zip)
 
 
35
 
36
  For more device-specific assets and performance metrics, visit **[MiniLM-v2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/minilm_v2)**.
37
 
38
 
39
  ### Option 2: Export with Custom Configurations
40
 
41
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.66.0/src/qai_hub_models/models/minilm_v2) Python library to compile and export the model with your own:
42
  - Custom weights (e.g., fine-tuned checkpoints)
43
  - Custom input shapes
44
  - Target device and runtime configurations
45
 
46
  This option is ideal if you need to customize the model beyond the default configuration provided here.
47
 
48
+ See our repository for [MiniLM-v2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.66.0/src/qai_hub_models/models/minilm_v2) for usage instructions.
49
 
50
  ## Model Details
51
 
 
75
  | MiniLM-v2 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 0.504 ms | 0 - 65 MB | NPU
76
  | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.336 ms | 0 - 64 MB | NPU
77
  | MiniLM-v2 | ONNX | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.443 ms | 0 - 65 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
78
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.407 ms | 0 - 62 MB | NPU
79
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.506 ms | 0 - 62 MB | NPU
80
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® X2 Elite | 0.604 ms | 1 - 1 MB | NPU
 
93
  | MiniLM-v2 | QNN_DLC | float | Qualcomm® SA8295P | 2.077 ms | 0 - 60 MB | NPU
94
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Extreme Gen 6 Mobile | 0.323 ms | 0 - 64 MB | NPU
95
  | MiniLM-v2 | QNN_DLC | float | Snapdragon® 8 Elite Gen 6 Mobile | 0.44 ms | 0 - 65 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
96
  | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite Gen 5 For Galaxy Mobile | 0.436 ms | 0 - 59 MB | NPU
97
  | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 0.537 ms | 0 - 66 MB | NPU
98
  | MiniLM-v2 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 0.772 ms | 0 - 107 MB | NPU
release_assets.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "version": "0.65.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
@@ -8,37 +8,20 @@
8
  "qairt": "2.50.0.260828221209",
9
  "onnx_runtime": "1.30.0"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.50.0.260828221209"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.50.0.260828221209",
22
  "litert": "1.4.2"
23
  },
24
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-tflite-float.zip"
25
- }
26
- }
27
- },
28
- "w8a8": {
29
- "universal_assets": {
30
- "onnx": {
31
- "tool_versions": {
32
- "qairt": "2.50.0.260828221209",
33
- "onnx_runtime": "1.30.0"
34
- },
35
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-onnx-w8a8.zip"
36
- },
37
- "qnn_dlc": {
38
- "tool_versions": {
39
- "qairt": "2.50.0.260828221209"
40
- },
41
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.65.0/minilm_v2-qnn_dlc-w8a8.zip"
42
  }
43
  }
44
  }
 
1
  {
2
+ "version": "0.66.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
 
8
  "qairt": "2.50.0.260828221209",
9
  "onnx_runtime": "1.30.0"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-onnx-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.50.0.260828221209"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-qnn_dlc-float.zip"
18
  },
19
  "tflite": {
20
  "tool_versions": {
21
  "qairt": "2.50.0.260828221209",
22
  "litert": "1.4.2"
23
  },
24
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/minilm_v2/releases/v0.66.0/minilm_v2-tflite-float.zip"
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
  }
26
  }
27
  }