qaihm-bot commited on
Commit
fa04be9
·
verified ·
1 Parent(s): ec476ce

See https://github.com/qualcomm/ai-hub-models/releases/v0.55.0 for changelog.

Files changed (2) hide show
  1. README.md +219 -215
  2. release_assets.json +20 -20
README.md CHANGED
@@ -27,13 +27,13 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-onnx-float.zip)
31
- | ONNX | w8a16 | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-onnx-w8a16.zip)
32
- | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-onnx-w8a8.zip)
33
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-qnn_dlc-float.zip)
34
- | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-qnn_dlc-w8a16.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-qnn_dlc-w8a8.zip)
36
- | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-tflite-w8a8.zip)
37
 
38
  For more device-specific assets and performance metrics, visit **[Detectron2-Detection on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detectron2_detection)**.
39
 
@@ -62,214 +62,218 @@ See our repository for [Detectron2-Detection on GitHub](https://github.com/qualc
62
  ## Performance Summary
63
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
64
  |---|---|---|---|---|---|---
65
- | proposal_generator | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 14.76 ms | 34 - 491 MB | NPU
66
- | proposal_generator | ONNX | float | Snapdragon® 8 Elite Mobile | 19.195 ms | 24 - 468 MB | NPU
67
- | proposal_generator | ONNX | float | Snapdragon® X2 Elite | 15.394 ms | 65 - 65 MB | NPU
68
- | proposal_generator | ONNX | float | Snapdragon® X Elite | 32.028 ms | 66 - 66 MB | NPU
69
- | proposal_generator | ONNX | float | Snapdragon® X Elite | 32.028 ms | 66 - 66 MB | NPU
70
- | proposal_generator | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 23.873 ms | 2 - 536 MB | NPU
71
- | proposal_generator | ONNX | float | Qualcomm® QCS8550 (Proxy) | 32.935 ms | 11 - 46 MB | NPU
72
- | proposal_generator | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 19.195 ms | 24 - 468 MB | NPU
73
- | proposal_generator | ONNX | float | Qualcomm® QCS9075 | 58.672 ms | 7 - 17 MB | NPU
74
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 8.563 ms | 0 - 501 MB | NPU
75
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 11.034 ms | 12 - 496 MB | NPU
76
- | proposal_generator | ONNX | w8a16 | Snapdragon® X2 Elite | 9.778 ms | 35 - 35 MB | NPU
77
- | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.927 ms | 33 - 33 MB | NPU
78
- | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.927 ms | 33 - 33 MB | NPU
79
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 13.558 ms | 19 - 555 MB | NPU
80
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS6490 | 3016.408 ms | 187 - 204 MB | CPU
81
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 19.454 ms | 6 - 30 MB | NPU
82
- | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 1402.793 ms | 191 - 198 MB | CPU
83
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS9075 | 29.615 ms | 17 - 20 MB | NPU
84
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 11.034 ms | 12 - 496 MB | NPU
85
- | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 1402.793 ms | 191 - 198 MB | CPU
86
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.795 ms | 8 - 428 MB | NPU
87
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 6.255 ms | 10 - 433 MB | NPU
88
- | proposal_generator | ONNX | w8a8 | Snapdragon® X2 Elite | 4.961 ms | 19 - 19 MB | NPU
89
- | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.629 ms | 19 - 19 MB | NPU
90
- | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.629 ms | 19 - 19 MB | NPU
91
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 8.587 ms | 9 - 474 MB | NPU
92
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS6490 | 440.21 ms | 153 - 180 MB | CPU
93
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.901 ms | 0 - 27 MB | NPU
94
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS9075 | 16.175 ms | 9 - 12 MB | NPU
95
- | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 354.389 ms | 152 - 161 MB | CPU
96
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCM6690 | 433.493 ms | 126 - 134 MB | CPU
97
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.255 ms | 10 - 433 MB | NPU
98
- | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 354.389 ms | 152 - 161 MB | CPU
99
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.227 ms | 7 - 494 MB | NPU
100
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 27.969 ms | 0 - 477 MB | NPU
101
- | proposal_generator | QNN_DLC | float | Snapdragon® X2 Elite | 22.008 ms | 7 - 7 MB | NPU
102
- | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.19 ms | 7 - 7 MB | NPU
103
- | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.19 ms | 7 - 7 MB | NPU
104
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 36.846 ms | 7 - 551 MB | NPU
105
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 54.735 ms | 7 - 12 MB | NPU
106
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.665 ms | 1 - 468 MB | NPU
107
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.665 ms | 1 - 468 MB | NPU
108
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.665 ms | 1 - 468 MB | NPU
109
- | proposal_generator | QNN_DLC | float | Qualcomm® SA7255P | 184.309 ms | 2 - 469 MB | NPU
110
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 27.969 ms | 0 - 477 MB | NPU
111
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8295P | 76.859 ms | 0 - 433 MB | NPU
112
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS9075 | 78.843 ms | 7 - 27 MB | NPU
113
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 85.514 ms | 7 - 500 MB | NPU
114
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 23.062 ms | 4 - 452 MB | NPU
115
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 25.482 ms | 4 - 443 MB | NPU
116
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 24.585 ms | 4 - 4 MB | NPU
117
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 55.632 ms | 4 - 4 MB | NPU
118
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 55.632 ms | 4 - 4 MB | NPU
119
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 36.467 ms | 4 - 756 MB | NPU
120
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 165.049 ms | 4 - 14 MB | NPU
121
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 54.567 ms | 4 - 8 MB | NPU
122
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.453 ms | 1 - 546 MB | NPU
123
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.453 ms | 1 - 546 MB | NPU
124
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.453 ms | 1 - 546 MB | NPU
125
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 422.315 ms | 4 - 541 MB | NPU
126
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 61.259 ms | 4 - 736 MB | NPU
127
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 64.191 ms | 4 - 532 MB | NPU
128
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 76.119 ms | 1 - 11 MB | NPU
129
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA7255P | 97.832 ms | 2 - 547 MB | NPU
130
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 25.482 ms | 4 - 443 MB | NPU
131
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8295P | 65.6 ms | 0 - 542 MB | NPU
132
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 64.191 ms | 4 - 532 MB | NPU
133
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 20.879 ms | 2 - 436 MB | NPU
134
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 23.735 ms | 2 - 441 MB | NPU
135
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 21.318 ms | 2 - 2 MB | NPU
136
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.297 ms | 2 - 2 MB | NPU
137
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.297 ms | 2 - 2 MB | NPU
138
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 27.417 ms | 2 - 497 MB | NPU
139
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 65.161 ms | 1 - 7 MB | NPU
140
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 40.084 ms | 2 - 200 MB | NPU
141
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.385 ms | 2 - 439 MB | NPU
142
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.385 ms | 2 - 439 MB | NPU
143
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.385 ms | 2 - 439 MB | NPU
144
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 43.495 ms | 1 - 7 MB | NPU
145
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 47.21 ms | 2 - 490 MB | NPU
146
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 29.061 ms | 2 - 437 MB | NPU
147
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 206.794 ms | 2 - 442 MB | NPU
148
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 23.735 ms | 2 - 441 MB | NPU
149
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA7255P | 71.748 ms | 2 - 439 MB | NPU
150
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8295P | 45.112 ms | 2 - 440 MB | NPU
151
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 29.061 ms | 2 - 437 MB | NPU
152
- | proposal_generator | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 21.67 ms | 10 - 504 MB | NPU
153
- | proposal_generator | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 37.815 ms | 9 - 582 MB | NPU
154
- | proposal_generator | TFLITE | float | Qualcomm® SA8295P | 77.718 ms | 11 - 452 MB | NPU
155
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 23.8 ms | 2 - 446 MB | NPU
156
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 25.183 ms | 2 - 432 MB | NPU
157
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 29.756 ms | 1 - 501 MB | NPU
158
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 43.188 ms | 3 - 6 MB | NPU
159
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.239 ms | 3 - 444 MB | NPU
160
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.239 ms | 3 - 444 MB | NPU
161
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.239 ms | 3 - 444 MB | NPU
162
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS9075 | 46.042 ms | 1 - 30 MB | NPU
163
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 46.806 ms | 0 - 490 MB | NPU
164
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 37.145 ms | 1 - 451 MB | NPU
165
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 25.183 ms | 2 - 432 MB | NPU
166
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA7255P | 73.101 ms | 3 - 444 MB | NPU
167
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8295P | 49.76 ms | 3 - 444 MB | NPU
168
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 37.145 ms | 1 - 451 MB | NPU
169
- | roi_head | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 28.594 ms | 10 - 1471 MB | NPU
170
- | roi_head | ONNX | float | Snapdragon® 8 Elite Mobile | 43.687 ms | 0 - 1376 MB | NPU
171
- | roi_head | ONNX | float | Snapdragon® X2 Elite | 31.554 ms | 32 - 32 MB | NPU
172
- | roi_head | ONNX | float | Snapdragon® X Elite | 67.658 ms | 29 - 29 MB | NPU
173
- | roi_head | ONNX | float | Snapdragon® X Elite | 67.658 ms | 29 - 29 MB | NPU
174
- | roi_head | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 49.134 ms | 10 - 1540 MB | NPU
175
- | roi_head | ONNX | float | Qualcomm® QCS8550 (Proxy) | 64.629 ms | 0 - 33 MB | NPU
176
- | roi_head | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 43.687 ms | 0 - 1376 MB | NPU
177
- | roi_head | ONNX | float | Qualcomm® QCS9075 | 115.915 ms | 10 - 22 MB | NPU
178
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 15.745 ms | 5 - 477 MB | NPU
179
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 20.852 ms | 2 - 463 MB | NPU
180
- | roi_head | ONNX | w8a16 | Snapdragon® X2 Elite | 17.157 ms | 14 - 14 MB | NPU
181
- | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 34.281 ms | 12 - 12 MB | NPU
182
- | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 34.281 ms | 12 - 12 MB | NPU
183
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.862 ms | 5 - 482 MB | NPU
184
- | roi_head | ONNX | w8a16 | Qualcomm® QCS6490 | 8758.485 ms | 3029 - 3042 MB | CPU
185
- | roi_head | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 33.367 ms | 0 - 18 MB | NPU
186
- | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3804.954 ms | 2957 - 2964 MB | CPU
187
- | roi_head | ONNX | w8a16 | Qualcomm® QCS9075 | 45.734 ms | 5 - 8 MB | NPU
188
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 20.852 ms | 2 - 463 MB | NPU
189
- | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3804.954 ms | 2957 - 2964 MB | CPU
190
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 7.996 ms | 2 - 312 MB | NPU
191
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 9.405 ms | 0 - 314 MB | NPU
192
- | roi_head | ONNX | w8a8 | Snapdragon® X2 Elite | 8.78 ms | 15 - 15 MB | NPU
193
- | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 19.064 ms | 14 - 14 MB | NPU
194
- | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 19.064 ms | 14 - 14 MB | NPU
195
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 13.594 ms | 3 - 355 MB | NPU
196
- | roi_head | ONNX | w8a8 | Qualcomm® QCS6490 | 1700.45 ms | 2531 - 2540 MB | CPU
197
- | roi_head | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.827 ms | 0 - 19 MB | NPU
198
- | roi_head | ONNX | w8a8 | Qualcomm® QCS9075 | 70.67 ms | 2 - 5 MB | NPU
199
- | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 978.086 ms | 2443 - 2451 MB | CPU
200
- | roi_head | ONNX | w8a8 | Qualcomm® QCM6690 | 1062.416 ms | 2432 - 2439 MB | CPU
201
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 9.405 ms | 0 - 314 MB | NPU
202
- | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 978.086 ms | 2443 - 2451 MB | CPU
203
- | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 28.116 ms | 10 - 1442 MB | NPU
204
- | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 40.645 ms | 0 - 1355 MB | NPU
205
- | roi_head | QNN_DLC | float | Snapdragon® X2 Elite | 31.382 ms | 10 - 10 MB | NPU
206
- | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.58 ms | 10 - 10 MB | NPU
207
- | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.58 ms | 10 - 10 MB | NPU
208
- | roi_head | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 48.744 ms | 10 - 1599 MB | NPU
209
- | roi_head | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 63.624 ms | 7 - 10 MB | NPU
210
- | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.224 ms | 1 - 1398 MB | NPU
211
- | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.224 ms | 1 - 1398 MB | NPU
212
- | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.224 ms | 1 - 1398 MB | NPU
213
- | roi_head | QNN_DLC | float | Qualcomm® SA7255P | 332.685 ms | 0 - 1398 MB | NPU
214
- | roi_head | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 40.645 ms | 0 - 1355 MB | NPU
215
- | roi_head | QNN_DLC | float | Qualcomm® SA8295P | 88.705 ms | 0 - 387 MB | NPU
216
- | roi_head | QNN_DLC | float | Qualcomm® QCS9075 | 104.253 ms | 12 - 23 MB | NPU
217
- | roi_head | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 118.057 ms | 10 - 442 MB | NPU
218
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 13.441 ms | 5 - 420 MB | NPU
219
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 19.327 ms | 5 - 420 MB | NPU
220
- | roi_head | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 15.998 ms | 5 - 5 MB | NPU
221
- | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 31.048 ms | 5 - 5 MB | NPU
222
- | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 31.048 ms | 5 - 5 MB | NPU
223
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.52 ms | 5 - 428 MB | NPU
224
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 147.561 ms | 5 - 11 MB | NPU
225
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 30.543 ms | 5 - 7 MB | NPU
226
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 32.433 ms | 1 - 370 MB | NPU
227
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 32.433 ms | 1 - 370 MB | NPU
228
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 32.433 ms | 1 - 370 MB | NPU
229
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 613.806 ms | 5 - 514 MB | NPU
230
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 46.448 ms | 5 - 428 MB | NPU
231
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 56.368 ms | 5 - 461 MB | NPU
232
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 45.01 ms | 1 - 7 MB | NPU
233
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA7255P | 95.015 ms | 5 - 374 MB | NPU
234
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 19.327 ms | 5 - 420 MB | NPU
235
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8295P | 50.576 ms | 0 - 371 MB | NPU
236
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 56.368 ms | 5 - 461 MB | NPU
237
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 7.848 ms | 2 - 306 MB | NPU
238
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 9.488 ms | 2 - 306 MB | NPU
239
- | roi_head | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 9.134 ms | 2 - 2 MB | NPU
240
- | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 18.923 ms | 2 - 2 MB | NPU
241
- | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 18.923 ms | 2 - 2 MB | NPU
242
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 13.338 ms | 2 - 339 MB | NPU
243
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 83.149 ms | 2 - 7 MB | NPU
244
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.265 ms | 2 - 5 MB | NPU
245
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 18.63 ms | 1 - 291 MB | NPU
246
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 18.63 ms | 1 - 291 MB | NPU
247
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 18.63 ms | 1 - 291 MB | NPU
248
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 75.869 ms | 0 - 4 MB | NPU
249
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 38.724 ms | 2 - 338 MB | NPU
250
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.59 ms | 2 - 321 MB | NPU
251
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 310.724 ms | 2 - 375 MB | NPU
252
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 9.488 ms | 2 - 306 MB | NPU
253
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA7255P | 51.485 ms | 2 - 292 MB | NPU
254
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8295P | 28.308 ms | 2 - 292 MB | NPU
255
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.59 ms | 2 - 321 MB | NPU
256
- | roi_head | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1995.437 ms | 0 - 2959 MB | NPU
257
- | roi_head | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 481.174 ms | 0 - 3364 MB | CPU
258
- | roi_head | TFLITE | float | Qualcomm® SA8295P | 1020.197 ms | 0 - 1601 MB | CPU
259
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 160.252 ms | 0 - 1453 MB | NPU
260
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 197.006 ms | 0 - 1349 MB | NPU
261
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 288.91 ms | 0 - 1597 MB | NPU
262
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 378.691 ms | 0 - 4 MB | NPU
263
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 365.951 ms | 0 - 1280 MB | NPU
264
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 365.951 ms | 0 - 1280 MB | NPU
265
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 365.951 ms | 0 - 1280 MB | NPU
266
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS9075 | 396.44 ms | 0 - 33 MB | NPU
267
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 901.915 ms | 0 - 803 MB | NPU
268
- | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1837.531 ms | 1071 - 2318 MB | NPU
269
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 197.006 ms | 0 - 1349 MB | NPU
270
- | roi_head | TFLITE | w8a8 | Qualcomm® SA7255P | 516.62 ms | 0 - 1279 MB | NPU
271
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8295P | 385.446 ms | 0 - 665 MB | NPU
272
- | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1837.531 ms | 1071 - 2318 MB | NPU
 
 
 
 
273
 
274
  ## License
275
  * The license for the original implementation of Detectron2-Detection can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-float.zip)
31
+ | ONNX | w8a16 | Universal | QAIRT 2.42, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a16.zip)
32
+ | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a8.zip)
33
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-float.zip)
34
+ | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a16.zip)
35
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a8.zip)
36
+ | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-tflite-w8a8.zip)
37
 
38
  For more device-specific assets and performance metrics, visit **[Detectron2-Detection on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detectron2_detection)**.
39
 
 
62
  ## Performance Summary
63
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
64
  |---|---|---|---|---|---|---
65
+ | proposal_generator | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 14.75 ms | 33 - 492 MB | NPU
66
+ | proposal_generator | ONNX | float | Snapdragon® X2 Elite | 15.374 ms | 205 - 205 MB | NPU
67
+ | proposal_generator | ONNX | float | Snapdragon® X Elite | 31.892 ms | 142 - 142 MB | NPU
68
+ | proposal_generator | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 24.131 ms | 33 - 573 MB | NPU
69
+ | proposal_generator | ONNX | float | Qualcomm® QCS8550 (Proxy) | 32.112 ms | 34 - 47 MB | NPU
70
+ | proposal_generator | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 19.034 ms | 28 - 478 MB | NPU
71
+ | proposal_generator | ONNX | float | Qualcomm® QCS9075 | 58.49 ms | 7 - 52 MB | NPU
72
+ | proposal_generator | ONNX | float | Qualcomm® QCS8750 | 19.034 ms | 28 - 478 MB | NPU
73
+ | proposal_generator | ONNX | float | Qualcomm® QCS7181 | 31.892 ms | 142 - 142 MB | NPU
74
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 8.555 ms | 20 - 521 MB | NPU
75
+ | proposal_generator | ONNX | w8a16 | Snapdragon® X2 Elite | 9.763 ms | 208 - 208 MB | NPU
76
+ | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.932 ms | 178 - 178 MB | NPU
77
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 13.661 ms | 18 - 559 MB | NPU
78
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS6490 | 3000.042 ms | 188 - 205 MB | CPU
79
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 19.4 ms | 1 - 56 MB | NPU
80
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 1406.716 ms | 190 - 198 MB | CPU
81
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 11.034 ms | 17 - 498 MB | NPU
82
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS9075 | 28.962 ms | 16 - 62 MB | NPU
83
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS7790 | 1406.716 ms | 190 - 198 MB | CPU
84
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8750 | 11.034 ms | 17 - 498 MB | NPU
85
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS7181 | 19.932 ms | 178 - 178 MB | NPU
86
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.802 ms | 9 - 432 MB | NPU
87
+ | proposal_generator | ONNX | w8a8 | Snapdragon® X2 Elite | 4.937 ms | 210 - 210 MB | NPU
88
+ | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.822 ms | 180 - 180 MB | NPU
89
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 8.578 ms | 9 - 480 MB | NPU
90
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS6490 | 440.45 ms | 153 - 180 MB | CPU
91
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.939 ms | 0 - 38 MB | NPU
92
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS9075 | 15.726 ms | 8 - 53 MB | NPU
93
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 356.922 ms | 125 - 134 MB | CPU
94
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.258 ms | 9 - 433 MB | NPU
95
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS7790 | 356.922 ms | 125 - 134 MB | CPU
96
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8750 | 6.258 ms | 9 - 433 MB | NPU
97
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS7181 | 11.822 ms | 180 - 180 MB | NPU
98
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.237 ms | 7 - 494 MB | NPU
99
+ | proposal_generator | QNN_DLC | float | Snapdragon® X2 Elite | 22.071 ms | 7 - 7 MB | NPU
100
+ | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.611 ms | 7 - 7 MB | NPU
101
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 37.691 ms | 7 - 554 MB | NPU
102
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8275 | 184.657 ms | 3 - 470 MB | NPU
103
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 54.561 ms | 8 - 10 MB | NPU
104
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.504 ms | 2 - 469 MB | NPU
105
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8650P | 67.504 ms | 2 - 469 MB | NPU
106
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8255P | 67.504 ms | 2 - 469 MB | NPU
107
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 28.08 ms | 0 - 476 MB | NPU
108
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA7255P | 184.657 ms | 3 - 470 MB | NPU
109
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS9075 | 79.034 ms | 7 - 27 MB | NPU
110
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8295P | 77.009 ms | 0 - 433 MB | NPU
111
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 86.58 ms | 7 - 501 MB | NPU
112
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8750 | 28.08 ms | 0 - 476 MB | NPU
113
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS7181 | 54.611 ms | 7 - 7 MB | NPU
114
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 23.222 ms | 4 - 451 MB | NPU
115
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 24.592 ms | 4 - 4 MB | NPU
116
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 56.664 ms | 4 - 4 MB | NPU
117
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 36.213 ms | 0 - 752 MB | NPU
118
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 164.199 ms | 3 - 13 MB | NPU
119
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 97.348 ms | 2 - 547 MB | NPU
120
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 54.842 ms | 4 - 8 MB | NPU
121
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.586 ms | 1 - 547 MB | NPU
122
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8650P | 54.586 ms | 1 - 547 MB | NPU
123
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8255P | 54.586 ms | 1 - 547 MB | NPU
124
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 63.767 ms | 4 - 530 MB | NPU
125
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 25.444 ms | 4 - 444 MB | NPU
126
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA7255P | 97.348 ms | 2 - 547 MB | NPU
127
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 418.837 ms | 4 - 538 MB | NPU
128
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8295P | 65.755 ms | 0 - 542 MB | NPU
129
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 76.322 ms | 1 - 11 MB | NPU
130
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 62.026 ms | 4 - 737 MB | NPU
131
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS7790 | 63.767 ms | 4 - 530 MB | NPU
132
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8750 | 25.444 ms | 4 - 444 MB | NPU
133
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 56.664 ms | 4 - 4 MB | NPU
134
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 20.868 ms | 2 - 434 MB | NPU
135
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 21.26 ms | 2 - 2 MB | NPU
136
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.345 ms | 2 - 2 MB | NPU
137
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 27.331 ms | 2 - 498 MB | NPU
138
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 64.869 ms | 2 - 8 MB | NPU
139
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 71.692 ms | 2 - 438 MB | NPU
140
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 40.25 ms | 2 - 4 MB | NPU
141
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.367 ms | 2 - 439 MB | NPU
142
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8650P | 40.367 ms | 2 - 439 MB | NPU
143
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8255P | 40.367 ms | 2 - 439 MB | NPU
144
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 43.947 ms | 1 - 7 MB | NPU
145
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 46.885 ms | 2 - 487 MB | NPU
146
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 29.517 ms | 2 - 435 MB | NPU
147
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 23.735 ms | 2 - 440 MB | NPU
148
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 200.777 ms | 2 - 440 MB | NPU
149
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8295P | 45.128 ms | 3 - 440 MB | NPU
150
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA7255P | 71.692 ms | 2 - 438 MB | NPU
151
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 29.517 ms | 2 - 435 MB | NPU
152
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 23.735 ms | 2 - 440 MB | NPU
153
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 41.345 ms | 2 - 2 MB | NPU
154
+ | proposal_generator | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.2 ms | 10 - 504 MB | NPU
155
+ | proposal_generator | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 37.722 ms | 10 - 582 MB | NPU
156
+ | proposal_generator | TFLITE | float | Qualcomm® SA8295P | 77.733 ms | 11 - 453 MB | NPU
157
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 29.914 ms | 2 - 503 MB | NPU
158
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8275 | 73.303 ms | 3 - 443 MB | NPU
159
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 42.773 ms | 3 - 6 MB | NPU
160
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.196 ms | 3 - 443 MB | NPU
161
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8650P | 43.196 ms | 3 - 443 MB | NPU
162
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8255P | 43.196 ms | 3 - 443 MB | NPU
163
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS9075 | 46.004 ms | 2 - 31 MB | NPU
164
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 46.679 ms | 3 - 494 MB | NPU
165
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 36.878 ms | 1 - 448 MB | NPU
166
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 25.39 ms | 2 - 434 MB | NPU
167
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8295P | 49.861 ms | 3 - 444 MB | NPU
168
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA7255P | 73.303 ms | 3 - 443 MB | NPU
169
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS7790 | 36.878 ms | 1 - 448 MB | NPU
170
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8750 | 25.39 ms | 2 - 434 MB | NPU
171
+ | roi_head | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 28.565 ms | 10 - 1473 MB | NPU
172
+ | roi_head | ONNX | float | Snapdragon® X2 Elite | 31.279 ms | 202 - 202 MB | NPU
173
+ | roi_head | ONNX | float | Snapdragon® X Elite | 64.708 ms | 171 - 171 MB | NPU
174
+ | roi_head | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 49.026 ms | 10 - 1540 MB | NPU
175
+ | roi_head | ONNX | float | Qualcomm® QCS8550 (Proxy) | 64.547 ms | 10 - 94 MB | NPU
176
+ | roi_head | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 44.216 ms | 1 - 1381 MB | NPU
177
+ | roi_head | ONNX | float | Qualcomm® QCS9075 | 115.763 ms | 10 - 64 MB | NPU
178
+ | roi_head | ONNX | float | Qualcomm® QCS8750 | 44.216 ms | 1 - 1381 MB | NPU
179
+ | roi_head | ONNX | float | Qualcomm® QCS7181 | 64.708 ms | 171 - 171 MB | NPU
180
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 15.493 ms | 5 - 485 MB | NPU
181
+ | roi_head | ONNX | w8a16 | Snapdragon® X2 Elite | 17.652 ms | 208 - 208 MB | NPU
182
+ | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 34.337 ms | 176 - 176 MB | NPU
183
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.705 ms | 5 - 492 MB | NPU
184
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS6490 | 8736.241 ms | 3030 - 3043 MB | CPU
185
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 33.476 ms | 0 - 43 MB | NPU
186
+ | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3789.73 ms | 2953 - 2960 MB | CPU
187
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 20.734 ms | 2 - 481 MB | NPU
188
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS9075 | 45.37 ms | 5 - 50 MB | NPU
189
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS7790 | 3789.73 ms | 2953 - 2960 MB | CPU
190
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS8750 | 20.734 ms | 2 - 481 MB | NPU
191
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS7181 | 34.337 ms | 176 - 176 MB | NPU
192
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 8.332 ms | 2 - 323 MB | NPU
193
+ | roi_head | ONNX | w8a8 | Snapdragon® X2 Elite | 9.066 ms | 210 - 210 MB | NPU
194
+ | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 18.516 ms | 179 - 179 MB | NPU
195
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 12.525 ms | 3 - 365 MB | NPU
196
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS6490 | 1719.409 ms | 2531 - 2540 MB | CPU
197
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 17.839 ms | 0 - 45 MB | NPU
198
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS9075 | 39.609 ms | 2 - 48 MB | NPU
199
+ | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 987.81 ms | 2442 - 2449 MB | CPU
200
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 10.487 ms | 0 - 322 MB | NPU
201
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS7790 | 987.81 ms | 2442 - 2449 MB | CPU
202
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS8750 | 10.487 ms | 0 - 322 MB | NPU
203
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS7181 | 18.516 ms | 179 - 179 MB | NPU
204
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 27.92 ms | 10 - 1446 MB | NPU
205
+ | roi_head | QNN_DLC | float | Snapdragon® X2 Elite | 31.205 ms | 10 - 10 MB | NPU
206
+ | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.835 ms | 10 - 10 MB | NPU
207
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 48.703 ms | 10 - 1598 MB | NPU
208
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8275 | 332.807 ms | 0 - 1397 MB | NPU
209
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 64.786 ms | 10 - 328 MB | NPU
210
+ | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.154 ms | 0 - 1397 MB | NPU
211
+ | roi_head | QNN_DLC | float | Qualcomm® SA8650P | 96.154 ms | 0 - 1397 MB | NPU
212
+ | roi_head | QNN_DLC | float | Qualcomm® SA8255P | 96.154 ms | 0 - 1397 MB | NPU
213
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 41.049 ms | 10 - 1366 MB | NPU
214
+ | roi_head | QNN_DLC | float | Qualcomm® SA7255P | 332.807 ms | 0 - 1397 MB | NPU
215
+ | roi_head | QNN_DLC | float | Qualcomm® QCS9075 | 103.423 ms | 10 - 21 MB | NPU
216
+ | roi_head | QNN_DLC | float | Qualcomm® SA8295P | 88.672 ms | 0 - 387 MB | NPU
217
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 116.209 ms | 3 - 433 MB | NPU
218
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8750 | 41.049 ms | 10 - 1366 MB | NPU
219
+ | roi_head | QNN_DLC | float | Qualcomm® QCS7181 | 63.835 ms | 10 - 10 MB | NPU
220
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 14.024 ms | 5 - 427 MB | NPU
221
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 15.9 ms | 5 - 5 MB | NPU
222
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 31.857 ms | 5 - 5 MB | NPU
223
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 25.094 ms | 5 - 438 MB | NPU
224
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 145.892 ms | 5 - 11 MB | NPU
225
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 96.96 ms | 5 - 384 MB | NPU
226
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 31.465 ms | 5 - 362 MB | NPU
227
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 31.518 ms | 1 - 380 MB | NPU
228
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8650P | 31.518 ms | 1 - 380 MB | NPU
229
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8255P | 31.518 ms | 1 - 380 MB | NPU
230
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 53.432 ms | 5 - 470 MB | NPU
231
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 18.77 ms | 5 - 430 MB | NPU
232
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA7255P | 96.96 ms | 5 - 384 MB | NPU
233
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 597.467 ms | 5 - 530 MB | NPU
234
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8295P | 51.608 ms | 0 - 381 MB | NPU
235
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 45.269 ms | 3 - 10 MB | NPU
236
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 47.933 ms | 5 - 436 MB | NPU
237
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS7790 | 53.432 ms | 5 - 470 MB | NPU
238
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8750 | 18.77 ms | 5 - 430 MB | NPU
239
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 31.857 ms | 5 - 5 MB | NPU
240
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 8.206 ms | 2 - 315 MB | NPU
241
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 9.405 ms | 2 - 2 MB | NPU
242
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 19.568 ms | 2 - 2 MB | NPU
243
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 12.47 ms | 3 - 352 MB | NPU
244
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 86.381 ms | 1 - 5 MB | NPU
245
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 48.898 ms | 2 - 302 MB | NPU
246
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.663 ms | 3 - 6 MB | NPU
247
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 19.404 ms | 1 - 302 MB | NPU
248
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8650P | 19.404 ms | 1 - 302 MB | NPU
249
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8255P | 19.404 ms | 1 - 302 MB | NPU
250
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 39.655 ms | 0 - 4 MB | NPU
251
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 34.457 ms | 2 - 348 MB | NPU
252
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.498 ms | 2 - 326 MB | NPU
253
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 10.023 ms | 2 - 315 MB | NPU
254
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 306.411 ms | 2 - 382 MB | NPU
255
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8295P | 28.139 ms | 0 - 302 MB | NPU
256
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA7255P | 48.898 ms | 2 - 302 MB | NPU
257
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 30.498 ms | 2 - 326 MB | NPU
258
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 10.023 ms | 2 - 315 MB | NPU
259
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 19.568 ms | 2 - 2 MB | NPU
260
+ | roi_head | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1992.262 ms | 0 - 2959 MB | NPU
261
+ | roi_head | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 494.582 ms | 0 - 3366 MB | CPU
262
+ | roi_head | TFLITE | float | Qualcomm® SA8295P | 1036.64 ms | 1 - 1601 MB | CPU
263
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 290.308 ms | 1 - 1595 MB | NPU
264
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8275 | 519.412 ms | 0 - 1278 MB | NPU
265
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 364.301 ms | 0 - 4 MB | NPU
266
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 366.721 ms | 0 - 1279 MB | NPU
267
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8650P | 366.721 ms | 0 - 1279 MB | NPU
268
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8255P | 366.721 ms | 0 - 1279 MB | NPU
269
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS9075 | 396.939 ms | 0 - 33 MB | NPU
270
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 872.801 ms | 1 - 806 MB | NPU
271
+ | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1806.313 ms | 1116 - 2374 MB | NPU
272
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 196.134 ms | 0 - 1350 MB | NPU
273
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8295P | 384.008 ms | 0 - 666 MB | NPU
274
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA7255P | 519.412 ms | 0 - 1278 MB | NPU
275
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS7790 | 1806.313 ms | 1116 - 2374 MB | NPU
276
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8750 | 196.134 ms | 0 - 1350 MB | NPU
277
 
278
  ## License
279
  * The license for the original implementation of Detectron2-Detection can be found
release_assets.json CHANGED
@@ -1,61 +1,61 @@
1
  {
2
- "version": "0.54.0",
3
  "precisions": {
4
- "float": {
5
  "universal_assets": {
6
  "qnn_dlc": {
7
  "tool_versions": {
8
  "qairt": "2.45.0.260326154327"
9
  },
10
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-qnn_dlc-float.zip"
11
  },
12
  "onnx": {
13
  "tool_versions": {
14
  "qairt": "2.42.0.251225135753_193295",
15
- "onnx_runtime": "1.24.3"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-onnx-float.zip"
18
  }
19
  }
20
  },
21
- "w8a8": {
22
  "universal_assets": {
23
- "tflite": {
24
- "tool_versions": {
25
- "qairt": "2.45.0.260326154327",
26
- "litert": "1.4.3"
27
- },
28
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-tflite-w8a8.zip"
29
- },
30
  "qnn_dlc": {
31
  "tool_versions": {
32
  "qairt": "2.45.0.260326154327"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-qnn_dlc-w8a8.zip"
35
  },
36
  "onnx": {
37
  "tool_versions": {
38
  "qairt": "2.42.0.251225135753_193295",
39
- "onnx_runtime": "1.24.3"
40
  },
41
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-onnx-w8a8.zip"
42
  }
43
  }
44
  },
45
- "w8a16": {
46
  "universal_assets": {
 
 
 
 
 
 
 
47
  "qnn_dlc": {
48
  "tool_versions": {
49
  "qairt": "2.45.0.260326154327"
50
  },
51
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-qnn_dlc-w8a16.zip"
52
  },
53
  "onnx": {
54
  "tool_versions": {
55
  "qairt": "2.42.0.251225135753_193295",
56
- "onnx_runtime": "1.24.3"
57
  },
58
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.54.0/detectron2_detection-onnx-w8a16.zip"
59
  }
60
  }
61
  }
 
1
  {
2
+ "version": "0.55.0",
3
  "precisions": {
4
+ "w8a16": {
5
  "universal_assets": {
6
  "qnn_dlc": {
7
  "tool_versions": {
8
  "qairt": "2.45.0.260326154327"
9
  },
10
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a16.zip"
11
  },
12
  "onnx": {
13
  "tool_versions": {
14
  "qairt": "2.42.0.251225135753_193295",
15
+ "onnx_runtime": "1.25.0"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a16.zip"
18
  }
19
  }
20
  },
21
+ "float": {
22
  "universal_assets": {
 
 
 
 
 
 
 
23
  "qnn_dlc": {
24
  "tool_versions": {
25
  "qairt": "2.45.0.260326154327"
26
  },
27
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-float.zip"
28
  },
29
  "onnx": {
30
  "tool_versions": {
31
  "qairt": "2.42.0.251225135753_193295",
32
+ "onnx_runtime": "1.25.0"
33
  },
34
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-float.zip"
35
  }
36
  }
37
  },
38
+ "w8a8": {
39
  "universal_assets": {
40
+ "tflite": {
41
+ "tool_versions": {
42
+ "qairt": "2.45.0.260326154327",
43
+ "litert": "1.4.3"
44
+ },
45
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-tflite-w8a8.zip"
46
+ },
47
  "qnn_dlc": {
48
  "tool_versions": {
49
  "qairt": "2.45.0.260326154327"
50
  },
51
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a8.zip"
52
  },
53
  "onnx": {
54
  "tool_versions": {
55
  "qairt": "2.42.0.251225135753_193295",
56
+ "onnx_runtime": "1.25.0"
57
  },
58
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a8.zip"
59
  }
60
  }
61
  }