qaihm-bot commited on
Commit
79e7d64
·
verified ·
1 Parent(s): fa04be9

See https://github.com/qualcomm/ai-hub-models/releases/v0.56.0 for changelog.

Files changed (2) hide show
  1. README.md +215 -219
  2. release_assets.json +20 -20
README.md CHANGED
@@ -27,13 +27,13 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-float.zip)
31
- | ONNX | w8a16 | Universal | QAIRT 2.42, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a16.zip)
32
- | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a8.zip)
33
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-float.zip)
34
- | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a16.zip)
35
- | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a8.zip)
36
- | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-tflite-w8a8.zip)
37
 
38
  For more device-specific assets and performance metrics, visit **[Detectron2-Detection on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detectron2_detection)**.
39
 
@@ -62,218 +62,214 @@ See our repository for [Detectron2-Detection on GitHub](https://github.com/qualc
62
  ## Performance Summary
63
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
64
  |---|---|---|---|---|---|---
65
- | proposal_generator | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 14.75 ms | 33 - 492 MB | NPU
66
- | proposal_generator | ONNX | float | Snapdragon® X2 Elite | 15.374 ms | 205 - 205 MB | NPU
67
- | proposal_generator | ONNX | float | Snapdragon® X Elite | 31.892 ms | 142 - 142 MB | NPU
68
- | proposal_generator | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 24.131 ms | 33 - 573 MB | NPU
69
- | proposal_generator | ONNX | float | Qualcomm® QCS8550 (Proxy) | 32.112 ms | 34 - 47 MB | NPU
70
- | proposal_generator | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 19.034 ms | 28 - 478 MB | NPU
71
- | proposal_generator | ONNX | float | Qualcomm® QCS9075 | 58.49 ms | 7 - 52 MB | NPU
72
- | proposal_generator | ONNX | float | Qualcomm® QCS8750 | 19.034 ms | 28 - 478 MB | NPU
73
- | proposal_generator | ONNX | float | Qualcomm® QCS7181 | 31.892 ms | 142 - 142 MB | NPU
74
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 8.555 ms | 20 - 521 MB | NPU
75
- | proposal_generator | ONNX | w8a16 | Snapdragon® X2 Elite | 9.763 ms | 208 - 208 MB | NPU
76
- | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.932 ms | 178 - 178 MB | NPU
77
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 13.661 ms | 18 - 559 MB | NPU
78
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS6490 | 3000.042 ms | 188 - 205 MB | CPU
79
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 19.4 ms | 1 - 56 MB | NPU
80
- | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 1406.716 ms | 190 - 198 MB | CPU
81
- | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 11.034 ms | 17 - 498 MB | NPU
82
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS9075 | 28.962 ms | 16 - 62 MB | NPU
83
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS7790 | 1406.716 ms | 190 - 198 MB | CPU
84
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8750 | 11.034 ms | 17 - 498 MB | NPU
85
- | proposal_generator | ONNX | w8a16 | Qualcomm® QCS7181 | 19.932 ms | 178 - 178 MB | NPU
86
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.802 ms | 9 - 432 MB | NPU
87
- | proposal_generator | ONNX | w8a8 | Snapdragon® X2 Elite | 4.937 ms | 210 - 210 MB | NPU
88
- | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.822 ms | 180 - 180 MB | NPU
89
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 8.578 ms | 9 - 480 MB | NPU
90
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS6490 | 440.45 ms | 153 - 180 MB | CPU
91
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.939 ms | 0 - 38 MB | NPU
92
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS9075 | 15.726 ms | 8 - 53 MB | NPU
93
- | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 356.922 ms | 125 - 134 MB | CPU
94
- | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.258 ms | 9 - 433 MB | NPU
95
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS7790 | 356.922 ms | 125 - 134 MB | CPU
96
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8750 | 6.258 ms | 9 - 433 MB | NPU
97
- | proposal_generator | ONNX | w8a8 | Qualcomm® QCS7181 | 11.822 ms | 180 - 180 MB | NPU
98
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.237 ms | 7 - 494 MB | NPU
99
- | proposal_generator | QNN_DLC | float | Snapdragon® X2 Elite | 22.071 ms | 7 - 7 MB | NPU
100
- | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.611 ms | 7 - 7 MB | NPU
101
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 37.691 ms | 7 - 554 MB | NPU
102
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8275 | 184.657 ms | 3 - 470 MB | NPU
103
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 54.561 ms | 8 - 10 MB | NPU
104
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8775P | 67.504 ms | 2 - 469 MB | NPU
105
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8650P | 67.504 ms | 2 - 469 MB | NPU
106
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8255P | 67.504 ms | 2 - 469 MB | NPU
107
- | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 28.08 ms | 0 - 476 MB | NPU
108
- | proposal_generator | QNN_DLC | float | Qualcomm® SA7255P | 184.657 ms | 3 - 470 MB | NPU
109
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS9075 | 79.034 ms | 7 - 27 MB | NPU
110
- | proposal_generator | QNN_DLC | float | Qualcomm® SA8295P | 77.009 ms | 0 - 433 MB | NPU
111
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 86.58 ms | 7 - 501 MB | NPU
112
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS8750 | 28.08 ms | 0 - 476 MB | NPU
113
- | proposal_generator | QNN_DLC | float | Qualcomm® QCS7181 | 54.611 ms | 7 - 7 MB | NPU
114
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 23.222 ms | 4 - 451 MB | NPU
115
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 24.592 ms | 4 - 4 MB | NPU
116
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 56.664 ms | 4 - 4 MB | NPU
117
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 36.213 ms | 0 - 752 MB | NPU
118
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 164.199 ms | 3 - 13 MB | NPU
119
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 97.348 ms | 2 - 547 MB | NPU
120
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 54.842 ms | 4 - 8 MB | NPU
121
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8775P | 54.586 ms | 1 - 547 MB | NPU
122
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8650P | 54.586 ms | 1 - 547 MB | NPU
123
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8255P | 54.586 ms | 1 - 547 MB | NPU
124
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 63.767 ms | 4 - 530 MB | NPU
125
- | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 25.444 ms | 4 - 444 MB | NPU
126
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA7255P | 97.348 ms | 2 - 547 MB | NPU
127
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 418.837 ms | 4 - 538 MB | NPU
128
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8295P | 65.755 ms | 0 - 542 MB | NPU
129
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 76.322 ms | 1 - 11 MB | NPU
130
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 62.026 ms | 4 - 737 MB | NPU
131
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS7790 | 63.767 ms | 4 - 530 MB | NPU
132
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8750 | 25.444 ms | 4 - 444 MB | NPU
133
- | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 56.664 ms | 4 - 4 MB | NPU
134
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 20.868 ms | 2 - 434 MB | NPU
135
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 21.26 ms | 2 - 2 MB | NPU
136
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.345 ms | 2 - 2 MB | NPU
137
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 27.331 ms | 2 - 498 MB | NPU
138
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 64.869 ms | 2 - 8 MB | NPU
139
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 71.692 ms | 2 - 438 MB | NPU
140
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 40.25 ms | 2 - 4 MB | NPU
141
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8775P | 40.367 ms | 2 - 439 MB | NPU
142
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8650P | 40.367 ms | 2 - 439 MB | NPU
143
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8255P | 40.367 ms | 2 - 439 MB | NPU
144
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 43.947 ms | 1 - 7 MB | NPU
145
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 46.885 ms | 2 - 487 MB | NPU
146
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 29.517 ms | 2 - 435 MB | NPU
147
- | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 23.735 ms | 2 - 440 MB | NPU
148
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 200.777 ms | 2 - 440 MB | NPU
149
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8295P | 45.128 ms | 3 - 440 MB | NPU
150
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA7255P | 71.692 ms | 2 - 438 MB | NPU
151
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 29.517 ms | 2 - 435 MB | NPU
152
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 23.735 ms | 2 - 440 MB | NPU
153
- | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 41.345 ms | 2 - 2 MB | NPU
154
- | proposal_generator | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 22.2 ms | 10 - 504 MB | NPU
155
- | proposal_generator | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 37.722 ms | 10 - 582 MB | NPU
156
- | proposal_generator | TFLITE | float | Qualcomm® SA8295P | 77.733 ms | 11 - 453 MB | NPU
157
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 29.914 ms | 2 - 503 MB | NPU
158
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8275 | 73.303 ms | 3 - 443 MB | NPU
159
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 42.773 ms | 3 - 6 MB | NPU
160
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8775P | 43.196 ms | 3 - 443 MB | NPU
161
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8650P | 43.196 ms | 3 - 443 MB | NPU
162
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8255P | 43.196 ms | 3 - 443 MB | NPU
163
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS9075 | 46.004 ms | 2 - 31 MB | NPU
164
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 46.679 ms | 3 - 494 MB | NPU
165
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 36.878 ms | 1 - 448 MB | NPU
166
- | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 25.39 ms | 2 - 434 MB | NPU
167
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8295P | 49.861 ms | 3 - 444 MB | NPU
168
- | proposal_generator | TFLITE | w8a8 | Qualcomm® SA7255P | 73.303 ms | 3 - 443 MB | NPU
169
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS7790 | 36.878 ms | 1 - 448 MB | NPU
170
- | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8750 | 25.39 ms | 2 - 434 MB | NPU
171
- | roi_head | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 28.565 ms | 10 - 1473 MB | NPU
172
- | roi_head | ONNX | float | Snapdragon® X2 Elite | 31.279 ms | 202 - 202 MB | NPU
173
- | roi_head | ONNX | float | Snapdragon® X Elite | 64.708 ms | 171 - 171 MB | NPU
174
- | roi_head | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 49.026 ms | 10 - 1540 MB | NPU
175
- | roi_head | ONNX | float | Qualcomm® QCS8550 (Proxy) | 64.547 ms | 10 - 94 MB | NPU
176
- | roi_head | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 44.216 ms | 1 - 1381 MB | NPU
177
- | roi_head | ONNX | float | Qualcomm® QCS9075 | 115.763 ms | 10 - 64 MB | NPU
178
- | roi_head | ONNX | float | Qualcomm® QCS8750 | 44.216 ms | 1 - 1381 MB | NPU
179
- | roi_head | ONNX | float | Qualcomm® QCS7181 | 64.708 ms | 171 - 171 MB | NPU
180
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 15.493 ms | 5 - 485 MB | NPU
181
- | roi_head | ONNX | w8a16 | Snapdragon® X2 Elite | 17.652 ms | 208 - 208 MB | NPU
182
- | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 34.337 ms | 176 - 176 MB | NPU
183
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 24.705 ms | 5 - 492 MB | NPU
184
- | roi_head | ONNX | w8a16 | Qualcomm® QCS6490 | 8736.241 ms | 3030 - 3043 MB | CPU
185
- | roi_head | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 33.476 ms | 0 - 43 MB | NPU
186
- | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3789.73 ms | 2953 - 2960 MB | CPU
187
- | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 20.734 ms | 2 - 481 MB | NPU
188
- | roi_head | ONNX | w8a16 | Qualcomm® QCS9075 | 45.37 ms | 5 - 50 MB | NPU
189
- | roi_head | ONNX | w8a16 | Qualcomm® QCS7790 | 3789.73 ms | 2953 - 2960 MB | CPU
190
- | roi_head | ONNX | w8a16 | Qualcomm® QCS8750 | 20.734 ms | 2 - 481 MB | NPU
191
- | roi_head | ONNX | w8a16 | Qualcomm® QCS7181 | 34.337 ms | 176 - 176 MB | NPU
192
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 8.332 ms | 2 - 323 MB | NPU
193
- | roi_head | ONNX | w8a8 | Snapdragon® X2 Elite | 9.066 ms | 210 - 210 MB | NPU
194
- | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 18.516 ms | 179 - 179 MB | NPU
195
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 12.525 ms | 3 - 365 MB | NPU
196
- | roi_head | ONNX | w8a8 | Qualcomm® QCS6490 | 1719.409 ms | 2531 - 2540 MB | CPU
197
- | roi_head | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 17.839 ms | 0 - 45 MB | NPU
198
- | roi_head | ONNX | w8a8 | Qualcomm® QCS9075 | 39.609 ms | 2 - 48 MB | NPU
199
- | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 987.81 ms | 2442 - 2449 MB | CPU
200
- | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 10.487 ms | 0 - 322 MB | NPU
201
- | roi_head | ONNX | w8a8 | Qualcomm® QCS7790 | 987.81 ms | 2442 - 2449 MB | CPU
202
- | roi_head | ONNX | w8a8 | Qualcomm® QCS8750 | 10.487 ms | 0 - 322 MB | NPU
203
- | roi_head | ONNX | w8a8 | Qualcomm® QCS7181 | 18.516 ms | 179 - 179 MB | NPU
204
- | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 27.92 ms | 10 - 1446 MB | NPU
205
- | roi_head | QNN_DLC | float | Snapdragon® X2 Elite | 31.205 ms | 10 - 10 MB | NPU
206
- | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.835 ms | 10 - 10 MB | NPU
207
- | roi_head | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 48.703 ms | 10 - 1598 MB | NPU
208
- | roi_head | QNN_DLC | float | Qualcomm® QCS8275 | 332.807 ms | 0 - 1397 MB | NPU
209
- | roi_head | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 64.786 ms | 10 - 328 MB | NPU
210
- | roi_head | QNN_DLC | float | Qualcomm® SA8775P | 96.154 ms | 0 - 1397 MB | NPU
211
- | roi_head | QNN_DLC | float | Qualcomm® SA8650P | 96.154 ms | 0 - 1397 MB | NPU
212
- | roi_head | QNN_DLC | float | Qualcomm® SA8255P | 96.154 ms | 0 - 1397 MB | NPU
213
- | roi_head | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 41.049 ms | 10 - 1366 MB | NPU
214
- | roi_head | QNN_DLC | float | Qualcomm® SA7255P | 332.807 ms | 0 - 1397 MB | NPU
215
- | roi_head | QNN_DLC | float | Qualcomm® QCS9075 | 103.423 ms | 10 - 21 MB | NPU
216
- | roi_head | QNN_DLC | float | Qualcomm® SA8295P | 88.672 ms | 0 - 387 MB | NPU
217
- | roi_head | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 116.209 ms | 3 - 433 MB | NPU
218
- | roi_head | QNN_DLC | float | Qualcomm® QCS8750 | 41.049 ms | 10 - 1366 MB | NPU
219
- | roi_head | QNN_DLC | float | Qualcomm® QCS7181 | 63.835 ms | 10 - 10 MB | NPU
220
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 14.024 ms | 5 - 427 MB | NPU
221
- | roi_head | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 15.9 ms | 5 - 5 MB | NPU
222
- | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 31.857 ms | 5 - 5 MB | NPU
223
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 25.094 ms | 5 - 438 MB | NPU
224
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 145.892 ms | 5 - 11 MB | NPU
225
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 96.96 ms | 5 - 384 MB | NPU
226
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 31.465 ms | 5 - 362 MB | NPU
227
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8775P | 31.518 ms | 1 - 380 MB | NPU
228
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8650P | 31.518 ms | 1 - 380 MB | NPU
229
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8255P | 31.518 ms | 1 - 380 MB | NPU
230
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 53.432 ms | 5 - 470 MB | NPU
231
- | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 18.77 ms | 5 - 430 MB | NPU
232
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA7255P | 96.96 ms | 5 - 384 MB | NPU
233
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 597.467 ms | 5 - 530 MB | NPU
234
- | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8295P | 51.608 ms | 0 - 381 MB | NPU
235
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 45.269 ms | 3 - 10 MB | NPU
236
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8450 (Proxy) | 47.933 ms | 5 - 436 MB | NPU
237
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS7790 | 53.432 ms | 5 - 470 MB | NPU
238
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8750 | 18.77 ms | 5 - 430 MB | NPU
239
- | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 31.857 ms | 5 - 5 MB | NPU
240
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 8.206 ms | 2 - 315 MB | NPU
241
- | roi_head | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 9.405 ms | 2 - 2 MB | NPU
242
- | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 19.568 ms | 2 - 2 MB | NPU
243
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 12.47 ms | 3 - 352 MB | NPU
244
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 86.381 ms | 1 - 5 MB | NPU
245
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 48.898 ms | 2 - 302 MB | NPU
246
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.663 ms | 3 - 6 MB | NPU
247
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8775P | 19.404 ms | 1 - 302 MB | NPU
248
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8650P | 19.404 ms | 1 - 302 MB | NPU
249
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8255P | 19.404 ms | 1 - 302 MB | NPU
250
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 39.655 ms | 0 - 4 MB | NPU
251
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 34.457 ms | 2 - 348 MB | NPU
252
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.498 ms | 2 - 326 MB | NPU
253
- | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 10.023 ms | 2 - 315 MB | NPU
254
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 306.411 ms | 2 - 382 MB | NPU
255
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8295P | 28.139 ms | 0 - 302 MB | NPU
256
- | roi_head | QNN_DLC | w8a8 | Qualcomm® SA7255P | 48.898 ms | 2 - 302 MB | NPU
257
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 30.498 ms | 2 - 326 MB | NPU
258
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 10.023 ms | 2 - 315 MB | NPU
259
- | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 19.568 ms | 2 - 2 MB | NPU
260
- | roi_head | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1992.262 ms | 0 - 2959 MB | NPU
261
- | roi_head | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 494.582 ms | 0 - 3366 MB | CPU
262
- | roi_head | TFLITE | float | Qualcomm® SA8295P | 1036.64 ms | 1 - 1601 MB | CPU
263
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 290.308 ms | 1 - 1595 MB | NPU
264
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8275 | 519.412 ms | 0 - 1278 MB | NPU
265
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 364.301 ms | 0 - 4 MB | NPU
266
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8775P | 366.721 ms | 0 - 1279 MB | NPU
267
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8650P | 366.721 ms | 0 - 1279 MB | NPU
268
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8255P | 366.721 ms | 0 - 1279 MB | NPU
269
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS9075 | 396.939 ms | 0 - 33 MB | NPU
270
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 872.801 ms | 1 - 806 MB | NPU
271
- | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1806.313 ms | 1116 - 2374 MB | NPU
272
- | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 196.134 ms | 0 - 1350 MB | NPU
273
- | roi_head | TFLITE | w8a8 | Qualcomm® SA8295P | 384.008 ms | 0 - 666 MB | NPU
274
- | roi_head | TFLITE | w8a8 | Qualcomm® SA7255P | 519.412 ms | 0 - 1278 MB | NPU
275
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS7790 | 1806.313 ms | 1116 - 2374 MB | NPU
276
- | roi_head | TFLITE | w8a8 | Qualcomm® QCS8750 | 196.134 ms | 0 - 1350 MB | NPU
277
 
278
  ## License
279
  * The license for the original implementation of Detectron2-Detection can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-onnx-float.zip)
31
+ | ONNX | w8a16 | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-onnx-w8a16.zip)
32
+ | ONNX | w8a8 | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-onnx-w8a8.zip)
33
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-qnn_dlc-float.zip)
34
+ | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-qnn_dlc-w8a16.zip)
35
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-qnn_dlc-w8a8.zip)
36
+ | TFLITE | w8a8 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-tflite-w8a8.zip)
37
 
38
  For more device-specific assets and performance metrics, visit **[Detectron2-Detection on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/detectron2_detection)**.
39
 
 
62
  ## Performance Summary
63
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
64
  |---|---|---|---|---|---|---
65
+ | proposal_generator | ONNX | float | Snapdragon® X2 Elite | 16.136 ms | 205 - 205 MB | NPU
66
+ | proposal_generator | ONNX | float | Snapdragon® X Elite | 33.277 ms | 142 - 142 MB | NPU
67
+ | proposal_generator | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 24.979 ms | 31 - 555 MB | NPU
68
+ | proposal_generator | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 63.028 ms | 31 - 504 MB | NPU
69
+ | proposal_generator | ONNX | float | Qualcomm® QCS8550 (Proxy) | 34.104 ms | 12 - 48 MB | NPU
70
+ | proposal_generator | ONNX | float | Qualcomm® QCS8450 | 63.028 ms | 31 - 504 MB | NPU
71
+ | proposal_generator | ONNX | float | Snapdragon® 8 Elite Mobile | 20.538 ms | 3 - 461 MB | NPU
72
+ | proposal_generator | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 15.898 ms | 25 - 492 MB | NPU
73
+ | proposal_generator | ONNX | float | Qualcomm® QCS9075 | 58.21 ms | 7 - 53 MB | NPU
74
+ | proposal_generator | ONNX | float | Qualcomm® QCS8750 | 20.538 ms | 3 - 461 MB | NPU
75
+ | proposal_generator | ONNX | float | Qualcomm® QCS7181 | 33.277 ms | 142 - 142 MB | NPU
76
+ | proposal_generator | ONNX | w8a16 | Snapdragon® X2 Elite | 10.816 ms | 209 - 209 MB | NPU
77
+ | proposal_generator | ONNX | w8a16 | Snapdragon® X Elite | 19.627 ms | 178 - 178 MB | NPU
78
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 13.611 ms | 18 - 545 MB | NPU
79
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 33.933 ms | 15 - 520 MB | NPU
80
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS6490 | 91.001 ms | 18 - 63 MB | NPU
81
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 19.063 ms | 5 - 43 MB | NPU
82
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8450 | 33.933 ms | 15 - 520 MB | NPU
83
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 9.488 ms | 14 - 487 MB | NPU
84
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 11.666 ms | 14 - 482 MB | NPU
85
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS9075 | 28.557 ms | 16 - 61 MB | NPU
86
+ | proposal_generator | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 33.476 ms | 17 - 498 MB | NPU
87
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCM6690 | 282.554 ms | 17 - 572 MB | NPU
88
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS7790 | 33.476 ms | 17 - 498 MB | NPU
89
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS8750 | 11.666 ms | 14 - 482 MB | NPU
90
+ | proposal_generator | ONNX | w8a16 | Qualcomm® QCS7181 | 19.627 ms | 178 - 178 MB | NPU
91
+ | proposal_generator | ONNX | w8a8 | Snapdragon® X2 Elite | 4.567 ms | 211 - 211 MB | NPU
92
+ | proposal_generator | ONNX | w8a8 | Snapdragon® X Elite | 11.227 ms | 180 - 180 MB | NPU
93
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 8.176 ms | 8 - 490 MB | NPU
94
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 15.699 ms | 8 - 483 MB | NPU
95
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS6490 | 36.513 ms | 7 - 52 MB | NPU
96
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.396 ms | 0 - 26 MB | NPU
97
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8450 | 15.699 ms | 8 - 483 MB | NPU
98
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS9075 | 17.866 ms | 7 - 53 MB | NPU
99
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 19.081 ms | 10 - 442 MB | NPU
100
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 4.491 ms | 10 - 445 MB | NPU
101
+ | proposal_generator | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 6.19 ms | 9 - 431 MB | NPU
102
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCM6690 | 134.697 ms | 8 - 430 MB | NPU
103
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS7790 | 19.081 ms | 10 - 442 MB | NPU
104
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS8750 | 6.19 ms | 9 - 431 MB | NPU
105
+ | proposal_generator | ONNX | w8a8 | Qualcomm® QCS7181 | 11.227 ms | 180 - 180 MB | NPU
106
+ | proposal_generator | QNN_DLC | float | Snapdragon® X2 Elite | 22.185 ms | 7 - 7 MB | NPU
107
+ | proposal_generator | QNN_DLC | float | Snapdragon® X Elite | 54.403 ms | 7 - 7 MB | NPU
108
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 36.791 ms | 5 - 547 MB | NPU
109
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 85.948 ms | 7 - 502 MB | NPU
110
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8275 | 184.342 ms | 2 - 469 MB | NPU
111
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 54.358 ms | 7 - 11 MB | NPU
112
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8450 | 85.948 ms | 7 - 502 MB | NPU
113
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 28.342 ms | 7 - 484 MB | NPU
114
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA7255P | 184.342 ms | 2 - 469 MB | NPU
115
+ | proposal_generator | QNN_DLC | float | Qualcomm® SA8295P | 76.872 ms | 0 - 433 MB | NPU
116
+ | proposal_generator | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 21.601 ms | 7 - 500 MB | NPU
117
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS9075 | 78.84 ms | 7 - 27 MB | NPU
118
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS8750 | 28.342 ms | 7 - 484 MB | NPU
119
+ | proposal_generator | QNN_DLC | float | Qualcomm® QCS7181 | 54.403 ms | 7 - 7 MB | NPU
120
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 24.666 ms | 4 - 4 MB | NPU
121
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® X Elite | 56.364 ms | 4 - 4 MB | NPU
122
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 36.634 ms | 4 - 754 MB | NPU
123
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 61.086 ms | 4 - 736 MB | NPU
124
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 164.598 ms | 2 - 12 MB | NPU
125
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 97.762 ms | 1 - 546 MB | NPU
126
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 54.425 ms | 4 - 6 MB | NPU
127
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 61.086 ms | 4 - 736 MB | NPU
128
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 22.906 ms | 4 - 455 MB | NPU
129
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 25.433 ms | 4 - 442 MB | NPU
130
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 76.817 ms | 1 - 11 MB | NPU
131
+ | proposal_generator | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 63.688 ms | 4 - 530 MB | NPU
132
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 438.974 ms | 4 - 539 MB | NPU
133
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA8295P | 65.471 ms | 0 - 542 MB | NPU
134
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® SA7255P | 97.762 ms | 1 - 546 MB | NPU
135
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS7790 | 63.688 ms | 4 - 530 MB | NPU
136
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS8750 | 25.433 ms | 4 - 442 MB | NPU
137
+ | proposal_generator | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 56.364 ms | 4 - 4 MB | NPU
138
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 21.273 ms | 2 - 2 MB | NPU
139
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® X Elite | 41.494 ms | 2 - 2 MB | NPU
140
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 27.217 ms | 0 - 492 MB | NPU
141
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 47.211 ms | 2 - 487 MB | NPU
142
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 65.81 ms | 4 - 10 MB | NPU
143
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 71.717 ms | 2 - 439 MB | NPU
144
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 40.17 ms | 2 - 6 MB | NPU
145
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 47.211 ms | 2 - 487 MB | NPU
146
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 43.498 ms | 2 - 8 MB | NPU
147
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA7255P | 71.717 ms | 2 - 439 MB | NPU
148
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 29.203 ms | 2 - 435 MB | NPU
149
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® SA8295P | 45.108 ms | 2 - 439 MB | NPU
150
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 20.813 ms | 2 - 439 MB | NPU
151
+ | proposal_generator | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 23.574 ms | 2 - 440 MB | NPU
152
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 208.528 ms | 2 - 441 MB | NPU
153
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 29.203 ms | 2 - 435 MB | NPU
154
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 23.574 ms | 2 - 440 MB | NPU
155
+ | proposal_generator | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 41.494 ms | 2 - 2 MB | NPU
156
+ | proposal_generator | TFLITE | float | Qualcomm® SA8295P | 77.874 ms | 11 - 452 MB | NPU
157
+ | proposal_generator | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 21.864 ms | 10 - 505 MB | NPU
158
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 30.091 ms | 1 - 501 MB | NPU
159
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8275 | 73.158 ms | 3 - 443 MB | NPU
160
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 43.094 ms | 3 - 6 MB | NPU
161
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS9075 | 46.03 ms | 1 - 29 MB | NPU
162
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA7255P | 73.158 ms | 3 - 443 MB | NPU
163
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 36.528 ms | 1 - 448 MB | NPU
164
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® SA8295P | 49.706 ms | 3 - 444 MB | NPU
165
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 23.444 ms | 1 - 451 MB | NPU
166
+ | proposal_generator | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 24.849 ms | 1 - 434 MB | NPU
167
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS7790 | 36.528 ms | 1 - 448 MB | NPU
168
+ | proposal_generator | TFLITE | w8a8 | Qualcomm® QCS8750 | 24.849 ms | 1 - 434 MB | NPU
169
+ | roi_head | ONNX | float | Snapdragon® X2 Elite | 31.75 ms | 203 - 203 MB | NPU
170
+ | roi_head | ONNX | float | Snapdragon® X Elite | 64.403 ms | 173 - 173 MB | NPU
171
+ | roi_head | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 49.089 ms | 10 - 1408 MB | NPU
172
+ | roi_head | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 96.92 ms | 11 - 436 MB | NPU
173
+ | roi_head | ONNX | float | Qualcomm® QCS8550 (Proxy) | 64.626 ms | 8 - 12 MB | NPU
174
+ | roi_head | ONNX | float | Qualcomm® QCS8450 | 96.92 ms | 11 - 436 MB | NPU
175
+ | roi_head | ONNX | float | Snapdragon® 8 Elite Mobile | 41.523 ms | 0 - 1200 MB | NPU
176
+ | roi_head | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 27.893 ms | 1 - 1286 MB | NPU
177
+ | roi_head | ONNX | float | Qualcomm® QCS9075 | 104.628 ms | 10 - 65 MB | NPU
178
+ | roi_head | ONNX | float | Qualcomm® QCS8750 | 41.523 ms | 0 - 1200 MB | NPU
179
+ | roi_head | ONNX | float | Qualcomm® QCS7181 | 64.403 ms | 173 - 173 MB | NPU
180
+ | roi_head | ONNX | w8a16 | Snapdragon® X2 Elite | 15.966 ms | 208 - 208 MB | NPU
181
+ | roi_head | ONNX | w8a16 | Snapdragon® X Elite | 32.727 ms | 148 - 148 MB | NPU
182
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 25.864 ms | 0 - 440 MB | NPU
183
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 48.467 ms | 5 - 443 MB | NPU
184
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS6490 | 138.626 ms | 5 - 50 MB | NPU
185
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 32.563 ms | 5 - 9 MB | NPU
186
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS8450 | 48.467 ms | 5 - 443 MB | NPU
187
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 13.903 ms | 1 - 439 MB | NPU
188
+ | roi_head | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 19.34 ms | 2 - 443 MB | NPU
189
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS9075 | 46.265 ms | 5 - 50 MB | NPU
190
+ | roi_head | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 60.383 ms | 5 - 532 MB | NPU
191
+ | roi_head | ONNX | w8a16 | Qualcomm® QCM6690 | 587.684 ms | 5 - 829 MB | NPU
192
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS7790 | 60.383 ms | 5 - 532 MB | NPU
193
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS8750 | 19.34 ms | 2 - 443 MB | NPU
194
+ | roi_head | ONNX | w8a16 | Qualcomm® QCS7181 | 32.727 ms | 148 - 148 MB | NPU
195
+ | roi_head | ONNX | w8a8 | Snapdragon® X2 Elite | 9.047 ms | 210 - 210 MB | NPU
196
+ | roi_head | ONNX | w8a8 | Snapdragon® X Elite | 19.056 ms | 179 - 179 MB | NPU
197
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 12.593 ms | 3 - 343 MB | NPU
198
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 42.926 ms | 3 - 343 MB | NPU
199
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS6490 | 88.673 ms | 2 - 48 MB | NPU
200
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.449 ms | 0 - 21 MB | NPU
201
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS8450 | 42.926 ms | 3 - 343 MB | NPU
202
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS9075 | 39.542 ms | 2 - 48 MB | NPU
203
+ | roi_head | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 31.307 ms | 3 - 343 MB | NPU
204
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 8.342 ms | 0 - 318 MB | NPU
205
+ | roi_head | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 10.037 ms | 0 - 318 MB | NPU
206
+ | roi_head | ONNX | w8a8 | Qualcomm® QCM6690 | 306.11 ms | 3 - 478 MB | NPU
207
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS7790 | 31.307 ms | 3 - 343 MB | NPU
208
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS8750 | 10.037 ms | 0 - 318 MB | NPU
209
+ | roi_head | ONNX | w8a8 | Qualcomm® QCS7181 | 19.056 ms | 179 - 179 MB | NPU
210
+ | roi_head | QNN_DLC | float | Snapdragon® X2 Elite | 31.294 ms | 10 - 10 MB | NPU
211
+ | roi_head | QNN_DLC | float | Snapdragon® X Elite | 63.742 ms | 10 - 10 MB | NPU
212
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 48.01 ms | 10 - 1668 MB | NPU
213
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 116.633 ms | 3 - 437 MB | NPU
214
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8275 | 332.477 ms | 0 - 1466 MB | NPU
215
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 63.044 ms | 10 - 13 MB | NPU
216
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8450 | 116.633 ms | 3 - 437 MB | NPU
217
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 40.16 ms | 10 - 1369 MB | NPU
218
+ | roi_head | QNN_DLC | float | Qualcomm® SA7255P | 332.477 ms | 0 - 1466 MB | NPU
219
+ | roi_head | QNN_DLC | float | Qualcomm® SA8295P | 88.759 ms | 0 - 387 MB | NPU
220
+ | roi_head | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 27.429 ms | 10 - 1460 MB | NPU
221
+ | roi_head | QNN_DLC | float | Qualcomm® QCS9075 | 103.862 ms | 12 - 23 MB | NPU
222
+ | roi_head | QNN_DLC | float | Qualcomm® QCS8750 | 40.16 ms | 10 - 1369 MB | NPU
223
+ | roi_head | QNN_DLC | float | Qualcomm® QCS7181 | 63.742 ms | 10 - 10 MB | NPU
224
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 15.836 ms | 5 - 5 MB | NPU
225
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® X Elite | 32.046 ms | 5 - 5 MB | NPU
226
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 25.393 ms | 5 - 436 MB | NPU
227
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 47.614 ms | 5 - 438 MB | NPU
228
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS6490 | 145.573 ms | 3 - 10 MB | NPU
229
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8275 | 96.965 ms | 0 - 379 MB | NPU
230
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 31.391 ms | 5 - 7 MB | NPU
231
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 47.614 ms | 5 - 438 MB | NPU
232
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 13.93 ms | 4 - 432 MB | NPU
233
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 18.889 ms | 5 - 429 MB | NPU
234
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 45.261 ms | 4 - 11 MB | NPU
235
+ | roi_head | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 53.888 ms | 5 - 470 MB | NPU
236
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 633.522 ms | 5 - 522 MB | NPU
237
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA8295P | 51.669 ms | 0 - 381 MB | NPU
238
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® SA7255P | 96.965 ms | 0 - 379 MB | NPU
239
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS7790 | 53.888 ms | 5 - 470 MB | NPU
240
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS8750 | 18.889 ms | 5 - 429 MB | NPU
241
+ | roi_head | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 32.046 ms | 5 - 5 MB | NPU
242
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 9.439 ms | 2 - 2 MB | NPU
243
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® X Elite | 19.673 ms | 2 - 2 MB | NPU
244
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 12.499 ms | 2 - 349 MB | NPU
245
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 34.18 ms | 2 - 349 MB | NPU
246
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS6490 | 86.662 ms | 2 - 6 MB | NPU
247
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8275 | 48.925 ms | 2 - 303 MB | NPU
248
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 18.666 ms | 3 - 5 MB | NPU
249
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 34.18 ms | 2 - 349 MB | NPU
250
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 39.369 ms | 0 - 5 MB | NPU
251
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA7255P | 48.925 ms | 2 - 303 MB | NPU
252
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 30.435 ms | 2 - 326 MB | NPU
253
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® SA8295P | 28.153 ms | 0 - 301 MB | NPU
254
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 8.236 ms | 2 - 321 MB | NPU
255
+ | roi_head | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 10.018 ms | 2 - 317 MB | NPU
256
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 311.557 ms | 3 - 382 MB | NPU
257
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS7790 | 30.435 ms | 2 - 326 MB | NPU
258
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS8750 | 10.018 ms | 2 - 317 MB | NPU
259
+ | roi_head | QNN_DLC | w8a8 | Qualcomm® QCS7181 | 19.673 ms | 2 - 2 MB | NPU
260
+ | roi_head | TFLITE | float | Qualcomm® SA8295P | 1168.466 ms | 0 - 1600 MB | CPU
261
+ | roi_head | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1995.664 ms | 0 - 2991 MB | NPU
262
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 285.764 ms | 0 - 1593 MB | NPU
263
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8275 | 515.803 ms | 0 - 1278 MB | NPU
264
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 362.305 ms | 0 - 4 MB | NPU
265
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS9075 | 395.58 ms | 0 - 33 MB | NPU
266
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA7255P | 515.803 ms | 0 - 1278 MB | NPU
267
+ | roi_head | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1814.464 ms | 1143 - 2402 MB | NPU
268
+ | roi_head | TFLITE | w8a8 | Qualcomm® SA8295P | 387.574 ms | 0 - 665 MB | NPU
269
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 161.12 ms | 0 - 1473 MB | NPU
270
+ | roi_head | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 196.038 ms | 0 - 1349 MB | NPU
271
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS7790 | 1814.464 ms | 1143 - 2402 MB | NPU
272
+ | roi_head | TFLITE | w8a8 | Qualcomm® QCS8750 | 196.038 ms | 0 - 1349 MB | NPU
 
 
 
 
273
 
274
  ## License
275
  * The license for the original implementation of Detectron2-Detection can be found
release_assets.json CHANGED
@@ -1,61 +1,61 @@
1
  {
2
- "version": "0.55.0",
3
  "precisions": {
4
- "w8a16": {
5
  "universal_assets": {
 
 
 
 
 
 
 
6
  "qnn_dlc": {
7
  "tool_versions": {
8
  "qairt": "2.45.0.260326154327"
9
  },
10
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a16.zip"
11
  },
12
  "onnx": {
13
  "tool_versions": {
14
- "qairt": "2.42.0.251225135753_193295",
15
  "onnx_runtime": "1.25.0"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a16.zip"
18
  }
19
  }
20
  },
21
- "float": {
22
  "universal_assets": {
23
  "qnn_dlc": {
24
  "tool_versions": {
25
  "qairt": "2.45.0.260326154327"
26
  },
27
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-float.zip"
28
  },
29
  "onnx": {
30
  "tool_versions": {
31
- "qairt": "2.42.0.251225135753_193295",
32
  "onnx_runtime": "1.25.0"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-float.zip"
35
  }
36
  }
37
  },
38
- "w8a8": {
39
  "universal_assets": {
40
- "tflite": {
41
- "tool_versions": {
42
- "qairt": "2.45.0.260326154327",
43
- "litert": "1.4.3"
44
- },
45
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-tflite-w8a8.zip"
46
- },
47
  "qnn_dlc": {
48
  "tool_versions": {
49
  "qairt": "2.45.0.260326154327"
50
  },
51
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-qnn_dlc-w8a8.zip"
52
  },
53
  "onnx": {
54
  "tool_versions": {
55
- "qairt": "2.42.0.251225135753_193295",
56
  "onnx_runtime": "1.25.0"
57
  },
58
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.55.0/detectron2_detection-onnx-w8a8.zip"
59
  }
60
  }
61
  }
 
1
  {
2
+ "version": "0.56.0",
3
  "precisions": {
4
+ "w8a8": {
5
  "universal_assets": {
6
+ "tflite": {
7
+ "tool_versions": {
8
+ "qairt": "2.45.0.260326154327",
9
+ "litert": "1.4.4"
10
+ },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-tflite-w8a8.zip"
12
+ },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-qnn_dlc-w8a8.zip"
18
  },
19
  "onnx": {
20
  "tool_versions": {
21
+ "qairt": "2.45.0.260326154327",
22
  "onnx_runtime": "1.25.0"
23
  },
24
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-onnx-w8a8.zip"
25
  }
26
  }
27
  },
28
+ "w8a16": {
29
  "universal_assets": {
30
  "qnn_dlc": {
31
  "tool_versions": {
32
  "qairt": "2.45.0.260326154327"
33
  },
34
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-qnn_dlc-w8a16.zip"
35
  },
36
  "onnx": {
37
  "tool_versions": {
38
+ "qairt": "2.45.0.260326154327",
39
  "onnx_runtime": "1.25.0"
40
  },
41
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-onnx-w8a16.zip"
42
  }
43
  }
44
  },
45
+ "float": {
46
  "universal_assets": {
 
 
 
 
 
 
 
47
  "qnn_dlc": {
48
  "tool_versions": {
49
  "qairt": "2.45.0.260326154327"
50
  },
51
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-qnn_dlc-float.zip"
52
  },
53
  "onnx": {
54
  "tool_versions": {
55
+ "qairt": "2.45.0.260326154327",
56
  "onnx_runtime": "1.25.0"
57
  },
58
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/detectron2_detection/releases/v0.56.0/detectron2_detection-onnx-float.zip"
59
  }
60
  }
61
  }