qaihm-bot commited on
Commit
af1135c
·
verified ·
1 Parent(s): 077c8b0

See https://github.com/qualcomm/ai-hub-models/releases/v0.60.0 for changelog.

Files changed (1) hide show
  1. README.md +145 -130
README.md CHANGED
@@ -15,18 +15,18 @@ pipeline_tag: object-detection
15
  Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.
16
 
17
  This is based on the implementation of YOLOv9-Detection found [here](https://github.com/ultralytics/ultralytics/tree/main/ultralytics/models/yolo/detect).
18
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/yolov9_det) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
22
  ## Getting Started
23
  Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
24
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/yolov9_det) Python library to compile and export the model with your own:
25
  - Custom weights (e.g., fine-tuned checkpoints)
26
  - Custom input shapes
27
  - Target device and runtime configurations
28
 
29
- See our repository for [YOLOv9-Detection on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/yolov9_det) for usage instructions.
30
 
31
 
32
  ## Model Details
@@ -34,141 +34,156 @@ See our repository for [YOLOv9-Detection on GitHub](https://github.com/qualcomm/
34
  **Model Type:** Model_use_case.object_detection
35
 
36
  **Model Stats:**
37
- - Model checkpoint: YOLOv9-T
38
  - Input resolution: 640x640
 
39
  - Model size (float): 8.84 MB
 
40
  - Model size (w8a8): 3.23 MB
41
  - Model size (w8a8_mixed_int16): 3.74 MB
42
- - Model size (w8a16): 3.25 MB
43
 
44
  ## Performance Summary
45
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
46
  |---|---|---|---|---|---|---
47
- | YOLOv9-Detection | ONNX | float | Snapdragon® X2 Elite | 3.838 ms | 5 - 5 MB | NPU
48
- | YOLOv9-Detection | ONNX | float | Snapdragon® X Elite | 10.864 ms | 5 - 5 MB | NPU
49
- | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.544 ms | 5 - 266 MB | NPU
50
- | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.172 ms | 5 - 252 MB | NPU
51
- | YOLOv9-Detection | ONNX | float | Qualcomm® QCS8450 | 17.172 ms | 5 - 252 MB | NPU
52
- | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.751 ms | 5 - 7 MB | NPU
53
- | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.864 ms | 5 - 5 MB | NPU
54
- | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 4.395 ms | 0 - 209 MB | NPU
55
- | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Mobile | 4.395 ms | 0 - 209 MB | NPU
56
- | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.512 ms | 1 - 227 MB | NPU
57
- | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X2 Elite | 91.058 ms | 2 - 2 MB | NPU
58
- | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X Elite | 314.851 ms | 1 - 1 MB | NPU
59
- | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 228.108 ms | 3 - 164 MB | NPU
60
- | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 390.715 ms | 3 - 164 MB | NPU
61
- | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 605.206 ms | 2 - 5 MB | NPU
62
- | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 300.092 ms | 3 - 5 MB | NPU
63
- | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® QCS8450 | 390.715 ms | 3 - 164 MB | NPU
64
- | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 304.075 ms | 2 - 5 MB | NPU
65
- | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 314.851 ms | 1 - 1 MB | NPU
66
- | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 115.322 ms | 1 - 132 MB | NPU
67
- | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 115.322 ms | 1 - 132 MB | NPU
68
- | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 91.438 ms | 0 - 136 MB | NPU
69
- | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X2 Elite | 110.864 ms | 1 - 1 MB | NPU
70
- | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X Elite | 188.552 ms | 0 - 0 MB | NPU
71
- | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.76 ms | 2 - 123 MB | NPU
72
- | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.777 ms | 2 - 124 MB | NPU
73
- | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 530.293 ms | 1 - 4 MB | NPU
74
- | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 179.048 ms | 2 - 4 MB | NPU
75
- | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® QCS8450 | 237.777 ms | 2 - 124 MB | NPU
76
- | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 181.993 ms | 1 - 4 MB | NPU
77
- | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 188.552 ms | 0 - 0 MB | NPU
78
- | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 143.558 ms | 2 - 103 MB | NPU
79
- | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 143.558 ms | 2 - 103 MB | NPU
80
- | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.295 ms | 0 - 102 MB | NPU
81
- | YOLOv9-Detection | QNN_DLC | float | Snapdragon® X2 Elite | 3.452 ms | 5 - 5 MB | NPU
82
- | YOLOv9-Detection | QNN_DLC | float | Snapdragon® X Elite | 8.79 ms | 5 - 5 MB | NPU
83
- | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 5.937 ms | 5 - 238 MB | NPU
84
- | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 13.848 ms | 4 - 234 MB | NPU
85
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 21.587 ms | 4 - 208 MB | NPU
86
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.122 ms | 5 - 17 MB | NPU
87
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8775P | 10.418 ms | 0 - 206 MB | NPU
88
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8650P | 10.418 ms | 0 - 206 MB | NPU
89
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8255P | 10.418 ms | 0 - 206 MB | NPU
90
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® QCS8450 | 13.848 ms | 4 - 234 MB | NPU
91
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 10.183 ms | 5 - 11 MB | NPU
92
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 8.79 ms | 5 - 5 MB | NPU
93
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.14 ms | 0 - 209 MB | NPU
94
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA7255P | 21.587 ms | 4 - 208 MB | NPU
95
- | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8295P | 13.411 ms | 0 - 203 MB | NPU
96
- | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.14 ms | 0 - 209 MB | NPU
97
- | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.825 ms | 5 - 212 MB | NPU
98
- | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 80.2 ms | 2 - 2 MB | NPU
99
- | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X Elite | 224.447 ms | 2 - 2 MB | NPU
100
- | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 165.734 ms | 2 - 120 MB | NPU
101
- | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 357.619 ms | 2 - 120 MB | NPU
102
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 605.298 ms | 1 - 5 MB | NPU
103
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8275 | 447.421 ms | 1 - 92 MB | NPU
104
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 214.684 ms | 3 - 4 MB | NPU
105
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8775P | 235.288 ms | 0 - 95 MB | NPU
106
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8650P | 235.288 ms | 0 - 95 MB | NPU
107
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8255P | 235.288 ms | 0 - 95 MB | NPU
108
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 357.619 ms | 2 - 120 MB | NPU
109
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 234.503 ms | 3 - 7 MB | NPU
110
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 224.447 ms | 2 - 2 MB | NPU
111
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 562.138 ms | 2 - 204 MB | NPU
112
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 285.78 ms | 2 - 215 MB | NPU
113
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 115.005 ms | 2 - 98 MB | NPU
114
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA7255P | 447.421 ms | 1 - 92 MB | NPU
115
- | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8295P | 301.816 ms | 0 - 96 MB | NPU
116
- | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 115.005 ms | 2 - 98 MB | NPU
117
- | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 79.77 ms | 2 - 102 MB | NPU
118
- | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 285.78 ms | 2 - 215 MB | NPU
119
- | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 100.585 ms | 1 - 1 MB | NPU
120
- | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X Elite | 176.012 ms | 1 - 1 MB | NPU
121
- | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.362 ms | 9 - 88 MB | NPU
122
- | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.808 ms | 1 - 84 MB | NPU
123
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 585.802 ms | 1 - 4 MB | NPU
124
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 347.577 ms | 2 - 63 MB | NPU
125
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.046 ms | 2 - 3 MB | NPU
126
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8775P | 170.736 ms | 1 - 64 MB | NPU
127
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8650P | 170.736 ms | 1 - 64 MB | NPU
128
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8255P | 170.736 ms | 1 - 64 MB | NPU
129
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 237.808 ms | 1 - 84 MB | NPU
130
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 189.592 ms | 2 - 5 MB | NPU
131
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 176.012 ms | 1 - 1 MB | NPU
132
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 510.248 ms | 1 - 186 MB | NPU
133
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 176.126 ms | 1 - 64 MB | NPU
134
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 133.37 ms | 2 - 64 MB | NPU
135
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA7255P | 347.577 ms | 2 - 63 MB | NPU
136
- | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8295P | 202.754 ms | 0 - 60 MB | NPU
137
- | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 133.37 ms | 2 - 64 MB | NPU
138
- | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.477 ms | 1 - 67 MB | NPU
139
- | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 176.126 ms | 1 - 64 MB | NPU
140
- | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 5.596 ms | 0 - 120 MB | NPU
141
- | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 11.961 ms | 0 - 111 MB | NPU
142
- | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 21.008 ms | 0 - 95 MB | NPU
143
- | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.723 ms | 0 - 3 MB | NPU
144
- | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8775P | 10.225 ms | 0 - 107 MB | NPU
145
- | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8650P | 10.225 ms | 0 - 107 MB | NPU
146
- | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8255P | 10.225 ms | 0 - 107 MB | NPU
147
- | YOLOv9-Detection | TFLITE | float | Qualcomm® QCS8450 | 11.961 ms | 0 - 111 MB | NPU
148
- | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 9.887 ms | 0 - 14 MB | NPU
149
- | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 2.96 ms | 0 - 99 MB | NPU
150
- | YOLOv9-Detection | TFLITE | float | Qualcomm® SA7255P | 21.008 ms | 0 - 95 MB | NPU
151
- | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8295P | 12.898 ms | 0 - 76 MB | NPU
152
- | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Mobile | 2.96 ms | 0 - 99 MB | NPU
153
- | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.324 ms | 0 - 117 MB | NPU
154
- | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.657 ms | 0 - 83 MB | NPU
155
- | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.786 ms | 0 - 82 MB | NPU
156
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 566.125 ms | 0 - 7 MB | NPU
157
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 347.774 ms | 0 - 61 MB | NPU
158
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.297 ms | 0 - 95 MB | NPU
159
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8775P | 182.804 ms | 0 - 63 MB | NPU
160
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8650P | 182.804 ms | 0 - 63 MB | NPU
161
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8255P | 182.804 ms | 0 - 63 MB | NPU
162
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® QCS8450 | 237.786 ms | 0 - 82 MB | NPU
163
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 181.601 ms | 0 - 7 MB | NPU
164
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 500.669 ms | 0 - 186 MB | NPU
165
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 179.395 ms | 0 - 59 MB | NPU
166
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 133.412 ms | 1 - 64 MB | NPU
167
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA7255P | 347.774 ms | 0 - 61 MB | NPU
168
- | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8295P | 202.907 ms | 0 - 58 MB | NPU
169
- | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 133.412 ms | 1 - 64 MB | NPU
170
- | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.462 ms | 0 - 63 MB | NPU
171
- | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 179.395 ms | 0 - 59 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
172
 
173
  ## License
174
  * The license for the original implementation of YOLOv9-Detection can be found
 
15
  Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.
16
 
17
  This is based on the implementation of YOLOv9-Detection found [here](https://github.com/ultralytics/ultralytics/tree/main/ultralytics/models/yolo/detect).
18
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/yolov9_det) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
22
  ## Getting Started
23
  Due to licensing restrictions, we cannot distribute pre-exported model assets for this model.
24
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/yolov9_det) Python library to compile and export the model with your own:
25
  - Custom weights (e.g., fine-tuned checkpoints)
26
  - Custom input shapes
27
  - Target device and runtime configurations
28
 
29
+ See our repository for [YOLOv9-Detection on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/yolov9_det) for usage instructions.
30
 
31
 
32
  ## Model Details
 
34
  **Model Type:** Model_use_case.object_detection
35
 
36
  **Model Stats:**
 
37
  - Input resolution: 640x640
38
+ - Model checkpoint: YOLOv9-T
39
  - Model size (float): 8.84 MB
40
+ - Model size (w8a16): 3.25 MB
41
  - Model size (w8a8): 3.23 MB
42
  - Model size (w8a8_mixed_int16): 3.74 MB
 
43
 
44
  ## Performance Summary
45
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
46
  |---|---|---|---|---|---|---
47
+ | YOLOv9-Detection | ONNX | float | Snapdragon® X2 Elite | 3.825 ms | 5 - 5 MB | NPU
48
+ | YOLOv9-Detection | ONNX | float | Snapdragon® X Elite | 10.796 ms | 5 - 5 MB | NPU
49
+ | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.573 ms | 5 - 270 MB | NPU
50
+ | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.218 ms | 5 - 254 MB | NPU
51
+ | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 11.234 ms | 5 - 8 MB | NPU
52
+ | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.446 ms | 5 - 10 MB | NPU
53
+ | YOLOv9-Detection | ONNX | float | Qualcomm® QCS8450 | 17.218 ms | 5 - 254 MB | NPU
54
+ | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.889 ms | 5 - 8 MB | NPU
55
+ | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.796 ms | 5 - 5 MB | NPU
56
+ | YOLOv9-Detection | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 4.403 ms | 1 - 215 MB | NPU
57
+ | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Mobile | 4.403 ms | 1 - 215 MB | NPU
58
+ | YOLOv9-Detection | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.511 ms | 1 - 231 MB | NPU
59
+ | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X2 Elite | 91.159 ms | 2 - 2 MB | NPU
60
+ | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® X Elite | 315.109 ms | 1 - 1 MB | NPU
61
+ | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 228.047 ms | 3 - 163 MB | NPU
62
+ | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 390.95 ms | 3 - 164 MB | NPU
63
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 606.067 ms | 2 - 5 MB | NPU
64
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 295.57 ms | 2 - 6 MB | NPU
65
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 299.994 ms | 2 - 7 MB | NPU
66
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® QCS8450 | 390.95 ms | 3 - 164 MB | NPU
67
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 304.496 ms | 2 - 5 MB | NPU
68
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 315.109 ms | 1 - 1 MB | NPU
69
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 647.723 ms | 2 - 238 MB | NPU
70
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 272.718 ms | 3 - 255 MB | NPU
71
+ | YOLOv9-Detection | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 115.309 ms | 1 - 129 MB | NPU
72
+ | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 115.309 ms | 1 - 129 MB | NPU
73
+ | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 91.376 ms | 2 - 135 MB | NPU
74
+ | YOLOv9-Detection | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 272.718 ms | 3 - 255 MB | NPU
75
+ | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X2 Elite | 110.718 ms | 1 - 1 MB | NPU
76
+ | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® X Elite | 188.477 ms | 0 - 0 MB | NPU
77
+ | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.551 ms | 1 - 120 MB | NPU
78
+ | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.973 ms | 2 - 123 MB | NPU
79
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 531.21 ms | 1 - 4 MB | NPU
80
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 176.996 ms | 1 - 5 MB | NPU
81
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 178.726 ms | 0 - 117 MB | NPU
82
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® QCS8450 | 237.973 ms | 2 - 123 MB | NPU
83
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 208.411 ms | 1 - 4 MB | NPU
84
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 188.477 ms | 0 - 0 MB | NPU
85
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 512.0 ms | 1 - 223 MB | NPU
86
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 171.551 ms | 1 - 216 MB | NPU
87
+ | YOLOv9-Detection | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 143.405 ms | 1 - 101 MB | NPU
88
+ | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 143.405 ms | 1 - 101 MB | NPU
89
+ | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.375 ms | 0 - 98 MB | NPU
90
+ | YOLOv9-Detection | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 171.551 ms | 1 - 216 MB | NPU
91
+ | YOLOv9-Detection | QNN_DLC | float | Snapdragon® X2 Elite | 3.463 ms | 5 - 5 MB | NPU
92
+ | YOLOv9-Detection | QNN_DLC | float | Snapdragon® X Elite | 8.804 ms | 5 - 5 MB | NPU
93
+ | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 5.921 ms | 5 - 241 MB | NPU
94
+ | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 13.874 ms | 4 - 235 MB | NPU
95
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 9.1 ms | 5 - 12 MB | NPU
96
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-8275 | 21.653 ms | 0 - 203 MB | NPU
97
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.119 ms | 5 - 6 MB | NPU
98
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8775P | 10.433 ms | 0 - 206 MB | NPU
99
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8650P | 10.433 ms | 0 - 206 MB | NPU
100
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8255P | 10.433 ms | 0 - 206 MB | NPU
101
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® QCS8450 | 13.874 ms | 4 - 235 MB | NPU
102
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 10.178 ms | 7 - 13 MB | NPU
103
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 8.804 ms | 5 - 5 MB | NPU
104
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 3.26 ms | 5 - 209 MB | NPU
105
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA7255P | 21.653 ms | 0 - 203 MB | NPU
106
+ | YOLOv9-Detection | QNN_DLC | float | Qualcomm® SA8295P | 13.358 ms | 0 - 203 MB | NPU
107
+ | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3.26 ms | 5 - 209 MB | NPU
108
+ | YOLOv9-Detection | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.828 ms | 5 - 211 MB | NPU
109
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 80.22 ms | 2 - 2 MB | NPU
110
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® X Elite | 224.595 ms | 2 - 2 MB | NPU
111
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 165.483 ms | 2 - 121 MB | NPU
112
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 357.269 ms | 3 - 121 MB | NPU
113
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 603.858 ms | 1 - 5 MB | NPU
114
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 228.516 ms | 1 - 6 MB | NPU
115
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-8275 | 447.555 ms | 1 - 94 MB | NPU
116
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 213.88 ms | 3 - 29 MB | NPU
117
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8775P | 235.314 ms | 2 - 96 MB | NPU
118
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8650P | 235.314 ms | 2 - 96 MB | NPU
119
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8255P | 235.314 ms | 2 - 96 MB | NPU
120
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 357.269 ms | 3 - 121 MB | NPU
121
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 235.01 ms | 2 - 6 MB | NPU
122
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 224.595 ms | 2 - 2 MB | NPU
123
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 562.367 ms | 2 - 203 MB | NPU
124
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 286.235 ms | 0 - 212 MB | NPU
125
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 114.841 ms | 0 - 96 MB | NPU
126
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA7255P | 447.555 ms | 1 - 94 MB | NPU
127
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Qualcomm® SA8295P | 301.58 ms | 0 - 91 MB | NPU
128
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 114.841 ms | 0 - 96 MB | NPU
129
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 79.79 ms | 2 - 100 MB | NPU
130
+ | YOLOv9-Detection | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 286.235 ms | 0 - 212 MB | NPU
131
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 100.814 ms | 1 - 1 MB | NPU
132
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® X Elite | 176.146 ms | 1 - 1 MB | NPU
133
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.238 ms | 1 - 80 MB | NPU
134
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.529 ms | 1 - 83 MB | NPU
135
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 582.81 ms | 1 - 4 MB | NPU
136
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 177.087 ms | 1 - 5 MB | NPU
137
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 347.516 ms | 1 - 63 MB | NPU
138
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.082 ms | 0 - 15 MB | NPU
139
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8775P | 170.886 ms | 2 - 64 MB | NPU
140
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8650P | 170.886 ms | 2 - 64 MB | NPU
141
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8255P | 170.886 ms | 2 - 64 MB | NPU
142
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 237.529 ms | 1 - 83 MB | NPU
143
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 170.232 ms | 1 - 4 MB | NPU
144
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 176.146 ms | 1 - 1 MB | NPU
145
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 510.506 ms | 3 - 188 MB | NPU
146
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 175.946 ms | 1 - 63 MB | NPU
147
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 133.355 ms | 2 - 65 MB | NPU
148
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA7255P | 347.516 ms | 1 - 63 MB | NPU
149
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Qualcomm® SA8295P | 202.988 ms | 1 - 62 MB | NPU
150
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 133.355 ms | 2 - 65 MB | NPU
151
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.577 ms | 1 - 67 MB | NPU
152
+ | YOLOv9-Detection | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 175.946 ms | 1 - 63 MB | NPU
153
+ | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 5.581 ms | 0 - 125 MB | NPU
154
+ | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 11.974 ms | 0 - 110 MB | NPU
155
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 8.74 ms | 0 - 14 MB | NPU
156
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-8275 | 21.03 ms | 0 - 95 MB | NPU
157
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 7.691 ms | 0 - 2 MB | NPU
158
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8775P | 10.205 ms | 0 - 107 MB | NPU
159
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8650P | 10.205 ms | 0 - 107 MB | NPU
160
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8255P | 10.205 ms | 0 - 107 MB | NPU
161
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® QCS8450 | 11.974 ms | 0 - 110 MB | NPU
162
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 13.379 ms | 0 - 14 MB | NPU
163
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 2.966 ms | 0 - 103 MB | NPU
164
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® SA7255P | 21.03 ms | 0 - 95 MB | NPU
165
+ | YOLOv9-Detection | TFLITE | float | Qualcomm® SA8295P | 12.878 ms | 0 - 77 MB | NPU
166
+ | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Mobile | 2.966 ms | 0 - 103 MB | NPU
167
+ | YOLOv9-Detection | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.33 ms | 0 - 115 MB | NPU
168
+ | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 136.648 ms | 0 - 81 MB | NPU
169
+ | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 237.725 ms | 0 - 83 MB | NPU
170
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 566.744 ms | 0 - 7 MB | NPU
171
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 176.892 ms | 0 - 7 MB | NPU
172
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-8275 | 347.711 ms | 0 - 60 MB | NPU
173
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 167.004 ms | 0 - 5 MB | NPU
174
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8775P | 182.756 ms | 0 - 63 MB | NPU
175
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8650P | 182.756 ms | 0 - 63 MB | NPU
176
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8255P | 182.756 ms | 0 - 63 MB | NPU
177
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® QCS8450 | 237.725 ms | 0 - 83 MB | NPU
178
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 182.065 ms | 0 - 7 MB | NPU
179
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 500.671 ms | 0 - 186 MB | NPU
180
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 178.944 ms | 0 - 59 MB | NPU
181
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 133.131 ms | 1 - 61 MB | NPU
182
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA7255P | 347.711 ms | 0 - 60 MB | NPU
183
+ | YOLOv9-Detection | TFLITE | w8a8 | Qualcomm® SA8295P | 202.849 ms | 0 - 58 MB | NPU
184
+ | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 133.131 ms | 1 - 61 MB | NPU
185
+ | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 110.311 ms | 0 - 65 MB | NPU
186
+ | YOLOv9-Detection | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 178.944 ms | 0 - 59 MB | NPU
187
 
188
  ## License
189
  * The license for the original implementation of YOLOv9-Detection can be found