Yolo-v7: Optimized for Qualcomm Devices
YoloV7 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of Yolo-v7 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for Yolo-v7 on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Model checkpoint: YoloV7 Tiny
- Input resolution: 640x640
- Number of parameters: 6.24M
- Model size (float): 23.8 MB
- Model size (w8a8): 6.23 MB
- Model size (w8a16): 6.66 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| Yolo-v7 | ONNX | float | Snapdragon® X2 Elite | 5.874 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® X Elite | 10.881 ms | 8 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 7.679 ms | 6 - 191 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 17.412 ms | 6 - 196 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.446 ms | 0 - 11 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® QCS8450 | 17.412 ms | 6 - 196 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 12.817 ms | 5 - 7 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.881 ms | 8 - 8 MB | NPU |
| Yolo-v7 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 6.552 ms | 1 - 171 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Mobile | 6.552 ms | 1 - 171 MB | NPU |
| Yolo-v7 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.93 ms | 1 - 173 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X2 Elite | 2.004 ms | 2 - 2 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® X Elite | 4.752 ms | 4 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.919 ms | 0 - 215 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 7.065 ms | 0 - 219 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 17.498 ms | 2 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 4.503 ms | 0 - 123 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® QCS8450 | 7.065 ms | 0 - 219 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 4.906 ms | 2 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 4.752 ms | 4 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 2.22 ms | 0 - 190 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 2.22 ms | 0 - 190 MB | NPU |
| Yolo-v7 | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.766 ms | 0 - 195 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X2 Elite | 1.069 ms | 1 - 1 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® X Elite | 2.452 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.531 ms | 0 - 79 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.22 ms | 0 - 80 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.38 ms | 1 - 4 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.395 ms | 0 - 8 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® QCS8450 | 3.22 ms | 0 - 80 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.561 ms | 0 - 3 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 2.452 ms | 5 - 5 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.232 ms | 0 - 54 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Mobile | 1.232 ms | 0 - 54 MB | NPU |
| Yolo-v7 | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.986 ms | 0 - 62 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X2 Elite | 6.341 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® X Elite | 10.058 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 6.94 ms | 5 - 184 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 16.202 ms | 5 - 183 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 23.377 ms | 2 - 156 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.286 ms | 5 - 6 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8775P | 11.481 ms | 0 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8650P | 11.481 ms | 0 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8255P | 11.481 ms | 0 - 159 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® QCS8450 | 16.202 ms | 5 - 183 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 11.707 ms | 7 - 13 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 10.058 ms | 5 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 6.353 ms | 0 - 160 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA7255P | 23.377 ms | 2 - 156 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Qualcomm® SA8295P | 13.351 ms | 0 - 152 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 6.353 ms | 0 - 160 MB | NPU |
| Yolo-v7 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.649 ms | 5 - 163 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 1.987 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® X Elite | 4.044 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.534 ms | 2 - 197 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 5.581 ms | 2 - 202 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 15.592 ms | 1 - 5 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8275 | 8.613 ms | 2 - 167 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 3.598 ms | 2 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8775P | 4.304 ms | 0 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8650P | 4.304 ms | 0 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8255P | 4.304 ms | 0 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 5.581 ms | 2 - 202 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 3.949 ms | 3 - 7 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 4.044 ms | 2 - 2 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 29.184 ms | 2 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 4.834 ms | 0 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 1.892 ms | 2 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA7255P | 8.613 ms | 2 - 167 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Qualcomm® SA8295P | 5.245 ms | 0 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 1.892 ms | 2 - 166 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.563 ms | 2 - 176 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4.834 ms | 0 - 170 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 0.993 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.317 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.314 ms | 1 - 58 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Gen 1 Mobile | 2.794 ms | 1 - 62 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.627 ms | 1 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 4.316 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.042 ms | 1 - 3 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8775P | 2.425 ms | 1 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8650P | 2.425 ms | 1 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8255P | 2.425 ms | 1 - 42 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® QCS8450 | 2.794 ms | 1 - 62 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.152 ms | 1 - 4 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ IQ-X7181 | 2.317 ms | 1 - 1 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 13.787 ms | 1 - 157 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.345 ms | 1 - 158 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.026 ms | 1 - 39 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA7255P | 4.316 ms | 1 - 41 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Qualcomm® SA8295P | 3.336 ms | 1 - 38 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Mobile | 1.026 ms | 1 - 39 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.775 ms | 0 - 39 MB | NPU |
| Yolo-v7 | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.345 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 6.935 ms | 0 - 190 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 16.281 ms | 0 - 185 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 23.549 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.439 ms | 1 - 3 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8775P | 11.499 ms | 1 - 162 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8650P | 11.499 ms | 1 - 162 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8255P | 11.499 ms | 1 - 162 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® QCS8450 | 16.281 ms | 0 - 185 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 11.292 ms | 1 - 20 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 6.317 ms | 1 - 161 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA7255P | 23.549 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Qualcomm® SA8295P | 13.287 ms | 1 - 158 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Mobile | 6.317 ms | 1 - 161 MB | NPU |
| Yolo-v7 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.725 ms | 1 - 166 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.403 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Gen 1 Mobile | 3.012 ms | 0 - 67 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS6490 | 8.123 ms | 0 - 10 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8275 | 4.628 ms | 0 - 43 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 2.055 ms | 0 - 2 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8775P | 2.553 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8650P | 2.553 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8255P | 2.553 ms | 0 - 62 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® QCS8450 | 3.012 ms | 0 - 67 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ IQ-9075 | 2.311 ms | 0 - 9 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-6690 | 14.545 ms | 0 - 157 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-7790 | 3.489 ms | 0 - 165 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® Dragonwing™ Q-8750 | 1.114 ms | 0 - 72 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA7255P | 4.628 ms | 0 - 43 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Qualcomm® SA8295P | 3.623 ms | 0 - 42 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Mobile | 1.114 ms | 0 - 72 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.891 ms | 0 - 86 MB | NPU |
| Yolo-v7 | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 3.489 ms | 0 - 165 MB | NPU |
License
- The license for the original implementation of Yolo-v7 can be found here.
References
- YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
- Source Model Implementation
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
