Yolo-v5: Optimized for Qualcomm Devices
YoloV5 is a machine learning model that predicts bounding boxes and classes of objects in an image.
This is based on the implementation of Yolo-v5 found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.
Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.
Getting Started
Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:
- Custom weights (e.g., fine-tuned checkpoints)
- Custom input shapes
- Target device and runtime configurations
See our repository for Yolo-v5 on GitHub for usage instructions.
Model Details
Model Type: Model_use_case.object_detection
Model Stats:
- Model checkpoint: YoloV5-M
- Input resolution: 640x640
- Number of parameters: 21.2M
- Model size (float): 81.1 MB
- Model size (w8a16): 21.8 MB
Performance Summary
| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit |
|---|---|---|---|---|---|---|
| Yolo-v5 | ONNX | float | Snapdragon® X2 Elite | 7.272 ms | 5 - 5 MB | NPU |
| Yolo-v5 | ONNX | float | Snapdragon® X Elite | 13.51 ms | 47 - 47 MB | NPU |
| Yolo-v5 | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 9.614 ms | 0 - 242 MB | NPU |
| Yolo-v5 | ONNX | float | Snapdragon® 8 Gen 1 Mobile | 27.756 ms | 1 - 269 MB | NPU |
| Yolo-v5 | ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 13.094 ms | 0 - 53 MB | NPU |
| Yolo-v5 | ONNX | float | Qualcomm® QCS8450 | 27.756 ms | 1 - 269 MB | NPU |
| Yolo-v5 | ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 20.814 ms | 5 - 12 MB | NPU |
| Yolo-v5 | ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 13.51 ms | 47 - 47 MB | NPU |
| Yolo-v5 | ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 7.485 ms | 3 - 204 MB | NPU |
| Yolo-v5 | ONNX | float | Snapdragon® 8 Elite Mobile | 7.485 ms | 3 - 204 MB | NPU |
| Yolo-v5 | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.784 ms | 3 - 215 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Snapdragon® X2 Elite | 5.052 ms | 2 - 2 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Snapdragon® X Elite | 10.364 ms | 24 - 24 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 6.43 ms | 3 - 304 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Snapdragon® 8 Gen 1 Mobile | 13.641 ms | 3 - 306 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 50.318 ms | 2 - 5 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 9.734 ms | 0 - 28 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Qualcomm® QCS8450 | 13.641 ms | 3 - 306 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 9.938 ms | 2 - 5 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 10.364 ms | 24 - 24 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 5.553 ms | 1 - 261 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 5.553 ms | 1 - 261 MB | NPU |
| Yolo-v5 | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 4.364 ms | 1 - 270 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Snapdragon® X2 Elite | 6.764 ms | 5 - 5 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Snapdragon® X Elite | 12.24 ms | 5 - 5 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 8.562 ms | 4 - 238 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Snapdragon® 8 Gen 1 Mobile | 26.039 ms | 5 - 263 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8275 | 63.861 ms | 0 - 192 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 11.593 ms | 5 - 177 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® SA8775P | 17.482 ms | 1 - 194 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® SA8650P | 17.482 ms | 1 - 194 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® SA8255P | 17.482 ms | 1 - 194 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® QCS8450 | 26.039 ms | 5 - 263 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-9075 | 17.258 ms | 5 - 11 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® Dragonwing™ IQ-X7181 | 12.24 ms | 5 - 5 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® Dragonwing™ Q-8750 | 6.458 ms | 0 - 197 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® SA7255P | 63.861 ms | 0 - 192 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Qualcomm® SA8295P | 22.214 ms | 0 - 221 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 6.458 ms | 0 - 197 MB | NPU |
| Yolo-v5 | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.006 ms | 5 - 209 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 4.317 ms | 2 - 2 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Snapdragon® X Elite | 9.477 ms | 2 - 2 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 5.788 ms | 2 - 277 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Snapdragon® 8 Gen 1 Mobile | 13.425 ms | 2 - 279 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS6490 | 48.351 ms | 1 - 5 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8275 | 21.01 ms | 0 - 232 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 8.724 ms | 2 - 4 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® SA8775P | 8.98 ms | 0 - 233 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® SA8650P | 8.98 ms | 0 - 233 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® SA8255P | 8.98 ms | 0 - 233 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® QCS8450 | 13.425 ms | 2 - 279 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-9075 | 8.709 ms | 0 - 4 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ IQ-X7181 | 9.477 ms | 2 - 2 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-6690 | 125.369 ms | 2 - 273 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-7790 | 12.446 ms | 2 - 252 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® Dragonwing™ Q-8750 | 4.254 ms | 2 - 242 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® SA7255P | 21.01 ms | 0 - 232 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Qualcomm® SA8295P | 12.557 ms | 0 - 234 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 4.254 ms | 2 - 242 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 3.347 ms | 2 - 244 MB | NPU |
| Yolo-v5 | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 12.446 ms | 2 - 252 MB | NPU |
| Yolo-v5 | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.263 ms | 0 - 287 MB | NPU |
| Yolo-v5 | TFLITE | float | Snapdragon® 8 Gen 1 Mobile | 25.843 ms | 0 - 310 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® Dragonwing™ QCS8275 | 63.132 ms | 0 - 223 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 10.899 ms | 0 - 3 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® SA8775P | 17.032 ms | 0 - 222 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® SA8650P | 17.032 ms | 0 - 222 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® SA8255P | 17.032 ms | 0 - 222 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® QCS8450 | 25.843 ms | 0 - 310 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® Dragonwing™ IQ-9075 | 16.802 ms | 0 - 57 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® Dragonwing™ Q-8750 | 6.177 ms | 0 - 229 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® SA7255P | 63.132 ms | 0 - 223 MB | NPU |
| Yolo-v5 | TFLITE | float | Qualcomm® SA8295P | 21.64 ms | 0 - 249 MB | NPU |
| Yolo-v5 | TFLITE | float | Snapdragon® 8 Elite Mobile | 6.177 ms | 0 - 229 MB | NPU |
| Yolo-v5 | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4.479 ms | 0 - 233 MB | NPU |
License
- The license for the original implementation of Yolo-v5 can be found here.
References
Community
- Join our AI Hub Slack community to collaborate, post questions and learn more about on-device AI.
- For questions or feedback please reach out to us.
