YOLOv9-Detection: Optimized for Qualcomm Devices

Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of YOLOv9-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for YOLOv9-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YOLOv9-T
  • Input resolution: 640x640
  • Model size (float): 8.84 MB
  • Model size (w8a8): 3.23 MB
  • Model size (w8a8_mixed_int16): 3.74 MB
  • Model size (w8a16): 3.25 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
YOLOv9-Detection ONNX float Snapdragon® X2 Elite 3.838 ms 5 - 5 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X Elite 10.864 ms 5 - 5 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Gen 3 Mobile 7.544 ms 5 - 266 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Gen 1 Mobile 17.172 ms 5 - 252 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8450 17.172 ms 5 - 252 MB NPU
YOLOv9-Detection ONNX float Qualcomm® Dragonwing™ IQ-9075 12.751 ms 5 - 7 MB NPU
YOLOv9-Detection ONNX float Qualcomm® Dragonwing™ IQ-X7181 10.864 ms 5 - 5 MB NPU
YOLOv9-Detection ONNX float Qualcomm® Dragonwing™ Q-8750 4.395 ms 0 - 209 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Elite Mobile 4.395 ms 0 - 209 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.512 ms 1 - 227 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X2 Elite 91.058 ms 2 - 2 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X Elite 314.851 ms 1 - 1 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 228.108 ms 3 - 164 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 390.715 ms 3 - 164 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 605.206 ms 2 - 5 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 300.092 ms 3 - 5 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8450 390.715 ms 3 - 164 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 304.075 ms 2 - 5 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 314.851 ms 1 - 1 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 115.322 ms 1 - 132 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite Mobile 115.322 ms 1 - 132 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 91.438 ms 0 - 136 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X2 Elite 110.864 ms 1 - 1 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X Elite 188.552 ms 0 - 0 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 136.76 ms 2 - 123 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 237.777 ms 2 - 124 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 530.293 ms 1 - 4 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 179.048 ms 2 - 4 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8450 237.777 ms 2 - 124 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 181.993 ms 1 - 4 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 188.552 ms 0 - 0 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 143.558 ms 2 - 103 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite Mobile 143.558 ms 2 - 103 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.295 ms 0 - 102 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X2 Elite 3.452 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X Elite 8.79 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Gen 3 Mobile 5.937 ms 5 - 238 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Gen 1 Mobile 13.848 ms 4 - 234 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® Dragonwing™ QCS8275 21.587 ms 4 - 208 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 8.122 ms 5 - 17 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8775P 10.418 ms 0 - 206 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8650P 10.418 ms 0 - 206 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8255P 10.418 ms 0 - 206 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8450 13.848 ms 4 - 234 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 10.183 ms 5 - 11 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 8.79 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® Dragonwing™ Q-8750 3.14 ms 0 - 209 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA7255P 21.587 ms 4 - 208 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8295P 13.411 ms 0 - 203 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite Mobile 3.14 ms 0 - 209 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 2.825 ms 5 - 212 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X2 Elite 80.2 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X Elite 224.447 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 165.734 ms 2 - 120 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 357.619 ms 2 - 120 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 605.298 ms 1 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8275 447.421 ms 1 - 92 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 214.684 ms 3 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8775P 235.288 ms 0 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8650P 235.288 ms 0 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8255P 235.288 ms 0 - 95 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8450 357.619 ms 2 - 120 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 234.503 ms 3 - 7 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 224.447 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 562.138 ms 2 - 204 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 285.78 ms 2 - 215 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 115.005 ms 2 - 98 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA7255P 447.421 ms 1 - 92 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8295P 301.816 ms 0 - 96 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 115.005 ms 2 - 98 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 79.77 ms 2 - 102 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 285.78 ms 2 - 215 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X2 Elite 100.585 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X Elite 176.012 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 136.362 ms 9 - 88 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 237.808 ms 1 - 84 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 585.802 ms 1 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8275 347.577 ms 2 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 167.046 ms 2 - 3 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8775P 170.736 ms 1 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8650P 170.736 ms 1 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8255P 170.736 ms 1 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8450 237.808 ms 1 - 84 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 189.592 ms 2 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 176.012 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 510.248 ms 1 - 186 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 176.126 ms 1 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 133.37 ms 2 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA7255P 347.577 ms 2 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8295P 202.754 ms 0 - 60 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 133.37 ms 2 - 64 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.477 ms 1 - 67 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 176.126 ms 1 - 64 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Gen 3 Mobile 5.596 ms 0 - 120 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Gen 1 Mobile 11.961 ms 0 - 111 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® Dragonwing™ QCS8275 21.008 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 7.723 ms 0 - 3 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8775P 10.225 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8650P 10.225 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8255P 10.225 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8450 11.961 ms 0 - 111 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® Dragonwing™ IQ-9075 9.887 ms 0 - 14 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® Dragonwing™ Q-8750 2.96 ms 0 - 99 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA7255P 21.008 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8295P 12.898 ms 0 - 76 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite Mobile 2.96 ms 0 - 99 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.324 ms 0 - 117 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 136.657 ms 0 - 83 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 237.786 ms 0 - 82 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 566.125 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS8275 347.774 ms 0 - 61 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 167.297 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8775P 182.804 ms 0 - 63 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8650P 182.804 ms 0 - 63 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8255P 182.804 ms 0 - 63 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8450 237.786 ms 0 - 82 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 181.601 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 500.669 ms 0 - 186 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 179.395 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 133.412 ms 1 - 64 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA7255P 347.774 ms 0 - 61 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8295P 202.907 ms 0 - 58 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite Mobile 133.412 ms 1 - 64 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.462 ms 0 - 63 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 179.395 ms 0 - 59 MB NPU

License

  • The license for the original implementation of YOLOv9-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support