YOLOv8-Detection: Optimized for Qualcomm Devices

Ultralytics YOLOv8 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of YOLOv8-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for YOLOv8-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YOLOv8-N
  • Input resolution: 640x640
  • Number of parameters: 3.18M
  • Model size (float): 12.2 MB
  • Model size (w8a8): 3.25 MB
  • Model size (w8a16): 3.60 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
YOLOv8-Detection ONNX float Snapdragon® X2 Elite 3.139 ms 5 - 5 MB NPU
YOLOv8-Detection ONNX float Snapdragon® X Elite 6.417 ms 5 - 5 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Gen 3 Mobile 5.374 ms 5 - 223 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Gen 1 Mobile 13.492 ms 5 - 201 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.878 ms 5 - 12 MB NPU
YOLOv8-Detection ONNX float Qualcomm® QCS8450 13.492 ms 5 - 201 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ IQ-9075 8.05 ms 5 - 7 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ IQ-X7181 6.417 ms 5 - 5 MB NPU
YOLOv8-Detection ONNX float Qualcomm® Dragonwing™ Q-8750 4.242 ms 3 - 199 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Elite Mobile 4.242 ms 3 - 199 MB NPU
YOLOv8-Detection ONNX float Snapdragon® 8 Elite Gen 5 Mobile 2.8 ms 3 - 218 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® X2 Elite 2.157 ms 2 - 2 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® X Elite 5.008 ms 1 - 1 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 2.915 ms 0 - 92 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Gen 1 Mobile 6.134 ms 3 - 93 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ QCS6490 16.162 ms 2 - 5 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 4.791 ms 2 - 124 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® QCS8450 6.134 ms 3 - 93 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ IQ-9075 5.199 ms 2 - 5 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ IQ-X7181 5.008 ms 1 - 1 MB NPU
YOLOv8-Detection ONNX w8a16 Qualcomm® Dragonwing™ Q-8750 2.23 ms 0 - 71 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Elite Mobile 2.23 ms 0 - 71 MB NPU
YOLOv8-Detection ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 2.028 ms 0 - 75 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® X2 Elite 0.67 ms 1 - 1 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® X Elite 1.598 ms 3 - 3 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 1.013 ms 0 - 67 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 1.845 ms 0 - 70 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 10.36 ms 1 - 4 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 1.532 ms 0 - 5 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® QCS8450 1.845 ms 0 - 70 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 1.707 ms 0 - 3 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 1.598 ms 3 - 3 MB NPU
YOLOv8-Detection ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 0.727 ms 0 - 54 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Elite Mobile 0.727 ms 0 - 54 MB NPU
YOLOv8-Detection ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.629 ms 0 - 54 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® X2 Elite 2.817 ms 2 - 2 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® X Elite 6.594 ms 0 - 0 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® 8 Gen 3 Mobile 4.275 ms 3 - 132 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.274 ms 2 - 139 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ IQ-9075 6.848 ms 2 - 5 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ IQ-X7181 6.594 ms 0 - 0 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Qualcomm® Dragonwing™ Q-8750 2.987 ms 0 - 100 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® 8 Elite Mobile 2.987 ms 0 - 100 MB NPU
YOLOv8-Detection ONNX w8a8_mixed_int16 Snapdragon® 8 Elite Gen 5 Mobile 2.678 ms 0 - 116 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® X2 Elite 2.527 ms 5 - 5 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® X Elite 4.173 ms 5 - 5 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Gen 3 Mobile 2.777 ms 0 - 213 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Gen 1 Mobile 7.839 ms 5 - 192 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ QCS8275 13.694 ms 0 - 184 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.778 ms 5 - 6 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8775P 5.316 ms 0 - 188 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8650P 5.316 ms 0 - 188 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8255P 5.316 ms 0 - 188 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® QCS8450 7.839 ms 5 - 192 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 5.04 ms 5 - 11 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 4.173 ms 5 - 5 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® Dragonwing™ Q-8750 2.087 ms 5 - 193 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA7255P 13.694 ms 0 - 184 MB NPU
YOLOv8-Detection QNN_DLC float Qualcomm® SA8295P 7.863 ms 0 - 161 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Elite Mobile 2.087 ms 5 - 193 MB NPU
YOLOv8-Detection QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 1.849 ms 5 - 197 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® X2 Elite 1.67 ms 2 - 2 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® X Elite 3.689 ms 2 - 2 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 2.252 ms 2 - 75 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 1 Mobile 4.113 ms 2 - 74 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS6490 12.665 ms 1 - 5 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8275 6.687 ms 2 - 51 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.336 ms 2 - 4 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8775P 3.896 ms 0 - 54 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8650P 3.896 ms 0 - 54 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8255P 3.896 ms 0 - 54 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® QCS8450 4.113 ms 2 - 74 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-9075 4.354 ms 0 - 4 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ IQ-X7181 3.689 ms 2 - 2 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-6690 19.932 ms 2 - 168 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-7790 4.531 ms 2 - 170 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® Dragonwing™ Q-8750 1.539 ms 2 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA7255P 6.687 ms 2 - 51 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Qualcomm® SA8295P 4.58 ms 0 - 48 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Mobile 1.539 ms 2 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 1.245 ms 1 - 57 MB NPU
YOLOv8-Detection QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 4.531 ms 2 - 170 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® X2 Elite 0.813 ms 1 - 1 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® X Elite 1.607 ms 1 - 1 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 0.944 ms 1 - 51 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 1.637 ms 1 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS6490 4.531 ms 1 - 4 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8275 3.199 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 1.381 ms 1 - 3 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8775P 1.775 ms 0 - 38 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8650P 1.775 ms 0 - 38 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8255P 1.775 ms 0 - 38 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® QCS8450 1.637 ms 1 - 55 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 1.557 ms 1 - 4 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 1.607 ms 1 - 1 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-6690 8.417 ms 1 - 153 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-7790 1.501 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 0.681 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA7255P 3.199 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Qualcomm® SA8295P 2.201 ms 0 - 35 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Mobile 0.681 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.588 ms 1 - 37 MB NPU
YOLOv8-Detection QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 1.501 ms 1 - 37 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Gen 3 Mobile 2.472 ms 0 - 107 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Gen 1 Mobile 6.436 ms 0 - 80 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ QCS8275 13.1 ms 0 - 75 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 3.346 ms 0 - 2 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8775P 4.98 ms 0 - 83 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8650P 4.98 ms 0 - 83 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8255P 4.98 ms 0 - 83 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® QCS8450 6.436 ms 0 - 80 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ IQ-9075 4.716 ms 0 - 14 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® Dragonwing™ Q-8750 1.88 ms 0 - 83 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA7255P 13.1 ms 0 - 75 MB NPU
YOLOv8-Detection TFLITE float Qualcomm® SA8295P 7.362 ms 0 - 53 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Elite Mobile 1.88 ms 0 - 83 MB NPU
YOLOv8-Detection TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 1.502 ms 0 - 94 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 0.899 ms 0 - 49 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 1.577 ms 0 - 54 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 4.264 ms 0 - 7 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS8275 3.045 ms 0 - 36 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 1.314 ms 0 - 3 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8775P 1.696 ms 0 - 40 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8650P 1.696 ms 0 - 40 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8255P 1.696 ms 0 - 40 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® QCS8450 1.577 ms 0 - 54 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 1.491 ms 0 - 7 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 8.399 ms 0 - 151 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 1.45 ms 0 - 35 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 0.65 ms 0 - 34 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA7255P 3.045 ms 0 - 36 MB NPU
YOLOv8-Detection TFLITE w8a8 Qualcomm® SA8295P 2.128 ms 0 - 35 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Elite Mobile 0.65 ms 0 - 34 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 0.577 ms 0 - 37 MB NPU
YOLOv8-Detection TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 1.45 ms 0 - 35 MB NPU

License

  • The license for the original implementation of YOLOv8-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support