qaihm-bot commited on
Commit
0caacaa
·
verified ·
1 Parent(s): 04ea85a

See https://github.com/quic/ai-hub-models/releases/v0.37.0 for changelog.

Files changed (1) hide show
  1. README.md +29 -25
README.md CHANGED
@@ -38,37 +38,41 @@ More details on model performance across various devices, can be found
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
  | Yolo-v3 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 30.586 ms | 0 - 73 MB | NPU | -- |
41
- | Yolo-v3 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 25.26 ms | 5 - 91 MB | NPU | -- |
42
  | Yolo-v3 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 17.386 ms | 0 - 90 MB | NPU | -- |
43
- | Yolo-v3 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 15.971 ms | 5 - 78 MB | NPU | -- |
44
  | Yolo-v3 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 15.724 ms | 0 - 10 MB | NPU | -- |
45
- | Yolo-v3 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.818 ms | 5 - 27 MB | NPU | -- |
 
46
  | Yolo-v3 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 16.631 ms | 0 - 73 MB | NPU | -- |
47
- | Yolo-v3 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 12.364 ms | 1 - 86 MB | NPU | -- |
48
  | Yolo-v3 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 15.454 ms | 0 - 10 MB | NPU | -- |
49
- | Yolo-v3 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 10.813 ms | 5 - 25 MB | NPU | -- |
50
- | Yolo-v3 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 9.151 ms | 0 - 70 MB | NPU | -- |
51
  | Yolo-v3 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 9.635 ms | 0 - 97 MB | NPU | -- |
52
- | Yolo-v3 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 7.94 ms | 5 - 99 MB | NPU | -- |
53
- | Yolo-v3 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 7.108 ms | 5 - 104 MB | NPU | -- |
54
  | Yolo-v3 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 7.404 ms | 0 - 78 MB | NPU | -- |
55
- | Yolo-v3 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 8.031 ms | 5 - 95 MB | NPU | -- |
56
- | Yolo-v3 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 7.11 ms | 5 - 103 MB | NPU | -- |
57
- | Yolo-v3 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 11.013 ms | 18 - 18 MB | NPU | -- |
58
- | Yolo-v3 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 9.508 ms | 21 - 21 MB | NPU | -- |
59
- | Yolo-v3 | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.785 ms | 2 - 70 MB | NPU | -- |
60
- | Yolo-v3 | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.039 ms | 2 - 94 MB | NPU | -- |
61
- | Yolo-v3 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 6.273 ms | 2 - 28 MB | NPU | -- |
62
- | Yolo-v3 | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 6.791 ms | 1 - 70 MB | NPU | -- |
63
- | Yolo-v3 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 21.036 ms | 2 - 84 MB | NPU | -- |
64
- | Yolo-v3 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 6.288 ms | 2 - 30 MB | NPU | -- |
65
- | Yolo-v3 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 77.677 ms | 57 - 281 MB | NPU | -- |
66
- | Yolo-v3 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.566 ms | 2 - 88 MB | NPU | -- |
67
- | Yolo-v3 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 66.736 ms | 61 - 2868 MB | NPU | -- |
68
- | Yolo-v3 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 4.479 ms | 2 - 78 MB | NPU | -- |
69
- | Yolo-v3 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 63.331 ms | 56 - 1740 MB | NPU | -- |
70
- | Yolo-v3 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 6.267 ms | 65 - 65 MB | NPU | -- |
71
- | Yolo-v3 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 86.366 ms | 132 - 132 MB | NPU | -- |
 
 
 
72
 
73
 
74
 
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
  | Yolo-v3 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 30.586 ms | 0 - 73 MB | NPU | -- |
41
+ | Yolo-v3 | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 25.181 ms | 2 - 88 MB | NPU | -- |
42
  | Yolo-v3 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 17.386 ms | 0 - 90 MB | NPU | -- |
43
+ | Yolo-v3 | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 16.183 ms | 5 - 78 MB | NPU | -- |
44
  | Yolo-v3 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 15.724 ms | 0 - 10 MB | NPU | -- |
45
+ | Yolo-v3 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 10.988 ms | 5 - 22 MB | NPU | -- |
46
+ | Yolo-v3 | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 12.237 ms | 0 - 64 MB | NPU | -- |
47
  | Yolo-v3 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 16.631 ms | 0 - 73 MB | NPU | -- |
48
+ | Yolo-v3 | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 12.31 ms | 2 - 88 MB | NPU | -- |
49
  | Yolo-v3 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 15.454 ms | 0 - 10 MB | NPU | -- |
50
+ | Yolo-v3 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 10.918 ms | 5 - 23 MB | NPU | -- |
51
+ | Yolo-v3 | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 12.174 ms | 0 - 65 MB | NPU | -- |
52
  | Yolo-v3 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 9.635 ms | 0 - 97 MB | NPU | -- |
53
+ | Yolo-v3 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 7.935 ms | 5 - 98 MB | NPU | -- |
54
+ | Yolo-v3 | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 9.08 ms | 5 - 91 MB | NPU | -- |
55
  | Yolo-v3 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 7.404 ms | 0 - 78 MB | NPU | -- |
56
+ | Yolo-v3 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 8.092 ms | 5 - 94 MB | NPU | -- |
57
+ | Yolo-v3 | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 9.127 ms | 5 - 90 MB | NPU | -- |
58
+ | Yolo-v3 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 11.014 ms | 8 - 8 MB | NPU | -- |
59
+ | Yolo-v3 | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 11.873 ms | 21 - 21 MB | NPU | -- |
60
+ | Yolo-v3 | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 13.718 ms | 1 - 69 MB | NPU | -- |
61
+ | Yolo-v3 | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 8.174 ms | 2 - 93 MB | NPU | -- |
62
+ | Yolo-v3 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 6.271 ms | 2 - 29 MB | NPU | -- |
63
+ | Yolo-v3 | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 68.937 ms | 51 - 246 MB | NPU | -- |
64
+ | Yolo-v3 | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 6.756 ms | 2 - 70 MB | NPU | -- |
65
+ | Yolo-v3 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | QNN_DLC | 20.677 ms | 2 - 84 MB | NPU | -- |
66
+ | Yolo-v3 | w8a16 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 174.329 ms | 90 - 102 MB | CPU | -- |
67
+ | Yolo-v3 | w8a16 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 154.683 ms | 82 - 103 MB | CPU | -- |
68
+ | Yolo-v3 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 6.256 ms | 2 - 35 MB | NPU | -- |
69
+ | Yolo-v3 | w8a16 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 68.882 ms | 62 - 282 MB | NPU | -- |
70
+ | Yolo-v3 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 4.57 ms | 2 - 90 MB | NPU | -- |
71
+ | Yolo-v3 | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 50.406 ms | 0 - 683 MB | NPU | -- |
72
+ | Yolo-v3 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 4.485 ms | 2 - 77 MB | NPU | -- |
73
+ | Yolo-v3 | w8a16 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 51.485 ms | 65 - 728 MB | NPU | -- |
74
+ | Yolo-v3 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 6.336 ms | 65 - 65 MB | NPU | -- |
75
+ | Yolo-v3 | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 64.666 ms | 115 - 115 MB | NPU | -- |
76
 
77
 
78