sebastientaylor commited on
Commit
6ce8b3d
Β·
verified Β·
1 Parent(s): d7ccc34

Update model card for yolo11-det

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -94,17 +94,33 @@ Row conventions in the table below:
94
  | Nano | macOS CoreML β€” Metal GPU (FP16) | 53.04% | -0.01 | 37.80% | 4.26 | 8.30 | 412.5 | [v-51e](https://edgefirst.studio/public/validation/v-51e/details?mode=charts) |
95
  | Nano | macOS CoreML β€” CPU (FP16) | 53.05% | +0.00 | 37.78% | 15.69 | 20.37 | 124.5 | [v-51f](https://edgefirst.studio/public/validation/v-51f/details?mode=charts) |
96
  | Nano | NXP i.MX 8M Plus + VeriSilicon NPU | 49.15% | -3.90 | 34.66% | 87.08 | 131.63 | 10.2 | [v-531](https://edgefirst.studio/public/validation/v-531/details?mode=charts) |
 
 
97
  | Nano | NXP i.MX 95 + eIQ Neutron NPU | Not supported | β€” | β€” | β€” | β€” | β€” | [v-532](https://edgefirst.studio/public/validation/v-532/details?mode=charts) |
 
 
 
 
 
 
98
  | Nano | Raspberry Pi 5 + Hailo-8L NPU | 50.90% | -2.15 | 36.02% | 17.86 | 28.43 | 53.7 | [v-4de](https://edgefirst.studio/public/validation/v-4de/details?mode=charts) |
 
99
  | Nano | NVIDIA Jetson Orin Nano (TensorRT FP16) | 53.03% | -0.02 | 37.81% | 7.09 | 17.56 | 161.4 | [v-4dc](https://edgefirst.studio/public/validation/v-4dc/details?mode=charts) |
 
100
  | Small | ONNX FP32 (AWS Graviton Β· 48-core) | 61.16% | -0.03 | 44.88% | 63.52 | 72.25 | 60.0 | [v-71c](https://edgefirst.studio/public/validation/v-71c/details?mode=charts) |
101
  | Small | ONNX FP32 (CUDA) | 61.19% | ref | 44.88% | 15.36 | 20.95 | 205.5 | [v-705](https://edgefirst.studio/public/validation/v-705/details?mode=charts) |
102
  | Small | ONNX FP16 (CUDA) | 61.16% | -0.03 | 44.84% | 10.30 | 15.98 | 304.0 | [v-706](https://edgefirst.studio/public/validation/v-706/details?mode=charts) |
103
  | Small | macOS CoreML β€” Neural Engine (FP16) | 61.17% | -0.02 | 44.88% | 4.95 | 8.74 | 328.9 | [v-517](https://edgefirst.studio/public/validation/v-517/details?mode=charts) |
104
  | Small | macOS CoreML β€” Metal GPU (FP16) | 61.19% | +0.00 | 44.89% | 9.95 | 13.73 | 194.5 | [v-520](https://edgefirst.studio/public/validation/v-520/details?mode=charts) |
105
  | Small | macOS CoreML β€” CPU (FP16) | 61.13% | -0.06 | 44.86% | 31.94 | 36.54 | 60.0 | [v-521](https://edgefirst.studio/public/validation/v-521/details?mode=charts) |
 
 
 
 
106
  | Small | Raspberry Pi 5 + Hailo-8L NPU | 58.88% | -2.31 | 42.84% | 36.53 | 47.06 | 25.2 | [v-4df](https://edgefirst.studio/public/validation/v-4df/details?mode=charts) |
 
107
  | Small | NVIDIA Jetson Orin Nano (TensorRT FP16) | 61.13% | -0.06 | 44.85% | 15.57 | 24.81 | 109.0 | [v-4dd](https://edgefirst.studio/public/validation/v-4dd/details?mode=charts) |
 
108
  | Medium | ONNX FP32 (AWS Graviton Β· 48-core) | 65.94% | +0.03 | 49.60% | 169.65 | 178.45 | 24.0 | [v-71e](https://edgefirst.studio/public/validation/v-71e/details?mode=charts) |
109
  | Medium | ONNX FP32 (CUDA) | 65.91% | ref | 49.59% | 39.57 | 45.08 | 88.0 | [v-707](https://edgefirst.studio/public/validation/v-707/details?mode=charts) |
110
  | Medium | ONNX FP16 (CUDA) | 65.90% | -0.01 | 49.55% | 22.09 | 28.59 | 152.0 | [v-708](https://edgefirst.studio/public/validation/v-708/details?mode=charts) |
@@ -112,8 +128,13 @@ Row conventions in the table below:
112
  | Medium | macOS CoreML β€” Metal GPU (FP16) | 64.75% | -1.16 | 48.59% | 40.41 | 44.71 | 72.0 | [v-76b](https://edgefirst.studio/public/validation/v-76b/details?mode=charts) |
113
  | Medium | NXP i.MX 8M Plus + VeriSilicon NPU | 50.85% | -15.06 ⚠ | 35.38% | 333.96 | 367.36 | 3.0 | [v-794](https://edgefirst.studio/public/validation/v-794/details?mode=charts) |
114
  | Medium | NXP i.MX 8M Plus + VeriSilicon NPU | 53.75% | -12.16 ⚠ | 39.48% | 327.98 | 377.23 | 3.0 | [v-780](https://edgefirst.studio/public/validation/v-780/details?mode=charts) |
 
 
 
115
  | Medium | Raspberry Pi 5 + Hailo-8L NPU | 62.87% | -3.04 | 47.03% | 70.72 | 81.73 | 14.0 | [v-76e](https://edgefirst.studio/public/validation/v-76e/details?mode=charts) |
 
116
  | Medium | NVIDIA Jetson Orin Nano (TensorRT FP16) | 65.88% | -0.03 | 49.56% | 50.81 | 63.11 | 78.0 | [v-762](https://edgefirst.studio/public/validation/v-762/details?mode=charts) |
 
117
 
118
  > **⚠ Below expectations β€” under investigation.** The rows marked ⚠ above measure more than 10 percentage points below the same training session's float reference: the model accuracy on that platform is below our expectations. We publish the measured numbers rather than hiding them, and we are investigating the results to make improvements β€” the next snapshot of this card will reflect any recovered accuracy.
119
 
 
94
  | Nano | macOS CoreML β€” Metal GPU (FP16) | 53.04% | -0.01 | 37.80% | 4.26 | 8.30 | 412.5 | [v-51e](https://edgefirst.studio/public/validation/v-51e/details?mode=charts) |
95
  | Nano | macOS CoreML β€” CPU (FP16) | 53.05% | +0.00 | 37.78% | 15.69 | 20.37 | 124.5 | [v-51f](https://edgefirst.studio/public/validation/v-51f/details?mode=charts) |
96
  | Nano | NXP i.MX 8M Plus + VeriSilicon NPU | 49.15% | -3.90 | 34.66% | 87.08 | 131.63 | 10.2 | [v-531](https://edgefirst.studio/public/validation/v-531/details?mode=charts) |
97
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | 49.80% | -3.30 | 35.05% | 87.42 | 140.19 | 10.0 | [v-8a7](https://edgefirst.studio/public/validation/v-8a7/details?mode=charts) |
98
+ | Nano | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | 47.25% | -5.85 | 31.54% | 93.34 | 127.62 | 10.0 | [v-88e](https://edgefirst.studio/public/validation/v-88e/details?mode=charts) |
99
  | Nano | NXP i.MX 95 + eIQ Neutron NPU | Not supported | β€” | β€” | β€” | β€” | β€” | [v-532](https://edgefirst.studio/public/validation/v-532/details?mode=charts) |
100
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) β€” latency | Not supported | β€” | β€” | β€” | β€” | β€” | [v-8a4](https://edgefirst.studio/public/validation/v-8a4/details?mode=charts) |
101
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) β€” latency | Not supported | β€” | β€” | β€” | β€” | β€” | [v-88b](https://edgefirst.studio/public/validation/v-88b/details?mode=charts) |
102
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) β€” throughput | Not supported | β€” | β€” | β€” | β€” | β€” | [v-8a5](https://edgefirst.studio/public/validation/v-8a5/details?mode=charts) |
103
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (FRDM) β€” throughput | Not supported | β€” | β€” | β€” | β€” | β€” | [v-89d](https://edgefirst.studio/public/validation/v-89d/details?mode=charts) |
104
+ | Nano | NXP i.MX 95 + eIQ Neutron NPU (Phytec) β€” throughput | Not supported | β€” | β€” | β€” | β€” | β€” | [v-887](https://edgefirst.studio/public/validation/v-887/details?mode=charts) |
105
+ | Nano | NXP ARA240 (Kinara DVM) (FRDM) | 50.03% | -3.07 | 34.45% | 6.68 | 28.13 | 197.0 | [v-889](https://edgefirst.studio/public/validation/v-889/details?mode=charts) |
106
  | Nano | Raspberry Pi 5 + Hailo-8L NPU | 50.90% | -2.15 | 36.02% | 17.86 | 28.43 | 53.7 | [v-4de](https://edgefirst.studio/public/validation/v-4de/details?mode=charts) |
107
+ | Nano | Raspberry Pi 5 + Hailo-8L NPU | 51.77% | -1.33 | 36.73% | 17.86 | 36.29 | 54.0 | [v-8dc](https://edgefirst.studio/public/validation/v-8dc/details?mode=charts) |
108
  | Nano | NVIDIA Jetson Orin Nano (TensorRT FP16) | 53.03% | -0.02 | 37.81% | 7.09 | 17.56 | 161.4 | [v-4dc](https://edgefirst.studio/public/validation/v-4dc/details?mode=charts) |
109
+ | Nano | NVIDIA Jetson Orin Nano (TensorRT FP16) | 53.05% | -0.05 | 37.80% | 11.46 | 26.68 | 251.0 | [v-917](https://edgefirst.studio/public/validation/v-917/details?mode=charts) |
110
  | Small | ONNX FP32 (AWS Graviton Β· 48-core) | 61.16% | -0.03 | 44.88% | 63.52 | 72.25 | 60.0 | [v-71c](https://edgefirst.studio/public/validation/v-71c/details?mode=charts) |
111
  | Small | ONNX FP32 (CUDA) | 61.19% | ref | 44.88% | 15.36 | 20.95 | 205.5 | [v-705](https://edgefirst.studio/public/validation/v-705/details?mode=charts) |
112
  | Small | ONNX FP16 (CUDA) | 61.16% | -0.03 | 44.84% | 10.30 | 15.98 | 304.0 | [v-706](https://edgefirst.studio/public/validation/v-706/details?mode=charts) |
113
  | Small | macOS CoreML β€” Neural Engine (FP16) | 61.17% | -0.02 | 44.88% | 4.95 | 8.74 | 328.9 | [v-517](https://edgefirst.studio/public/validation/v-517/details?mode=charts) |
114
  | Small | macOS CoreML β€” Metal GPU (FP16) | 61.19% | +0.00 | 44.89% | 9.95 | 13.73 | 194.5 | [v-520](https://edgefirst.studio/public/validation/v-520/details?mode=charts) |
115
  | Small | macOS CoreML β€” CPU (FP16) | 61.13% | -0.06 | 44.86% | 31.94 | 36.54 | 60.0 | [v-521](https://edgefirst.studio/public/validation/v-521/details?mode=charts) |
116
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU | 2.99% | -58.20 ⚠ | 1.78% | 174.38 | 207.49 | 5.0 | [v-7b1](https://edgefirst.studio/public/validation/v-7b1/details?mode=charts) |
117
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | 3.48% | -57.71 ⚠ | 2.34% | 168.47 | 220.09 | 6.0 | [v-9bc](https://edgefirst.studio/public/validation/v-9bc/details?mode=charts) |
118
+ | Small | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | 2.99% | -58.20 ⚠ | 1.78% | 174.40 | 208.10 | 5.0 | [v-9b2](https://edgefirst.studio/public/validation/v-9b2/details?mode=charts) |
119
+ | Small | NXP ARA240 (Kinara DVM) (FRDM) | 57.15% | -4.04 | 40.11% | 10.28 | 23.98 | 141.0 | [v-9b1](https://edgefirst.studio/public/validation/v-9b1/details?mode=charts) |
120
  | Small | Raspberry Pi 5 + Hailo-8L NPU | 58.88% | -2.31 | 42.84% | 36.53 | 47.06 | 25.2 | [v-4df](https://edgefirst.studio/public/validation/v-4df/details?mode=charts) |
121
+ | Small | Raspberry Pi 5 + Hailo-8L NPU | 59.45% | -1.74 | 43.25% | 36.19 | 51.00 | 25.0 | [v-8e7](https://edgefirst.studio/public/validation/v-8e7/details?mode=charts) |
122
  | Small | NVIDIA Jetson Orin Nano (TensorRT FP16) | 61.13% | -0.06 | 44.85% | 15.57 | 24.81 | 109.0 | [v-4dd](https://edgefirst.studio/public/validation/v-4dd/details?mode=charts) |
123
+ | Small | NVIDIA Jetson Orin Nano (TensorRT FP16) | 61.13% | -0.06 | 44.85% | 24.64 | 36.52 | 157.0 | [v-91f](https://edgefirst.studio/public/validation/v-91f/details?mode=charts) |
124
  | Medium | ONNX FP32 (AWS Graviton Β· 48-core) | 65.94% | +0.03 | 49.60% | 169.65 | 178.45 | 24.0 | [v-71e](https://edgefirst.studio/public/validation/v-71e/details?mode=charts) |
125
  | Medium | ONNX FP32 (CUDA) | 65.91% | ref | 49.59% | 39.57 | 45.08 | 88.0 | [v-707](https://edgefirst.studio/public/validation/v-707/details?mode=charts) |
126
  | Medium | ONNX FP16 (CUDA) | 65.90% | -0.01 | 49.55% | 22.09 | 28.59 | 152.0 | [v-708](https://edgefirst.studio/public/validation/v-708/details?mode=charts) |
 
128
  | Medium | macOS CoreML β€” Metal GPU (FP16) | 64.75% | -1.16 | 48.59% | 40.41 | 44.71 | 72.0 | [v-76b](https://edgefirst.studio/public/validation/v-76b/details?mode=charts) |
129
  | Medium | NXP i.MX 8M Plus + VeriSilicon NPU | 50.85% | -15.06 ⚠ | 35.38% | 333.96 | 367.36 | 3.0 | [v-794](https://edgefirst.studio/public/validation/v-794/details?mode=charts) |
130
  | Medium | NXP i.MX 8M Plus + VeriSilicon NPU | 53.75% | -12.16 ⚠ | 39.48% | 327.98 | 377.23 | 3.0 | [v-780](https://edgefirst.studio/public/validation/v-780/details?mode=charts) |
131
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | 54.45% | -11.46 ⚠ | 40.02% | 328.40 | 380.36 | 3.0 | [v-98d](https://edgefirst.studio/public/validation/v-98d/details?mode=charts) |
132
+ | Medium | NXP i.MX 8M Plus + VeriSilicon NPU (FRDM) | 50.85% | -15.06 ⚠ | 35.38% | 334.31 | 367.93 | 3.0 | [v-985](https://edgefirst.studio/public/validation/v-985/details?mode=charts) |
133
+ | Medium | NXP ARA240 (Kinara DVM) (FRDM) | 62.56% | -3.35 | 45.12% | 24.23 | 37.01 | 47.0 | [v-909](https://edgefirst.studio/public/validation/v-909/details?mode=charts) |
134
  | Medium | Raspberry Pi 5 + Hailo-8L NPU | 62.87% | -3.04 | 47.03% | 70.72 | 81.73 | 14.0 | [v-76e](https://edgefirst.studio/public/validation/v-76e/details?mode=charts) |
135
+ | Medium | Raspberry Pi 5 + Hailo-8L NPU | 63.78% | -2.13 | 47.69% | 70.71 | 86.10 | 14.0 | [v-90f](https://edgefirst.studio/public/validation/v-90f/details?mode=charts) |
136
  | Medium | NVIDIA Jetson Orin Nano (TensorRT FP16) | 65.88% | -0.03 | 49.56% | 50.81 | 63.11 | 78.0 | [v-762](https://edgefirst.studio/public/validation/v-762/details?mode=charts) |
137
+ | Medium | NVIDIA Jetson Orin Nano (TensorRT FP16) | 65.89% | -0.02 | 49.56% | 50.85 | 63.05 | 77.0 | [v-927](https://edgefirst.studio/public/validation/v-927/details?mode=charts) |
138
 
139
  > **⚠ Below expectations β€” under investigation.** The rows marked ⚠ above measure more than 10 percentage points below the same training session's float reference: the model accuracy on that platform is below our expectations. We publish the measured numbers rather than hiding them, and we are investigating the results to make improvements β€” the next snapshot of this card will reflect any recovered accuracy.
140