Image Classification
LiteRT
LiteRT
vit
vision
snnn001 commited on
Commit
f10f70a
·
verified ·
1 Parent(s): 2c83b43

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -3
README.md CHANGED
@@ -50,6 +50,13 @@ compilation; they do not contain device-specific compiled NPU programs.
50
  substantial accuracy tradeoff and retains INT16 regions, so backend support
51
  must be verified.
52
 
 
 
 
 
 
 
 
53
  ## TorchAO quantization recipe
54
 
55
  Both variants use post-training static quantization, without QAT or fine-tuning.
@@ -158,7 +165,7 @@ value is the median of three process means, with five warmup invocations and
158
  30 measured invocations per process. All configurations are AOT compiled and
159
  fully delegated to the NPU, with no residual CPU operations.
160
 
161
- | Model file | `SM-S937U1`, Qualcomm SM8750 (ms) | `LJ9`, MediaTek MT6897 (ms) |
162
  | --- | ---: | ---: |
163
  | `model_fp32.tflite` | 6 | 129 |
164
  | `model_a16w8.tflite` | 4 | 71 |
@@ -174,8 +181,8 @@ preprocessing, file I/O and explicit host input/output buffer transfers.
174
  Some variants were measured in separate sessions using the same benchmark
175
  and dispatch runtime for each device.
176
 
177
- The Samsung ran Android 17 with Qualcomm QNN/QAIRT 2.50 in burst performance
178
- mode. The TECNO ran Android 15 with the MediaTek Neuron runtime in sustained
179
  speed mode. Power settings were not normalized, and energy consumption was
180
  not measured. These results apply to the listed device/compiler/runtime
181
  combinations and do not characterize JIT performance.
 
50
  substantial accuracy tradeoff and retains INT16 regions, so backend support
51
  must be verified.
52
 
53
+ Extra notes: Apple ANE and QC NPUs support FP16 natively and the performances are
54
+ usually very good. Deloying a FP16 model is much easier since it does not require
55
+ calibration steps. Note that the A16W8 and A8W8 assets provided here were calibrated
56
+ from a particular dataset and should not used in production directly. A FP16 model
57
+ file is not provided here is because it is easy to be generated from the fp32 asset.
58
+ It is actually a top choice.
59
+
60
  ## TorchAO quantization recipe
61
 
62
  Both variants use post-training static quantization, without QAT or fine-tuning.
 
165
  30 measured invocations per process. All configurations are AOT compiled and
166
  fully delegated to the NPU, with no residual CPU operations.
167
 
168
+ | Model file | `SM-S937U1`(ms) | `LJ9`(ms) |
169
  | --- | ---: | ---: |
170
  | `model_fp32.tflite` | 6 | 129 |
171
  | `model_a16w8.tflite` | 4 | 71 |
 
181
  Some variants were measured in separate sessions using the same benchmark
182
  and dispatch runtime for each device.
183
 
184
+ The `SM-S937U1` ran Android 17 with Qualcomm QNN/QAIRT 2.50 in burst performance
185
+ mode. The LJ9 ran Android 15 with the MediaTek Neuron runtime in sustained
186
  speed mode. Power settings were not normalized, and energy consumption was
187
  not measured. These results apply to the listed device/compiler/runtime
188
  combinations and do not characterize JIT performance.