Instructions to use litert-community/vit-base-patch16-224 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use litert-community/vit-base-patch16-224 with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -50,6 +50,13 @@ compilation; they do not contain device-specific compiled NPU programs.
|
|
| 50 |
substantial accuracy tradeoff and retains INT16 regions, so backend support
|
| 51 |
must be verified.
|
| 52 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
## TorchAO quantization recipe
|
| 54 |
|
| 55 |
Both variants use post-training static quantization, without QAT or fine-tuning.
|
|
@@ -158,7 +165,7 @@ value is the median of three process means, with five warmup invocations and
|
|
| 158 |
30 measured invocations per process. All configurations are AOT compiled and
|
| 159 |
fully delegated to the NPU, with no residual CPU operations.
|
| 160 |
|
| 161 |
-
| Model file | `SM-S937U1`
|
| 162 |
| --- | ---: | ---: |
|
| 163 |
| `model_fp32.tflite` | 6 | 129 |
|
| 164 |
| `model_a16w8.tflite` | 4 | 71 |
|
|
@@ -174,8 +181,8 @@ preprocessing, file I/O and explicit host input/output buffer transfers.
|
|
| 174 |
Some variants were measured in separate sessions using the same benchmark
|
| 175 |
and dispatch runtime for each device.
|
| 176 |
|
| 177 |
-
The
|
| 178 |
-
mode. The
|
| 179 |
speed mode. Power settings were not normalized, and energy consumption was
|
| 180 |
not measured. These results apply to the listed device/compiler/runtime
|
| 181 |
combinations and do not characterize JIT performance.
|
|
|
|
| 50 |
substantial accuracy tradeoff and retains INT16 regions, so backend support
|
| 51 |
must be verified.
|
| 52 |
|
| 53 |
+
Extra notes: Apple ANE and QC NPUs support FP16 natively and the performances are
|
| 54 |
+
usually very good. Deloying a FP16 model is much easier since it does not require
|
| 55 |
+
calibration steps. Note that the A16W8 and A8W8 assets provided here were calibrated
|
| 56 |
+
from a particular dataset and should not used in production directly. A FP16 model
|
| 57 |
+
file is not provided here is because it is easy to be generated from the fp32 asset.
|
| 58 |
+
It is actually a top choice.
|
| 59 |
+
|
| 60 |
## TorchAO quantization recipe
|
| 61 |
|
| 62 |
Both variants use post-training static quantization, without QAT or fine-tuning.
|
|
|
|
| 165 |
30 measured invocations per process. All configurations are AOT compiled and
|
| 166 |
fully delegated to the NPU, with no residual CPU operations.
|
| 167 |
|
| 168 |
+
| Model file | `SM-S937U1`(ms) | `LJ9`(ms) |
|
| 169 |
| --- | ---: | ---: |
|
| 170 |
| `model_fp32.tflite` | 6 | 129 |
|
| 171 |
| `model_a16w8.tflite` | 4 | 71 |
|
|
|
|
| 181 |
Some variants were measured in separate sessions using the same benchmark
|
| 182 |
and dispatch runtime for each device.
|
| 183 |
|
| 184 |
+
The `SM-S937U1` ran Android 17 with Qualcomm QNN/QAIRT 2.50 in burst performance
|
| 185 |
+
mode. The LJ9 ran Android 15 with the MediaTek Neuron runtime in sustained
|
| 186 |
speed mode. Power settings were not normalized, and energy consumption was
|
| 187 |
not measured. These results apply to the listed device/compiler/runtime
|
| 188 |
combinations and do not characterize JIT performance.
|