Instructions to use Arm/deit-tiny-int8-litert with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use Arm/deit-tiny-int8-litert with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Sync model repo (text/metadata)
Browse files
README.md
CHANGED
|
@@ -11,22 +11,22 @@ tags:
|
|
| 11 |
- litert
|
| 12 |
---
|
| 13 |
|
| 14 |
-
# DeiT-Tiny Patch16-224 optimized for Arm-based
|
| 15 |
|
| 16 |
-
DeiT-Tiny Patch16-224 optimized with INT8 static post-training quantization for image classification, exported to LiteRT `.tflite` format for efficient inference on Arm-based
|
| 17 |
|
| 18 |
## Summary
|
| 19 |
|
| 20 |
-
This repository contains an Arm-optimized version of facebook/deit-tiny-patch16-224 for image classification, quantized to INT8 via static post-training quantization — affine per-tensor activations, symmetric per-channel weights — while patch embeddings remain in FP32. The model is provided in LiteRT `.tflite` format, targeting
|
| 21 |
|
| 22 |
-
This version is intended to demonstrate efficient inference on Arm-based platforms while preserving the original model's intended behavior. Arm has evaluated this model on ImageNet-1k and measured performance on
|
| 23 |
|
| 24 |
**Key results**
|
| 25 |
|
| 26 |
| Area | Result |
|
| 27 |
|---|---|
|
| 28 |
| Model format | LiteRT `.tflite` |
|
| 29 |
-
| Target device class |
|
| 30 |
| Reference device | vivo X300 (C1-Ultra, C1-Premium, C1-Pro, Android 16 / OriginOS 6) |
|
| 31 |
| Example environment | AWS Graviton, Ubuntu arm64 |
|
| 32 |
| Primary performance result | p50 latency of 5.36 ms (1.74x faster than baseline) |
|
|
@@ -141,7 +141,7 @@ uv sync --frozen
|
|
| 141 |
uv run example.py
|
| 142 |
```
|
| 143 |
|
| 144 |
-
Note: The Python/uv example runs on AWS Graviton (Ubuntu arm64) to confirm runtime compatibility only, and is intended as a guideline for building an equivalent run script on
|
| 145 |
|
| 146 |
### Expected input
|
| 147 |
|
|
|
|
| 11 |
- litert
|
| 12 |
---
|
| 13 |
|
| 14 |
+
# DeiT-Tiny Patch16-224 optimized for Arm-based mobile CPUs with SME2
|
| 15 |
|
| 16 |
+
DeiT-Tiny Patch16-224 optimized with INT8 static post-training quantization for image classification, exported to LiteRT `.tflite` format for efficient inference on Arm-based mobile CPUs with SME2.
|
| 17 |
|
| 18 |
## Summary
|
| 19 |
|
| 20 |
+
This repository contains an Arm-optimized version of facebook/deit-tiny-patch16-224 for image classification, quantized to INT8 via static post-training quantization — affine per-tensor activations, symmetric per-channel weights — while patch embeddings remain in FP32. The model is provided in LiteRT `.tflite` format, targeting Mobile CPU systems.
|
| 21 |
|
| 22 |
+
This version is intended to demonstrate efficient inference on Arm-based platforms while preserving the original model's intended behavior. Arm has evaluated this model on ImageNet-1k and measured performance on a representative evaluation target.
|
| 23 |
|
| 24 |
**Key results**
|
| 25 |
|
| 26 |
| Area | Result |
|
| 27 |
|---|---|
|
| 28 |
| Model format | LiteRT `.tflite` |
|
| 29 |
+
| Target device class | Mobile CPU |
|
| 30 |
| Reference device | vivo X300 (C1-Ultra, C1-Premium, C1-Pro, Android 16 / OriginOS 6) |
|
| 31 |
| Example environment | AWS Graviton, Ubuntu arm64 |
|
| 32 |
| Primary performance result | p50 latency of 5.36 ms (1.74x faster than baseline) |
|
|
|
|
| 141 |
uv run example.py
|
| 142 |
```
|
| 143 |
|
| 144 |
+
Note: The Python/uv example runs on AWS Graviton (Ubuntu arm64) to confirm runtime compatibility only, and is intended as a guideline for building an equivalent run script on Mobile CPU systems.
|
| 145 |
|
| 146 |
### Expected input
|
| 147 |
|