Sync model repo (text/metadata)
Browse files
README.md
CHANGED
|
@@ -14,22 +14,22 @@ tags:
|
|
| 14 |
- imagenet-1k
|
| 15 |
---
|
| 16 |
|
| 17 |
-
# DeiT-Tiny optimized for Arm-based
|
| 18 |
|
| 19 |
-
DeiT-Tiny image classification optimized as a quantized ExecuTorch `.pte` model for Arm-based
|
| 20 |
|
| 21 |
## Summary
|
| 22 |
|
| 23 |
-
This repository contains an Arm-optimized version of facebook/deit-tiny-patch16-224 for image classification. The model is provided in ExecuTorch `.pte` format, targeting Arm-based
|
| 24 |
|
| 25 |
-
This version demonstrates efficient inference on Arm-based platforms while preserving the original model's intended behavior. Arm evaluated the model on ImageNet-1k and measured
|
| 26 |
|
| 27 |
**Key results**
|
| 28 |
|
| 29 |
| Area | Result |
|
| 30 |
|---|---|
|
| 31 |
| Model format | ExecuTorch `.pte` |
|
| 32 |
-
| Target device class |
|
| 33 |
| Reference device | Alif DK-E8 (Cortex-M55 + Ethos-U85, bare-metal) |
|
| 34 |
| Primary performance result | 81.59 ms p50 latency (12.26 inferences/s) |
|
| 35 |
| Accuracy result | Top-1 67.95% / Top-5 88.47% (PyTorch quantized simulation, not measured on-device — see Limitations) |
|
|
|
|
| 14 |
- imagenet-1k
|
| 15 |
---
|
| 16 |
|
| 17 |
+
# DeiT-Tiny optimized for Arm-based Ethos-U NPU
|
| 18 |
|
| 19 |
+
DeiT-Tiny image classification optimized as a quantized ExecuTorch `.pte` model for Arm-based Ethos-U NPU systems (Ethos-U85). Most quantized layers use INT8 activations and INT8 weights (a8w8), while selected output.dense layers use INT16 activations and INT8 weights (a16w8) to preserve accuracy within acceptable ranges. Quantization is per-tensor throughout: weights use symmetric quantization (zero-point fixed at 0) across all layers, while a8w8 activations use an asymmetric scheme (affine, histogram-observer-derived zero-point); the a16w8-overridden output.dense activations are symmetric (zero-point fixed at 0), still histogram-observer-derived.
|
| 20 |
|
| 21 |
## Summary
|
| 22 |
|
| 23 |
+
This repository contains an Arm-optimized version of facebook/deit-tiny-patch16-224 for image classification. The model is provided in ExecuTorch `.pte` format, targeting Arm-based Ethos-U NPU systems.
|
| 24 |
|
| 25 |
+
This version demonstrates efficient inference on Arm-based platforms while preserving the original model's intended behavior. Arm evaluated the model on ImageNet-1k and measured performance on a representative evaluation target.
|
| 26 |
|
| 27 |
**Key results**
|
| 28 |
|
| 29 |
| Area | Result |
|
| 30 |
|---|---|
|
| 31 |
| Model format | ExecuTorch `.pte` |
|
| 32 |
+
| Target device class | Ethos-U NPU |
|
| 33 |
| Reference device | Alif DK-E8 (Cortex-M55 + Ethos-U85, bare-metal) |
|
| 34 |
| Primary performance result | 81.59 ms p50 latency (12.26 inferences/s) |
|
| 35 |
| Accuracy result | Top-1 67.95% / Top-5 88.47% (PyTorch quantized simulation, not measured on-device — see Limitations) |
|