aorabdel commited on
Commit
d042478
·
verified ·
1 Parent(s): 2f39677

Sync model repo (text/metadata)

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -14,22 +14,22 @@ tags:
14
  - imagenet-1k
15
  ---
16
 
17
- # DeiT-Tiny optimized for Arm-based Edge NPU
18
 
19
- DeiT-Tiny image classification optimized as a quantized ExecuTorch `.pte` model for Arm-based Edge NPU systems (Ethos-U85). Most quantized layers use INT8 activations and INT8 weights (a8w8), while selected output.dense layers use INT16 activations and INT8 weights (a16w8) to preserve accuracy within acceptable ranges. Quantization is per-tensor throughout: weights use symmetric quantization (zero-point fixed at 0) across all layers, while a8w8 activations use an asymmetric scheme (affine, histogram-observer-derived zero-point); the a16w8-overridden output.dense activations are symmetric (zero-point fixed at 0), still histogram-observer-derived.
20
 
21
  ## Summary
22
 
23
- This repository contains an Arm-optimized version of facebook/deit-tiny-patch16-224 for image classification. The model is provided in ExecuTorch `.pte` format, targeting Arm-based Edge NPU systems.
24
 
25
- This version demonstrates efficient inference on Arm-based platforms while preserving the original model's intended behavior. Arm evaluated the model on ImageNet-1k and measured on-device performance on an Alif DK-E8 (Cortex-M55 + Ethos-U85 NPU).
26
 
27
  **Key results**
28
 
29
  | Area | Result |
30
  |---|---|
31
  | Model format | ExecuTorch `.pte` |
32
- | Target device class | Edge NPU |
33
  | Reference device | Alif DK-E8 (Cortex-M55 + Ethos-U85, bare-metal) |
34
  | Primary performance result | 81.59 ms p50 latency (12.26 inferences/s) |
35
  | Accuracy result | Top-1 67.95% / Top-5 88.47% (PyTorch quantized simulation, not measured on-device — see Limitations) |
 
14
  - imagenet-1k
15
  ---
16
 
17
+ # DeiT-Tiny optimized for Arm-based Ethos-U NPU
18
 
19
+ DeiT-Tiny image classification optimized as a quantized ExecuTorch `.pte` model for Arm-based Ethos-U NPU systems (Ethos-U85). Most quantized layers use INT8 activations and INT8 weights (a8w8), while selected output.dense layers use INT16 activations and INT8 weights (a16w8) to preserve accuracy within acceptable ranges. Quantization is per-tensor throughout: weights use symmetric quantization (zero-point fixed at 0) across all layers, while a8w8 activations use an asymmetric scheme (affine, histogram-observer-derived zero-point); the a16w8-overridden output.dense activations are symmetric (zero-point fixed at 0), still histogram-observer-derived.
20
 
21
  ## Summary
22
 
23
+ This repository contains an Arm-optimized version of facebook/deit-tiny-patch16-224 for image classification. The model is provided in ExecuTorch `.pte` format, targeting Arm-based Ethos-U NPU systems.
24
 
25
+ This version demonstrates efficient inference on Arm-based platforms while preserving the original model's intended behavior. Arm evaluated the model on ImageNet-1k and measured performance on a representative evaluation target.
26
 
27
  **Key results**
28
 
29
  | Area | Result |
30
  |---|---|
31
  | Model format | ExecuTorch `.pte` |
32
+ | Target device class | Ethos-U NPU |
33
  | Reference device | Alif DK-E8 (Cortex-M55 + Ethos-U85, bare-metal) |
34
  | Primary performance result | 81.59 ms p50 latency (12.26 inferences/s) |
35
  | Accuracy result | Top-1 67.95% / Top-5 88.47% (PyTorch quantized simulation, not measured on-device — see Limitations) |