Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

75

Base only

Active filters: arm-optimized

Arm/clip-vit-base-patch32-int8-xnnpack-executorch

Zero-Shot Image Classification • Updated 16 days ago • 80 • 1

Arm/deit-tiny-int8-xnnpack-executorch

Image Classification • Updated 17 days ago • 339

Arm/resnet-50-int8-xnnpack-executorch

Image Classification • Updated 17 days ago • 611

Arm/resnet-18-int8-xnnpack-executorch

Image Classification • Updated 17 days ago • 448

Arm/squeezenet-1-1-int8-xnnpack-executorch

Image Classification • Updated 16 days ago • 193

Arm/shufflenet-v2-x1-0-int8-xnnpack-executorch

Image Classification • Updated 17 days ago • 189

Arm/googlenet-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 16 days ago • 346

Arm/vit-base-int8-xnnpack-executorch

Image Classification • Updated 9 days ago • 729

Arm/swin-tiny-int8-xnnpack-executorch

Image Classification • Updated 17 days ago • 618

Arm/inception-v3-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 17 days ago • 590

Arm/llama-3-2-1b-base-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 17 days ago • 33

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 17 days ago • 41

Arm/yolov8s-int8-xnnpack-executorch

Object Detection • Updated 9 days ago • 44

Arm/whisper-tiny-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 17 days ago • 59

Arm/whisper-small-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 16 days ago • 87

Arm/whisper-base-int8-litert

Automatic Speech Recognition • Updated 17 days ago • 36

Arm/whisper-medium-int8-litert

Automatic Speech Recognition • Updated 17 days ago • 19

Arm/whisper-large-v3-int8-litert

Automatic Speech Recognition • Updated 16 days ago • 21

Arm/efficient-sam-s-int8-xnnpack-executorch

Image Segmentation • Updated 17 days ago • 59

Arm/yolov8s-seg-int8-xnnpack-executorch

Image Segmentation • Updated 16 days ago • 59

Arm/yolov7-seg-int8-xnnpack-executorch

Image Segmentation • Updated 16 days ago • 90

Arm/mobile-sam-int8-xnnpack-executorch

Image Segmentation • Updated 16 days ago • 61

Arm/minilm-l6-v2-int8-litert

Feature Extraction • Updated 17 days ago • 11

Arm/bge-base-en-v1.5-int8-litert

Feature Extraction • Updated 17 days ago • 23

Arm/nomic-embed-text-v1-int8-litert

Feature Extraction • Updated 17 days ago • 12

Arm/mobilenet-v3-small-int8-xnnpack-executorch

Image Classification • Updated 16 days ago • 199

Arm/qwen3-0-6b-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 17 days ago • 55

Arm/llama-3-2-3b-instruct-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 17 days ago • 44

Arm/gemma-3-1b-base-onnx-genai-int4-emb-int8

Text Generation • Updated 17 days ago • 42

Arm/gemma-3-1b-instruct-onnx-genai-int4-emb-int8

Text Generation • Updated 17 days ago • 44