Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

111

Base only

Active filters: arm

Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix

12B • Updated Oct 3, 2024 • 2.36k • 16

Makatia/microsoft_Phi-3-mini-4k-instruct_onnx_rpi

Text Generation • Updated Mar 25

Makatia/TinyLlama_TinyLlama-1.1B-Chat-v1.0_onnx

Text Generation • Updated Mar 25 • 2

stiv14/audio-caption-categorizer-model

Audio Classification • Updated Dec 4, 2025 • 28 • 1

mtrpires/Qwen3.5-35B-A3B-IQK-RPi5-16GB

Text Generation • 35B • Updated Mar 28 • 168

electron-rare/kiki-stm32-sft-v1

Arm/deit-tiny-int8-xnnpack-executorch

Image Classification • Updated 21 days ago • 360

Arm/resnet-50-int8-xnnpack-executorch

Image Classification • Updated 21 days ago • 665

Arm/resnet-18-int8-xnnpack-executorch

Image Classification • Updated 21 days ago • 477

Arm/squeezenet-1-1-int8-xnnpack-executorch

Image Classification • Updated 20 days ago • 209

Arm/shufflenet-v2-x1-0-int8-xnnpack-executorch

Image Classification • Updated 21 days ago • 400

Arm/googlenet-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 20 days ago • 370

Arm/vit-base-int8-xnnpack-executorch

Image Classification • Updated 13 days ago • 756

Arm/swin-tiny-int8-xnnpack-executorch

Image Classification • Updated 21 days ago • 705

Arm/inception-v3-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 21 days ago • 653

mehmetkeremturkcan/mote

Text Generation • Updated Jun 17

Arm/llama-3-2-1b-base-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated about 10 hours ago • 60

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated about 10 hours ago • 48

Ethgar/skyfull-lookat-chamonix-v1

doggydon007/Ornith-1.0-9B-Hardware-Expert-fp16

Text Generation • 9B • Updated Jul 15 • 139 • 4

Arm/yolov8s-int8-xnnpack-executorch

Object Detection • Updated 13 days ago • 198

VoxRT/silero-vad-vxrt

Voice Activity Detection • Updated 13 days ago • 1

VoxRT/wake-word-hey-assistant-vxrt

Audio Classification • Updated 13 days ago • 2

VoxRT/streaming-medium-pc-vxrt

Automatic Speech Recognition • Updated 13 days ago • 1

Arm/whisper-tiny-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 21 days ago • 373

Arm/whisper-small-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 20 days ago • 116

arthors/carwin-element-detection

Object Detection • Updated Jul 15

Arm/whisper-base-int8-litert

Automatic Speech Recognition • Updated 21 days ago • 39

Arm/whisper-medium-int8-litert

Automatic Speech Recognition • Updated 21 days ago • 108

Arm/whisper-large-v3-int8-litert

Automatic Speech Recognition • Updated 20 days ago • 142