Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

93

Base only

Active filters: optiq

mlx-community/KAT-Coder-V2.5-Dev-OptiQ-4bit

Text Generation • 35B • Updated 7 days ago • 1.54k • 6

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 17 days ago • 12.5k • 75

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 17 days ago • 12.6k • 58

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 12 days ago • 4.31k • 15

mlx-community/LLaDA2.2-flash-OptiQ-2bit

Text Generation • 103B • Updated 7 days ago • 331 • 4

mlx-community/XYZ-Aquila-mini-OptiQ-4bit

Text Generation • 35B • Updated 6 days ago • 139 • 3

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 17 days ago • 9.55k • 89

mlx-community/gemma-4-12B-it-qat-OptiQ-4bit

Text Generation • 12B • Updated 12 days ago • 5.02k • 11

mlx-community/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-OptiQ-4bit

Text Generation • 0.2B • Updated 17 days ago • 1.27k • 4

mlx-community/Nanbeige4.2-3B-OptiQ-4bit

Text Generation • 0.9B • Updated 5 days ago • 608 • 2

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.9B • Updated 17 days ago • 3.75k • 27

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated 12 days ago • 7.99k • 29

mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit

Text Generation • 25B • Updated 12 days ago • 4.22k • 18

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 12 days ago • 4.22k • 12

mlx-community/MiniCPM5-1B-OptiQ-4bit

Text Generation • 0.2B • Updated 17 days ago • 4.6k • 9

mlx-community/diffusiongemma-26B-A4B-it-OptiQ-4bit

Image-Text-to-Text • 25B • Updated 12 days ago • 2.49k • 19

mlx-community/ThinkingCap-Qwen3.6-27B-OptiQ-4bit

Image-Text-to-Text • 27B • Updated 17 days ago • 1.86k • 3

mlx-community/Ornith-1.0-9B-OptiQ-4bit

Image-Text-to-Text • 9B • Updated 17 days ago • 1.36k • 5

mlx-community/Ornith-1.0-35B-OptiQ-4bit

Image-Text-to-Text • 35B • Updated 17 days ago • 1.39k • 3

SwinliQ-AIs/Qwen3.5-2B-4bit

Text Generation • 0.4B • Updated 5 days ago • 236 • 1

mlx-community/Laguna-XS-2.1-OptiQ-4bit

Text Generation • 33B • Updated about 14 hours ago • 1

mlx-community/Laguna-S-2.1-OptiQ-2bit

Text Generation • 118B • Updated about 13 hours ago • 1

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.2B • Updated 17 days ago • 1.48k • 21

mlx-community/Qwen3.5-2B-OptiQ-4bit

Text Generation • 0.4B • Updated 17 days ago • 1.3k • 12

machinadeusex/Qwen3.5-4B-OptiQ-4bit

Text Generation • 0.8B • Updated Mar 14 • 49 • 1

mlx-community/YOLO26n-OptiQ-6bit

Object Detection • Updated Apr 26 • 49

mlx-community/YOLO26s-OptiQ-6bit

Object Detection • Updated Apr 26 • 38

mlx-community/YOLO26m-OptiQ-6bit

Object Detection • Updated Apr 26 • 36

mlx-community/YOLO26x-OptiQ-6bit

Object Detection • Updated Apr 26 • 130 • 2

mlx-community/YOLO26l-OptiQ-6bit

Object Detection • Updated Apr 26 • 42