Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,155

Base only

Active filters: speculative-decoding

mlx-community/gemma-4-12B-it-qat-assistant-mxfp4

Text Generation • 0.4B • Updated Jun 5 • 65

mlx-community/gemma-4-12B-it-qat-assistant-nvfp4

Text Generation • 0.4B • Updated Jun 5 • 71

mlx-community/gemma-4-12B-it-qat-assistant-mxfp8

Text Generation • 0.4B • Updated Jun 5 • 55

mlx-community/gemma-4-26B-A4B-it-qat-assistant-4bit

Text Generation • 0.4B • Updated Jun 5 • 2.54k • 2

mlx-community/gemma-4-26B-A4B-it-qat-assistant-5bit

Text Generation • 0.4B • Updated Jun 5 • 46

mlx-community/gemma-4-26B-A4B-it-qat-assistant-6bit

Text Generation • 0.4B • Updated Jun 5 • 70

mlx-community/gemma-4-26B-A4B-it-qat-assistant-8bit

Text Generation • 0.4B • Updated Jun 5 • 130

mlx-community/gemma-4-26B-A4B-it-qat-assistant-bf16

Text Generation • 0.4B • Updated Jun 5 • 132 • 1

mlx-community/gemma-4-26B-A4B-it-qat-assistant-mxfp4

Text Generation • 0.4B • Updated Jun 5 • 105 • 1

mlx-community/gemma-4-26B-A4B-it-qat-assistant-nvfp4

Text Generation • 0.4B • Updated Jun 5 • 80

mlx-community/gemma-4-26B-A4B-it-qat-assistant-mxfp8

Text Generation • 0.4B • Updated Jun 5 • 80 • 1

mlx-community/gemma-4-31B-it-qat-assistant-4bit

Text Generation • 0.5B • Updated Jun 5 • 234

mlx-community/gemma-4-31B-it-qat-assistant-5bit

Text Generation • 0.5B • Updated Jun 5 • 53

mlx-community/gemma-4-31B-it-qat-assistant-6bit

Text Generation • 0.5B • Updated Jun 5 • 78

mlx-community/gemma-4-31B-it-qat-assistant-8bit

Text Generation • 0.5B • Updated Jun 5 • 105

mlx-community/gemma-4-31B-it-qat-assistant-bf16

Text Generation • 0.5B • Updated Jun 5 • 148 • 1

mlx-community/gemma-4-31B-it-qat-assistant-mxfp4

Text Generation • 0.5B • Updated Jun 5 • 49

mlx-community/gemma-4-31B-it-qat-assistant-nvfp4

Text Generation • 0.5B • Updated Jun 5 • 52

mlx-community/gemma-4-31B-it-qat-assistant-mxfp8

Text Generation • 0.5B • Updated Jun 5 • 97 • 1

vladimir94/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-GGUF

Text Generation • 35B • Updated Jun 6 • 697

mradermacher/OYM-Qimi-122B-A10B-K2.6-GGUF

125B • Updated Jun 6 • 1.86k

patrickbdevaney/qwen-3.6-35b-a3b-dflash-jetson-agx-thor

Text Generation • Updated Jun 7 • 1

mradermacher/OYM-Qimi-122B-A10B-K2.6-i1-GGUF

125B • Updated Jul 3 • 1.22k • 5

NeoRoth/gemma-4-e4b-it-assistant-mlx

78.8M • Updated Jun 6 • 15

NeoRoth/gemma-4-26b-a4b-it-assistant-mlx

0.4B • Updated Jun 6 • 16

NeoRoth/gemma-4-31b-it-assistant-mlx

0.5B • Updated Jun 6 • 24

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 6 • 1.64k • 38

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Speed

Text Generation • 35B • Updated 20 days ago • 1.75k • 5

boxwrench/gemma-4-qat-mtp-assistant-heads

0.4B • Updated Jun 6 • 317 • 4

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 35B • Updated 20 days ago • 1.16k • 10