Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,152

Base only

Active filters: speculative-decoding

AngelSlim/Qwen3-8b-dflare

Text Generation • 1B • Updated Jun 4 • 200 • 3

jedisct1/gemma-4-E2B-it-txt-mlx-4bit

Text Generation • 5B • Updated Jun 3 • 27

jedisct1/gemma-4-E2B-it-txt-mlx-8bit

Text Generation • 5B • Updated Jun 3 • 26

jakeatx/gemma4-12b-mtp-assistant

Text Generation • 0.4B • Updated Jun 3 • 264 • 3

agentmish/gemma-4-12B-it-assistant-mlx-bf16

0.4B • Updated Jun 3 • 23

bahadirakdemir/gemma-4-12B-it-assistant-fp8

Text Generation • 0.4B • Updated Jun 3 • 49 • 2

Phil2Sat/gemma-4-31B-it-assistant-GGUF

Text Generation • 0.5B • Updated Jun 4 • 174

khaduyen1993/qwen3.6-27b

Image-Text-to-Text • 28B • Updated Jun 4 • 7

Mungert/Qwopus3.5-9B-Coder-MTP-GGUF

Image-Text-to-Text • 9B • Updated Jun 4 • 690 • 1

colefuoco00/gemma-4-12B-it-assistant-GGUF

0.4B • Updated Jun 4 • 181 • 3

OpenYourMind/OYM-Qimi-122B-A10B-K2.6

Image-Text-to-Text • 125B • Updated Jun 16 • 58 • 5

slevinw/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 4 • 727

k-l-lambda/kimi-k2.6-eagle3-mla

Text Generation • 3B • Updated Jun 15 • 30

RedHatAI/NVIDIA-Nemotron-3-Ultra-550B-A55B-speculator.dflash

3B • Updated Jul 16 • 108 • 1

ji-farthing/gemma-4-12B-it-MTP-ik-llama-GGUF

0.4B • Updated Jun 5 • 171 • 2

ji-farthing/gemma-4-qat-q4_0-MTP-assistants-ik-llama-GGUF

0.4B • Updated Jun 8 • 611 • 6

mlx-community/gemma-4-E2B-it-qat-assistant-4bit

Text Generation • 78M • Updated Jun 5 • 163

mlx-community/gemma-4-E2B-it-qat-assistant-5bit

Text Generation • 78M • Updated Jun 5 • 41

mlx-community/gemma-4-E2B-it-qat-assistant-6bit

Text Generation • 78M • Updated Jun 5 • 36

mlx-community/gemma-4-E2B-it-qat-assistant-8bit

Text Generation • 78M • Updated Jun 5 • 38

mlx-community/gemma-4-E2B-it-qat-assistant-bf16

Text Generation • 78M • Updated Jun 5 • 64

mlx-community/gemma-4-E2B-it-qat-assistant-mxfp4

Text Generation • 78M • Updated Jun 5 • 92 • 1

mlx-community/gemma-4-E2B-it-qat-assistant-nvfp4

Text Generation • 78M • Updated Jun 5 • 72

mlx-community/gemma-4-E2B-it-qat-assistant-mxfp8

Text Generation • 78M • Updated Jun 5 • 40

mlx-community/gemma-4-E4B-it-qat-assistant-4bit

Text Generation • 78.8M • Updated Jun 5 • 244 • 1

mlx-community/gemma-4-E4B-it-qat-assistant-6bit

Text Generation • 78.8M • Updated Jun 5 • 40

mlx-community/gemma-4-E4B-it-qat-assistant-5bit

Text Generation • 78.8M • Updated Jun 5 • 32

mlx-community/gemma-4-E4B-it-qat-assistant-8bit

Text Generation • 78.8M • Updated Jun 5 • 86

mlx-community/gemma-4-E4B-it-qat-assistant-bf16

Text Generation • 78.8M • Updated Jun 5 • 186 • 2

mlx-community/gemma-4-E4B-it-qat-assistant-mxfp4

Text Generation • 78.8M • Updated Jun 5 • 77 • 1