Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,151

Base only

Active filters: speculative-decoding

NeoRoth/gemma-4-31b-it-assistant-mlx

0.5B • Updated Jun 6 • 24

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 6 • 1.62k • 38

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Speed

Text Generation • 35B • Updated 20 days ago • 1.77k • 5

boxwrench/gemma-4-qat-mtp-assistant-heads

0.4B • Updated Jun 6 • 317 • 4

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 35B • Updated 20 days ago • 1.16k • 10

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed-FP16

Text Generation • 9B • Updated 20 days ago • 907 • 2

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance-FP16

Text Generation • 35B • Updated 20 days ago • 783 • 2

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill

Text Generation • 35B • Updated Jun 28 • 1.1k • 10

kunhunjon/gemma-4-12B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 7 • 258 • 2

SyzygyResearch/DeepSeek-V4-Flash-EAGLE3.1

Text Generation • Updated Jun 7 • 83 • 8

sakamakismile/Huihui-gemma-4-12B-it-abliterated-NVFP4A16

Image-Text-to-Text • 7B • Updated Jun 7 • 403 • 4

superbonyx/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0.gguf

Text Generation • 0.4B • Updated Jun 8 • 308 • 2

kunhunjon/gemma-4-26B-A4B-it-qat-assistant-w4a16-ct

Text Generation • 0.4B • Updated Jun 8 • 41

plunderstruck/Qwen3.6-35B-A3B-MTP-ROCmFP4-GGUF

0.4B • Updated Jun 21 • 6.9k • 16

XiaomiMiMo/MiMo-V2.5-Pro-FP4-DFlash

Text Generation • 1T • Updated Jun 8 • 807 • 147

ysong21/gemma-4-12B-it-qat-assistant-MTP-Q4_0-GGUF

Text Generation • 0.4B • Updated Jun 8 • 204

asherszhang/MiniMax-M2.7-EAGLE3-draft-vocab200k

1B • Updated Jun 8 • 3.66k

asherszhang/MiniMax-M2.7-EAGLE3-draft-vocab32k

1.0B • Updated Jun 8 • 54

inference-optimization/Qwen3-8B-from-Qwen3-8B_regen-speculators.eagle3-qwen3arch-ckpt1

1B • Updated Jun 10 • 7.58k

Janvitos/gemma-4-26B-A4B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 8 • 381 • 4

Janvitos/gemma-4-31B-it-qat-assistant-MTP-Q8_0-GGUF

0.5B • Updated Jun 8 • 189 • 5

Vegss/Qwopus3.6-35B-A3B-v1-MTP-GGUF

Image-Text-to-Text • 0.4B • Updated Jun 8 • 361

Kh0rd/gemma-4-12B-it-qat-assistant-q8_0-gguf

Text Generation • 0.4B • Updated Jun 8 • 31

Pulsate1680/gemma-4-mtp-q8_0-gguf

Text Generation • 0.4B • Updated Jun 9 • 112 • 1

cascade-tech/gemma-4-E4B-it-qat-q4_0-unquantized-assistant-gguf

78M • Updated Jun 9 • 365 • 2

amaranus/Gemma-4-E4B-it-qat-assistant-MTP-Q8_0-GGUF

78M • Updated Jun 13 • 268 • 3

saital/qwen4b-adaptfm-7p8x-vllm

RedHatAI/Qwen3-8B-speculator.peagle

2B • Updated Jun 9 • 129

eadx/Qwopus3.6-27B-v2-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 10 • 305

LaraAI-Labs/Lara-TRT-EDGE-LLM-Qwen3.5-9B-INT4