Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,052

Base only

Active filters: speculative-decoding

canada-quant/DeepSeek-V4-Pro-NVFP4-FP8-MTP

1.7T • Updated 7 days ago • 148 • 5

ironbcc/gemma-4-26B-A4B-it-MTP-GGUF

Text Generation • 0.4B • Updated May 24 • 1.78k • 7

Anbeeld/Qwen3.6-35B-A3B-DFlash-GGUF

Feature Extraction • 0.4B • Updated Aug 29 • 4.42k • 13

mlx-community/Qwen3.5-9B-MTP-4bit

Text Generation • 0.2B • Updated Jun 1 • 1.22k • 4

Inferact/MiniMax-M3-EAGLE3

Text Generation • 3B • Updated Jun 13 • 16.2k • 15

plunderstruck/Qwen3.6-27B-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 371 • 34

fraserprice/DeepSeek-V4-Flash-Abliterated-DSpark

165B • Updated Jul 1 • 473 • 10

ji-farthing/MiMo-V2.5-Pro-DFlash-draft-ik-llama-GGUF

Text Generation • 3B • Updated Jul 31 • 1.22k • 6

williamliao/qwen3.6-27B-DFlash-GGUF

Text Generation • 2B • Updated Jul 13 • 391 • 9

ManniX-ITA/gemma-4-E2B-it-assistant-GGUF

Image-Text-to-Text • 78M • Updated 17 days ago • 534 • 1

satgeze/Gemma4-12B-Uncensored-HauhauCS-1M-GGUF

Text Generation • 12B • Updated Jul 11 • 1.9k • 7

Gorilla4X/Bonsai-8B-Ternary-RDNA4

8B • Updated Jul 13 • 152 • 1

The-freezer/GLM-5.2-ABLITERATED-REAP-NU176-NVFP4

Text Generation • 273B • Updated Jul 31 • 480 • 5

braydenh563/Qwen3.6-35B-Uncensored-HauhauCS-1M-MTP-Ollama

Image-Text-to-Text • 36B • Updated Aug 6 • 821 • 10

Youssofal/Qwen3.5-4B-MTPLX-Optimized-Quality

Text Generation • 4B • Updated 16 days ago • 714 • 1

barozp/Qwen3.6-29B-REAP-Opus-Reasoning-Distill-MTP-GGUF

Text Generation • 29B • Updated Jul 22 • 3.29k • 11

PaddlePaddle/HPD-Parsing

Image-Text-to-Text • 1B • Updated Jul 22 • 5.09k • 101

satgeze/Qwen3.5-0.8B-DSpark

0.7B • Updated Jul 31 • 823 • 2

gsrunion/Qwen3.6-35B-A3B-ROCmFP4-STRIX_LEAN-DFLASH-GGUF

Text Generation • 36B • Updated Jul 24 • 281 • 2

modal-labs/Kimi-K3-DFlash

Text Generation • 3B • Updated Aug 5 • 1.54k • 4

Myric/KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

Text Generation • 35B • Updated Aug 21 • 9.83k • 12

ji-farthing/RalphSeek-V4-Flash-GGUF

Text Generation • 0.1B • Updated Aug 13 • 192 • 2

inclusionAI/Ling-3.0-flash-dspark

Text Generation • 1B • Updated Aug 22 • 2.23k • 20

reyden009/speculative-decoding-lab

Updated Aug 11 • 6

Akahsizrr/Mini-Whale-1-12B

Text Generation • 13B • Updated Aug 11 • 233 • 22

lued/Qwen3.8-27B-INT8-W8A16-MTP

Image-Text-to-Text • 28B • Updated Aug 15 • 45.3k • 91

Zynerji/Ektome-Qwen3.8-27B-PristinelyUncensored

Text Generation • 27B • Updated Aug 20 • 1.88k • • 13

mlx-community/Qwen3.8-27B-MTP-4bit

Text Generation • 0.4B • Updated Aug 14 • 21.7k • 34

ddalcu/Qwen3.8-27B-MLX-Serve-8bit

Image-Text-to-Text • 28B • Updated 4 days ago • 804 • 5

djrsystemservices/Agents-A1-4B-oQ6e-mtp

Image-Text-to-Text • 5B • Updated Aug 15 • 37 • 1