Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,152

Base only

Active filters: speculative-decoding

eadx/Qwopus3.6-27B-v2-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 10 • 305

LaraAI-Labs/Lara-TRT-EDGE-LLM-Qwen3.5-9B-INT4

SEBK4C/gemma-4-12b-it-qat-q4_0-llamafile

Text Generation • Updated Jul 6 • 29

dataopsnick/adapt-diff-qwen-0.8b

Text Generation • 0.8B • Updated Jun 28 • 18

naveenrajk/Qwen3.5-4B-DFlash-W8A16

Text Generation • 0.5B • Updated Jun 10 • 128 • 1

meshllm/GLM-4.7-Flash-MTP-GGUF

Text Generation • 31B • Updated Jul 1 • 469

KatterMobile/Gemma-4-31B-it-QAT-MX46A_S-GGUF

Text Generation • 31B • Updated Jun 11 • 76

ddalcu/Qwen3.6-27B-4bit-MTP-MLX-Serve

Text Generation • 27B • Updated Jun 11 • 389 • 8

lemuralabs/Qwen3.6-27B-v2.1-uncensored-mxfp4

Image-Text-to-Text • 27B • Updated Aug 5 • 243 • 2

trohrbaugh/gemma-4-31b-it-heretic-ara-NVFP4

Image-Text-to-Text • 22B • Updated Jun 11 • 80 • 1

sakamakismile/Huihui-gemma-4-26B-A4B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 16B • Updated Jun 12 • 602 • 5

sakamakismile/Huihui-gemma-4-31B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 18B • Updated Jun 12 • 228 • 2

RedHatAI/Mellum2-12B-A2.5B-Thinking-speculator.dflash

0.7B • Updated Jul 25 • 106 • 2

plunderstruck/Qwopus3.6-27B-Coder-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 399 • 9

plunderstruck/Qwen3.6-40B-Deckard-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 165 • 9

warshanks/gemma-4-12B-it-assistant-coreai

nom666/Qwopus3.6-27B-v2-MTPLX-8bit-Quality

Text Generation • 27B • Updated Jun 12 • 22

nom666/Qwopus3.6-27B-v2-MTPLX-4bit-Speed

Text Generation • 27B • Updated Jun 12 • 24 • 1

nom666/Qwopus3.6-27B-Coder-MTPLX-4bit-Speed

Text Generation • 27B • Updated Jun 12 • 336 • 4

nom666/Qwopus3.6-27B-Coder-MTPLX-8bit-Quality

Text Generation • 27B • Updated Jun 12 • 79 • 3

peerrh/treeflash-qwen3-8b

Text Generation • 1B • Updated Jun 18 • 16

s-batman/Qwopus3.6-27B-Coder-NVFP4-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 12 • 58 • 1

natfii/Qwen3.6-27B-VLM-Cascade

Image-Text-to-Text • 28B • Updated Jun 13 • 12

modal-labs/Qwen3.5-397B-A17B-DFlash

Text Generation • 1B • Updated Jun 15 • 78 • 5

natfii/Qwen3.6-27B-VLM-Cascade-NVFP4-MTP

Image-Text-to-Text • 16B • Updated Jul 4 • 95 • 2

originalGeek/Orthrus-Qwen3-8B-GGUF

Text Generation • 10B • Updated Jun 13 • 31

plunderstruck/Qwen3.6-27B-OBLITERATED-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 132 • 5

williamliao/Qwen3-8B-EAGLE3-Speculator-GGUF

Text Generation • 1B • Updated Jul 13 • 265

FINAL-Bench/Darwin-28B-Coder-GGUF

Text Generation • 27B • Updated Jul 25 • 207 • 38

williamliao/Qwen3-14B-EAGLE3-Speculator-GGUF

Text Generation • 1B • Updated Jul 13 • 298