Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,150

Base only

Active filters: speculative-decoding

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed-FP16

27B • Updated 20 days ago • 431 • 11

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Quality

Image-Text-to-Text • 27B • Updated 20 days ago • 564 • 15

Lucebox/Qwen3.6-27B-DFlash-GGUF

2B • Updated May 28 • 182 • 14

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated Jul 9 • 157 • 16

litcloud/Qwen3.6-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated May 10 • 27 • 1

dxx117/Qwen3.5-397B-A17B-GGUF-UD-IQ2_XXS-MTP-Q8_0

403B • Updated May 10 • 62

liamkou/gemma-4-26B-A4B-it-assistant-bf16

Text Generation • 0.4B • Updated May 11 • 22

weijiezz/SpecBlock-Qwen3-8B

0.7B • Updated May 11 • 14 • 1

weijiezz/SpecBlock-Llama-3.1-8B-Instruct

0.7B • Updated May 11 • 10

weijiezz/EAGLE3-Llama-3.1-8B-Instruct

0.4B • Updated May 11 • 15

stuchapin/Carnice-V2-27B-MTP-GGUF

Text Generation • 27B • Updated May 11 • 124 • 2

eric717273/Qwen3.5-122B-A10B-MXFP4_MOE-MTP-GGUF

Text Generation • 125B • Updated May 13 • 53 • 1

namenotfoundai/NNF-EAM

Text Generation • Updated Jul 29 • 7

webhie/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated May 12 • 253 • 1

Kevpadil/Qwen3.6-35B-A3B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 21B • Updated May 12 • 21

tnhnyzc/MiMO-V2.5-MTP-GGUF

Text Generation • 310B • Updated Jul 31 • 118 • 8

HuggingFaceBio/Carbon-500M

Text Generation • 0.5B • Updated Aug 7 • 790 • 38

ji-farthing/gemma-4-26B-A4B-it-assistant-Q4_K_S-GGUF

0.4B • Updated May 13 • 93 • 1

webhie/Qwen3.6-27B-int4-AutoRound-Code

Image-Text-to-Text • 6B • Updated May 12 • 272 • 20

shdennlin/gemma-4-26B-A4B-it-8bit

Image-Text-to-Text • 26B • Updated May 13 • 11

shdennlin/gemma-4-26B-A4B-it-assistant-8bit

Image-Text-to-Text • 0.4B • Updated May 13 • 14

bahadirakdemir/gemma-4-31B-it-assistant-fp8

Text Generation • 0.5B • Updated May 13 • 116 • 2

sleepyeldrazi/Qwen3.6-27B-MXFP4-MTP

Image-Text-to-Text • 28B • Updated May 13 • 18 • 1

ji-farthing/gemma-4-26B-A4B-it-assistant-Q6_K-GGUF

0.4B • Updated May 13 • 104 • 2

GazTrab/Qwen3.6-27B-MTP-UD-IQ3_XXS-GGUF

Text Generation • 27B • Updated May 13 • 816 • 1

GestaltLabs/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 0.5B • Updated May 14 • 658 • 15

grteam/Qwen3.6-35B-A3B-GRTEAM-MTP-Q5_K_M

Text Generation • 36B • Updated May 13 • 75 • 3

StentorLabs/Stentor3-50M

Text Generation • 49.4M • Updated May 19 • 298 • 7

zan/Qwen3.6-27B-DFlash-ja

Text Generation • 2B • Updated May 14 • 45

amd/Kimi-K2.5-Eagle3-FP8

3B • Updated Jun 26 • 64 • 1