Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,282

Base only

Active filters: speculative-decoding

dxx117/Qwen3.5-397B-A17B-GGUF-UD-IQ2_XXS-MTP-Q8_0

403B • Updated May 10 • 30

liamkou/gemma-4-26B-A4B-it-assistant-bf16

Text Generation • 0.4B • Updated May 11 • 34

weijiezz/SpecBlock-Qwen3-8B

0.7B • Updated May 11 • 10 • 1

weijiezz/SpecBlock-Llama-3.1-8B-Instruct

0.7B • Updated May 11 • 12

weijiezz/EAGLE3-Llama-3.1-8B-Instruct

0.4B • Updated May 11 • 21

stuchapin/Carnice-V2-27B-MTP-GGUF

Text Generation • 27B • Updated May 11 • 283 • 2

eric717273/Qwen3.5-122B-A10B-MXFP4_MOE-MTP-GGUF

Text Generation • 125B • Updated May 13 • 577 • 1

webhie/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated May 12 • 1.87k • 1

Kevpadil/Qwen3.6-35B-A3B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 21B • Updated May 12 • 9

ji-farthing/gemma-4-26B-A4B-it-assistant-Q4_K_S-GGUF

0.4B • Updated May 13 • 65

shdennlin/gemma-4-26B-A4B-it-8bit

Image-Text-to-Text • 8B • Updated May 13 • 12

shdennlin/gemma-4-26B-A4B-it-assistant-8bit

Image-Text-to-Text • 0.1B • Updated May 13 • 23

bahadirakdemir/gemma-4-31B-it-assistant-fp8

Text Generation • 0.5B • Updated May 13 • 327 • 2

sleepyeldrazi/Qwen3.6-27B-MXFP4-MTP

Image-Text-to-Text • 6B • Updated May 13 • 118 • 1

ji-farthing/gemma-4-26B-A4B-it-assistant-Q6_K-GGUF

0.4B • Updated May 13 • 54 • 1

GazTrab/Qwen3.6-27B-MTP-UD-IQ3_XXS-GGUF

Text Generation • 27B • Updated May 13 • 314

GestaltLabs/Ornstein3.6-27B-MTP-NSC-ACE-SABER-GGUF

Image-Text-to-Text • 0.5B • Updated May 14 • 520 • 15

grteam/Qwen3.6-35B-A3B-GRTEAM-MTP-Q5_K_M

Text Generation • 36B • Updated May 13 • 39

StentorLabs/Stentor3-50M

Text Generation • 49.4M • Updated May 19 • 175 • 5

zan/Qwen3.6-27B-DFlash-ja

Text Generation • 2B • Updated May 14 • 16

amd/Kimi-K2.5-Eagle3-FP8

3B • Updated Jun 26 • 52 • 1

hardik-xi11/gemma-4-31B-it-DFlash

Text Generation • 2B • Updated May 14 • 10

sleepyeldrazi/Qwen3.5-4B-MXFP4-MTP

Image-Text-to-Text • 0.8B • Updated May 15 • 108 • 1

sleepyeldrazi/Qwen3.5-9B-MXFP4-MTP

Image-Text-to-Text • 2B • Updated May 15 • 162 • 1

gaston-parravicini/Qwen3.6-27B-Abliterated-MTP-GGUF

27B • Updated May 17 • 6.15k • 10

StentorLabs/Stentor3-20M

Text Generation • 20.3M • Updated May 20 • 202 • 6

Shankara-A-S/voxtral-mini-4b-asr-specdec

Automatic Speech Recognition • Updated Jun 12

connorhzp/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-NVFP4-MTP-XS

Text Generation • 17B • Updated May 15 • 23

coolthor/Huihui-gemma-4-26B-A4B-it-abliterated-eagle3-draft

0.9B • Updated Jun 2 • 23 • 2

originalGeek/Qwen3.6-27B-unsloth-MTP-Q8_0-HEAD-ONLY

0.4B • Updated May 28 • 94 • 3