Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,282

Base only

Active filters: speculative-decoding

guardiangate1775/gemma-4-26B-A4B-it-assistant-8bit

Text Generation • 0.1B • Updated May 6 • 38

localweights/Qwen3.6-35B-A3B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

Text Generation • 36B • Updated 20 days ago • 1.91k • 3

dayngerous/CASM

Updated May 7 • 4

dxx117/Qwen3.5-397B-A17B-heretic-GGUF-v2-MTP

403B • Updated May 22 • 330 • 1

HackAfterDark/gemma-4-e4b-it-mtp-assistant-ultralight

0.4B • Updated May 7 • 537 • 12

Blongo1/gemma4-mtp-bench

localweights/Qwen3.6-35B-A3B-MTP-BF16-GGUF

Text Generation • 36B • Updated May 7 • 95 • 1

guru87/Qwen3.6-27B-MTP

Updated May 7 • 3

poolside/Laguna-XS.2-speculator.dflash

0.6B • Updated May 19 • 350 • 9

guru87/Qwen3.5-0.8B-MTP

guru87/Qwen3.5-2B-MTP

Updated May 7 • 1

guru87/Qwen3.5-4B-MTP

guru87/Qwen3.5-9B-MTP

SteadyVictor/Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4

Text Generation • 19B • Updated May 7 • 58

RedHatAI/Qwen3-8B-speculator.dflash

2B • Updated May 7 • 1.03k • 12

starskyzheng/Qwen3.6-35B-DFlash-GGUF

0.5B • Updated May 8 • 196 • 1

ericpandev/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-bf16

Image-Text-to-Text • 35B • Updated May 9 • 1.07k • • 5

localweights/Qwen3.6-27B-MTP-IMAT-IQ4_XS-Q8nextn-GGUF

Text Generation • 27B • Updated 20 days ago • 2.16k • 8

cafkafk/gemma-4-E2B-it-assistant-GGUF-noimatrix

78M • Updated May 8 • 402 • 2

cafkafk/gemma-4-E4B-it-assistant-GGUF-noimatrix

78.8M • Updated May 8 • 200 • 3

cafkafk/gemma-4-26B-A4B-it-assistant-GGUF-noimatrix

0.4B • Updated May 8 • 325 • 2

cafkafk/gemma-4-31B-it-assistant-GGUF-noimatrix

0.5B • Updated May 8 • 183 • 8

adasdadsd/smallq-flash-attention-ascend

z-lab/MiniMax-M2.7-DFlash

Text Generation • 0.6B • Updated Jun 25 • 110 • 26

QuixiAI/Qwen3.6-27B-DFlash

Text Generation • 2B • Updated May 9 • 87 • 3

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed-FP16

5B • Updated 30 days ago • 2.5k • 11

Lucebox/Qwen3.6-27B-DFlash-GGUF

2B • Updated May 28 • 6.23k • 14

LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8

Text Generation • 44B • Updated 28 days ago • 4.07k • 16

litcloud/Qwen3.6-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated May 10 • 236 • 1

dxx117/Qwen3.5-397B-A17B-GGUF-UD-IQ2_XXS-MTP-Q8_0

403B • Updated May 10 • 30