Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,275

Base only

Active filters: speculative-decoding

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill-FP8

Text Generation • 28B • Updated Jun 28 • 332 • 5

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-8bit

Image-Text-to-Text • 8B • Updated Jun 28 • 1.59k • 5

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-MLX-FP4

Image-Text-to-Text • 6B • Updated Jun 28 • 1.59k • 2

AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-MLX-MTP-Drafter

0.4B • Updated Jun 28 • 2.85k • 2

tooltd/Qwen3.6-27B-MTP-TENSORS-ONLY-GGUF

0.4B • Updated Jun 27 • 97 • 1

christopher-kapic/AEON-Ultimate-ROCmFP4-Strix-Halo-GGUF

27B • Updated Jun 26 • 435 • 2

CosmicRaisins/GLM-5.2-MTP-INT4

11B • Updated Jun 23 • 67 • 1

EntityDeletr/North-Mini-Code-1.0-EAGLE3-GGUF

0.2B • Updated Jun 24 • 86

EntityDeletr/Qwen3.6-35B-A3B-Caption-Eagle3DraftModel-GGUF

0.7B • Updated Jun 24 • 208

EntityDeletr/EAGLE3-gpt-oss-20b-GGUF

Text Generation • 0.4B • Updated Jun 24 • 155

markmonger/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-iMatrix-MTP-GGUF

Text Generation • 39B • Updated Jun 25 • 1.74k

Mediform/gemma4-e4b-v13-assistant-rollout-gguf

78M • Updated Jun 24 • 34

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill-FP8

Text Generation • 37B • Updated Jun 28 • 122 • 1

ji-farthing/Qwen3.5-35B-A3B-DFlash-SWA-ik-llama-GGUF

0.4B • Updated Jun 24 • 91

ji-farthing/gemma-4-26B-A4B-it-DFlash-SWA-ik-llama-GGUF

0.4B • Updated Jun 24 • 71

inference-optimization/dflash-DeepSeek-V4-Flash-all-swa-muon-speculators-50k

2B • Updated Jun 27 • 44 • 2

jcbtc/Chadrockv2-Qwen3.6-27B-ROCmFP6-STRIX-QUALITY

Text Generation • 27B • Updated Jun 24 • 240 • 5

jglowa/Bielik-11B-v3.0-DFlash-GGUF

Text Generation • 1B • Updated Jul 3 • 190

pyloxsystems/hochelaga-8b

Text Generation • 8B • Updated Jun 24 • 65 • 1

groxaxo/Qwen3.6-35B-A3B-Heretic-REAP-0.30-GPTQ-Pro-vLLM

Text Generation • 26B • Updated Jun 25 • 210 • 1

mradermacher/hochelaga-8b-GGUF

8B • Updated Jun 25 • 229 • 1

mradermacher/hochelaga-8b-i1-GGUF

8B • Updated Jun 25 • 1.01k • 1

inferencerlabs/GLM-5.2-MTP-MLX-Q4

Image-Text-to-Text • 2B • Updated Jun 25 • 4.46k • 7

Zhangdanyang/Kimi_K25_eagle3_v2_phase1_Lumen

3B • Updated Jun 25 • 13

jcbtc/Qwable-5-27B-Chadrock-v2-ROCmFP6-QUALITY

Text Generation • 27B • Updated Jun 25 • 143 • 1

keXjos/Qwen3.6-27B-DSV4Pro-Thinking-Distill-mlx-4Bit

Text Generation • 27B • Updated Jun 25 • 435 • 2

sant1an/GLM-5.2-NVFP4-MTP

Text Generation • Updated Jun 25 • 68 • 2

gangel/Bielik-11B-v3.0-DFlash-MLX-8bit

Text Generation • 0.4B • Updated Jun 25 • 197

mattbucci/Devstral-Small-2-24B-AWQ-EAGLE3

0.8B • Updated Jun 26 • 12

noctuashap/Confucius3-Math-DFlash

Feature Extraction • 2B • Updated Jun 26 • 17