Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,277

Base only

Active filters: speculative-decoding

a4lg/Qwen3.6-35B-A3B-MTP-ONLY-GGUF

2B • Updated Jun 30 • 1.58k

a4lg/Qwen3.6-27B-MTP-ONLY-GGUF

3B • Updated Jun 30 • 410 • 2

a4lg/Qwen3.5-397B-A17B-MTP-ONLY-GGUF

9B • Updated Jun 30 • 239

a4lg/Qwen3.5-122B-A10B-MTP-ONLY-GGUF

4B • Updated Jun 30 • 640 • 3

ankk98/dspark-qwen3-8b-block7-Q4_K_M-GGUF

2B • Updated Jun 30 • 1.48k • 3

williamliao/gemma-4-31B-it-DFlash-GGUF

Text Generation • 2B • Updated Jun 30 • 835 • 1

williamliao/gemma-4-26B-A4B-it-DFlash-GGUF

Text Generation • 0.4B • Updated 23 days ago • 1.34k

williamliao/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated 23 days ago • 5.49k • 16

williamliao/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 36B • Updated 23 days ago • 756 • 3

a4lg/Qwen3.5-9B-MTP-ONLY-GGUF

2B • Updated Jun 30 • 297

onion515/ornith-9b-dflash

Text Generation • 1B • Updated Jun 30 • 646 • 1

neko-legends/Qwen3.6-35B-A3B-NVFP4-MTP-GGUF

Text Generation • 36B • Updated 16 days ago • 14.9k • 4

utautako/Qwen3.6-27B-NVIDIA-NVFP4-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated 20 days ago • 9.1k • 11

onion515/Qwen3.5-9B-DFlash-GGUF

Text Generation • 1B • Updated Jul 1 • 881

a4lg/Step-3.7-Flash-MTP-ONLY-GGUF

3B • Updated Jul 1 • 1.18k

nwzjk/MiniMax-M3-EAGLE3-Duplicated

Text Generation • 3B • Updated Jul 1 • 19

EntityDeletr/Qwen3.5-9B-DFlash-GGUF

1B • Updated Jul 1 • 173

EntityDeletr/gpt-oss-20b-DFlash-GGUF

0.8B • Updated Jul 1 • 720 • 1

williamliao/Gemma-4-26B-A4B-NVFP4-GGUF

Text Generation • 25B • Updated 23 days ago • 689

bannert/tmax-27b-AWQ-BF16-INT4

Text Generation • 29B • Updated Jul 1 • 408

williamliao/Gemma-4-31B-NVFP4-GGUF

Image-Text-to-Text • 32B • Updated Jul 1 • 3.47k

programmer-666/Ornith-1.0-35B-MLX-oQ7

Text Generation • 35B • Updated 23 days ago • 1.15k • 3

s-batman/Agents-A1-NVFP4-MTP-GGUF

Image-Text-to-Text • 36B • Updated Jul 1 • 10.5k • 15

pablogrant/ORNITH-1.0_35B_AEON_PABLOG-OPTIMIZED_UNCENSORED_DSPARK-DRAFT_NVFP4

Text Generation • 0.8B • Updated Jul 1 • 283 • 4

Jim-and-HF/Qwen3.6-27B-MXFP4-MTP

Image-Text-to-Text • 6B • Updated Jul 1 • 226 • 1

RedHatAI/Qwen3.5-397B-A17B-speculator.dflash

2B • Updated 13 days ago • 296 • 3

pablogrant/ORNITH-1.0_35B_AEON_PABLOG-OPTIMIZED_UNCENSORED_BF16

Text Generation • 35B • Updated Jul 1 • 340 • 1

pablogrant/ORNITH-1.0_35B_AEON_PABLOG-OPTIMIZED_UNCENSORED_NVFP4

Text Generation • 21B • Updated Jul 1 • 658

fraserprice/Ornith-1.0-397B-W4A16-AutoRound-DFlash

Text Generation • Updated Jul 2 • 1.04k

RedTeamLab/Qwen3.6-27B-redteam-v5

27B • Updated Jul 3 • 975 • 4