Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,130

Base only

Active filters: speculative-decoding

williamliao/gemma-4-26B-A4B-it-DFlash-GGUF

Text Generation • 0.4B • Updated Jul 13 • 653 • 1

williamliao/gemma-4-12B-it-DFlash-GGUF

Text Generation • 0.7B • Updated Jul 13 • 1.01k • 3

williamliao/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated Jul 13 • 149 • 19

williamliao/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 36B • Updated Jul 13 • 670 • 7

LordNeel/Agents-A1-GGUF

Text Generation • 35B • Updated Jul 18 • 801 • 17

a4lg/Qwen3.5-9B-MTP-ONLY-GGUF

2B • Updated Aug 15 • 1.13k • 3

onion515/ornith-9b-dflash

Text Generation • 1B • Updated Jun 30 • 97 • 1

neko-legends/Qwen3.6-35B-A3B-NVFP4-MTP-GGUF

Text Generation • 36B • Updated Jul 19 • 324 • 4

utautako/Qwen3.6-27B-NVIDIA-NVFP4-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Jul 15 • 179 • 11

onion515/Qwen3.5-9B-DFlash-GGUF

Text Generation • 1B • Updated Jul 1 • 1.03k

a4lg/Step-3.7-Flash-MTP-ONLY-GGUF

3B • Updated Aug 17 • 196 • 1

nwzjk/MiniMax-M3-EAGLE3-Duplicated

Text Generation • 3B • Updated Jul 1 • 19

EntityDeletr/Qwen3.5-9B-DFlash-GGUF

1B • Updated Jul 1 • 219 • 1

EntityDeletr/gpt-oss-20b-DFlash-GGUF

0.8B • Updated Jul 1 • 2.16k • 3

williamliao/Gemma-4-26B-A4B-NVFP4-GGUF

Text Generation • 25B • Updated Jul 13 • 107

bannert/tmax-27b-AWQ-BF16-INT4

Text Generation • 29B • Updated Jul 1 • 20

williamliao/Gemma-4-31B-NVFP4-GGUF

Image-Text-to-Text • 32B • Updated Jul 1 • 64

huihui-ai/Huihui-Ornith-1.0-9B-abliterated-MTP-GGUF

Text Generation • 2B • Updated Jul 5 • 16.1k • 29

programmer-666/Ornith-1.0-35B-MLX-oQ7

Text Generation • Updated Jul 12 • 77 • 3

s-batman/Agents-A1-NVFP4-MTP-GGUF

Image-Text-to-Text • 36B • Updated Jul 1 • 554 • 15

Jim-and-HF/Qwen3.6-27B-MXFP4-MTP

Image-Text-to-Text • 28B • Updated Jul 1 • 13 • 1

RedHatAI/Qwen3.5-397B-A17B-speculator.dflash

2B • Updated Jul 22 • 109 • 3

fraserprice/Ornith-1.0-397B-W4A16-AutoRound-DFlash

Text Generation • Updated Jul 2 • 44

fal/Qwen3.6-35B-A3B-Magic-Prompt-FP8-DSpark

1B • Updated Jul 8 • 97 • 5

Rishu11277/Qwopus3.5-4B-Coder-mlx-4Bit

Text Generation • 4B • Updated Jul 1 • 27

drowzeys/DeepSeek-V4-Flash-DSpark-NVFP4-KV-1.5M-CTX-2xDGX-Spark

Text Generation • Updated Jul 1 • 1

tashfene/Ornith-1.0-35B-MTP-Q4_K_M-GGUF

Text Generation • 36B • Updated Jul 2 • 77 • 3

xuan-luo/DMTD-Qwen3-4B

Text Generation • 4B • Updated Jul 7 • 15

xunkutech-ai/Qwythos-9B-Claude-Mythos-5-1M-MLX-bf16-mtp-draft

Text Generation • 0.2B • Updated Jul 2 • 35

jcbtc/qwable-27b-chadrock-rocmfpx-ultraquality-7p61bpw

Text Generation • Updated Jul 2