Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,263

Base only

Active filters: speculative-decoding

FancieF/Qwythos-27B-v1-MLX-MTP

0.4B • Updated about 3 hours ago • 72

dynamicagency/gemma-4-31b-it-oQ8e-mtp-drafter

0.5B • Updated 3 days ago • 50

dynamicagency/gemma-4-31b-it-oQ8e-mtp

9B • Updated 2 days ago • 22

maci0/ThinkingCap-Qwen3.6-27B-abliterated-NVFP4

Image-Text-to-Text • 27B • Updated about 19 hours ago • 165

PaulRamesh/Kimi-K3-DSpark

Text Generation • 2B • Updated 2 days ago • 12

will702/Qwen3-8B-DFly-MLX

1B • Updated 2 days ago • 9

mlx-community/Qwen3-8B-DFly-MLX

1B • Updated 2 days ago • 17

tasticleeze/Qwopus3.6-27B-Fusion-NVFP4-FP8

Text Generation • 21B • Updated 2 days ago • 18

srmiles/gemma-4-E2B-it-assistant-GGUF

Text Generation • 77.2M • Updated 2 days ago • 343

srmiles/gemma-4-E4B-it-assistant-GGUF

Text Generation • 78M • Updated 2 days ago • 343

srmiles/gemma-4-12B-it-assistant-GGUF

Text Generation • 0.4B • Updated 2 days ago • 348

PocketAiHub/Qwopus3.6-27B-v2-MTPLX-BF16

Text Generation • 27B • Updated 2 days ago • 52

petr567/Qwen3.5-2B-MTP-fast-GGUF

Image-Text-to-Text • 2B • Updated 2 days ago • 102

TheWirelessPhoenix/Qwen3.5-9B-MTP-4bit

Text Generation • 38M • Updated 2 days ago • 14

anthonyya/Qwen3.6-27B-DFlash-6bit

Text Generation • 0.4B • Updated 2 days ago • 18

anthonyya/Qwen3.6-27B-DFlash-4bit

Text Generation • 0.3B • Updated 2 days ago • 30

anthonyya/Qwen3.6-27B-DFlash-8bit

Text Generation • 0.5B • Updated 2 days ago • 29

TheWirelessPhoenix/Qwen3.5-4B-MTP-4bit

Text Generation • 18.9M • Updated 1 day ago • 17

davisliu/Qwen3.6-27B-MXFP4-VL-MTP

Image-Text-to-Text • 6B • Updated 1 day ago • 17

josefprusa/Nemotron-Labs-3-Puzzle-75B-A9B-oQNVFP4-MTP

Text Generation • 15B • Updated about 11 hours ago

singulared/DeepSeek-V4-Flash-0731-DSpark-GGUF

20B • Updated about 4 hours ago

arunmadhusudh/llava-v1.6-vicuna-7b-dflash-vlm-clean-overfit

1B • Updated about 19 hours ago • 12

arunmadhusudh/llava-v1.6-vicuna-7b-dflash-text-pretrain-verify

1B • Updated about 19 hours ago • 8

Rarri/DeepSeek-V4-Flash-0731-NVFP4

Text Generation • 304B • Updated about 3 hours ago • 5

kingjones777/Frontis-MA1-35B-NVFP4

Image-Text-to-Text • 36B • Updated about 18 hours ago • 7

kingjones777/Macaron-V1-Tall-NVFP4

Text Generation • 36B • Updated about 18 hours ago • 1

pocharlies/Qwen3-Coder-30B-A3B-NVFP4-EAGLE3-DGXSpark

Text Generation • 17B • Updated about 11 hours ago

ToPo-ToPo/DeepSeek-V4-Flash-MTP-bf16

Text Generation • 1B • Updated about 10 hours ago

Joseph007fu/Ornith-1.0-35B-MTP2-MTPLX

Text Generation • Updated about 6 hours ago

SubconsciousDev/glm-5.2-fp8-dflash-v2

2B • Updated about 7 hours ago