Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,105

Base only

Active filters: speculative-decoding

TheWirelessPhoenix/Qwen3.5-9B-MTP-4bit

Text Generation • 0.2B • Updated Aug 2 • 32

anthonyya/Qwen3.6-27B-DFlash-6bit

Text Generation • 2B • Updated Aug 2 • 53

anthonyya/Qwen3.6-27B-DFlash-4bit

Text Generation • 2B • Updated Aug 2 • 121

anthonyya/Qwen3.6-27B-DFlash-8bit

Text Generation • 2B • Updated Aug 2 • 108

TheWirelessPhoenix/Qwen3.5-4B-MTP-4bit

Text Generation • 0.1B • Updated Aug 2 • 16

maci0/Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic-NM-DAU-MTP-NVFP4

Image-Text-to-Text • 27B • Updated Aug 4 • 217 • 7

davisliu/Qwen3.6-27B-MXFP4-VL-MTP

Image-Text-to-Text • 28B • Updated Aug 2 • 74 • 1

josefprusa/Nemotron-Labs-3-Puzzle-75B-A9B-oQNVFP4-MTP

Text Generation • 75B • Updated Aug 3 • 120 • 2

gbuzhf/KAT-Coder-V2.5-Dev-MTP-GGUF

36B • Updated 23 days ago • 21.2k • 15

MRockatansky/NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-MTP-GGUF

Text Generation • 78B • Updated Aug 3 • 629 • 3

singulared/DeepSeek-V4-Flash-0731-DSpark-GGUF

20B • Updated Aug 8 • 414

arunmadhusudh/llava-v1.6-vicuna-7b-dflash-vlm-clean-overfit

1B • Updated Aug 3 • 6

arunmadhusudh/llava-v1.6-vicuna-7b-dflash-text-pretrain-verify

1B • Updated Aug 3 • 7

Rarri/DeepSeek-V4-Flash-0731-NVFP4

Text Generation • 304B • Updated Aug 3 • 328 • 6

kingjones777/Frontis-MA1-35B-NVFP4

Image-Text-to-Text • 36B • Updated Aug 11 • 75

kingjones777/Macaron-V1-Tall-NVFP4

Text Generation • 36B • Updated Aug 11 • 65 • 1

pocharlies/Qwen3-Coder-30B-A3B-NVFP4-EAGLE3-DGXSpark

Text Generation • 17B • Updated Aug 3 • 58

ToPo-ToPo/DeepSeek-V4-Flash-MTP-bf16

Text Generation • 7B • Updated Aug 3 • 164

Joseph007fu/Ornith-1.0-35B-MTP2-MTPLX

Text Generation • Updated Aug 3 • 1

nerkyor/Qwen3.6-27B-Uncensored-Heretic-DSV4Pro-GLM52-SFT-GPT55-RL-Coding-VL-MTP-GGUF

Image-Text-to-Text • 27B • Updated Aug 5 • 2.6k • 11

SubconsciousDev/glm-5.2-fp8-dflash-v2

2B • Updated Aug 3 • 78

biosai-hf/kimi-k2.5-eagle3-mla

Text Generation • 3B • Updated Aug 3 • 20

biosai-hf/kimi-k2.5-eagle3

3B • Updated Aug 3 • 27

jason-schulz/KAT-Coder-V2.5-Dev-VL-oQ8e-mtp

Image-Text-to-Text • 36B • Updated Aug 4 • 174 • 2

kodelow/Kimi-K3-DSpark-FP8

Text Generation • 4B • Updated Aug 4 • 49

Myric/KAT-Coder-V2.5-Dev-MTP-APEX-GGUF

Text Generation • 35B • Updated Aug 21 • 10k • 12

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed-V2

Text Generation • 27B • Updated 18 days ago • 1.31k • 13

shreybirmiwal/Qwen3-4B-DSpark-b16

1B • Updated Aug 3 • 97 • 1

kodelow/Kimi-K3-DSpark-NVFP4

Text Generation • 4B • Updated Aug 3 • 51

YTan2000/DeepSeek-V4-Flash-0731-TQ3_4S

Text Generation • 284B • Updated Aug 6 • 99 • 2