Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,116

Base only

Active filters: speculative-decoding

sapidlabs/Sparkulator-GLM-5.2

Text Generation • 4B • Updated Jul 20 • 30 • 4

scatyf3/speccompact-draft-sft-ep2-qwen3-14b-distill

Text Generation • Updated Jul 21 • 12

remichu/GLM-5.2-MTP-exl3-4.0bpw

4B • Updated Jul 21 • 15

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated Jul 28 • 28 • 3

thoddnn/Qwopus3.5-4B-Coder-MLX-4bit

Text Generation • 5B • Updated Jul 21 • 82 • 1

RedHatAI/gemma-4-31B-it-speculator.dspark

4B • Updated Jul 21 • 509 • 5

SinclairSchneider/DeepSeek-V4-Flash-W4A16-FP8-MTP-Ada

Text Generation • 51B • Updated Jul 23 • 41 • 1

shujunyi/Qwen3.5-4B-DFlash-Q4_0-GGUF

0.6B • Updated Jul 21 • 139

RedHatAI/Mistral-Small-4-119B-2603-speculator.dspark

2B • Updated Aug 7 • 85

coolthor/Laguna-S-2.1-attnQ8-DFlash-Q4-GGUF

Text Generation • 118B • Updated Jul 22 • 189 • 4

sapidlabs/Sparkulator-Laguna-S-2.1

Text Generation • 1B • Updated Jul 27 • 21

wang-yang/Qwen3.6-27B-Q4-MTPLX

Text Generation • 27B • Updated Jul 24 • 97 • 1

IamBerbec/MiniMax-M2.5-Eagle3

Text Generation • 0.2B • Updated Jul 22 • 23

nvidia/DeepSeek-V4-Flash-nvfp4-DSpark

Text Generation • 304B • Updated 24 days ago • 2.88k • 30

nvidia/DeepSeek-V4-Pro-nvfp4-DSpark

Text Generation • 1.7T • Updated 24 days ago • 1.28k • 3

olka-amd/dspark-gemma-4-31b-it

4B • Updated Aug 3 • 46 • 1

vinpix/Ternary-Bonsai-27B-Stock-MTP-GGUF

Text Generation • 29B • Updated Jul 27 • 1.17k • 9

multimodalart/laguna-s-2.1-DFlash

1B • Updated Jul 24 • 83 • 3

RadixArk/Inkling-DSpark-Preview

Text Generation • 2B • Updated Jul 22 • 241 • 3

rdtand/Qwen3.6-27B-prismaquant-gridbook-5.5bit-vllm

Image-Text-to-Text • 20B • Updated Jul 28 • 99 • 6

satgeze/Qwen3.5-0.8B-DSpark

0.7B • Updated Jul 31 • 836 • 2

tngtech/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated Jul 27 • 138 • 3

Myric/Laguna-S-2.1-APEX-GGUF

Text Generation • 118B • Updated Aug 26 • 183k • 24

suryatmodulus/Qwen3.5-397B-A17B-speculator.dflash

2B • Updated Jul 22 • 23

SEBK4C/Ornith-1.0-35B-MTP-GGUF

Text Generation • 36B • Updated Jul 23 • 235

singulared/Ornith-1.0-35B-MTP-ROCmFP4-GGUF

Text Generation • 36B • Updated Jul 23 • 35

morphllm/dspark-glm52-draft

4B • Updated Jul 23 • 44

ckoh04/deepseek-v3-pruned-8experts-mtp

Text Generation • 40B • Updated Jul 23 • 31

giocom/Qwen3.6-35B-A3B-MTP-GGUF

Text Generation • 2B • Updated Aug 5 • 97

giocom/Qwen3.6-27B-MTP-GGUF

Text Generation • 3B • Updated Jul 23 • 108