Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,108

Base only

Active filters: speculative-decoding

darkmaniac7/Qwen3-0.6B-lk-alpha-40k-MNN

Text Generation • Updated about 4 hours ago • 10

darkmaniac7/Qwen3-0.6B-lk-alpha-14b-paired-MNN

Text Generation • Updated about 4 hours ago • 10

darkmaniac7/Qwen3.5-0.8B-lk-alpha-ep4-MNN

Text Generation • Updated about 4 hours ago • 14

inference-optimization/Qwen3-Next-80B-A3B-Instruct-GSM8K-MTP-finetuned

81B • Updated Mar 25 • 15

thoughtworks/Qwen2.5-7B-Instruct-Eagle3

Text Generation • 0.4B • Updated Mar 28 • 2.32k • 1

thoughtworks/Llama-3.2-3B-Instruct-Eagle3

Text Generation • 0.2B • Updated Mar 28 • 50 • 1

thoughtworks/DeepSeek-R1-Distill-Qwen-7B-Eagle3

Text Generation • 0.4B • Updated Mar 28 • 90

thoughtworks/DeepSeek-R1-Distill-Qwen-14B-Eagle3

Text Generation • 0.6B • Updated Mar 28 • 43

thoughtworks/Llama-3.1-8B-Instruct-Eagle3

Text Generation • 0.4B • Updated Mar 28 • 68

thoughtworks/Qwen2.5-14B-Instruct-Eagle3

Text Generation • 0.6B • Updated Mar 28 • 31

thoughtworks/Qwen3-8B-Eagle3

Text Generation • 0.4B • Updated Mar 28 • 286 • 2

thoughtworks/Qwen3-14B-Eagle3

Text Generation • 0.6B • Updated Mar 28 • 44 • 1

thoughtworks/Qwen3-32B-Eagle3

Text Generation • 0.8B • Updated Mar 28 • 56

Kevletesteur/chimere-dflash-data

Kevletesteur/Qwen3.5-35B-A3B-IQ3_S-MTP

Text Generation • 37B • Updated Mar 29 • 23

z-lab/Alpamayo-1.5-10B-DFlash

Robotics • 0.5B • Updated Jul 4 • 4.24k • 5

ArcticHuaji/specdecpp-acc-heads

Text Generation • Updated Apr 3

datasysdev/clsd

raspbfox/tp906-mtp

z-lab/Kimi-K2.5-DFlash

Text Generation • 3B • Updated Apr 18 • 424 • 33

lightseekorg/kimi-k2.5-eagle3-mla

Text Generation • 3B • Updated Jun 10 • 694 • 1

mradermacher/Harmonic-2B-GGUF

2B • Updated Apr 6 • 327

mradermacher/Harmonic-2B-i1-GGUF

2B • Updated May 24 • 1.36k

TitanPythons/Qwen3.5-VL-2B-8bit-MLX-CRACK

Image-Text-to-Text • 2B • Updated Mar 7 • 48

thoughtworks/Gemma-4-31B-Eagle3

Text Generation • 0.6B • Updated Apr 7 • 164 • 6

rdtand/Qwen3.5-122B-A10B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 72B • Updated Apr 21 • 182 • 19

chankhavu/Nemotron-Cascade2-30B-A3B-Eagle3-Long-Context

Text Generation • 0.2B • Updated Apr 22 • 76 • 4

AEON-7/Gemma-4-26B-A4B-it-Uncensored-NVFP4

Text Generation • 15B • Updated Jul 15 • 42.4k • 25

StentorLabs/Portimbria-150M

Text Generation • 0.2B • Updated Apr 24 • 137 • 11

chankhavu/c2.eagle3-test-v2

Text Generation • 0.2B • Updated Apr 9 • 14