Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,252

Base only

Active filters: speculative-decoding

togethercomputer/Aurora-Spec-Minimax-M2.5

Text Generation • 0.9B • Updated Mar 19 • 30 • 6

StentorLabs/Stentor-30M

Text Generation • 30.4M • Updated Feb 21 • 37 • 3

mradermacher/Stentor-30M-GGUF

Text Generation • 30.4M • Updated Feb 21 • 250 • 3

mradermacher/Stentor-30M-i1-GGUF

Text Generation • 30.4M • Updated Feb 21 • 517 • 2

StentorLabs/Stentor2-12M-Preview

Text Generation • 12.3M • Updated Feb 25 • 98 • 1

z-lab/gpt-oss-120b-DFlash

Text Generation • 0.8B • Updated Apr 7 • 4.17k • 10

husj576/GTO-deepseek-8B

Text Generation • Updated Mar 4 • 9

husj576/GTO-llama33-instruct-70B

Text Generation • Updated Mar 4 • 8

husj576/GTO-vicuna-13b

Text Generation • Updated Mar 4 • 15

husj576/GTO-qwen3-8B

Text Generation • 0.4B • Updated May 25 • 8

AICP-Labs/qwen3-32b-dflash-en-zh

Text Generation • 0.5B • Updated Mar 1 • 53 • 3

osoleve/Qwen3.5-27B-Text-NVFP4-MTP

Text Generation • 17B • Updated Mar 5 • 793 • 19

surogate/Qwen3.5-27B-NVFP4

Text Generation • 17B • Updated Feb 28 • 21

festr2/GLM-5-NVFP4-MTP

435B • Updated Mar 1 • 16 • 3

z-lab/Qwen3.5-35B-A3B-DFlash

Text Generation • 0.4B • Updated Jun 19 • 8.39k • 43

Cloudriver/MSD-Qwen2.5-VL-7B-Instruct

Image-Text-to-Text • Updated Mar 2 • 25

Cloudriver/EAGLE3-Qwen2.5-VL-7B-Instruct

Image-Text-to-Text • Updated Mar 2 • 21

ping69852/Medusa-LLaVA1.5-7B

Image-Text-to-Text • Updated Mar 5 • 8

ping69852/Medusa-Qwen2.5-VL-7B-Instruct

Image-Text-to-Text • Updated Mar 5 • 6

celestialcreator/Llama-3.2-1B-MTP-k8

Text Generation • Updated Mar 5 • 37 • 3

lightseekorg/kimi-k2.5-eagle3

3B • Updated Mar 16 • 63.5k • 15

StentorLabs/Stentor2-12M

Text Generation • 12.3M • Updated Mar 8 • 22 • 2

BLR2/Qwen3.5-9B-Eagle3-ShareGPT

0.4B • Updated Mar 7 • 99 • 4

z-lab/Alpamayo-R1-10B-DFlash

Robotics • 0.5B • Updated about 1 month ago • 609 • 3

StentorLabs/Stentor2-30M

Text Generation • 30.4M • Updated Mar 21 • 30 • 2

Thr45h/MEDUSA-Llama-3.1-8B-Instruct

Text Generation • 3B • Updated Mar 17 • 10

darkmaniac7/TokForge-AccelerationPack-Draft

Text Generation • Updated 21 days ago • 416

darkmaniac7/TokForge-AccelerationPack-Qwen35-Draft

Text Generation • Updated 21 days ago • 305

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch1

2B • Updated Mar 19 • 8

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch2

2B • Updated Mar 19 • 9