Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

autoquant-agent

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

31

Base only

Active filters: autoquant-agent

INCModel3/Qwen3.5-9B-MXFP8-CT-AutoRound

Text Generation • 10B • Updated Aug 21 • 414

INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-AutoRound

Text Generation • 36B • Updated Aug 21 • 37

LeaderboardModel1/gpt-oss-20b-AutoRound-MXFP8

Text Generation • 21B • Updated Aug 24 • 160

INCModel3/gemma-4-31B-MXFP8-CT-AutoRound

Text Generation • 31B • Updated Aug 21 • 28

LeaderboardModel1/gemma-4-26B-AutoRound-MXFP8

Text Generation • 26B • Updated Aug 23 • 15

LeaderboardModel1/gemma-4-26B-A4B-AutoRound-MXFP8

Text Generation • 26B • Updated Aug 24 • 41

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16

Text Generation • 6B • Updated Aug 25 • 248 • 1

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-tuning

Text Generation • 6B • Updated Aug 25 • 190 • 1

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-v2

Text Generation • 6B • Updated Aug 26 • 249 • 2

lvkaokao/Qwen3-30B-A3B-Instruct-2507-mixed-MXFP8-mxfp4experts

Text Generation • 31B • Updated 29 days ago • 33

lvkaokao/Qwen3-30B-A3B-Instruct-2507-fp8kv-MXFP8

Text Generation • 17B • Updated 29 days ago • 44

lvkaokao/Qwen3-30B-A3B-Instruct-2507-fp8kv-fp8attn-MXFP8

Text Generation • 17B • Updated 29 days ago • 47

lvkaokao/Qwen3-235B-A22B-MXFP4-Mixed-CT-RTN-AutoRound

Text Generation • 235B • Updated 29 days ago • 143

INCModel3/Z-Image-Turbo-MXFP8-RTN-AutoRound

Text-to-Image • Updated 28 days ago • 23

INCModel3/Z-Image-Turbo-MXFP4-RTN-AutoRound

Text-to-Image • Updated 28 days ago • 17

INCModel3/FLUX.2-dev-MXFP4-RTN-AutoRound

Text-to-Image • Updated 27 days ago • 27

INCModel3/FLUX.2-klein-4B-MXFP8-RTN-AutoRound

Text-to-Image • Updated 26 days ago • 23

INCModel3/FLUX.2-klein-4B-MXFP4-RTN-AutoRound

Text-to-Image • Updated 26 days ago • 22

INCModel3/FLUX.2-klein-9B-MXFP8-RTN-AutoRound

Text-to-Image • Updated 26 days ago • 26

INCModel3/FLUX.2-klein-9B-MXFP4-RTN-AutoRound

Text-to-Image • Updated 26 days ago • 24 • 1

INCModel3/Qwen3.5-9B-MXFP4-CT-AutoRound

Text Generation • 10B • Updated 25 days ago • 261

INCModel3/Qwen3.5-9B-MXFP4-FP8KV-CT-AutoRound

Text Generation • 5B • Updated 25 days ago • 55

INCModel3/Qwen3.5-9B-MXFP4-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 5B • Updated 25 days ago • 45

INCModel3/Qwen3.5-9B-MXFP8-CT-RTN-AutoRound

Text Generation • 10B • Updated 25 days ago • 41

INCModel3/Qwen3.5-9B-MXFP8-FP8KV-CT-AutoRound

Text Generation • 2B • Updated 25 days ago • 202

INCModel3/Qwen3.5-9B-MXFP8-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 2B • Updated 25 days ago • 30.7k

INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-RTN-AutoRound

Text Generation • 36B • Updated 23 days ago • 110 • 3

INCModel3/Qwen3.5-35B-A3B-MXFP8-FP8KV-CT-AutoRound

Text Generation • 1B • Updated 23 days ago • 30 • 2

INCModel3/Qwen3.5-35B-A3B-MXFP8-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 1B • Updated 23 days ago • 652

INCModel3/Qwen3.8-Flash-Next-MXFP4-Mixed-CT-RTN-AutoRound

Text Generation • Updated 15 days ago • 363