Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,285

Base only

Active filters: quantization

nota-ai/Solar-Open2-250B-Nota-NVFP4

Text Generation • 145B • Updated Aug 7 • 2.26k • 178

nota-ai/Solar-Open2-250B-Nota-INT4

Text Generation • 41B • Updated Jul 23 • 1.68k • 40

nota-ai/Solar-Open2-250B-Nota-NVFP4-GlobalPruned

Text Generation • 117B • Updated Aug 7 • 108 • 34

nota-ai/Solar-Open2-250B-Nota-INT4-GlobalPruned

Text Generation • 35B • Updated Jul 31 • 154 • 43

Bruce001/gemma4-12b-ashq1-4850

Text Generation • 12B • Updated Jul 21 • 53 • 2

weili-0234/Qwen3.5-9B-MXFP4-RTN

6B • Updated Jul 21

xv0y5ncu/SmolLM3-3B-trellis-3inst-4bpw-kernel

Text Generation • 1.0B • Updated Aug 5 • 3.52k

weili-0234/Qwen3.5-9B-MXFP4-QAD-s1000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-s2000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-s3000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-s4000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-GPTQ

6B • Updated Jul 21

weili-0234/Qwen3.5-9B-NVFP4-QAD-s1000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-NVFP4-QAD-s2000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-NVFP4-QAD-s3000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-NVFP4-QAD-s4000

Text Generation • 6B • Updated Jul 22

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated Jul 28 • 28 • 3

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s1000

Text Generation • 6B • Updated Jul 22

owao/Nanbeige4.2-3B-GGUF

Text Generation • 4B • Updated 26 days ago • 53.4k • 59

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s4000

Text Generation • 6B • Updated Jul 22

kachowtowmater/SuperGLM-5.2-abliterated-MXFP8-NVFP4-NF3-Hybrid

Text Generation • 347B • Updated Jul 21 • 38

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s2000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s3000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s4000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s1000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s2000

Text Generation • 6B • Updated Jul 22

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s3000

Text Generation • 6B • Updated Jul 22

EschaLabs/Qwen3.6-35B-A3B-Escha-W2

Text Generation • 7B • Updated Aug 9 • 2.36k • 257

fanwu103/MiMo-V2.5-Pro-MXFP4v2

Text Generation • 554B • Updated Jul 22 • 27

EschaLabs/escha-runtime-qwen3moe

Updated 12 days ago • 12