Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,346

Base only

Active filters: quantization

weili-0234/Qwen3.5-9B-MXFP4-RTN

6B • Updated 17 days ago • 37

xv0y5ncu/SmolLM3-3B-trellis-3inst-4bpw-kernel

Text Generation • 1.0B • Updated 1 day ago • 299

weili-0234/Qwen3.5-9B-MXFP4-QAD-s1000

Text Generation • 6B • Updated 15 days ago • 109

weili-0234/Qwen3.5-9B-MXFP4-QAD-s2000

Text Generation • 6B • Updated 15 days ago • 110

weili-0234/Qwen3.5-9B-MXFP4-QAD-s3000

Text Generation • 6B • Updated 15 days ago • 107

weili-0234/Qwen3.5-9B-MXFP4-QAD-s4000

Text Generation • 6B • Updated 15 days ago • 113

weili-0234/Qwen3.5-9B-MXFP4-GPTQ

6B • Updated 17 days ago • 5

weili-0234/Qwen3.5-9B-NVFP4-QAD-s1000

Text Generation • 6B • Updated 15 days ago • 113

weili-0234/Qwen3.5-9B-NVFP4-QAD-s2000

Text Generation • 6B • Updated 15 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s3000

Text Generation • 6B • Updated 15 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s4000

Text Generation • 6B • Updated 15 days ago

yasu-oh/gemma-4-12B-it-qat-NVFP4

Image-Text-to-Text • 12B • Updated 8 days ago • 357

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated 10 days ago • 98 • 3

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s1000

Text Generation • 6B • Updated 15 days ago • 4

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s4000

Text Generation • 6B • Updated 15 days ago • 2

kachowtowmater/SuperGLM-5.2-abliterated-MXFP8-NVFP4-NF3-Hybrid

Text Generation • 347B • Updated 16 days ago • 83

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s2000

Text Generation • 6B • Updated 15 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s3000

Text Generation • 6B • Updated 15 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR1e-5-s4000

Text Generation • 6B • Updated 15 days ago • 6

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s1000

Text Generation • 6B • Updated 15 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s2000

Text Generation • 6B • Updated 15 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s3000

Text Generation • 6B • Updated 15 days ago • 2

fanwu103/MiMo-V2.5-Pro-MXFP4v2

Text Generation • 554B • Updated 16 days ago • 21

bogdan-radulescu/gemma-4-26B-A4B-it-asym-GGUF

Text Generation • 27B • Updated 16 days ago • 215

bogdan-radulescu/qwen3.6-35B-A3B-asym-GGUF

Text Generation • 35B • Updated 16 days ago • 160

guideboardlabs/Nanbeige4.2-3B-GGUF

4B • Updated 16 days ago • 869 • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated 15 days ago • 3

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s4000

Text Generation • 6B • Updated 15 days ago • 5

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000

Text Generation • 6B • Updated 15 days ago • 5

FardoX/sasori-qwen3-14b-tq3p

15B • Updated 13 days ago • 109 • 1