Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,292

Base only

Active filters: quantization

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 6B • Updated 10 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s2000

Text Generation • 6B • Updated 10 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s3000

Text Generation • 6B • Updated 10 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s3000

Text Generation • 6B • Updated 10 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-LR8e-6-s4000-BF16

Text Generation • 9B • Updated 10 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000-weight-only

Text Generation • 6B • Updated 10 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-W4A4-LR1e-5-s4000-BF16

Text Generation • 9B • Updated 10 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s4000-weight-only

Text Generation • 6B • Updated 10 days ago • 2

weili-0234/Qwen3.5-9B-MXFP4-QAD-W4A4-LR1e-5-s4000-BF16

Text Generation • 9B • Updated 10 days ago

weili-0234/Qwen3.5-9B-MXFP4-QAD-s4000-BF16

Text Generation • 9B • Updated 10 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-s4000-BF16

Text Generation • 9B • Updated 9 days ago

weili-0234/Qwen3.5-9B-NVFP4-QAD-LR1e-5-s4000-BF16

Text Generation • 9B • Updated 9 days ago

weili-0234/Qwen3.5-27B-MXFP4-RTN

Text Generation • 16B • Updated 9 days ago • 6

weili-0234/Qwen3.5-27B-NVFP4-RTN

Text Generation • 17B • Updated 9 days ago • 8

weili-0234/Qwen3.5-27B-NVFP4-RTN-weight-only

Text Generation • 17B • Updated 9 days ago

sarayar/DeepSeek-R1-Distill-Llama-8B-GGUF-Q2_K

8B • Updated 9 days ago • 147

sarayar/Qwen2.5-Coder-7B-Instruct-GGUF-Q3_K_M

8B • Updated 9 days ago • 711

brewbadgertim/Qwen_Image_2512_Quants

Updated 9 days ago

QuantNAS/QuantNAS

Updated 9 days ago

urakozz/Ornith-1.0-35B-int4-AutoRound

Text Generation • 3B • Updated 7 days ago • 86

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s1000

Text Generation • 16B • Updated 8 days ago • 33

mncai/nf4moe

Updated 8 days ago

weili-0234/Qwen3.5-27B-MXFP4-GPTQ

Text Generation • 16B • Updated 8 days ago • 35

weili-0234/Qwen3.5-27B-NVFP4-GPTQ

Text Generation • 17B • Updated 8 days ago • 33

Thox-ai/ThoxSpeech-ASR-BitNet

Automatic Speech Recognition • 2B • Updated 8 days ago • 28

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A4-LR1e-5-s2640

Text Generation • 16B • Updated 8 days ago • 28

koryl/bge-m3-quantized-int8

Feature Extraction • Updated 8 days ago • 36

felipesztutman/krea-realtime-video-14b-w4a4

Text-to-Video • Updated 7 days ago

ajh-code/Mage-Flow-Turbo-NVFP4-Balanced-AJH

Text-to-Image • 3B • Updated 7 days ago • 63

tooltd/Qwen3.6-27B-Architect-Polaris2-Fable-B-F451-Tess-GGUF

27B • Updated 1 day ago • 89