Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,292

Base only

Active filters: quantization

FartingBackwards/wan2.1-vace-14b-int8-convrot

Updated 7 days ago

suryatmodulus/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated 7 days ago • 58

FartingBackwards/wan2.2-fun-vace-14B-int8-convrot

Updated 7 days ago

ajh-code/Mage-Flow-Turbo-XPO3-NVFP4

Text-to-Image • Updated 2 days ago • 3.46k

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A16-LR1e-5-s2640

17B • Updated 7 days ago • 23

AtesiT/bge-m3-int8-dynamic-quantized

Feature Extraction • Updated 7 days ago • 26

ghostchoir/rebuttal_w4g128_awq_w2

Text Generation • 2B • Updated 7 days ago • 29

ghostchoir/rebuttal_w4g128_awq

Text Generation • 2B • Updated 7 days ago • 29

ghostchoir/rebuttal_w3g128_awq_w2

Text Generation • 2B • Updated 7 days ago • 29

ghostchoir/rebuttal_w3g128_awq

Text Generation • 2B • Updated 7 days ago • 33

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A4-LR1e-5-s2640

17B • Updated 7 days ago • 29

FartingBackwards/wan2.2-t2v-14B-int8-convrot

Text-to-Video • Updated 7 days ago

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A16-LR1e-5-s2640

16B • Updated 6 days ago • 32

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A16-LR1e-5-s2640-A4Schema

17B • Updated 6 days ago • 29

ghostchoir/rebuttal_w3pc_cbq

Text Generation • 2B • Updated 6 days ago • 22

ghostchoir/rebuttal_w4pc_cbq

Text Generation • 2B • Updated 6 days ago • 20

ghostchoir/rebuttal_w3g128_cbq

Text Generation • 2B • Updated 6 days ago • 15

ghostchoir/rebuttal_w4g128_cbq

Text Generation • 2B • Updated 6 days ago • 16

aidendle94/GLM-5.2-NF4-Lloyd-Experts-GPTQ

Updated 5 days ago

urakozz/Ornith-1.0-9B-MTP-int4-AutoRound

3B • Updated 6 days ago • 44

happynood/quant-control-bench-policies

Robotics • Updated 6 days ago

Spangler3000/MiniMax-M3-Mixed-4.5bit-MLX

Image-Text-to-Text • 81B • Updated 4 days ago • 267

FardoX/sasori-qwen3-14b-tq2p-q4k6

Text Generation • 15B • Updated 6 days ago • 47

armanibadboy/whisper-small-ternary

Automatic Speech Recognition • 0.2B • Updated 5 days ago • 31

weili-0234/Qwen3.5-9B-NVFP4-RTN

Text Generation • 6B • Updated 5 days ago • 15

weili-0234/Qwen3.5-9B-NVFP4-GPTQ

Text Generation • 6B • Updated 5 days ago • 40

muooon/QPOLA

Updated 3 days ago

Mwanzau/Mazgu_Llama-1B-V2-GGUF

Text Generation • 1B • Updated 4 days ago • 261

rudrakshrakeshzodage/nllb-200-distilled-600M-int8-cpu

Translation • Updated 3 days ago • 25

rudrakshrakeshzodage/nllb-200-distilled-600M-nf4-4bit-gpu

Translation • Updated 3 days ago