Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,285

Base only

Active filters: quantization

ghostchoir/rebuttal_w3g128_awq

Text Generation • 2B • Updated Jul 25 • 13

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A4-LR1e-5-s2640

17B • Updated Jul 25 • 14

FartingBackwards/wan2.2-t2v-14B-int8-convrot

Text-to-Video • Updated Jul 25

weili-0234/Qwen3.5-27B-MXFP4-QAD-W4A16-LR1e-5-s2640

16B • Updated Jul 26 • 22

weili-0234/Qwen3.5-27B-NVFP4-QAD-W4A16-LR1e-5-s2640-A4Schema

17B • Updated Jul 26 • 20

SC117/Laguna-S-2.1-Uncensored-APEX-GGUF

Text Generation • 118B • Updated Aug 3 • 3.62k • 22

ghostchoir/rebuttal_w3pc_cbq

Text Generation • 2B • Updated Jul 26 • 5

ghostchoir/rebuttal_w4pc_cbq

Text Generation • 2B • Updated Jul 26 • 10

ghostchoir/rebuttal_w3g128_cbq

Text Generation • 2B • Updated Jul 26 • 7

ghostchoir/rebuttal_w4g128_cbq

Text Generation • 2B • Updated Jul 26 • 9

aidendle94/GLM-5.2-NF4-Lloyd-Experts-GPTQ

Updated Jul 27 • 1

FermionResearch/Neutrino-0.6B

Text Generation • 0.6B • Updated 1 day ago • 373 • 11

happynood/quant-control-bench-policies

Robotics • Updated Jul 26

Spangler3000/MiniMax-M3-Mixed-4.5bit-MLX

Image-Text-to-Text • 427B • Updated Jul 27 • 121

FardoX/sasori-qwen3-14b-tq2p-q4k6

Text Generation • 15B • Updated Jul 26 • 11

kingjones777/Leanstral-1.5-119B-A6B-ROCmFP4-STRIX_LEAN-GGUF

Text Generation • 119B • Updated Aug 11 • 60 • 2

armanibadboy/whisper-small-ternary

Automatic Speech Recognition • 0.2B • Updated Jul 27 • 9

weili-0234/Qwen3.5-9B-NVFP4-RTN

Text Generation • 6B • Updated Jul 27 • 24

weili-0234/Qwen3.5-9B-NVFP4-GPTQ

Text Generation • 6B • Updated Jul 27 • 303

muooon/QPOLA

Updated 22 days ago

raws-labs/tinycast

Time Series Forecasting • 147k • Updated Aug 31 • 68 • 6

rudrakshrakeshzodage/nllb-200-distilled-600M-int8-cpu

Translation • Updated Aug 6 • 12

rudrakshrakeshzodage/nllb-200-distilled-600M-nf4-4bit-gpu

Translation • Updated Aug 30

HattoriHanzo1/Qijang

4B • Updated Jul 29 • 488

LeadingPoint/R3-embedding-0.6b-GGUF

0.6B • Updated Jul 28 • 26 • 1

LeadingPoint/R3-rerank-0.6b-GGUF

0.6B • Updated Aug 2 • 65 • 1

r0b0tlab/XYZ-Aquila-mini-NVFP4

Text Generation • 19B • Updated Jul 29 • 66

labeebaryan/Qwen3.5-0.8B-Base-CliffQuant-W4A16-G128

Image-Text-to-Text • 0.9B • Updated Jul 28 • 12

HattoriHanzo1/Qijang-i1

4B • Updated Jul 29 • 949

TiGa-RCE/Qwen3-Embedding-0.6B-MLX-Q4

Feature Extraction • 0.6B • Updated Jul 28 • 25