Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,314

Base only

Active filters: quantization

oshkorinova/MamayLM-Gemma-3-12B-IT-v1.0-FP8-Dynamic

Text Generation • 12B • Updated Feb 25 • 19

EricRollei/HunyuanImage-3-INT8-v2

Text-to-Image • 83B • Updated Feb 21 • 30 • 1

EricRollei/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Feb 21 • 123 • 3

EricRollei/HunyuanImage-3.0-Instruct-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 106 • 3

EricRollei/HunyuanImage-3.0-Instruct-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 191 • 7

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated Feb 22 • 347 • 15

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 127 • 8

Tushe/nllb-200-600M-ct2-float16

Translation • Updated Feb 22 • 27 • 1

Tushe/nllb-200-600M-ct2-int8

Translation • Updated Feb 22 • 145

Jakubrd4/Bielik-11B-v2.3-Instruct-QuIP-2bit

Text Generation • 0.6B • Updated Feb 22 • 5

Tushe/nllb-200-600M-nf4-custom-weights-bare-metal

Translation • 0.4B • Updated Feb 24 • 8

MO7YW4NG/ms-marco-MiniLM-L-6-v2-4bit-nf4

Text Ranking • 23.1M • Updated Feb 24 • 16

groxaxo/qwen3-embed-8b-gptq

Feature Extraction • 8B • Updated Aug 22 • 98 • 2

luigicfilho/intento-v1-edge

504k • Updated Feb 23 • 1

ApacheOne/ZImageTurbo-nvfp4_mixed

Updated Apr 8 • 24 • 1

ApacheOne/Qwen2.5-VL-7B-Instruct-abliterated-nvfp4

Updated Feb 24 • 54 • 6

CelesteImperia/profile

JongYeop/Llama-3.1-8B-Instruct-MXFP4-W4A4

Text Generation • 5B • Updated Feb 24 • 24

JongYeop/Qwen2.5-7B-Instruct-MXFP4-W4A4

Text Generation • 5B • Updated Feb 24 • 34

jameshhugg/OptiMind-SFT-Q4_K_M-GGUF

21B • Updated Feb 24 • 15

Shifusen/Qwen3.5-122B-A10B-FP8

Image-Text-to-Text • 123B • Updated Feb 25 • 36 • 1

oshkorinova/MamayLM-Gemma-3-12B-IT-v1.0-FP8-Static-Ultrachat-200k

Text Generation • 12B • Updated Feb 25 • 20

Tushe/nllb-200-600M-int8-custom-weights-bare-metal

Translation • 0.9B • Updated Feb 25 • 18

elon-trump/pixtral-12b-2409-w4a16-gptq

3B • Updated Apr 25 • 2

damema5941/Qwen-Image-Edit-2511-FP8

Image-to-Image • Updated Feb 26 • 5

Shifusen/Qwen3.5-122B-A10B-abliterated-FP8

Text Generation • 123B • Updated Feb 26 • 149 • 3

joshuaeric/vllm-tool-calling-guide

Text Generation • Updated Feb 26

ApacheOne/ZImageBase-nvfp4_mixed

Updated Apr 19 • 21 • 1

Wojtekb30/Trurl-2-7B-Q4_K_M-GGUF

7B • Updated Feb 26 • 2

chronicskink51/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • 7B • Updated Feb 27 • 6