Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

289

Base only

Active filters: qat

nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2

Text Generation • 2B • Updated 24 days ago • 51.2k • 51

SC117/gemma-4-26B-A4B-it-qat-heretic-GGUF

25B • Updated 2 days ago • 7.67k • 33

xbill9/gemma-4-E4B-it-qat-q4_0-exact-gguf

Text Generation • 7B • Updated 5 days ago • 207 • 2

jesdga/Qwen3.8-27B-QUASAR-DFlash2-nvfp4-NInfer

Image-Text-to-Text • Updated 4 days ago • 190 • 2

geotessera/TESSERA-V-1.0

Updated May 22 • 4

SC117/gemma-4-12B-it-heretic-QAT-GGUF

12B • Updated 2 days ago • 10.6k • 54

YoozLabs/Qwen3.5-0.8B-qat-GGUF

Text Generation • 0.8B • Updated Jul 13 • 168 • 1

YoozLabs/Qwen3.5-4B-qat-GGUF

Text Generation • 4B • Updated Jul 13 • 224 • 2

Sandy-sys/osint-argus-gemma4-qat-w4a16

12B • Updated Sep 4 • 36 • 1

nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-MTP-NVFP4

Text Generation • Updated 24 days ago • 1

ConwayResearch/Underdog-27B-1.0

Image-Text-to-Text • 27B • Updated 4 days ago • 173 • 1

OliviaRossi/Gemma-4-12B-it-QAT-Q5_K_L-MTP-GGUF

12B • Updated about 8 hours ago • 1

OliviaRossi/Gemma-4-12B-it-QAT-Hybrid

12B • Updated about 6 hours ago • 1

OliviaRossi/Gemma-4-12B-it-QAT-Hybrid-GGUF

12B • Updated about 5 hours ago • 1

Thomaschtl/qwen3-0.6b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025 • 1

Thomaschtl/test2

Text Generation • Updated Jun 4, 2025 • 20

Thomaschtl/test3

Text Generation • 0.2B • Updated Jun 4, 2025 • 18

PKU-DS-LAB/Fairy2i-W2

Text Generation • 7B • Updated Dec 12, 2025 • 111 • 3

mradermacher/Fairy2i-W2-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 242

mradermacher/Fairy2i-W2-i1-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 920

thebajajra/RexReranker-0.6B-MXFP4

Text Ranking • 0.5B • Updated Jan 24 • 33 • 3

Adanmohh/apuri-v3-0.6b-sft-qat-gguf

0.6B • Updated Jan 14 • 34

junzzhu/atomllama-33K-5x5-DigitMesh-sparse-q8

Text Generation • 34.7k • Updated Jan 15 • 9

tokenlabsdotrun/Llama-3.1-8B-Unsloth-FP8_INT4-QAT

Text Generation • Updated Jan 19 • 18

Harahan/QVGen-Wan-1_3B-W4A4

Text-to-Video • 1B • Updated Feb 2 • 21 • 3

Harahan/QVGen-CogVideoX-2B-W4A4

Text-to-Video • 2B • Updated Feb 2 • 19 • 2

Sikaworld1990/gemma-3-12b-qat-abliterated-sikaworld-fp4-ltx2

Feature Extraction • Updated Mar 11 • 39

kusakana/ReasoningQAT-Qwen3-1.7B-3bit

2B • Updated Mar 20 • 12

kusakana/ReasoningQAT-Qwen3-1.7B-2bit

2B • Updated Mar 20 • 20