Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,304

Base only

Active filters: quantization

Helllbos/Qwen_Quantised3.50.5b

Text Generation • Updated Aug 17 • 1

vinpix/Bonsai-8B-llama.cpp

Text Generation • 8B • Updated Jul 13 • 429 • 8

clark-labs/clark-air-sana-1.6b-1.58bit

Text-to-Image • 2B • Updated Jun 28 • 36 • 12

wepiqx/gemma-4-12B-OBLITERATED-SHQ7-GGUF

Text Generation • 12B • Updated Jun 23 • 240 • 3

tonera/FLUX.2-klein-4B-Nunchaku

Image-to-Image • 4B • Updated Jun 23 • 776 • 6

NU-World-Model-Embodied-AI/ActQuant-Pi05-LIBERO-3bpw

Robotics • 3B • Updated Jun 19 • 119

NU-World-Model-Embodied-AI/ActQuant-Pi05-LIBERO-4bpw

Robotics • 3B • Updated Jun 19 • 329

NU-World-Model-Embodied-AI/ActQuant-Pi05-LIBERO-3.5bpw

Robotics • 3B • Updated Jun 19 • 182

tg-techie-agents/Q1D-4B-Blk0thru1-V1

Text Generation • 4B • Updated Jun 19 • 23

tg-techie-agents/Q1D-4B-Blk0thru3-V1

Text Generation • 4B • Updated Jun 19 • 27

tg-techie-agents/Q1D-4B-Blk0thru3-V2

Text Generation • 4B • Updated Jun 19 • 15

tg-techie-agents/Q1D-4B-Blk0thru3-V3

Text Generation • 4B • Updated Jun 19 • 21

wepiqx/Qwable-9B-Claude-Fable-5-SHQ8-GGUF

Text Generation • 9B • Updated Jun 23 • 169 • 4

tonera/Qwen-Image-2512-Lightning-Nunchaku

Text-to-Image • 20B • Updated Jun 23 • 122 • 2

kongbai-84/animagguf-quantizer

phptop/cohere-transcribe-03-2026-int8

Automatic Speech Recognition • Updated Jun 21

RESMP-DEV/MiMo-V2.5-ASR-FP8

Automatic Speech Recognition • 8B • Updated Aug 6 • 12

barryke/granite-4.1-8b-FP8-DYNAMIC

Text Generation • 9B • Updated Jun 21 • 17

sheikhmufrad/omniASR-LLM-7B-v2-quantized

Automatic Speech Recognition • Updated Jun 22 • 1

FloatinggOnion/mobile-llm-quant-demo

4B • Updated Jun 21 • 78

petergilani/Qwen3.6-27B-MTP-4bit

Text Generation • 27B • Updated Jun 22 • 7

petergilani/Qwen3.6-27B-MTP-8bit

Text Generation • 8B • Updated Aug 15 • 23

donghyunli/Llama-2-7b-KronQ-W4A16

Text Generation • 4B • Updated Jul 24

donghyunli/Llama-2-7b-KronQ-W2A16

Text Generation • 2B • Updated Jul 24 • 1

donghyunli/Meta-Llama-3-8B-KronQ-W4A16

Text Generation • 5B • Updated Jul 13

donghyunli/Llama-2-7b-KronQ-W3A16-fake

Text Generation • 7B • Updated Jul 24 • 24

donghyunli/Meta-Llama-3-8B-KronQ-W3A16-fake

Text Generation • 8B • Updated Jul 14 • 18

donghyunli/Meta-Llama-3-8B-KronQ-W2A16

Text Generation • 3B • Updated Jul 14

donghyunli/Llama-2-13b-KronQ-W4A16

Text Generation • 7B • Updated Jul 14

donghyunli/Llama-2-13b-KronQ-W2A16

Text Generation • 4B • Updated Jul 14