Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,295

Base only

Active filters: quantization

anoopbhargavakm87/Meta-Llama-3-8B-Instruct-4bit-Compressed

Text Generation • 8B • Updated Jun 23 • 6

Arki05/Qwen3.6-27B-GGUF

27B • Updated 10 days ago • 60

xv0y5ncu/gemma-4-12B-it-GLQ-3bpw-e8p-bd

Image-Text-to-Text • 2B • Updated Jun 24 • 13

ShockleyWong/gemma4-e2b-rdk-s100p

Image-Text-to-Text • Updated Jun 24

nameistoken/Step-3.7-Flash-Quark-W4A16

Image-Text-to-Text • 203B • Updated Jun 24 • 880

nameistoken/Step-3.7-Flash-Quark-W8A8

Image-Text-to-Text • 201B • Updated Jun 24 • 20

Abhimanue/TCompress

0.1B • Updated Jun 24

Fredred89/Qwopus3.6-27B-Coder-GGUF-kaitchup-MoQ-4.0

Fredred89/Qwopus3.6-27B-Coder-GGUF-ASI-MoQ-4.0

donghyunli/Llama-2-7b-KronQ-W4A16-g128

Text Generation • 4B • Updated 9 days ago • 733

donghyunli/Llama-2-7b-KronQ-W2A16-g128

Text Generation • 2B • Updated 9 days ago • 728

donghyunli/Meta-Llama-3-8B-KronQ-W4A16-g128

Text Generation • 5B • Updated 20 days ago • 594

donghyunli/Meta-Llama-3-8B-KronQ-W2A16-g128

Text Generation • 3B • Updated 20 days ago • 507

donghyunli/Llama-2-13b-KronQ-W4A16-g128

Text Generation • 7B • Updated 20 days ago • 287

donghyunli/Llama-2-70b-KronQ-W4A16-g128

Text Generation • 36B • Updated 18 days ago • 619

donghyunli/Llama-2-13b-KronQ-W2A16-g128

Text Generation • 4B • Updated 18 days ago • 583

donghyunli/Llama-2-7b-KronQ-W3A16-g128-fake

Text Generation • 7B • Updated 9 days ago • 664

donghyunli/Meta-Llama-3-8B-KronQ-W3A16-g128-fake

Text Generation • 8B • Updated 18 days ago • 778

donghyunli/Llama-2-70b-KronQ-W2A16-g128

Text Generation • 19B • Updated 20 days ago • 329

donghyunli/Llama-2-13b-KronQ-W3A16-g128-fake

Text Generation • 13B • Updated 18 days ago • 546

donghyunli/Meta-Llama-3-70B-KronQ-W4A16-g128

Text Generation • 37B • Updated 18 days ago • 742

donghyunli/Meta-Llama-3-70B-KronQ-W2A16-g128

Text Generation • 20B • Updated 20 days ago • 457

donghyunli/Llama-2-70b-KronQ-W3A16-g128-fake

Text Generation • 69B • Updated 18 days ago • 584

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-g128-fake

Text Generation • 71B • Updated 18 days ago • 684

yw223/Qwen3-8B-OmniQuant-3bit

Text Generation • 8B • Updated Jun 24 • 8

yw223/Meta-Llama-3.1-8B-Instruct-OmniQuant-4bit

Text Generation • 8B • Updated Jun 24 • 10

yw223/Meta-Llama-3.1-8B-Instruct-OmniQuant-3bit

Text Generation • 8B • Updated Jun 24 • 8

yw223/Qwen3-8B-OmniQuant-2bit

Text Generation • 8B • Updated Jun 24 • 7

yw223/Meta-Llama-3.1-8B-Instruct-OmniQuant-2bit

Text Generation • 8B • Updated Jun 24 • 12

yw223/Gemma-2-9B-it-OmniQuant-3bit

Text Generation • 9B • Updated Jun 24 • 5