Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,366

Base only

Active filters: quantization

donghyunli/Llama-2-7b-KronQ-W2A16-g128

Text Generation • 2B • Updated Jul 24 • 57

donghyunli/Meta-Llama-3-8B-KronQ-W4A16-g128

Text Generation • 5B • Updated Jul 13 • 50

donghyunli/Meta-Llama-3-8B-KronQ-W2A16-g128

Text Generation • 3B • Updated Jul 13 • 51

donghyunli/Llama-2-13b-KronQ-W4A16-g128

Text Generation • 7B • Updated Jul 13 • 31

donghyunli/Llama-2-70b-KronQ-W4A16-g128

Text Generation • 36B • Updated Jul 14 • 14

donghyunli/Llama-2-13b-KronQ-W2A16-g128

Text Generation • 4B • Updated Jul 14 • 51

donghyunli/Llama-2-7b-KronQ-W3A16-g128-fake

Text Generation • 7B • Updated Jul 24 • 24

donghyunli/Meta-Llama-3-8B-KronQ-W3A16-g128-fake

Text Generation • 8B • Updated Jul 14 • 16

donghyunli/Llama-2-70b-KronQ-W2A16-g128

Text Generation • 19B • Updated Jul 13 • 16

donghyunli/Llama-2-13b-KronQ-W3A16-g128-fake

Text Generation • 13B • Updated Jul 14 • 23

donghyunli/Meta-Llama-3-70B-KronQ-W4A16-g128

Text Generation • 37B • Updated Jul 14 • 18

donghyunli/Meta-Llama-3-70B-KronQ-W2A16-g128

Text Generation • 20B • Updated Jul 13 • 19

donghyunli/Llama-2-70b-KronQ-W3A16-g128-fake

Text Generation • 69B • Updated Jul 14 • 14

donghyunli/Meta-Llama-3-70B-KronQ-W3A16-g128-fake

Text Generation • 71B • Updated Jul 14 • 20

molbal/krea2-gguf

Text-to-Image • 13B • Updated Sep 4 • 18.7k • 21

yw223/Qwen3-8B-OmniQuant-3bit

Text Generation • 8B • Updated Jun 24 • 14

yw223/Meta-Llama-3.1-8B-Instruct-OmniQuant-4bit

Text Generation • 8B • Updated Jun 24 • 11

yw223/Meta-Llama-3.1-8B-Instruct-OmniQuant-3bit

Text Generation • 8B • Updated Jun 24 • 20

yw223/Qwen3-8B-OmniQuant-2bit

Text Generation • 8B • Updated Jun 24 • 13

yw223/Meta-Llama-3.1-8B-Instruct-OmniQuant-2bit

Text Generation • 8B • Updated Jun 24 • 15

yw223/Gemma-2-9B-it-OmniQuant-3bit

Text Generation • 9B • Updated Jun 24 • 13

yw223/Gemma-2-9B-it-OmniQuant-4bit

Text Generation • 9B • Updated Jun 24 • 12

yw223/Qwen3-8B-OmniQuant-4bit

Text Generation • 8B • Updated Jun 24 • 22

yw223/Gemma-2-9B-it-OmniQuant-2bit

Text Generation • 9B • Updated Jun 24 • 15

groxaxo/Qwen3.6-35B-A3B-Heretic-REAP-0.30-GPTQ-Pro-vLLM

Text Generation • 26B • Updated Aug 22 • 395 • 1

sensiarion/embeddinggemma-300m-code-8L-distill-int8

Feature Extraction • Updated Jun 25 • 39

wepiqx/ASHQ1

Text Generation • Updated 28 days ago • 3

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill-NVFP4

Text Generation • 19B • Updated Jun 28 • 34 • 2

wepiqx/Ornith-1.0-9B-ASHQ1-GGUF

Text Generation • 9B • Updated Jul 1 • 278 • 7

aquaman164/GLM-5.2-VQ-Arith

Text Generation • 52B • Updated Jun 27 • 25