Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,313

Base only

Active filters: quantization

ThomasYn/GenomeOcean-100M-v1.2-AWQ

0.1B • Updated Mar 22 • 42

kalistratov/rqvae-pet-supplies

ThomasYn/GenomeOcean-500M-v1.2-GGUF

0.5B • Updated Mar 22 • 69

ThomasYn/GenomeOcean-500M-v1.2-AWQ

0.5B • Updated Mar 22 • 36

ThomasYn/GenomeOcean-100M-GGUF

0.1B • Updated Mar 23 • 96

ThomasYn/GenomeOcean-100M-AWQ

0.1B • Updated Mar 23 • 33

ThomasYn/GenomeOcean-500M-GGUF

0.5B • Updated Mar 23 • 77

ThomasYn/GenomeOcean-500M-AWQ

0.5B • Updated Mar 23 • 36

ThomasYn/GenomeOcean-4B-GGUF

4B • Updated Mar 23 • 62

ThomasYn/GenomeOcean-4B-AWQ

4B • Updated Mar 23 • 36

ThomasYn/GenomeOcean-4B-bgcFM-GGUF

4B • Updated Mar 23 • 53

ThomasYn/GenomeOcean-4B-bgcFM-AWQ

4B • Updated Mar 23 • 35

emreyigitozturk/llama-3.2-3b-awq-4bit

Text Generation • 4B • Updated Mar 23 • 8

emreyigitozturk/llama-3.2-3b-gptq-4bit

Text Generation • Updated Mar 23 • 14

emreyigitozturk/llama-3.2-3b-bitsandbytes-4bit-nf4

Text Generation • Updated Mar 24

emreyigitozturk/llama2-7b-owq-int4-fp16

Text Generation • Updated Mar 24 • 10

emreyigitozturk/llama-3.2-3b-smoothquant-gptq-hybrid

Text Generation • 4B • Updated Mar 24 • 18

emreyigitozturk/qwen3-vl-2b-dynamic-ptq

Image-Text-to-Text • Updated Mar 24

daslab-testing/Kimi-K2.5-2bit-GSQ

1T • Updated Mar 24 • 27

CompressEDai4good/sarvam-30b-compressed

Text Generation • 33B • Updated Jun 15

2imi9/olmoearth-nano-fp8

Feature Extraction • Updated Mar 25

2imi9/olmoearth-nano-fp4

Feature Extraction • Updated Mar 25

flovflo/turboquant-mlx-qwen35-kv

Updated Mar 25 • 18

Ccre/Z-Image-Turbo-MXFP8

Text-to-Image • Updated Mar 25 • 49 • 5

happypatrick/Qwen3.5-397B-A17B-heretic-int4-AutoRound

Text Generation • Updated Mar 26 • 286 • 4

aios-framework/aios-paper

upsman/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • 2B • Updated Mar 26 • 97

tonera/Nepotism_xii-Nunchaku

Text-to-Image • 12B • Updated Mar 27 • 78 • 1

tonera/FLUX.2-klein-9B-Nunchaku

Image-to-Image • 9B • Updated Jun 23 • 2.44k • 18

tonera/Qwen2.5vl-Nunchaku

Updated Apr 9 • 907 • 3