Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,625

Base only

Active filters: 3-bit

orcarouter/OrcaSAQ-2-27B

Text Generation • 7B • Updated 6 days ago • 2.14k • 212

orcarouter/DeepSeek-V4.1-Flash-Uncensored-MLX

Image-Text-to-Text • Updated 17 days ago • 41

0xSero/GLM-5.3-500B-EXL3-3.0bpw

Text Generation • 99B • Updated 22 days ago • 1k • 25

ukisai/Swift-1.5-3bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 538 • 3

EliovpAI/Qwen3.8-27B-W3Rot-INT3-Paiton-RDNA4

Text Generation • Updated about 18 hours ago • 3

drowzeys/keys-GLM-5.3-EXL3-Abliterated

Text Generation • 165B • Updated 26 days ago • 194 • 13

0xSero/GLM-5.3-EXL3-3.0bpw

Text Generation • 146B • Updated 22 days ago • 552 • 3

numen-tech/Dolphin3.0-Llama3.1-8B-w3a16g40sym

Text Generation • Updated Feb 13, 2025 • 1

RossAscends/24B-XortronCriminalComputingConfig-3bpw-EXL3

Text Generation • 5B • Updated Jun 21, 2025 • 41 • 1

mlx-community/Qwen3-235B-A22B-Instruct-2507-3bit-DWQ

Text Generation • 235B • Updated Jul 26, 2025 • 155 • 6

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 94.6k • 7

RepublicOfKorokke/GLM-4.7-Flash-REAP-23B-A3B-oQ3.5

Text Generation • 23B • Updated Mar 30 • 75 • 1

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 27B • Updated 29 days ago • 5.73k • 18

d9beuD/Qwen3.8-27B-oQ3e-mtp

28B • Updated 15 days ago • 194 • 1

Litwein/Qwen3.8-Flash-Next-REAP320-oQ3e-fp16-DWQ-MTP-Vision-MTPLX

Image-Text-to-Text • 81B • Updated 12 days ago • 798 • 3

r0b0tlab/GLM-5.3-Flash-DFlash2-EXL3-3.00bpw

Text Generation • 0.3B • Updated 2 days ago • 282 • 1

topboss9527/GLM-5.3-Flash-abliterated-EXL3-K3.25

Image-Text-to-Text • 73B • Updated 1 day ago • 15 • 1

kaitchup/Llama-2-7b-gptq-3bit

Text Generation • Updated Sep 9, 2023 • 21

clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 13 • 3

clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 17 • 3

MiNeves-tops/opt-125m-gptq-3bit

Text Generation • Updated Sep 25, 2023 • 17

Kimata/opt-125m-3bit

Text Generation • Updated Sep 29, 2023 • 14

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 27

danny0122/Llama-2-7b-hf-gptq-3bits

Text Generation • 6B • Updated Dec 11, 2023 • 22

danny0122/Llama-2-7b-hf-gptq-3bitssafe

Text Generation • 6B • Updated Dec 11, 2023 • 23

danny0122/stablelm-base-alpha-3b-gptq-3bits

Text Generation • 3B • Updated Dec 11, 2023 • 26

danny0122/stablelm-base-alpha-3b-gptq-3bitssafe

Text Generation • 3B • Updated Dec 11, 2023 • 27

SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT

Text Generation • 31B • Updated Feb 13, 2024 • 22

mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ

Text Generation • 65B • Updated Dec 18, 2023 • 21

SicariusSicariiStuff/Tenebra_PreAlpha_No_Group_g_3BIT

Text Generation • 31B • Updated Feb 13, 2024 • 21