Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,626

Base only

Active filters: 3-bit

orcarouter/OrcaSAQ-2-27B

Text Generation • 7B • Updated 6 days ago • 2.46k • 213

orcarouter/DeepSeek-V4.1-Flash-Uncensored-MLX

Image-Text-to-Text • Updated 18 days ago • 41

ukisai/Swift-1.5-3bit-MLX-TextOnly

Text Generation • 27B • Updated 6 days ago • 647 • 4

EliovpAI/Qwen3.8-27B-W3Rot-INT3-Paiton-RDNA4

Text Generation • Updated 1 day ago • 3

drowzeys/keys-GLM-5.3-EXL3-Abliterated

Text Generation • 165B • Updated 26 days ago • 209 • 13

0xSero/GLM-5.3-EXL3-3.0bpw

Text Generation • 146B • Updated 23 days ago • 563 • 3

0xSero/GLM-5.3-500B-EXL3-3.0bpw

Text Generation • 99B • Updated 23 days ago • 1.02k • 25

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 1.7k • 12

numen-tech/Dolphin3.0-Llama3.1-8B-w3a16g40sym

Text Generation • Updated Feb 13, 2025 • 1

RossAscends/24B-XortronCriminalComputingConfig-3bpw-EXL3

Text Generation • 5B • Updated Jun 21, 2025 • 46 • 1

mlx-community/Qwen3-235B-A22B-Instruct-2507-3bit-DWQ

Text Generation • 235B • Updated Jul 26, 2025 • 155 • 6

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 94.8k • 7

RepublicOfKorokke/GLM-4.7-Flash-REAP-23B-A3B-oQ3.5

Text Generation • 23B • Updated Mar 30 • 82 • 1

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 27B • Updated 29 days ago • 5.49k • 18

d9beuD/Qwen3.8-27B-oQ3e-mtp

28B • Updated 16 days ago • 213 • 1

Litwein/Qwen3.8-Flash-Next-REAP320-oQ3e-fp16-DWQ-MTP-Vision-MTPLX

Image-Text-to-Text • 81B • Updated 12 days ago • 836 • 3

r0b0tlab/GLM-5.3-Flash-DFlash2-EXL3-3.00bpw

Text Generation • 0.3B • Updated 2 days ago • 299 • 1

drowzeys/keys-GLM-5.3-EXL3-2.75BPW

Text Generation • 138B • Updated about 5 hours ago • 21 • 1

topboss9527/GLM-5.3-Flash-abliterated-EXL3-K3.25

Image-Text-to-Text • 73B • Updated 1 day ago • 21 • 1

kaitchup/Llama-2-7b-gptq-3bit

Text Generation • Updated Sep 9, 2023 • 21

clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 12 • 3

clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 16 • 3

MiNeves-tops/opt-125m-gptq-3bit

Text Generation • Updated Sep 25, 2023 • 16

Kimata/opt-125m-3bit

Text Generation • Updated Sep 29, 2023 • 13

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 25

danny0122/Llama-2-7b-hf-gptq-3bits

Text Generation • 6B • Updated Dec 11, 2023 • 21

danny0122/Llama-2-7b-hf-gptq-3bitssafe

Text Generation • 6B • Updated Dec 11, 2023 • 22

danny0122/stablelm-base-alpha-3b-gptq-3bits

Text Generation • 3B • Updated Dec 11, 2023 • 27

danny0122/stablelm-base-alpha-3b-gptq-3bitssafe

Text Generation • 3B • Updated Dec 11, 2023 • 28

SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT

Text Generation • 31B • Updated Feb 13, 2024 • 21