Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,623

Base only

Active filters: 3-bit

orcarouter/OrcaSAQ-2-27B

Text Generation • 7B • Updated 5 days ago • 1.66k • 200

0xSero/GLM-5.3-500B-EXL3-3.0bpw

Text Generation • 99B • Updated 22 days ago • 947 • 25

orcarouter/DeepSeek-V4.1-Flash-Uncensored-MLX

Image-Text-to-Text • Updated 16 days ago • 41

ukisai/Swift-1.5-3bit-MLX-TextOnly

Text Generation • 27B • Updated 5 days ago • 444 • 3

EliovpAI/Qwen3.8-27B-W3Rot-INT3-Paiton-RDNA4

Text Generation • Updated about 20 hours ago • 3

drowzeys/keys-GLM-5.3-EXL3-Abliterated

Text Generation • 165B • Updated 25 days ago • 192 • 13

0xSero/GLM-5.3-EXL3-3.0bpw

Text Generation • 146B • Updated 22 days ago • 521 • 3

numen-tech/Dolphin3.0-Llama3.1-8B-w3a16g40sym

Text Generation • Updated Feb 13, 2025 • 1

RossAscends/24B-XortronCriminalComputingConfig-3bpw-EXL3

Text Generation • 5B • Updated Jun 21, 2025 • 21 • 1

mlx-community/Qwen3-235B-A22B-Instruct-2507-3bit-DWQ

Text Generation • 235B • Updated Jul 26, 2025 • 123 • 6

MaziyarPanahi/GLM-4.6V-Flash-GGUF

Text Generation • 9B • Updated Dec 8, 2025 • 91.1k • 7

RepublicOfKorokke/GLM-4.7-Flash-REAP-23B-A3B-oQ3.5

Text Generation • 23B • Updated Mar 30 • 59 • 1

lukaskremla/Qwen3.8-27B-3bit-MLX-TextOnly

Text Generation • 27B • Updated 28 days ago • 5.83k • 18

d9beuD/Qwen3.8-27B-oQ3e-mtp

28B • Updated 15 days ago • 192 • 1

Litwein/Qwen3.8-Flash-Next-REAP320-oQ3e-DWQ-MTP-Vision-MLX

Image-Text-to-Text • 134B • Updated 13 days ago • 825 • 4

Litwein/Qwen3.8-Flash-Next-REAP320-oQ3e-fp16-DWQ-MTP-Vision-MLX

Image-Text-to-Text • 134B • Updated 11 days ago • 710 • 4

r0b0tlab/GLM-5.3-Flash-DFlash2-EXL3-3.00bpw

Text Generation • 0.3B • Updated 1 day ago • 246 • 1

kaitchup/Llama-2-7b-gptq-3bit

Text Generation • Updated Sep 9, 2023 • 21

clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 13 • 3

clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit

Text Generation • Updated Sep 20, 2023 • 17 • 3

MiNeves-tops/opt-125m-gptq-3bit

Text Generation • Updated Sep 25, 2023 • 17

Kimata/opt-125m-3bit

Text Generation • Updated Sep 29, 2023 • 14

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 27

danny0122/Llama-2-7b-hf-gptq-3bits

Text Generation • 6B • Updated Dec 11, 2023 • 22

danny0122/Llama-2-7b-hf-gptq-3bitssafe

Text Generation • 6B • Updated Dec 11, 2023 • 23

danny0122/stablelm-base-alpha-3b-gptq-3bits

Text Generation • 3B • Updated Dec 11, 2023 • 26

danny0122/stablelm-base-alpha-3b-gptq-3bitssafe

Text Generation • 3B • Updated Dec 11, 2023 • 27

SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT

Text Generation • 31B • Updated Feb 13, 2024 • 22

mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ

Text Generation • 65B • Updated Dec 18, 2023 • 21

SicariusSicariiStuff/Tenebra_PreAlpha_No_Group_g_3BIT

Text Generation • 31B • Updated Feb 13, 2024 • 21