Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

1,233

Base only

Active filters: 4bit

ConfidentialMind/Arcee-Blitz-GPTQ-G32-W4A16-MSE

Text Generation • 24B • Updated Feb 26, 2025 • 9

mradermacher/Phi4-MoE-2x14B-Instruct-GGUF

14B • Updated Feb 24, 2025 • 238

Deepak7376/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit

Text Generation • 2B • Updated Feb 25, 2025 • 18 • 1

saishshinde15/Clyrai_Vortex_GGUF

3B • Updated Aug 8, 2025 • 10

San73r/chatbot_HTML5

Text Generation • Updated Mar 2, 2025

GainEnergy/ogai-8x7b-4bit

Text Generation • 48B • Updated Mar 5, 2025 • 1

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • 33B • Updated Mar 9, 2025 • 32 • 12

syubraj/DietRecommender_4bit_Qwen2.5-0.5B

Text Generation • Updated Mar 11, 2025

Lowkey-Loki/Viper-Coder-v1.7-Vsm6-MLX-4bit

15B • Updated Mar 11, 2025 • 15

Lowkey-Loki/reka-flash-3-mlx-4bit

21B • Updated Mar 11, 2025 • 24 • 1

Tonic/c4ai-command-a-03-2025-4bit_nf4_double

Text Generation • 114B • Updated Mar 13, 2025 • 9 • 1

Tonic/c4ai-command-a-03-2025-4bit_fp4

Text Generation • 113B • Updated Mar 13, 2025 • 33

Tonic/c4ai-command-a-03-2025-4bit_nf4_no_double

Text Generation • 113B • Updated Mar 13, 2025 • 10

Lowkey-Loki/Mistral-Small-3.1-24B-Instruct-TextOnly-mlx-4bit

Text Generation • 24B • Updated Mar 18, 2025 • 30

adriabama06/ReaderLM-v2-AWQ

Text Generation • 2B • Updated May 16, 2025 • 11 • 1

TheCluster/gemma-3-27b-it-uncensored-mlx-4bit

Image-Text-to-Text • Updated Apr 16, 2025 • 727 • 4

Lowkey-Loki/gemma-3-12b-it-textonly-mlx-4bit

Text Generation • 13B • Updated Mar 23, 2025 • 23

btbtyler09/Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • 8B • Updated Apr 5, 2025 • 36

IrfanHamid/ChatBot-lora-7b

Updated Apr 8, 2025

Alxis955/qwen25-adv-lora

Text Generation • 8B • Updated Apr 8, 2025 • 6 • 1

Serione/Llama-3.2-1B-SRLQ-4bit

Updated Apr 9, 2025 • 8

jjeccles/autoround-quantized-4bit

3B • Updated Apr 9, 2025 • 11

adriabama06/DeepCoder-1.5B-Preview-AWQ

Text Generation • Updated Apr 13, 2025 • 11 • 2

bubblspace/Bubbl-P4-multimodal-instruct

6B • Updated Apr 15, 2025 • 11 • 7

TheCluster/amoral-gemma-3-12B-v2-mlx-4bit

Image-Text-to-Text • Updated Apr 16, 2025 • 263 • 3

TheCluster/amoral-gemma-3-27B-v2-mlx-4bit

Image-Text-to-Text • Updated Apr 16, 2025 • 18

BoltMonkey/boltmonkey_shortreasoning-8b

Text Generation • 8B • Updated Apr 18, 2025 • 12 •

BoltMonkey/boltmonkey_shortreasoning-8b-Q5_K_M-GGUF

Text Generation • 8B • Updated Apr 18, 2025 • 9

TechyCode/tinyllama-sciq-lora

Text Generation • Updated Apr 23, 2025

Sumo10/Phi-4-mini-instruct-AWQ-4bit

4B • Updated Apr 25, 2025 • 9 • 1