Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

1,233

Base only

Active filters: 4bit

cyberandy/SEOcrate-4B_grpo_new_01

Text Generation • 4B • Updated May 8, 2025 • 37 • 7

Chun121/qwen3-4B-rpg-roleplay

Text Generation • 4B • Updated Jul 7, 2025 • 763 • 19

taetae030/fin-term-model

8B • Updated May 4, 2025 • 6 • 1

SujitShelar/llama3-medchat-8b-lora

Question Answering • Updated May 5, 2025

boods/mistral-location-extractor-4bit

Text Generation • 7B • Updated Sep 29, 2025 • 9

mradermacher/SEOcrate-4B_grpo_new_01-GGUF

Reinforcement Learning • 4B • Updated Jul 11, 2025 • 228 • 1

mradermacher/SEOcrate-4B_grpo_new_01-i1-GGUF

Reinforcement Learning • 4B • Updated Jul 11, 2025 • 521

vannishh/llama3-2.1B-4bit-finetuned

Updated May 15, 2025 • 3

Programmer-RD-AI/ResearchQwen-2.5-3B-LoRA

Question Answering • 3B • Updated May 26, 2025 • 4

CodCodingCode/DeepSeek-V2-medical

Text Generation • Updated May 18, 2025

tripolskypetr/Plutus-Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated May 21, 2025 • 154 • 1

abdou-u/MNLP_M2_quantized_model

Text Generation • 0.6B • Updated May 19, 2025 • 6

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b

Text Generation • 12B • Updated May 22, 2025 • 22 • 1

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b-GGUF

Text Generation • 12B • Updated May 23, 2025 • 618 • 2

Jimmi42/sarvam-m-4bit-mlx

Text Generation • 24B • Updated May 26, 2025 • 37 • 2

geninhu/RakutenAI-7B-instruct-GPTQ

Updated May 30, 2025 • 6

umangshikarvar/sentiment-qlora-gptneo

Text Classification • Updated Jun 2, 2025 • 4

Fulstac/deepseek-r1-Distill-Qwen-32B-sqlgen-4bit-v1

Text Generation • 33B • Updated Jun 6, 2025 • 14

Fulstac/deepseek-r1-Distill-Qwen-32B-lora-4bit-v3

Text Generation • 33B • Updated Jun 6, 2025 • 9

acauanrr/qlora-ti-2025-adapter

Updated Jun 7, 2025 • 3

abdou-u/MNLP_M3_quantized_dpo_mcqa_model

Multiple Choice • 0.6B • Updated Jun 8, 2025 • 4

kevin510/friday-4bit

Text Generation • 4B • Updated Sep 23, 2025 • 7

ayureasehealthcare/ayurezeastraai

Text Generation • Updated Jun 13, 2025

Renugadevi82/cisco-nx-ai-4bit

1B • Updated Jun 16, 2025 • 3

avinashhm/Llama-3.1-Nemotron-Nano-4B-v1.1-GPTQ

Text Generation • 5B • Updated Jun 17, 2025 • 14

btbtyler09/Kimi-Dev-72B-GPTQ-4bit

Text Generation • 73B • Updated Jun 19, 2025 • 23 • 2

riddhimanrana/fastvlm-0.5b-captions

Image-Text-to-Text • 0.6B • Updated Sep 30 • 138 • 3

mehta/CooperLM-354M-4bit

Text Generation • 0.4B • Updated Jun 21, 2025 • 11 • 1

adriabama06/GLM-4-9B-0414-exl3

Text Generation • Updated Jun 23, 2025 • 14 • 1

JustJaro/SmolLM-135M_gptq_g32_4bit

Text Generation • 0.1B • Updated Jul 7, 2025 • 12