Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

3,994

Base only

Active filters: instruct

Lucy-in-the-Sky/Gemma2-2B-OpenHermes2.5-Q8_0-GGUF

3B • Updated Jan 20, 2025 • 23

mradermacher/Llama-3.2-Taiwan-3B-Instruct-i1-GGUF

3B • Updated Jan 21, 2025 • 668

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v1

Text Generation • 8B • Updated Jan 24, 2025 • 35 • 6

matrixportalx/Qwen2.5-7B-HomerCreative-Mix-GGUF

8B • Updated Jan 22, 2025 • 38

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2

Text Generation • 8B • Updated Jan 24, 2025 • 63 • 8

p-christ/ModernBERT-large-nli

Zero-Shot Classification • 0.4B • Updated Jan 24, 2025 • 44

roleplaiapp/Llama-3.2-3B-Instruct-uncensored-Q6_K-GGUF

Text Generation • 4B • Updated Jan 27, 2025 • 148 • 1

roleplaiapp/Llama-3.2-3B-Instruct-uncensored-Q2_K-GGUF

Text Generation • 4B • Updated Jan 27, 2025 • 63 • 1

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-IQ4_XS-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 140

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q2_K-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 56

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q3_K_L-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 63

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q3_K_M-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 98

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q3_K_S-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 78

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 223

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q4_K_S-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 88

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 107 • 2

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q5_K_S-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 25

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q6_K-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 41

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-f16-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 61

roleplaiapp/Qwen2.5-7B-Instruct-Uncensored-Q8_0-GGUF

Text Generation • 8B • Updated Jan 27, 2025 • 50

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q2_K-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 13

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q6_K-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 12

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_L-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 20

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_M-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 10

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q3_K_S-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 6

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 30

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q4_K_S-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 26

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_M-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 4

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-Q5_K_S-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 9

roleplaiapp/SILMA-Kashif-2B-Instruct-v1.0-i1-IQ3_M-GGUF

Text Generation • 3B • Updated Jan 28, 2025 • 14