Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,143

Base only

Active filters: llama.cpp

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 142 • 2

spikymoth/G3-Heresy-MPOA-G-W99-D0.0394-R03-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 103

RinKana/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit-Deconstruct-V2-GGUF

2B • Updated Dec 25, 2025 • 91

mizuxx/finetuned_model

21B • Updated Dec 25, 2025 • 20

spikymoth/G3-Heresy-MPOA-G-W99-D0.0199-R08-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 92

prithivMLmods/DeepCaption-VLA-7B-AIO-GGUF

Image-Text-to-Text • 8B • Updated Dec 25, 2025 • 223 • 1

prithivMLmods/DeepCaption-VLA-V2.0-7B-AIO-GGUF

Image-Text-to-Text • 8B • Updated Dec 25, 2025 • 330 • 2

A5CENSION-SRT/mental-health-deepseek-v1-GGUF

8B • Updated Dec 25, 2025 • 25

RinKana/Qwen2.5-3B-Deconstruct-V2.3-GGUF

3B • Updated Dec 25, 2025 • 18

WarlordHermes/Magidonia-24B-v4.3-creative-ORPO-v3-GGUF

24B • Updated Dec 28, 2025 • 72

ermiaazarkhalili/Qwen2.5-0.5B-SFT-UltraChat-GGUF

0.5B • Updated Apr 18 • 28

Ashraya/gemma-270m-legal-gguf

0.3B • Updated Dec 25, 2025 • 11

prithivMLmods/LFM2-2.6B-Exp-GGUF

Text Generation • 3B • Updated Dec 25, 2025 • 255 • 5

icebird50817/gsm8k-llama31-8b-unsloth-lora

8B • Updated Dec 25, 2025 • 24

LiquidAI/LFM2-2.6B-Exp-GGUF

Text Generation • 3B • Updated Mar 30 • 3.21k • 67

nolabs/deepfabric-blender-mcp-gguf

4B • Updated Dec 25, 2025 • 705 • 3

pavanc21/EMET-Mistral-2.0-GGUF

7B • Updated Dec 26, 2025 • 9

kalai4390/FunctionGemma_Q8_270M_finetuned_GGUF_MobileActionsdataset

0.3B • Updated Dec 25, 2025 • 45 • 1

johkamb/task-decomposer-270m

Text Generation • 0.3B • Updated Dec 25, 2025 • 26

ermiaazarkhalili/Qwen2.5-1.5B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 43

kalai4390/Gemma3N_4B_finetuned_Q8GGUF_conversation

7B • Updated Dec 25, 2025 • 16

Capibara-LLM/gemma-2-9b-it-Jopara-GGUF

9B • Updated Dec 26, 2025 • 20

ermiaazarkhalili/Qwen3-0.6B-SFT-UltraChat-GGUF

0.6B • Updated Apr 18 • 38

nullzero-live/gem3COMPILAR

4B • Updated Dec 26, 2025 • 28

ermiaazarkhalili/Qwen3-1.7B-SFT-UltraChat-GGUF

2B • Updated Apr 18 • 39

TeichAI/Qwen3-4B-Instruct-2507-Claude-Opus-3-Distill-GGUF

4B • Updated Dec 26, 2025 • 275 • 5

RinKana/Qwen2.5-3B-Deconstruct-V2.4-GGUF

3B • Updated Dec 26, 2025 • 13

ermiaazarkhalili/Qwen2.5-3B-SFT-UltraChat-GGUF

3B • Updated Apr 18 • 28

bisonnetworking/bison-medical-v3-1.7b-gguf

2B • Updated Dec 26, 2025 • 73 • 1

WarlordHermes/QwenLong-30B-creative-ORPO-v3-Q4_K_M-GGUF

31B • Updated Dec 26, 2025 • 10