Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,037

Base only

Active filters: llama.cpp

Okediya/buddy-gguf

8B • Updated Feb 27 • 17

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated Mar 13 • 74 • 8

thuniverse-ai/SiliconMind-V1-Qwen3-8B-GGUF

Text Generation • 8B • Updated Feb 27 • 207

rounakchhatait/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated Feb 27 • 774 • 1

thuniverse-ai/SiliconMind-V1-Qwen2.5-C-7B-I-GGUF

Text Generation • 8B • Updated Feb 27 • 104

thuniverse-ai/SiliconMind-V1-Qwen3-4B-T-2507-GGUF

Text Generation • 4B • Updated Feb 27 • 214

thuniverse-ai/SiliconMind-V1-Olmo-3-7B-Think-GGUF

Text Generation • 7B • Updated Feb 27 • 47

BansheeTechnologies/Ouija-1.5B

Text Generation • 2B • Updated Feb 27 • 10 • 1

moxin-org/Qwen3.5-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated Feb 27 • 75 • 1

Randyliu99/qwen2.5-7b-jcole-gguf

8B • Updated Feb 28 • 23

Ex0bit/Qwen3.5-122B-A10B-PRISM-LITE-GGUF

Image-Text-to-Text • 122B • Updated Feb 28 • 95 • 16

BansheeTechnologies/Ouija2-1.7B

Text Generation • 2B • Updated Feb 28 • 656 • 1

Partha11/qwen3-tag-generator-fcomm

2B • Updated Feb 28 • 23

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated Mar 2 • 194 • 27

2796gauravc/artha-functiongemma-270m-gguf

0.3B • Updated Feb 28 • 27

prithivMLmods/FireRed-OCR-GGUF

Image-Text-to-Text • 2B • Updated Feb 28 • 455 • 1

Varadrajan/ITDR-SFT-Qwen2.5-3B-v1

3B • Updated Feb 28 • 29 • 1

Aadeshisdoingsomething/Llama-3.2-1b-Claude-Gemini-reasoning

1B • Updated Mar 4 • 263 • 1

ozashu/mistral-3b-sft-prompt-hack-gguf

Text Generation • 3B • Updated Mar 1 • 29

TeichAI/Qwen3.5-27B-Claude-Opus-4.6-Distill-GGUF

27B • Updated Mar 4 • 1.96k • 37

mradermacher/ITDR-SFT-Qwen2.5-3B-v1-GGUF

3B • Updated Mar 1 • 104

jsrobinson3/beebuddy-gguf

8B • Updated Mar 1 • 20

mirfan899/gluco-gemma

0.3B • Updated Mar 11 • 30

pryoot/qwen_finetune

4B • Updated Mar 1 • 21

codeslord/ministral-14b-web-agent-gguf

14B • Updated Mar 1 • 108

Rabe3/gemma270-suadi-gguf

0.3B • Updated Mar 1 • 23

jsrobinson3/beebuddy-bee-gguf

8B • Updated Mar 1 • 18

amadews/LFM2_5_code_instructions_120k_alpaca_q4

1B • Updated Mar 2 • 21

Acvarius-AI/GhostLlama

1B • Updated Mar 3 • 9

DylM0nster22/qwen_finetune

4B • Updated Mar 2 • 33