Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,878

Base only

Active filters: llama.cpp

theprint/Empathetic-Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Jul 30, 2025 • 29

CrucibleLab-TG/M3.2-24B-Loki-V1.0-GGUF

24B • Updated Aug 1, 2025 • 39

Darkhn-Quants/M3.2-36B-Animus-V8.0-GGUF

35B • Updated Sep 11, 2025 • 88

CrucibleLab-TG/M3.2-24B-Loki-V1.1-1.2-1.3-GGUF

24B • Updated Aug 3, 2025 • 5

Darkhn-Quants/M3.2-36B-Animus-V8.1-GGUF

35B • Updated Aug 5, 2025 • 32

CrucibleLab-TG/M3.2-24B-Loki-V1.3-GGUF

24B • Updated Aug 23, 2025 • 424 • 12

CrucibleLab-TG/M3.2-24B-Loki-V1.2-GGUF

24B • Updated Aug 4, 2025 • 5 • 1

daskalos-apps/phi4-cybersec-Q4_K_M

4B • Updated Aug 6, 2025 • 22

prithivMLmods/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 98 • 1

prithivMLmods/Qwen3-4B-Instruct-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 138 • 2

NovaAI6868/BaiHu-gguf

Image-Text-to-Text • 5B • Updated Jun 22 • 41 • 2

kturki/qwen2.5-7B_internal_audit

Question Answering • 8B • Updated Aug 8, 2025 • 78 • 1

atsintli/model_sonbee_8bits

2B • Updated about 11 hours ago • 125

giladgd/gpt-oss-20b-GGUF

Text Generation • 21B • Updated Oct 23, 2025 • 370 • 2

giladgd/gpt-oss-120b-GGUF

Text Generation • 117B • Updated Oct 23, 2025 • 301 • 1

Choyrens/ChoyrensAI-Telekom-Agent-v6-gguf

8B • Updated Aug 9, 2025 • 3

giladgd/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 9, 2025 • 282

HuggingBelto/gpt-oss-20b

Text Generation • 21B • Updated Aug 10, 2025 • 1

simraann/ExplainIt-Phi-GGUF

Text Generation • 3B • Updated Sep 22, 2025 • 26

HillPhelmuth/gpt-oss-20B-chess-analysis-GGUF

21B • Updated Aug 11, 2025 • 10

ganchito/dante-7b.gguf

Text Generation • 8B • Updated Aug 11, 2025 • 5

codebasic/Qwen3-8B-GGUF

8B • Updated Aug 12, 2025 • 22

theprint/TiTan-Gemma3-1B-GGUF

Text Generation • 1B • Updated Aug 12, 2025 • 13

nhay103/gpt-oss-20b-GGUF

Text Generation • 21B • Updated Aug 13, 2025 • 35

theprint/TiTan-Qwen2.5-0.5B-GGUF

Text Generation • 0.5B • Updated Aug 14, 2025 • 174 • 3

sharadsnaik/medgemma-4b-it-medical-gguf

Image-Text-to-Text • 4B • Updated Aug 16, 2025 • 19 • 1

theprint/TiTan-Gemma3-0.27B-GGUF

Text Generation • 0.4B • Updated Aug 16, 2025 • 47 • 1

LiquidAI/LFM2-VL-1.6B-GGUF

Image-Text-to-Text • 1B • Updated Jun 29 • 11.3k • 59

LiquidAI/LFM2-VL-450M-GGUF

Image-Text-to-Text • 0.4B • Updated Jun 29 • 3.94k • 42

theprint/Genuine-7B-Instruct-GGUF

Text Generation • 8B • Updated Aug 18, 2025 • 49