Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,009

Base only

Active filters: llama.cpp

yuvaliloo/malware-scanner-v1

8B • Updated Dec 23, 2025 • 34

glogwa68/granite-4.0-h-micro-DISTILL-OPUS-4.5-think-GGUF

Text Generation • 3B • Updated Dec 23, 2025 • 50

Yubaiyubai/model_q4_k_m

3B • Updated Dec 23, 2025 • 5

glogwa68/olmo-3-DISTILL-glm-4.7-think-GGUF

Text Generation • 7B • Updated Dec 23, 2025 • 106 • 1

glogwa68/granite-4.0-h-tiny-DISTILL-OPUS-4.5-think-GGUF

Text Generation • 7B • Updated Dec 23, 2025 • 513 • 1

RinKana/Qwen3-4B-Deconstruct-V2-GGUF

4B • Updated Dec 24, 2025 • 12

mew151mew/llama3.1-mental-health-5-Epoch

8B • Updated Dec 24, 2025 • 22

TeichAI/Qwen3-4B-Instruct-2507-Gemini-3-Pro-Preview-Distill-GGUF

4B • Updated Dec 24, 2025 • 433 • 8

shemilk/Seri-Malayalam-LoRA-GGUF

4B • Updated Dec 24, 2025 • 13

CHHIEVTONG/chhievtong-ly-gguf

8B • Updated Dec 24, 2025 • 8

ChetanCh/qwen3

0.6B • Updated Dec 24, 2025 • 24

jessitoi/LlamaTrader

8B • Updated Dec 24, 2025 • 10

RinKana/Qwen2.5-3B-Deconstruct-V2-103-GGUF

3B • Updated Dec 24, 2025 • 12

LyBunleang/ly_bunleang-gguf

8B • Updated Dec 24, 2025 • 12

antony9952/Qwen_McMillan_Model

2B • Updated Dec 24, 2025 • 10

notgoodkeeper/My_Evo_Llama_GGUF

8B • Updated Dec 24, 2025 • 7

WarlordHermes/Chekhov-10B-Test-GGUF

9B • Updated Dec 24, 2025 • 9

AbdelilahYounsi/Qwen2.5-0.5B-Instruct-summarization-GGUF

0.5B • Updated Dec 24, 2025 • 14

RinKana/Gemma3-4b-Deconstruct-V2-103-GGUF

4B • Updated Dec 24, 2025 • 17

spikymoth/G3-Heresy-MPOA-G-W99-D0.1099-R01-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 4

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 268 • 3

spikymoth/G3-Heresy-MPOA-G-W99-D0.0394-R03-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 5

spikymoth/G3-Heresy-MPOA-G-W99-D0.1099-R01-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 4

spikymoth/G3-Heresy-MPOA-G-W99-D0.0690-R02-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 88 • 2

spikymoth/G3-Heresy-MPOA-G-W99-D0.0394-R03-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 14

RinKana/DeepSeek-R1-Distill-Qwen-1.5B-bnb-4bit-Deconstruct-V2-GGUF

2B • Updated Dec 25, 2025 • 67

mizuxx/finetuned_model

21B • Updated Dec 25, 2025 • 11

spikymoth/G3-Heresy-MPOA-G-W99-D0.0199-R08-i1-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 12

prithivMLmods/DeepCaption-VLA-7B-AIO-GGUF

Image-Text-to-Text • 8B • Updated Dec 25, 2025 • 172 • 1

prithivMLmods/DeepCaption-VLA-V2.0-7B-AIO-GGUF

Image-Text-to-Text • 8B • Updated Dec 25, 2025 • 161 • 2