Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,144

Base only

Active filters: llama.cpp

mew151mew/llama3.1-mental-health-2-Epoch

8B • Updated Dec 20, 2025 • 12

TeichAI/Qwen3-4B-Thinking-2507-GPT-5.2-High-Reasoning-Distill-GGUF

4B • Updated Dec 20, 2025 • 847 • 5

WarlordHermes/Chekhov-24B-v1.0-JSON-GGUF

24B • Updated Dec 20, 2025 • 31

TeichAI/Qwen3-4B-GPT-5.2-High-Reasoning-Distill-GGUF

4B • Updated Dec 20, 2025 • 332 • 1

WarlordHermes/Chekhov-24B-v1.0-GGUF

24B • Updated Dec 20, 2025 • 25

nquangit/gemma-270M-http-classification-gguf

0.3B • Updated Dec 21, 2025 • 19

mew151mew/llama3.1-mental-health-3-Epoch

8B • Updated Dec 21, 2025 • 18

albertosg112/Jarvis_Prime_Expert_V2

3B • Updated Dec 21, 2025 • 24

ChetanCh/qwen2.5

0.5B • Updated Dec 21, 2025 • 47

hasinduOnline/akura_llama_8b_dyslexia

8B • Updated Dec 21, 2025 • 13

AndrewThompson1233/conscious-nano-qwen-1.5B

2B • Updated 2 days ago • 48

AichaRi/PedegogicalExp2qwen2.5-14b-GGUF

15B • Updated Dec 21, 2025 • 13

WarlordHermes/Chekhov-12B-Test-GGUF

12B • Updated Dec 21, 2025 • 22

kresnandika/Llama-3.1-8B-email-reimbursement-GGUF

8B • Updated Dec 22, 2025 • 28

iamamy1999/llma-1b-context-finetune

1B • Updated Dec 22, 2025 • 67

khalidabalida/functiongemma-gguf

0.3B • Updated Dec 22, 2025 • 17

hasinduOnline/akura_ai_sinhala_dyslexic_word_corrector_4bit

8B • Updated Dec 22, 2025 • 29

duttaturja/SolvPredic-3B

3B • Updated Mar 17 • 21

khalidabalida/functiongemma-skia-shapes-gguf

0.3B • Updated Dec 22, 2025 • 27

momo223/gemma-financial-gguf

9B • Updated Dec 22, 2025 • 18

spikymoth/G3-Heresy-MPOA-G-W99-D0.1838-R01-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 105

spikymoth/G3-Heresy-MPOA-G-W99-D0.0999-R02-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 102

spikymoth/G3-Heresy-MPOA-G-W99-D0.0523-R03-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 104

spikymoth/G3-Heresy-MPOA-G-W99-D0.0359-R04-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 106

spikymoth/G3-Heresy-MPOA-G-W99-D0.0276-R06-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 99

spikymoth/G3-Heresy-MPOA-G-W99-D0.0199-R08-GGUF

Text Generation • 27B • Updated Dec 31, 2025 • 103

TeichAI/Qwen3-4B-Instruct-2507-Claude-Haiku-4.5-Distill-GGUF

4B • Updated Dec 23, 2025 • 686 • 4

yongxgh/fortunetelling

8B • Updated Dec 23, 2025 • 18

prithivMLmods/SenseNova-SI-1.1-Qwen3-VL-8B-GGUF

Image-Text-to-Text • 8B • Updated Dec 23, 2025 • 316 • 1

prithivMLmods/Cosmos-Reason2-8B-GGUF

Image-Text-to-Text • 8B • Updated Dec 23, 2025 • 423 • 3