Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,155

Base only

Active filters: llama.cpp

TeichAI/Qwen3-8B-GPT-5.2-High-Reasoning-Distill-GGUF

8B • Updated Dec 21, 2025 • 1.19k • 4

AIMS2025/DeepSignal

Text Generation • 4B • Updated Jul 20 • 2 • 3

naveedashfaq/llama-3-8b-pruned-30-percent-taylor

6B • Updated Dec 16, 2025 • 11 • 1

ss-lab/IBM-granite-4.0-micro-GGUF

Text Generation • 3B • Updated Jan 11 • 38 • 1

ArslanRobo/llama-3.1-8b-instruct-smoothquant-Pruned30Tailor-fp16

Text Generation • 6B • Updated Dec 16, 2025 • 18

beratdgan/Qwen3-14B-Interview-Coach-v2

15B • Updated Dec 16, 2025 • 18

saisatwikkuppili/unslot-llama-3.2_1B_merged-gguf

1B • Updated Dec 16, 2025 • 27

saisatwikkuppili/unslot-llama-3.2_1B_merged-quantised

1B • Updated Dec 16, 2025 • 46

GTKING/ZFusionAI_Hacker

2B • Updated Jan 15 • 226 • 1

aotal/curso-ai-crew-llama3-8b-gguf

8B • Updated Dec 16, 2025 • 25

aotal/curso-ai-crew-Qwen2.5-7B-gguf

8B • Updated Dec 16, 2025 • 14

Christoferson/qwen2.5-500M-grpo-after-sft-both-basic-3000-3e-5-20251216-153659-GGUF

0.5B • Updated Dec 16, 2025 • 75

anezatra/gpt-oss-20b-eliza-v1-orpo-GGUF

21B • Updated Dec 25, 2025 • 82

moxin-org/Nemotron-3-Nano-30B-A3B-GGUF

Text Generation • 32B • Updated Dec 17, 2025 • 120 • 3

Harsha901/Qwen3_4B_GRPO_GGUF

Text Generation • 4B • Updated Dec 23, 2025 • 54

SMOK33Y3/gary-nemotron-8b-v2-gguf

8B • Updated Dec 17, 2025 • 28

atul0341/my-qwen-finetuned1_16

0.5B • Updated Dec 17, 2025 • 20

Christoferson/gemma3-270m-grpo-after-sft-sysmprompt-both-3000-1e-6-cosine-20251216-152129-GGUF

0.3B • Updated Dec 17, 2025 • 39

robiophantom/model

8B • Updated Dec 17, 2025 • 19

goldenall/phi4-imdb-sentiment

15B • Updated Dec 17, 2025 • 27

aotal/curso-ai-crew-llama3-8b-2-gguf

8B • Updated Dec 17, 2025 • 16

Sr-Carlos/model_SFT_gemma_3n_E2B_it-4B

4B • Updated Dec 17, 2025 • 58

ss-lab/Google-gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated Jan 11 • 54

NgVietAnh41/Qwen3-4b-it-test-VietMedQA-gguf

4B • Updated Dec 17, 2025 • 22

eigenben/llama-3-8b-bnb-4bit-alpaca-finetuned-gguf

8B • Updated Dec 17, 2025 • 32

TeichAI/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-GGUF

8B • Updated Dec 17, 2025 • 461 • 8

ajvikram/Qwen2.5-Coder-3B-Network-Eng-GGUF

3B • Updated Dec 17, 2025 • 56

lokegud/infrastructure-assistant-7b-gguf

8B • Updated Dec 18, 2025 • 43

jhewlin/Llama-3.1-8B

8B • Updated Dec 18, 2025 • 17

prithivMLmods/SAGE-MM-Qwen3-VL-4B-SFT-GGUF

Video-Text-to-Text • 4B • Updated Dec 20, 2025 • 1.29k • 1