Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,033

Base only

Active filters: llama.cpp

mathensley/lfm2.5-it-ft-v2

1B • Updated Mar 3 • 23

MeridianVector/qwen3-5-4b-vision-gspo-v1-GGUF

4B • Updated Mar 3 • 71

youngoffcial/blink-bc-model-gguf

8B • Updated Mar 3 • 13

hinny/Qwen3.5-4B-GGUF-Q4_K_M

4B • Updated Mar 3 • 441

WithinUsAI/GPT5.1-High.Reasoning.Codex-0.4B-GGUF

Text Generation • 0.4B • Updated Mar 21 • 114 • 3

pihu21057w/kks

8B • Updated Mar 3 • 54

chhatramani/qwen3-1.7B_nyayalm_7legaltask_1e_GGUF

2B • Updated Mar 3 • 21

xXGioXx/sad_core_v1_q8

2B • Updated Mar 3 • 16

billylo/medgemma-1.5-4b-it-mmproj-gguf

0.4B • Updated Mar 3 • 66 • 1

Colby/Apertus-8B-openhermes-gguf

8B • Updated Mar 3 • 91

tarball0/ELF-Decompiler-GGUF

8B • Updated Apr 8 • 64

Hack337/Qwen3.5-4B-high-reasoning-GGUF

4B • Updated Mar 3 • 109

WithinUsAI/Qwen3-Qrazy.Qoder-0.6B-GGUF

Text Generation • 0.6B • Updated Mar 21 • 118 • 2

professoorr/cyber-qwen2.5-coder-7b-redteam-gguf

8B • Updated Mar 3 • 79

alibidaran/Qwen_fullstackAssist_GGUF

3B • Updated Mar 3 • 29

rjohal164/coachmode-llama31-8b-vbmi-q4km

8B • Updated Mar 4 • 29

mradermacher/notifai-lfm25-1.2b-GGUF

1B • Updated Mar 4 • 38

smpaz7467/my-custom-coder-qwen

8B • Updated Mar 4 • 14

bambuuai/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Mar 4 • 28

Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF

Text Generation • 12B • Updated Mar 4 • 1.44k • 11

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled

5B • Updated Mar 6 • 95 • 3

avalon2244/Qwen3.5-4B-Claude-Opus-4.6-Distilled-GGUF

4B • Updated Mar 6 • 539 • 9

titantv090/GLM-4.7-Flash-Claude-Opus-4.6-High-Reasoning-Distill-GGUF

30B • Updated Mar 4 • 1.06k • 1

manuojvv/Qwen3.5-4B-gabliterated-Q8

Text Generation • 4B • Updated Mar 4 • 205 • 1

tejasgowda05/Kanoonu-AI-Phi3-GGUF

4B • Updated Mar 12 • 35 • 1

marksverdhei/LCO-Embedding-Omni-7B-GGUF

Feature Extraction • 8B • Updated Mar 4 • 409 • 6

itryv/gwen-frontend-4b-GGUF

4B • Updated Mar 4 • 290

yanyao/roitium_echo

9B • Updated Mar 4 • 36

Redhanuman/Ankita-3B-Hinglish-v1-GGUF

3B • Updated Mar 4 • 21

marksverdhei/LCO-Embedding-Omni-3B-GGUF

Feature Extraction • 3B • Updated May 16 • 331 • 5