Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,012

Base only

Active filters: llama.cpp

yurifacanha/Lllama8B_llmquoter

8B • Updated Jan 19 • 33

saisumanthb/GordonAI-3B-v19

3B • Updated Jan 19 • 5

abvashis/travel-agent-llama3-gguf

8B • Updated Jan 19 • 17

yurifacanha/Qwen4B_llmquoter

4B • Updated Jan 19 • 16

jiminaa/Llama-3.2-1B-Instruct-language-lora

1B • Updated Jan 19 • 2

dikcej/llama3-hukum-indo-forrag-v1

8B • Updated Jan 20 • 12

uaebn/leesplank-municipal-GGUF

Text Generation • 2B • Updated Jan 22 • 4

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 466 • 5

jonatasgomes/llama3-sql-pt-finetune

8B • Updated Jan 19 • 12

RuiLi2023/medical-o1-reasoning-lora

8B • Updated Jan 23 • 16

VishwanathAS/Qwen2.5-VLA_Drive-GGUF

3B • Updated Jan 20 • 16

Sudharta/sudharta-experiment

3B • Updated Jan 20 • 11

developerasaad/Qwen3-0.6B

0.8B • Updated Jan 20 • 14

Mathieu-Thomas-JOSSET/qwen2.5-3b-instruct-text-gguf-20260120_095909

3B • Updated Jan 20 • 11

Mathieu-Thomas-JOSSET/qwen2.5-3b-instruct-text-gguf-20260120_111441

3B • Updated Jan 20 • 15

jsdevtom/qwen2.5-coder-7b-ts-fim-autocomplete-defuss-gguf

8B • Updated Jan 20 • 715 • 1

MuXodious/gemma-3n-E4B-it-absolute-heresy-MPOA-imatrix-GGUF

Image-Text-to-Text • 7B • Updated Jan 20 • 135

VishwanathAS/Qwen3-VL-Driver-GGUF

2B • Updated Jan 20 • 27

Soumyajit2000/bucktlist-agent-gguf

4B • Updated Feb 26 • 18

viplav0009/chandler-bing-3.2-1B-gguf

1B • Updated Jan 20 • 9

JesusAura999/Senik-3B-V1-GGUF

3B • Updated Jan 20 • 17

ukung/qwen3-4B-finetune-sintesis-dataset

4B • Updated Jan 20 • 7

JesusAura999/Senik-3B-Thinker-GGUF

3B • Updated Jan 20 • 16

AfkaraLP/gemma-3-270M-coralmc-9500it-v06

0.3B • Updated Jan 20 • 5

ngocquy2004/Qwen3-4B-Instruct-FineTuned-GGUF

4B • Updated Apr 19 • 11

chukypedro/Niajalingo-Qwen2.5-0.5B-GGUF

0.5B • Updated Jan 20 • 37

VijayRam1812/gemma3-1b-query-optimizer

1.0B • Updated Jan 21 • 14

terasut/typhoon-si-med-thinking-4b-research-preview-GGUF

Text Generation • 4B • Updated Jan 21 • 10

VishwanathAS/Qwen3-VL-Driver-GGUF_v2

2B • Updated Jan 21 • 16

sunkencity/survival-expert-qwen-32b-gguf

33B • Updated Jan 21 • 28