Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,368

Base only

Active filters: llama.cpp

andrelu08mj/btc-scalper-llama3

8B • Updated Jan 11 • 63 • 1

aakashrajput/Andy_Minecraft_Bot_GGUF

Updated Jan 11 • 31

Mathieu-Thomas-JOSSET/joke-finetome-model-gguf-phi4-20260111-113458

Text Generation • 1B • Updated Jan 11 • 109

Umesh1212/phi-3.5-k8s-troubleshoot-phi

4B • Updated Jan 11 • 25

dam2452/Qwen3-VL-Embedding-8B-GGUF

8B • Updated Jan 11 • 559 • 4

Capibara-LLM/Llama-3.1-8B-it-Jopara-GGUF

8B • Updated Jan 11 • 15

WeihuaAI/Gemma3-270-TsundereLadyDemo

0.3B • Updated Jan 11 • 15

dainlieu/qsolv-qwen2.5-coder-7b-gguf

8B • Updated Jan 11 • 33

khengkok/model

4B • Updated Jan 11 • 20

jayanthanc/cali-3-12b-ndr-gguf

12B • Updated Jan 11 • 28

affanshaikhsurab/Qwen3-0.6B-GPQA-Diamond-CoT-GGUF

0.6B • Updated Jan 11 • 137

ali12wsa/Arabic-Fasih-Model-GGUF

8B • Updated Jan 16 • 17

bayhaqieee/qwen2-7b-nlaw-gguf

8B • Updated Apr 6 • 38

Tristepin/clktm25pqwn34b-ins2

4B • Updated Jan 11 • 19

Tanoshi6428/llama-3-8b-GGUF

8B • Updated Jan 12 • 26

nzros/DevNexAI-v1-Pro

8B • Updated Jan 12 • 10

colossus2000/takumimodel_gguf

8B • Updated Jan 12 • 10

khengkok/mental_health_gguf_model

4B • Updated Jan 12 • 11

Mathieu-Thomas-JOSSET/joke-finetome-model-gguf-phi4-20260112-081758

Text Generation • 15B • Updated Jan 12 • 39

subodh624/k8s-phi3.5-train-trobleshoot

4B • Updated Jan 12 • 51

Stormtrooperaim/llama2-13b-lemon-GGUF

13B • Updated Jan 12 • 128

okinosan/tunacantweet_260112

4B • Updated Jan 12 • 12

Tristepin/uzdpqwn34b-ins2

4B • Updated Jan 12 • 22

Mathieu-Thomas-JOSSET/joke-finetome-model-gguf-phi4-20260112-114159

Text Generation • 8B • Updated Jan 12 • 62

AOUNZakaria/llama3-8b-function-calling-gguf

8B • Updated Jan 12 • 16

YGV/The_Dirt_V1

8B • Updated Jan 12 • 15

elliotthwang/Llama-3.1-8B-GGUF

8B • Updated Jan 12 • 22

dreambleumer/Qwen2.5-3B-Chinese-DPO-GGUF

3B • Updated Jan 12 • 15

Tristepin/uzdpqwn34b-ins3

4B • Updated Jan 12 • 22

chhatramani/Qwen3-4B-civillaw-En-Ne-v2-gguf

4B • Updated Jan 12 • 29