Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,011

Base only

Active filters: llama.cpp

waqasm86/llcuda-models

Text Generation • 1.0B • Updated Dec 29, 2025 • 4

Christoferson/CHANGEDPROMPTqwen2.5-500M-grpo-after-sft-sys-cosine-3000-1e-5-20251229-203750-GGUF

0.5B • Updated Dec 29, 2025 • 12

brandtcormorant/Qwen3-4B-Base-unsloth-bnb-4bit-paperback-writer

4B • Updated Dec 30, 2025 • 44

gannima/AutoGLM-Phone-9B-Multilingual-GGUF

Text Generation • 9B • Updated Dec 30, 2025 • 214

prithivMLmods/KAIROS-MM-Qwen2.5-VL-SFT-GGUF

Video-Text-to-Text • 8B • Updated Dec 30, 2025 • 71 • 1

ermiaazarkhalili/Qwen2.5-0.5B-SFT-OpenHermes-2.5-100-GGUF

0.5B • Updated Apr 18 • 7

chengxuanyyy/NeuroWwise-V6-Expert-GGUF

8B • Updated Dec 30, 2025 • 21

WarlordHermes/Magidonia-24B-v4.3-creative-V4-GGUF-maybe-broken

24B • Updated Dec 30, 2025 • 26

Melikshah/gpt-oss-20b-clinical-cot-gguf

Text Generation • 21B • Updated Jun 5 • 846 • 4

RinKana/Qwen3-4B-Makisu-V2.0.1-GGUF

4B • Updated Dec 31, 2025 • 7

singlerr/qwen2.5-coder-mcmodding

8B • Updated Dec 30, 2025 • 8

ss-lab/LFM2-2.6B-Exp-GGUF

Text Generation • 3B • Updated Jan 11 • 13

Tristepin/qwn3gzdm4b-ins3

4B • Updated Dec 30, 2025 • 42

yhily/Llama-3.2-3B-bnb-4bit-3

3B • Updated Dec 30, 2025 • 10

winhsss/AOKO_V1

3B • Updated Jan 10 • 6

brandtcormorant/Qwen3-1.7B-Base-paperback-writer-GGUF

2B • Updated Dec 30, 2025 • 19

axelblenna/model_phi3_5_mini_instruct

4B • Updated Dec 31, 2025 • 11

svshrithik12/GPT2

Text Generation • 0.1B • Updated Dec 30, 2025 • 21

prithivMLmods/KAIROS-MM-Qwen2.5-VL-7B-SFT-GGUF-AIO-GGUF

Video-Text-to-Text • 8B • Updated Dec 30, 2025 • 126 • 1

WarlordHermes/QwenLong-creative-ORPO-v4-Q4_K_M-GGUF

31B • Updated Dec 30, 2025 • 2

nquangit/gemma-3-270m-http-classifier-update-gguf

0.3B • Updated Jan 2 • 32

Tristepin/qwn3gdt364b-ins1

4B • Updated Dec 31, 2025 • 49

dreambleumer/chaoyang-Qwen2.5-3B-Instruct-5828s-08891

3B • Updated Dec 31, 2025 • 12

axelblenna/model_phi_3

4B • Updated Dec 31, 2025 • 11

reboo13/llama-3

8B • Updated Jan 2 • 11

SakumyZ/qwen3-4b-fine-tuning

2B • Updated Dec 31, 2025 • 9

prithivMLmods/KAIROS-MM-Qwen2.5-VL-7B-RL-AIO-GGUF

Video-Text-to-Text • 8B • Updated Feb 3 • 292 • 2

hitty28/functiongemma-gguf

0.3B • Updated Dec 31, 2025 • 10

Fedir-Ilina/llama-3.2-1b-gguf

1B • Updated Feb 21 • 25

MuXodious/gemma-3n-E4B-it-absolute-heresy-imatrix-GGUF

Image-Text-to-Text • 7B • Updated Jan 21 • 46 • 2