Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,040

Base only

Active filters: llama.cpp

Acvarius-AI/GhostLlama

1B • Updated Mar 3 • 9

DylM0nster22/qwen_finetune

4B • Updated Mar 2 • 33

Ellbendls/Omnisec1-4b-Thinking-GGUF

4B • Updated Mar 2 • 61

MeridianVector/gemma3-4b-vision-gspo-GGUF

4B • Updated Mar 2 • 82

moxin-org/Qwen3.5-27B-GGUF

Image-Text-to-Text • Updated Mar 2

mustafaulas/brs

8B • Updated Mar 2 • 19

Ellbendls/Omnisec1-1.2b-Thinking-GGUF

1B • Updated Mar 2 • 22

fweyh/spinoza-qwen3-8b-gguf

8B • Updated Mar 2 • 17

nvlan/ndc_finetune

8B • Updated Mar 8 • 31

ibitato/c64-ministral-3-14b-thinking-c64-reasoning-gguf

Text Generation • 14B • Updated Mar 2 • 98

prithivMLmods/Qwen3.5-2B-f32-GGUF

Image-Text-to-Text • 2B • Updated Mar 3 • 403 • 1

prithivMLmods/Qwen3.5-0.8B-f32-GGUF

Image-Text-to-Text • 0.8B • Updated Mar 3 • 451 • 1

NrengifoBTS/redactoria-v3-gold

8B • Updated Mar 6 • 30

prithivMLmods/Qwen3.5-4B-f32-GGUF

Image-Text-to-Text • 4B • Updated Mar 3 • 1k • 1

prithivMLmods/Qwen3.5-9B-f32-GGUF

Image-Text-to-Text • 9B • Updated Mar 3 • 870 • 3

mathensley/lfm2.5-it-ft-gguf

1B • Updated Mar 2 • 18

AlexStepanenko/llama-3.2-B-Instruct-bnb-4bit-demo

3B • Updated Mar 2 • 68

haidar038/tte-ai-assistant-gguf

8B • Updated Mar 2 • 14

AleRo96/Qwen3_14B_v2

15B • Updated Mar 2 • 13

thewillofdee/my-coder-model

8B • Updated Mar 3 • 29

rjohal164/coachmode-llama32-1b-vbmi-q4km

1B • Updated Mar 3 • 17

albertlieadrian/qwen3-0.6b-codeforces-sft-gguf

0.8B • Updated Mar 3 • 17

Jackrong/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Image-Text-to-Text • 9B • Updated Jul 9 • 17.2k • 359

MeridianVector/gemma3-4b-vision-gspo-v6-GGUF

4B • Updated Mar 3 • 83

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated Mar 3 • 766 • 11

daydreamwarrior/Nemotron-Research-GooseReason-4B-Instruct-heretic

4B • Updated Mar 17 • 111 • 1

doncoriolan/sec-summarizer-gemma3-gguf

4B • Updated Mar 3 • 52

ai-colombia/qwen3-job-searcher-gguf

8B • Updated Mar 3 • 16

lolilolikon/deepseek_test

8B • Updated Mar 3 • 63

2796gauravc/notifai-lfm25-1.2b

1B • Updated Mar 3 • 14