Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,945

Base only

Active filters: llama.cpp

Acvarius-AI/GhostLlama

1B • Updated Mar 3 • 1

DylM0nster22/qwen_finetune

4B • Updated Mar 2 • 6

Ellbendls/Omnisec1-4b-Thinking-GGUF

4B • Updated Mar 2 • 11

MeridianVector/gemma3-4b-vision-gspo-GGUF

4B • Updated Mar 2 • 153

moxin-org/Qwen3.5-27B-GGUF

Image-Text-to-Text • Updated Mar 2

mustafaulas/brs

8B • Updated Mar 2 • 12

Ellbendls/Omnisec1-1.2b-Thinking-GGUF

1B • Updated Mar 2 • 17

fweyh/spinoza-qwen3-8b-gguf

8B • Updated Mar 2 • 13

nvlan/ndc_finetune

8B • Updated Mar 8 • 18

ibitato/c64-ministral-3-14b-thinking-c64-reasoning-gguf

Text Generation • 14B • Updated Mar 2 • 13

prithivMLmods/Qwen3.5-2B-f32-GGUF

Image-Text-to-Text • 2B • Updated Mar 3 • 445 • 1

prithivMLmods/Qwen3.5-0.8B-f32-GGUF

Image-Text-to-Text • 0.8B • Updated Mar 3 • 295 • 1

NrengifoBTS/redactoria-v3-gold

8B • Updated Mar 6 • 8

prithivMLmods/Qwen3.5-4B-f32-GGUF

Image-Text-to-Text • 4B • Updated Mar 3 • 896 • 1

prithivMLmods/Qwen3.5-9B-f32-GGUF

Image-Text-to-Text • 9B • Updated Mar 3 • 1.14k • 2

mathensley/lfm2.5-it-ft-gguf

1B • Updated Mar 2 • 16

AlexStepanenko/llama-3.2-B-Instruct-bnb-4bit-demo

3B • Updated Mar 2 • 46

haidar038/tte-ai-assistant-gguf

8B • Updated Mar 2 • 16

AleRo96/Qwen3_14B_v2

15B • Updated Mar 2 • 10

thewillofdee/my-coder-model

8B • Updated Mar 3 • 9

rjohal164/coachmode-llama32-1b-vbmi-q4km

1B • Updated Mar 3 • 11

albertlieadrian/qwen3-0.6b-codeforces-sft-gguf

0.8B • Updated Mar 3 • 2

MeridianVector/gemma3-4b-vision-gspo-v6-GGUF

4B • Updated Mar 3 • 108

Ex0bit/Qwen3.5-PRISM-Dynamic-Quant-GGUF

Text Generation • 0.8B • Updated Mar 3 • 660 • 10

daydreamwarrior/Nemotron-Research-GooseReason-4B-Instruct-heretic

4B • Updated Mar 17 • 48 • 1

doncoriolan/sec-summarizer-gemma3-gguf

4B • Updated Mar 3 • 36

ai-colombia/qwen3-job-searcher-gguf

8B • Updated Mar 3 • 12

lolilolikon/deepseek_test

8B • Updated Mar 3 • 66

2796gauravc/notifai-lfm25-1.2b

1B • Updated Mar 3 • 14

Basti83/german-support-qwen-gguf

3B • Updated Mar 3 • 61