Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,906

Base only

Active filters: llama.cpp

shivaprasadks/Llama-3.2-3B-Buffett-Reasoning-v1-GGUF

3B • Updated Mar 14 • 11

Sunngttssu/enterprise-support-bot

8B • Updated Mar 14 • 17

Mero-dev/Ageis-model

8B • Updated Mar 19 • 20

ramgovindv/mindcall_llama3_gguf

3B • Updated Mar 14 • 7

morningwould/llama3-bespin-gguf

8B • Updated Mar 14 • 12

NamrataThakur/llama31-8bn_Reinforcement-Fine-Tuned

Question Answering • 8B • Updated Mar 14 • 33

wangzhang/Qwen3.5-122B-A10B-abliterated-GGUF

Text Generation • 122B • Updated Mar 30 • 54 • 7

bagusm/gemma-3-12b-it-heretic

lszczuro/Bielik-1.5B-v3.0-Instruct-polish-riddles-gguf

2B • Updated Mar 14 • 146

machinadeusex/Qwen3.5-Thinking-AIO-GGUF

Image-Text-to-Text • 0.8B • Updated Mar 14 • 138

robcorey/model

8B • Updated Mar 15 • 9

Daga2001/Llama-70B-God-Tier-GGUF

Text Generation • 71B • Updated Mar 15 • 12

chai1208/Qwen3.5-35B-A3B-patent-Q8_0-GGUF

35B • Updated Mar 15 • 254

chhatramani/nyayalm-6legaltaskrag_qwen3-4B-Q4_K_M-GGUF

4B • Updated Mar 15 • 6

NicolasSaba/Clone_Nicolas_V1

8B • Updated Mar 15 • 7

apache256/qwen_finetune

0.8B • Updated Mar 15 • 9

RamRamki/medical-phi3

4B • Updated Mar 15 • 73 • 1

mrrobots18/gguf-poc-alignment-nullderef

32 • Updated Mar 15

JIULANG/unsloth-Qwen3.5-4B-Instruct-CitationMarker-GGUG

4B • Updated Mar 15 • 332

SALEETAI/Medical-Llama-3-GGUF

4B • Updated Mar 15 • 8

Pruthvirahul/astramind-gguf

3B • Updated Jun 11 • 33

qingyi26/GGUF_clip_memory_corruption

1 • Updated Mar 15

qingyi26/GGUF_semantic_output_manipulation

chhatramani/nyayalm-civilcode_qwen3-4B_2e_GGUF

4B • Updated Mar 15 • 6

ia-espirita/riv-ai

Text Generation • 8B • Updated May 4 • 67 • 5

ishmaifan/patent-sum-llama3.2-3b-gguf

3B • Updated Mar 16 • 30

drissea-ai/drissy-qwen3.5-2b-GGUF

Image-Text-to-Text • 2B • Updated Mar 16 • 53 • 2

rkumar70900/qwen2.5-1.5b-gguf-experiments

Text Generation • 2B • Updated Mar 15 • 12

asazot/gemma_ft_q4_k_m

0.3B • Updated Mar 16 • 13

N-Bot-Int/SmolSam3-GGUF

3B • Updated Mar 16 • 11