Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,045

Base only

Active filters: llama.cpp

itryv/gwen-frontend-4b-GGUF

4B • Updated Mar 4 • 290

yanyao/roitium_echo

9B • Updated Mar 4 • 36

Redhanuman/Ankita-3B-Hinglish-v1-GGUF

3B • Updated Mar 4 • 21

marksverdhei/LCO-Embedding-Omni-3B-GGUF

Feature Extraction • 3B • Updated May 16 • 331 • 5

ivanchaushiji/gemma-finetuned-ollama

0.3B • Updated Mar 4 • 21

Aakash098/ShinchanAI-small

Text Generation • 3B • Updated Mar 8 • 26

Lijr2002/e_emotion

8B • Updated Mar 6 • 21

madox81/SmolLM2-Cyber-Insight-GGUF

2B • Updated Mar 4 • 26

fjhghfghdfg/dotexeai

4B • Updated Mar 4 • 23

FloatDo/exaone-4.0-1.2b-float-right-tagger-GGUF

1B • Updated Mar 4 • 31

TheEpTic/IQuest-Coder-V1-7B-Instruct-GGUF

Text Generation • 8B • Updated Mar 4 • 39

TheEpTic/IQuest-Coder-V1-7B-Thinking-GGUF

Text Generation • 8B • Updated Mar 4 • 71 • 1

jimmm1212/my_expert_llama3

8B • Updated Mar 4 • 17

BricksDisplay/Soprano-1.1-80M-GGUF

Text-to-Speech • 30.4M • Updated Apr 30 • 144

chhatramani/nyayalm_v0.2_7task_GGUF

2B • Updated Mar 4 • 37

FloatDo/EXAONE-3.5-2.4B-Instruct-GGUF

2B • Updated Mar 4 • 22

FloatDo/EXAONE-3.5-7.8B-Instruct-GGUF

8B • Updated Mar 5 • 68

FloatDo/EXAONE-3.5-32B-Instruct-GGUF

32B • Updated Mar 5 • 34

FloatDo/EXAONE-Deep-7.8B-GGUF

8B • Updated Mar 5 • 41

FloatDo/EXAONE-Deep-32B-GGUF

32B • Updated Mar 5 • 24

rudycaz/qwen35-27b-phish-finetuned-gguf

Text Generation • 27B • Updated Mar 4 • 38

Phonepadith/gemma-3n-laos-fine-tuned

8B • Updated Mar 8 • 107

FloatDo/EXAONE-Deep-2.4B-GGUF

2B • Updated Mar 5 • 51

hans00/kani-tts-2-GGUF

Text-to-Speech • 68.6M • Updated May 2 • 72

AntoineChatry/mistral-7b-python

7B • Updated Mar 4 • 28

megabytes/Home-Qwen3.5-0.8B-v0-GGUF

Image-Text-to-Text • 0.8B • Updated Mar 4 • 217 • 1

zsjTiger/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated Mar 5 • 562 • 2

III111II1I1/Qwen3.5-9B-GGUF

9B • Updated Mar 5 • 55

smpaz7467/qwen3.5-9b-agency-architect

9B • Updated Mar 5 • 185

mammothsoft/test

8B • Updated Mar 5 • 20