Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,529

Base only

Active filters: llama-cpp

Kondara/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 28, 2024 • 2.3k • 4

ggml-org/Qwen2.5-Coder-7B-Q8_0-GGUF

Text Generation • 8B • Updated Oct 28, 2024 • 2.38k • 13

sheldonrobinson/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF

Text Generation • 2B • Updated Nov 4, 2024 • 428 • 1

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 2.26k • 16

kenonix/Phi-4-mini-instruct-abliterated-Q5_K_M-GGUF

Text Generation • 4B • Updated Mar 6, 2025 • 266 • 1

sabafallah/bge-reranker-v2-m3-Q4_K_M-GGUF

Text Ranking • 0.6B • Updated Apr 2, 2025 • 56 • 2

firoz123/codegemma-2b-Q4_K_M-GGUF

3B • Updated Apr 25, 2025 • 34 • 1

Aldaris/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 8.75k • 7

Bouquets/StrikeGPT-R1-Zero-8B

8B • Updated Jun 12, 2025 • 131 • 9

tinh2406/full_llama2_split_merged-Q4_K_M-GGUF

7B • Updated Jun 11, 2025 • 7 • 1

xmanii/gemma-270m-persian-Q4_K_M-GGUF

0.3B • Updated Aug 15, 2025 • 103 • 2

Growcompany/SmolLM2-360M-Q4_K_M-GGUF

0.4B • Updated Aug 19, 2025 • 11 • 1

enacimie/LFM2-700M-Q4_K_M-GGUF

Text Generation • 0.7B • Updated Sep 10, 2025 • 58 • 1

AL-DN/medical-llm-mistral7B-F16-GGUF

Text Generation • 6.82M • Updated Sep 23, 2025 • 19 • 1

kozynthetaquito/Dolphin-Mistral-24B-Venice-Edition-exl2-6bpw-Q4_K_M-GGUF

Text Generation • Updated Oct 16, 2025 • 85 • 1

ErenAta00/CaptureTheFlag-CypherMindLLM-XRLAB-GGUF

Text Generation • 8B • Updated Nov 18, 2025 • 4.62k • 7

richardyoung/Qwen2.5-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated 5 days ago • 5.15k • 3

straino/Qwen3-Coder-30B-A3B-Instruct-AWQ-4bit-Q4_K_M-GGUF

Text Generation • 31B • Updated Dec 9, 2025 • 497 • 3

enacimie/Qwen3-0.6B-Q4_K_M-GGUF

Text Generation • 0.8B • Updated Dec 23, 2025 • 746 • 4

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 209 • 6

jinaai/jina-embeddings-v5-text-small-clustering

Feature Extraction • 0.6B • Updated Apr 15 • 2.56k • 8

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated Apr 15 • 117k • 13

jinaai/jina-embeddings-v5-text-nano-retrieval-GGUF

Sentence Similarity • 0.2B • Updated Feb 27 • 4.53k • 4

AYI-NEDJIMI/CyberSec-Assistant-3B-GGUF

Text Generation • 3B • Updated Feb 21 • 1.3k • 5

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 584 • 10

aashish1904/Qwen3.5-2B-Base-GGUF

Text Generation • 2B • Updated Mar 2 • 868 • 3

Abiray/zembed-1-Q4_K_M-GGUF

Feature Extraction • 4B • Updated Mar 11 • 212 • 5

mtrpires/Qwen3.5-35B-A3B-IQK-RPi5-16GB

Text Generation • 35B • Updated Mar 28 • 171 • 1

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 2.21k • 22

Abiray/gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

Text Generation • 31B • Updated Apr 6 • 906 • 12