Edit Models filters

Model Tree

Qwen/Qwen2.5-7B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

222

Base only

Active filters: ollama, Qwen/Qwen2.5-7B-Instruct

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 20, 2024 • 77.4k • 169

paultimothymooney/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 18, 2024 • 6.15k • 4

mradermacher/Qwen2.5-7B-Instruct-i1-GGUF

8B • Updated Oct 11, 2024 • 1.78k • 2

QuantFactory/Qwen2.5-7B-Instruct-Uncensored-GGUF

Text Generation • 8B • Updated Oct 19, 2024 • 26.7k • 27

Mungert/VulnLLM-R-7B-GGUF

Text Generation • 8B • Updated Feb 17 • 2.35k • 4

pbhappliedsystems/qwen-2.5-7B-instruct-gguf-Q4-K-M

8B • Updated May 5 • 150 • 2

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 118k • 69

lmstudio-community/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 23.4k • 7

paultimothymooney/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Sep 18, 2024 • 168

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 18, 2024 • 60.1k • 11

second-state/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 562

gaianet/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 273

legraphista/Qwen2.5-7B-Instruct-IMat-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 579

raaedk/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 21, 2024 • 978

WSDW/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 21, 2024 • 290 • 1

mukel/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Apr 28, 2025 • 58 • 1

idasummer/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Sep 24, 2024 • 2.86k • 1

QuantFactory/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • 8B • Updated Sep 25, 2024 • 3.05k • 10

mradermacher/Qwen2.5-7B-Instruct-GGUF

8B • Updated Aug 1, 2025 • 731 • 4

aswqazx/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Sep 27, 2024 • 28

Kondara/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 27, 2024 • 38

Kondara/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Sep 28, 2024 • 41

mashima/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 1, 2024 • 18

QuantFactory/Replete-LLM-V2.5-Qwen-7b-GGUF

8B • Updated Oct 2, 2024 • 143 • 1

jacobcarajo/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Oct 2, 2024 • 24

redhat6/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 4, 2024 • 29

turingevo/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 4, 2024 • 18

TheRains/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 9, 2024 • 101

sheldonrobinson/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Oct 10, 2024 • 22

Junrui2021/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 15, 2024 • 22