Edit Models filters

Model Tree

Qwen/Qwen3-4B-Thinking-2507

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

135

Base only

Active filters: Qwen/Qwen3-4B-Thinking-2507

elichen-skymizer/Qwen3-4B-Thinking-2507-Q5_K_M-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 6

elichen-skymizer/Qwen3-4B-Thinking-2507-Q6_K-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 72 • 1

elichen-skymizer/Qwen3-4B-Thinking-2507-Q8_0-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 3

Eslzzyl/Qwen3-4B-Thinking-2507-AWQ

Text Generation • 4B • Updated Aug 12, 2025 • 32 • 1

Mungert/Jan-v1-4B-GGUF

Text Generation • 4B • Updated Sep 24, 2025 • 188

mradermacher/Qwen3-4B-Thinking-2507-GGUF

4B • Updated Aug 15, 2025 • 91 • 1

mradermacher/Qwen3-4B-Thinking-2507-i1-GGUF

4B • Updated Dec 9, 2025 • 221

brokilone/Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 17, 2025 • 55 • 1

AdvRahul/Axion-Thinking-4B

4B • Updated Oct 7, 2025 • 40

adeelahmad/ReasonableQwen3-4B

Text Generation • 4B • Updated Mar 30 • 197 • • 6

ertghiu256/Qwen3-4B-Thinking-2507-Hermes-3

4B • Updated Sep 1, 2025 • 176 • 2

driaforall/mem-agent-mlx-4bit

Text Generation • 0.6B • Updated Sep 9, 2025 • 93 • 5

JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4

Text Generation • 4B • Updated Sep 4, 2025 • 96 • 1

JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int8

Text Generation • 4B • Updated Sep 4, 2025 • 2 • 2

driaforall/mem-agent-mlx-8bit

Text Generation • 1B • Updated Sep 9, 2025 • 4 • 2

DevQuasar/Qwen.Qwen3-4B-Thinking-2507-NVFP4A16

Text Generation • 3B • Updated Sep 4, 2025 • 7

remodlai/Qwen3-4B-Thinking-2507-Nova-fp8

4B • Updated Sep 6, 2025 • 2

AmpereComputing/qwen-3-4b-2507-thinking-gguf

4B • Updated Sep 11, 2025 • 7

quelmap/Lightning-4b-GGUF

Text Generation • 4B • Updated Sep 20, 2025 • 134 • 1

quelmap/Lightning-4b-GGUF-short-ctx

Text Generation • 4B • Updated Sep 20, 2025 • 160 • 1

ggml-org/Qwen3-4B-Thinking-2507-Q8_0-GGUF

Text Generation • 4B • Updated Sep 22, 2025 • 145 • 2

itroot/Qwen3-4B-Thinking-2507-W8A8

Text Generation • 4B • Updated Sep 24, 2025 • 16

SandLogicTechnologies/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Sep 29, 2025 • 52

steampunque/Qwen3-4B-Thinking-2507-MP-GGUF

4B • Updated Apr 22 • 11 • 2

fcampanini74/mem-agent-4B-Q4-K-M-GGUF

4B • Updated Oct 12, 2025 • 8

RepublicOfKorokke/Qwen3-4B-Thinking-2507-mlx-mxfp4

Text Generation • 0.8B • Updated Oct 17, 2025 • 8

pramjana/Qwen3-4B-Thinking-2507-4bit-GPTQ

Text Generation • 4B • Updated Oct 30, 2025 • 3

suvadeep29/Luna-4B-thinking

Text Generation • 4B • Updated Oct 22, 2025 • 50 • 2

Alcoft/Qwen_Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Oct 22, 2025 • 2.74k

DevQuasar/Qwen.Qwen3-4B-Thinking-2507_nvfp4

Text Generation • 2B • Updated Oct 22, 2025 • 6