Edit Models filters

Model Tree

Qwen/Qwen3-4B-Thinking-2507

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

135

Base only

Active filters: Qwen/Qwen3-4B-Thinking-2507

PantheonUnbound/Satyr-V0.1-4B

4B • Updated Oct 12, 2025 • 8.74k • 187

Qwen/Qwen3-4B-Thinking-2507-FP8

Text Generation • 4B • Updated Aug 6, 2025 • 211k • 66

lmstudio-community/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 15.2k • 24

lmstudio-community/Qwen3-4B-Thinking-2507-MLX-4bit

Text Generation • 0.6B • Updated Aug 6, 2025 • 51k • 14

lmstudio-community/Qwen3-4B-Thinking-2507-MLX-5bit

Text Generation • 0.8B • Updated Aug 6, 2025 • 68 • 1

lmstudio-community/Qwen3-4B-Thinking-2507-MLX-6bit

Text Generation • 0.9B • Updated Aug 6, 2025 • 49.9k • 2

lmstudio-community/Qwen3-4B-Thinking-2507-MLX-8bit

Text Generation • 1B • Updated Aug 6, 2025 • 50.2k • 8

gabriellarson/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 47

bartowski/Qwen_Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 3.04k • 18

mlx-community/Qwen3-4B-Thinking-2507-4bit

Text Generation • 0.6B • Updated Aug 6, 2025 • 806 • 4

mlx-community/Qwen3-4B-Thinking-2507-5bit

Text Generation • 0.8B • Updated Aug 6, 2025 • 9 • 1

mlx-community/Qwen3-4B-Thinking-2507-6bit

Text Generation • 0.9B • Updated Aug 6, 2025 • 15

mlx-community/Qwen3-4B-Thinking-2507-8bit

Text Generation • 1B • Updated Aug 6, 2025 • 23

ArtusDev/Qwen_Qwen3-4B-Thinking-2507-EXL3

Updated Aug 6, 2025

cyankiwi/Qwen3-4B-Thinking-2507-AWQ-4bit

Text Generation • 4B • Updated 5 days ago • 671 • 5

warshanks/Qwen3-4B-Thinking-2507-AWQ

Text Generation • 4B • Updated Aug 6, 2025 • 5 • 1

prithivMLmods/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 6, 2025 • 165 • 1

unsloth/Qwen3-4B-Thinking-2507-GGUF

4B • Updated Sep 11, 2025 • 4.82k • 103

unsloth/Qwen3-4B-Thinking-2507-unsloth-bnb-4bit

Text Generation • 4B • Updated Aug 6, 2025 • 5.21k • 2

unsloth/Qwen3-4B-Thinking-2507-bnb-4bit

Text Generation • 4B • Updated Aug 6, 2025 • 634 • 2

DevQuasar/Qwen.Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 7, 2025 • 16

taobao-mnn/Qwen3-4B-Thinking-2507-MNN

Text Generation • Updated Aug 7, 2025 • 44 • 1

mmnga/Qwen3-4B-Thinking-2507-gguf

4B • Updated Aug 7, 2025 • 104

Rivaidan/Qwen3-4B-Thinking-2507-Q8_0-GGUF

Text Generation • 4B • Updated Aug 7, 2025 • 6

ALYTV/Qwen3-4B-Thinking-2507-mlx-4bit

Text Generation • 0.6B • Updated Aug 7, 2025 • 7

cyankiwi/Qwen3-4B-Thinking-2507-AWQ-8bit

Text Generation • 2B • Updated 5 days ago • 274 • 4

saneowl/Qwen3-4B-Thinking-2507-Q5_K_S-GGUF

Text Generation • 4B • Updated Aug 8, 2025 • 7

giladgd/Qwen3-4B-Thinking-2507-GGUF

Text Generation • 4B • Updated Aug 9, 2025 • 285

elichen-skymizer/Qwen3-4B-Thinking-2507-Q3_K_M-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 5

elichen-skymizer/Qwen3-4B-Thinking-2507-Q4_K_M-GGUF

Text Generation • 4B • Updated Aug 12, 2025 • 46