Edit Models filters

Model Tree

deepseek-ai/DeepSeek-V3-0324

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18

Base only

Active filters: jan, deepseek-ai/DeepSeek-V3-0324

bartowski/deepseek-ai_DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Apr 4, 2025 • 1.19k • 26

lmstudio-community/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Mar 25, 2025 • 831 • 12

DevQuasar/deepseek-ai.DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Mar 30, 2025 • 73 • 2

mmnga/DeepSeek-V3-0324-experts-pertok-4-gguf

671B • Updated Mar 25, 2025 • 17

MaziyarPanahi/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated Mar 25, 2025 • 53.8k • 23

unsloth/DeepSeek-V3-0324-GGUF

Text Generation • 671B • Updated May 22, 2025 • 4.59k • 200

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 81 • 36

tflsxyy/DeepSeek-V3-0324-MoE-Pruner-E160-IQ1_S

426B • Updated Apr 29, 2025 • 3 • 4

unsloth/DeepSeek-V3-0324-GGUF-UD

Text Generation • 671B • Updated Apr 28, 2025 • 1.68k • 23

Kebob/DeepSeek-V3-0324-IK_GGUF

671B • Updated Jul 6, 2025 • 34 • 1

bobchenyx/DeepSeek-V3-0324-MLA-GGUF

Text Generation • 671B • Updated Oct 20, 2025 • 3 • 2

gghfez/DeepSeek-V3-0324-IQ3_KS

Text Generation • 672B • Updated Jul 26, 2025 • 17 • 2

AmpereComputing/deepseek-v3-0324-gguf

671B • Updated Jul 28, 2025 • 3

gghfez/DeepSeek-V3-0324-IQ2_KS

Text Generation • 672B • Updated Oct 18, 2025 • 23

sokann/DeepSeek-V3-0324-GGUF

672B • Updated Jul 31, 2025 • 5

lmganon123/DeepSeek-V3-0324_IK_GGUF_Q2

672B • Updated Aug 17, 2025 • 3

moxin-org/DeepSeek-V3-0324-Moxin-GGUF

Text Generation • 671B • Updated Nov 30, 2025 • 79 • 8

Doctor-Shotgun/DeepSeek-V3-0324-GGUF

671B • Updated Dec 20, 2025 • 2