Edit Models filters

Model Tree

nvidia/Nemotron-Mini-4B-Instruct

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

29

Base only

Active filters: nvidia/Nemotron-Mini-4B-Instruct

NikolayKozloff/Nemotron-Mini-4B-Instruct-Q8_0-GGUF

4B • Updated Sep 13, 2024 • 47 • 2

bartowski/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Sep 13, 2024 • 2.81k • 21

abiks/Nemotron-Mini-4B-Instruct-GGUF-Q8

4B • Updated Sep 14, 2024 • 22 • 3

second-state/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Aug 29, 2025 • 983 • 1

gaianet/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Sep 15, 2024 • 197

Felladrin/gguf-Q5_K_L-Nemotron-Mini-4B-Instruct

4B • Updated Sep 16, 2024 • 25

Felladrin/gguf-Q5_K_M-Nemotron-Mini-4B-Instruct

4B • Updated Sep 16, 2024 • 67

Solshine/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Sep 18, 2024 • 22

DevQuasar-5/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Dec 4, 2024 • 266

WSDW/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Sep 30, 2024 • 22

jairo/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

4B • Updated Oct 5, 2024 • 16

MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 698 • 1

nvidia/Nemotron-Mini-4B-Instruct-ONNX-INT4

Updated Nov 18, 2024 • 9

mradermacher/Nemotron-Mini-4B-Instruct-GGUF

4B • Updated Feb 15, 2025 • 531

mradermacher/Nemotron-Mini-4B-Instruct-i1-GGUF

4B • Updated Feb 15, 2025 • 921

performanceoptician/Nemotron-Mini-4B-Instruct-IQ4_NL-GGUF

4B • Updated Nov 26, 2024 • 18

performanceoptician/Nemotron-Mini-4B-Instruct-IQ4_XS-GGUF

4B • Updated Nov 26, 2024 • 29

mitulagr2/gguf-Q5_K_M-Nemotron-Mini-4B-Instruct

4B • Updated Jan 21, 2025 • 74

DevQuasar-7/nvidia.Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Feb 17, 2025 • 544 • 1

BernTheCreator/Nemotron-Mini-4B-Instruct-Q4_0-GGUF

Text Generation • 4B • Updated Mar 6, 2025 • 26

itlwas/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 19, 2025 • 33

tensorblock/nvidia_Nemotron-Mini-4B-Instruct-GGUF

Text Generation • 4B • Updated Jan 27 • 192

jalasoft/nemotron-mini-4B-it-ft-typ

Text Generation • Updated Dec 17, 2025 • 23

DuoNeural/NVIDIA-Nemotron-3-Nano-4B-GGUF

4B • Updated Apr 30 • 165

mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx

4B • Updated May 5 • 283

TerraNTR/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated May 6 • 21

Snapkitty/snapkitty-nemotron

Text Generation • 4B • Updated 3 days ago • 37

Snapkitty/snapkitty-harness

Text Generation • 4B • Updated 3 days ago • 42

SiriusLLM/Sirius-N4-GGUF

Text Generation • 4B • Updated 5 days ago • 130