Instructions to use mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/Nemotron-Mini-4B-Instruct-4bit-mlx --local-dir Nemotron-Mini-4B-Instruct-4bit-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload tokenizer_config.json with huggingface_hub
Verified signatureb578419 -
Upload tokenizer.json with huggingface_hub
Verified signaturec07c3c8 -
Upload model.safetensors.index.json with huggingface_hub
Verified signature334b164 -
Upload model.safetensors with huggingface_hub
Verified signature20c51ab
-
Upload config.json with huggingface_hub
Verified signature90f0e77 -
Upload chat_template.jinja with huggingface_hub
Verified signature4ff0687 -
Upload README.md with huggingface_hub
Verified signatureaf2c835 -
initial commit
Verified signature1c0595e