Instructions to use mlx-community/Mistral-Nemo-Base-2407-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Mistral-Nemo-Base-2407-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/Mistral-Nemo-Base-2407-4bit --local-dir Mistral-Nemo-Base-2407-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- d12f9fe9478cc3ccf977a7a4853410d75568c07b57994912fd6fc786c3b08c5d (541fd06e163667385447fa86687749c6ccd27aeb) - f1555fa5ad0bd9797ea1bf071c34ca5a6eaeb1f476e4d733a7370f25949aaf86 (d55cb63ee3294e3f128c0a876000deac40331639)cca2104