How to use mlx-community/Mistral-Nemo-Instruct-2407-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/Mistral-Nemo-Instruct-2407-4bit --local-dir Mistral-Nemo-Instruct-2407-4bit
https://huggingface.co/mlx-community/Mistral-Nemo-Instruct-2407-4bit/resolve/main/tokenizer.json
hf download hf://mlx-community/Mistral-Nemo-Instruct-2407-4bit/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/mlx-community/Mistral-Nemo-Instruct-2407-4bit/resolve/main/tokenizer.json
