How to use nishide-dev/RakutenAI-7B-chat-mlx-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download nishide-dev/RakutenAI-7B-chat-mlx-4bit --local-dir RakutenAI-7B-chat-mlx-4bit
https://huggingface.co/nishide-dev/RakutenAI-7B-chat-mlx-4bit/resolve/main/tokenizer.json
hf download hf://nishide-dev/RakutenAI-7B-chat-mlx-4bit/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/nishide-dev/RakutenAI-7B-chat-mlx-4bit/resolve/main/tokenizer.json
