How to use Kadins/BiliBot-7B-Q with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download Kadins/BiliBot-7B-Q --local-dir BiliBot-7B-Q
https://huggingface.co/Kadins/BiliBot-7B-Q/resolve/main/tokenizer.json
hf download hf://Kadins/BiliBot-7B-Q/tokenizer.json
curl -L -o tokenizer.json https://huggingface.co/Kadins/BiliBot-7B-Q/resolve/main/tokenizer.json
