Instructions to use mlx-community/Mistral-7B-Instruct-v0.3-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/Mistral-7B-Instruct-v0.3-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/Mistral-7B-Instruct-v0.3-8bit --local-dir Mistral-7B-Instruct-v0.3-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- b5678ab97ee0176868467c2cd8a87551350a07f613a901daee15d718d8b14045 (58c48a3001c13fcac617cb8e3473ea375ab33bf0) - f6c872d5ca30d2c9af96b24670062b3a7939f3e3b8ba64adc6fea1d2917886b2 (e59cfb90f7f3caf5c85927ed361d95aeed374d5a) - 62164b6a4e24e9857916d56c76065e7e0f5ae6f3bcca34f3b08b2f0646f2a0c9 (3a9532f08f2afbc598533a5e7680eb52c1b771d5)c282bcd