Instructions to use mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit --local-dir DeepSeek-R1-Distill-Llama-8B-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Update tokenizer_config.json
Verified signaturee23907a -
Update tokenizer_config.json
Verified signaturebe05283
-
Upload folder using huggingface_hub (#1)
Verified signature- b0530322329378d5c35d119cf3e36d572283a8fb95d9dbe0f46bcdbe4fe90988 (27e8fd1a51658663b4b065de188a7d9893279028) - cd81e49490d03863725a69a0434634aae6c2ab4255a1ecf0d4dd8b7026744f5c (dcc8ae9fad2c53813f14259a6605fd3124eed251)b6d70cd -
initial commit
Verified signature3bf2b83