Instructions to use rohithsiddhartha/DeepSeek-R1-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use rohithsiddhartha/DeepSeek-R1-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download rohithsiddhartha/DeepSeek-R1-4bit --local-dir DeepSeek-R1-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Update config.json
Verified signatureSetting the values to match with https://huggingface.co/mlx-community/DeepSeek-R1-4bit/blob/main/config.json2b78d8a
-
Update tokenizer_config.json
Verified signaturefrom https://huggingface.co/mlx-community/DeepSeek-V3-0324-4bit/raw/main/tokenizer_config.json as this is returning <|begin▁of▁sentence|><|User|>Write a story about a bird instead of <|begin▁of▁sentence|><|User|>Write a story about a bird<|Assistant|>efe85d9 -
Update tokenizer_config.json (#3)
Verified signature- Update tokenizer_config.json (a51d3afd9b1fa468ca9b4a3697eb821208f63a45)3cad899 -
Update config.json (#2)
Verified signature- Update config.json (94c86b4c948e0c3b46841332c2a233623e95e863)85cb9b9
-
Update configuration_deepseek.py (#1)
Verified signature- Update configuration_deepseek.py (ffea3b49c17574e3f645f158e303c1f4cfd0d4c3)b12eb46
-
adding files as per mlx and config from hf repo
rohith.bheemreddy01e1f1f -
initial commit
Verified signature7f31812