Instructions to use mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download mlx-community/DeepSeek-R1-Distill-Llama-70B-8bit --local-dir DeepSeek-R1-Distill-Llama-70B-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub (#1)
Verified signature- 41fb4cbe35cd05ff7cb26d898515a5d6e842c47475234bea7020b881964b45d2 (fc1bb1c9ad72913356ac06034e243dee0e234ad5) - e94fc46cb5d387de628cff08f0c128ad6308a570b4858537bcdeda2cac557ec1 (43471dfbd3012b45ac46b3052456fa9d88059bf0) - 8e7838087afb0cc0b6458c26ced7c94729f823028299fee9485bbbf9be2b58e5 (40cc08304f40fea51eff072bafe6c2a31b3a46be) - 4ce9ecc2db4f98bdb43d1d3c416c7320982f7f515ca192ff27b0ebf8dc79e6c6 (f12ca4fff9965bb0ef5c5ca01761240a794924b6) - 7b54a0d2de045782ce6ac14a1e18069c8118a4f56a0e2ee2e6517a987b131573 (1f8166d1911f08b7be910f713d5e4aefc5ee32e6) - 6e5bf91509573ee834f00b2503b6918102478537024307f8504e1d2c79466318 (273aa3859e6df91c49f622575f5c431a0560013e) - a255e3942ee83d2583124e942ab308a1f19eadbac3b9474215cf1f78bb7daf92 (a13853b73971d2c9d08c79542042d820fd7efd15) - a1851f0235b4ef8f5aa19ce35c67243c7f84aa9c37b6715058084a361d617660 (98de0e3a5aaac7d4d7e481181b973e6f69b07422) - 26505fa0796cbce5f37242ce5d8575f7fc8caa1a2594a4fe24c0c166144c499d (bf0982e5eedb2f6ee8562b2b5c006d6fa18c5c40) - 83a2600f…e2d7c57