Instructions to use mradermacher/DeepSeek-R1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mradermacher/DeepSeek-R1-GGUF with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mradermacher/DeepSeek-R1-GGUF", device_map="auto") - Notebooks
- Google Colab
- Kaggle
auto-patch README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ quantized_by: mradermacher
|
|
| 16 |
static quants of https://huggingface.co/deepseek-ai/DeepSeek-R1
|
| 17 |
|
| 18 |
<!-- provided-files -->
|
| 19 |
-
weighted/imatrix quants
|
| 20 |
## Usage
|
| 21 |
|
| 22 |
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
|
|
|
| 16 |
static quants of https://huggingface.co/deepseek-ai/DeepSeek-R1
|
| 17 |
|
| 18 |
<!-- provided-files -->
|
| 19 |
+
weighted/imatrix quants are available at https://huggingface.co/mradermacher/DeepSeek-R1-i1-GGUF
|
| 20 |
## Usage
|
| 21 |
|
| 22 |
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|