Instructions to use DevQuasar-14/microsoft.MAI-DS-R1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use DevQuasar-14/microsoft.MAI-DS-R1-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M

Build from source code

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama cli -hf DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M

Use Docker

docker model run hf.co/DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M

Llama new
LM Studio
Jan

vLLM

How to use DevQuasar-14/microsoft.MAI-DS-R1-GGUF with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "DevQuasar-14/microsoft.MAI-DS-R1-GGUF"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DevQuasar-14/microsoft.MAI-DS-R1-GGUF",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M

Ollama
How to use DevQuasar-14/microsoft.MAI-DS-R1-GGUF with Ollama:
```
ollama run hf.co/DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use DevQuasar-14/microsoft.MAI-DS-R1-GGUF with Docker Model Runner:
```
docker model run hf.co/DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M
```

Lemonade

How to use DevQuasar-14/microsoft.MAI-DS-R1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull DevQuasar-14/microsoft.MAI-DS-R1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.microsoft.MAI-DS-R1-GGUF-Q4_K_M

List all available models

lemonade list

Atomic Chat

microsoft.MAI-DS-R1-GGUF / .gitattributes

Commit History

May 2, 2025

23:24
Upload microsoft.MAI-DS-R1.Q4_K_M-00011-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
b0ca799

Apr 30, 2025

07:48
Upload microsoft.MAI-DS-R1.Q4_K_M-00031-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
226a99c
07:34
Upload microsoft.MAI-DS-R1.Q4_K_M-00030-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
15230ba
06:16
Upload microsoft.MAI-DS-R1.Q4_K_M-00029-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
c215efc
05:04
Upload microsoft.MAI-DS-R1.Q4_K_M-00028-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
bf3440e
03:44
Upload microsoft.MAI-DS-R1.Q4_K_M-00027-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
06c21a2
02:27
Upload microsoft.MAI-DS-R1.Q4_K_M-00026-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
44b20f2
01:01
Upload microsoft.MAI-DS-R1.Q4_K_M-00025-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
9d9c277

Apr 29, 2025

23:33
Upload microsoft.MAI-DS-R1.Q4_K_M-00024-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
978bdbc
22:07
Upload microsoft.MAI-DS-R1.Q4_K_M-00023-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
70ad086
20:44
Upload microsoft.MAI-DS-R1.Q4_K_M-00022-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
ffaee1b
19:15
Upload microsoft.MAI-DS-R1.Q4_K_M-00021-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
34e3261
17:48
Upload microsoft.MAI-DS-R1.Q4_K_M-00020-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
6107390
16:28
Upload microsoft.MAI-DS-R1.Q4_K_M-00019-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
6aa5d06
14:59
Upload microsoft.MAI-DS-R1.Q4_K_M-00018-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
ab74af1
13:32
Upload microsoft.MAI-DS-R1.Q4_K_M-00017-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
2618fc8
12:50
Upload microsoft.MAI-DS-R1.Q4_K_M-00016-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
29522ba
12:06
Upload microsoft.MAI-DS-R1.Q4_K_M-00015-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
d027821
11:21
Upload microsoft.MAI-DS-R1.Q4_K_M-00014-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
6fcf906
10:40
Upload microsoft.MAI-DS-R1.Q4_K_M-00013-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
eb0cf5b
09:56
Upload microsoft.MAI-DS-R1.Q4_K_M-00012-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
701e8bf
08:11
Upload microsoft.MAI-DS-R1.Q4_K_M-00010-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
cea7992
07:06
Upload microsoft.MAI-DS-R1.Q4_K_M-00009-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
079c3f4
06:14
Upload microsoft.MAI-DS-R1.Q4_K_M-00008-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
9077cc9
05:17
Upload microsoft.MAI-DS-R1.Q4_K_M-00007-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
98d8c2a
04:24
Upload microsoft.MAI-DS-R1.Q4_K_M-00006-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
653591b
03:11
Upload microsoft.MAI-DS-R1.Q4_K_M-00005-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
db7f16e
02:16
Upload microsoft.MAI-DS-R1.Q4_K_M-00004-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
f63886e
01:13
Upload microsoft.MAI-DS-R1.Q4_K_M-00003-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
2a2f459
00:10
Upload microsoft.MAI-DS-R1.Q4_K_M-00002-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
07a9394

Apr 28, 2025

23:17
Upload microsoft.MAI-DS-R1.Q4_K_M-00001-of-00031.gguf with huggingface_hub

csabakecskemeti

Verified signature
78f7138
15:19
Upload microsoft.MAI-DS-R1.Q3_K_S-00021-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
b871853
14:37
Upload microsoft.MAI-DS-R1.Q3_K_S-00020-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
63bcf6a
10:37
Upload microsoft.MAI-DS-R1.Q3_K_S-00022-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
24323ff
08:46
Upload microsoft.MAI-DS-R1.Q3_K_S-00019-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
7a674f6
08:04
Upload microsoft.MAI-DS-R1.Q3_K_S-00018-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
26b84e5
07:22
Upload microsoft.MAI-DS-R1.Q3_K_S-00017-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
e3375bf
06:39
Upload microsoft.MAI-DS-R1.Q3_K_S-00016-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
3bd8ca4
05:57
Upload microsoft.MAI-DS-R1.Q3_K_S-00015-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
68cea97
05:15
Upload microsoft.MAI-DS-R1.Q3_K_S-00014-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
62bf1b2
04:33
Upload microsoft.MAI-DS-R1.Q3_K_S-00013-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
ad7ab66
03:42
Upload microsoft.MAI-DS-R1.Q3_K_S-00012-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
80a2dbf
03:00
Upload microsoft.MAI-DS-R1.Q3_K_S-00011-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
1161f90
02:16
Upload microsoft.MAI-DS-R1.Q3_K_S-00010-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
ae46c42
01:32
Upload microsoft.MAI-DS-R1.Q3_K_S-00009-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
f301d58
00:49
Upload microsoft.MAI-DS-R1.Q3_K_S-00008-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
87bd180
00:06
Upload microsoft.MAI-DS-R1.Q3_K_S-00007-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
4fc2501

Apr 27, 2025

23:23
Upload microsoft.MAI-DS-R1.Q3_K_S-00006-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
e3084ab
22:39
Upload microsoft.MAI-DS-R1.Q3_K_S-00005-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
a9a86f3
21:57
Upload microsoft.MAI-DS-R1.Q3_K_S-00004-of-00022.gguf with huggingface_hub

csabakecskemeti

Verified signature
83225e8

Commit History

May 2, 2025

Upload microsoft.MAI-DS-R1.Q4_K_M-00011-of-00031.gguf with huggingface_hub

Apr 30, 2025

Upload microsoft.MAI-DS-R1.Q4_K_M-00031-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00030-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00029-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00028-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00027-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00026-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00025-of-00031.gguf with huggingface_hub

Apr 29, 2025

Upload microsoft.MAI-DS-R1.Q4_K_M-00024-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00023-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00022-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00021-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00020-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00019-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00018-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00017-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00016-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00015-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00014-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00013-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00012-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00010-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00009-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00008-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00007-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00006-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00005-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00004-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00003-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q4_K_M-00002-of-00031.gguf with huggingface_hub

Apr 28, 2025

Upload microsoft.MAI-DS-R1.Q4_K_M-00001-of-00031.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00021-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00020-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00022-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00019-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00018-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00017-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00016-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00015-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00014-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00013-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00012-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00011-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00010-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00009-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00008-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00007-of-00022.gguf with huggingface_hub

Apr 27, 2025

Upload microsoft.MAI-DS-R1.Q3_K_S-00006-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00005-of-00022.gguf with huggingface_hub

Upload microsoft.MAI-DS-R1.Q3_K_S-00004-of-00022.gguf with huggingface_hub