minor
Browse files
README.md
CHANGED
|
@@ -95,10 +95,10 @@ This model was obtained by converting and quantizing the weights and activations
|
|
| 95 |
## Usage
|
| 96 |
|
| 97 |
|
| 98 |
-
To serve this checkpoint with [vLLM](https://github.com/vllm-project/vllm), you can start the docker `vllm/vllm-openai:
|
| 99 |
|
| 100 |
```sh
|
| 101 |
-
python3 -m vllm.entrypoints.openai.api_server --model nvidia/Kimi-K2-Thinking-NVFP4 --trust-remote-code --
|
| 102 |
```
|
| 103 |
|
| 104 |
|
|
|
|
| 95 |
## Usage
|
| 96 |
|
| 97 |
|
| 98 |
+
To serve this checkpoint with [vLLM](https://github.com/vllm-project/vllm), you can start the docker `vllm/vllm-openai:v0.11.2` and run the sample command below:
|
| 99 |
|
| 100 |
```sh
|
| 101 |
+
python3 -m vllm.entrypoints.openai.api_server --model nvidia/Kimi-K2-Thinking-NVFP4 --trust-remote-code --tensor-parallel-size 4
|
| 102 |
```
|
| 103 |
|
| 104 |
|