zhiyucheng commited on
Commit
4e8e8a2
·
unverified ·
1 Parent(s): c3154a8
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -95,10 +95,10 @@ This model was obtained by converting and quantizing the weights and activations
95
  ## Usage
96
 
97
 
98
- To serve this checkpoint with [vLLM](https://github.com/vllm-project/vllm), you can start the docker `vllm/vllm-openai:latest` and run the sample command below:
99
 
100
  ```sh
101
- python3 -m vllm.entrypoints.openai.api_server --model nvidia/Kimi-K2-Thinking-NVFP4 --trust-remote-code --quantization modelopt_fp4
102
  ```
103
 
104
 
 
95
  ## Usage
96
 
97
 
98
+ To serve this checkpoint with [vLLM](https://github.com/vllm-project/vllm), you can start the docker `vllm/vllm-openai:v0.11.2` and run the sample command below:
99
 
100
  ```sh
101
+ python3 -m vllm.entrypoints.openai.api_server --model nvidia/Kimi-K2-Thinking-NVFP4 --trust-remote-code --tensor-parallel-size 4
102
  ```
103
 
104