Commit ·
76348dd
1
Parent(s): cd3243f
Update README.md (#6)
Browse files- Update README.md (1f4e11683ae0a60b4e6fedfee1bcd3460e35d4c2)
Co-authored-by: Luke Alonso <lukealonso@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -139,6 +139,16 @@ This checkpoint requires community vLLM containers (provided in cooperation with
|
|
| 139 |
|
| 140 |
vLLM container: [`eugr/spark-vllm-b12x:latest`](https://hub.docker.com/r/eugr/spark-vllm-b12x/tags?name=latest)
|
| 141 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 142 |
Start the container on both nodes. Set `HF_TOKEN` in the host environment, and set the network values below to match your setup.
|
| 143 |
|
| 144 |
```sh
|
|
|
|
| 139 |
|
| 140 |
vLLM container: [`eugr/spark-vllm-b12x:latest`](https://hub.docker.com/r/eugr/spark-vllm-b12x/tags?name=latest)
|
| 141 |
|
| 142 |
+
One step launcher:
|
| 143 |
+
|
| 144 |
+
```sh
|
| 145 |
+
git clone https://github.com/eugr/spark-vllm-docker
|
| 146 |
+
cd spark-vllm-docker
|
| 147 |
+
./run-recipe.sh recipes/glm-5.3-flash.yaml --setup
|
| 148 |
+
```
|
| 149 |
+
|
| 150 |
+
Manual launch:
|
| 151 |
+
|
| 152 |
Start the container on both nodes. Set `HF_TOKEN` in the host environment, and set the network values below to match your setup.
|
| 153 |
|
| 154 |
```sh
|