Update README.md (#4)
Browse files- Update README.md (58d19a23dd96684a85ae7ff083abbc050ae94642)
Co-authored-by: Jimmy Shong <Jiminator@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -117,8 +117,7 @@ sglang serve \
|
|
| 117 |
--tool-call-parser poolside_v1 \
|
| 118 |
--tp 8 \
|
| 119 |
--host 0.0.0.0 \
|
| 120 |
-
--port 30000
|
| 121 |
-
--fp8-gemm-backend triton # Needed for SM100
|
| 122 |
```
|
| 123 |
#### TRT-LLM
|
| 124 |
|
|
|
|
| 117 |
--tool-call-parser poolside_v1 \
|
| 118 |
--tp 8 \
|
| 119 |
--host 0.0.0.0 \
|
| 120 |
+
--port 30000
|
|
|
|
| 121 |
```
|
| 122 |
#### TRT-LLM
|
| 123 |
|