Update README.md
#4
by MackenzieNVIDIA - opened
README.md
CHANGED
|
@@ -101,7 +101,7 @@ The model version is FP4 QAD 1.0 and is quantized with nvidia-modelopt **v0.47.0
|
|
| 101 |
**Datasets:** GPQA Diamond, ToolEvalBench <br>
|
| 102 |
**Data Collection Method by dataset:** Hybrid: Automated, Manually-Collected <br>
|
| 103 |
**Labeling Method by dataset:** Hybrid: Manually-Labeled, Automated <br>
|
| 104 |
-
**Properties:** GPQA Diamond contains
|
| 105 |
|
| 106 |
The accuracy benchmark results are presented in the table below:
|
| 107 |
|
|
@@ -284,7 +284,7 @@ vllm serve nvidia/GLM-5.3-Flash-FP4-Local \
|
|
| 284 |
|
| 285 |
### 2 x NVIDIA RTX PRO 6000 Blackwell
|
| 286 |
|
| 287 |
-
vLLM container: [`ghcr.io/local-inference-lab/vllm:
|
| 288 |
|
| 289 |
Start the container. Set `HF_TOKEN` in the host environment first.
|
| 290 |
|
|
@@ -299,7 +299,7 @@ docker run --rm -it \
|
|
| 299 |
-e HF_TOKEN=$HF_TOKEN \
|
| 300 |
-v ~/.cache/huggingface:/root/.cache/huggingface \
|
| 301 |
--entrypoint /bin/bash \
|
| 302 |
-
ghcr.io/local-inference-lab/vllm:
|
| 303 |
```
|
| 304 |
|
| 305 |
Then launch vLLM inside the container:
|
|
|
|
| 101 |
**Datasets:** GPQA Diamond, ToolEvalBench <br>
|
| 102 |
**Data Collection Method by dataset:** Hybrid: Automated, Manually-Collected <br>
|
| 103 |
**Labeling Method by dataset:** Hybrid: Manually-Labeled, Automated <br>
|
| 104 |
+
**Properties:** GPQA Diamond contains 198 graduate-level multiple-choice questions written by domain experts in biology, physics, and chemistry. ToolEvalBench is a tool-calling quality benchmark that runs deterministic multi-turn agent scenarios against mock tools, scoring tool selection, parameter precision, multi-step chains, error recovery, and structured output. <br>
|
| 105 |
|
| 106 |
The accuracy benchmark results are presented in the table below:
|
| 107 |
|
|
|
|
| 284 |
|
| 285 |
### 2 x NVIDIA RTX PRO 6000 Blackwell
|
| 286 |
|
| 287 |
+
vLLM container: [`ghcr.io/local-inference-lab/vllm:release-10142026`](https://github.com/local-inference-lab/blackwell-llm-docker/pkgs/container/vllm)
|
| 288 |
|
| 289 |
Start the container. Set `HF_TOKEN` in the host environment first.
|
| 290 |
|
|
|
|
| 299 |
-e HF_TOKEN=$HF_TOKEN \
|
| 300 |
-v ~/.cache/huggingface:/root/.cache/huggingface \
|
| 301 |
--entrypoint /bin/bash \
|
| 302 |
+
ghcr.io/local-inference-lab/vllm:release-10142026
|
| 303 |
```
|
| 304 |
|
| 305 |
Then launch vLLM inside the container:
|