Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -101,7 +101,7 @@ The model version is FP4 QAD 1.0 and is quantized with nvidia-modelopt **v0.47.0
101
  **Datasets:** GPQA Diamond, ToolEvalBench <br>
102
  **Data Collection Method by dataset:** Hybrid: Automated, Manually-Collected <br>
103
  **Labeling Method by dataset:** Hybrid: Manually-Labeled, Automated <br>
104
- **Properties:** GPQA Diamond contains 448 graduate-level multiple-choice questions written by domain experts in biology, physics, and chemistry. ToolEvalBench is a tool-calling quality benchmark that runs deterministic multi-turn agent scenarios against mock tools, scoring tool selection, parameter precision, multi-step chains, error recovery, and structured output. <br>
105
 
106
  The accuracy benchmark results are presented in the table below:
107
 
@@ -284,7 +284,7 @@ vllm serve nvidia/GLM-5.3-Flash-FP4-Local \
284
 
285
  ### 2 x NVIDIA RTX PRO 6000 Blackwell
286
 
287
- vLLM container: [`ghcr.io/local-inference-lab/vllm:karmic-kraken`](https://github.com/local-inference-lab/blackwell-llm-docker/pkgs/container/vllm)
288
 
289
  Start the container. Set `HF_TOKEN` in the host environment first.
290
 
@@ -299,7 +299,7 @@ docker run --rm -it \
299
  -e HF_TOKEN=$HF_TOKEN \
300
  -v ~/.cache/huggingface:/root/.cache/huggingface \
301
  --entrypoint /bin/bash \
302
- ghcr.io/local-inference-lab/vllm:karmic-kraken
303
  ```
304
 
305
  Then launch vLLM inside the container:
 
101
  **Datasets:** GPQA Diamond, ToolEvalBench <br>
102
  **Data Collection Method by dataset:** Hybrid: Automated, Manually-Collected <br>
103
  **Labeling Method by dataset:** Hybrid: Manually-Labeled, Automated <br>
104
+ **Properties:** GPQA Diamond contains 198 graduate-level multiple-choice questions written by domain experts in biology, physics, and chemistry. ToolEvalBench is a tool-calling quality benchmark that runs deterministic multi-turn agent scenarios against mock tools, scoring tool selection, parameter precision, multi-step chains, error recovery, and structured output. <br>
105
 
106
  The accuracy benchmark results are presented in the table below:
107
 
 
284
 
285
  ### 2 x NVIDIA RTX PRO 6000 Blackwell
286
 
287
+ vLLM container: [`ghcr.io/local-inference-lab/vllm:release-10142026`](https://github.com/local-inference-lab/blackwell-llm-docker/pkgs/container/vllm)
288
 
289
  Start the container. Set `HF_TOKEN` in the host environment first.
290
 
 
299
  -e HF_TOKEN=$HF_TOKEN \
300
  -v ~/.cache/huggingface:/root/.cache/huggingface \
301
  --entrypoint /bin/bash \
302
+ ghcr.io/local-inference-lab/vllm:release-10142026
303
  ```
304
 
305
  Then launch vLLM inside the container: