Image-Text-to-Text
Transformers
Safetensors
English
gamescaling
game-agent
embodied-agent
keyboard-mouse
continued-pretraining
qwen3_5
Instructions to use THUSI-Lab/GameScaling with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use THUSI-Lab/GameScaling with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="THUSI-Lab/GameScaling")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("THUSI-Lab/GameScaling", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use THUSI-Lab/GameScaling with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "THUSI-Lab/GameScaling" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "THUSI-Lab/GameScaling", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/THUSI-Lab/GameScaling
- SGLang
How to use THUSI-Lab/GameScaling with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "THUSI-Lab/GameScaling" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "THUSI-Lab/GameScaling", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "THUSI-Lab/GameScaling" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "THUSI-Lab/GameScaling", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use THUSI-Lab/GameScaling with Docker Model Runner:
docker model run hf.co/THUSI-Lab/GameScaling
Model card: no-wrap names and affiliations, narrower file tree
Browse files
README.md
CHANGED
|
@@ -24,13 +24,14 @@ tags:
|
|
| 24 |
# Scaling in Games: Continued Pre-Training for Embodied Agents in Diverse Virtual Worlds
|
| 25 |
|
| 26 |
<p align="center" style="line-height:1.5;margin:0.4em 0 0.3em;">
|
| 27 |
-
<b>Kuan Zhang</b><sup>1,2,*,β‘</sup>, <b>Yukun Chen</b><sup>1,3,*,β‘</sup>, <b>Zhihao Yang</b><sup>1,3,*,β‘</sup>, Yue Su<sup>4</sup>, Xiangnan Wu<sup>3</sup>, Zirong Chen<sup>2</sup>, Run Luo<sup>1,5,β‘</sup>, Jinkun Hou<sup>6</sup>, Tao Tan<sup>1</sup>, <b>Yinhe Zheng</b><sup>1,β </sup>, <b>Yiming Li</b><sup>2,β </sup>
|
| 28 |
</p>
|
| 29 |
|
| 30 |
-
<p align="center" style="font-size:0.85em;line-height:1.
|
| 31 |
-
<sup>1</sup>miHoYo Honkai AI R&D Team <sup>2</sup>College AI, Tsinghua University <sup>3</sup>University of Chinese Academy of Sciences <sup>4</sup>MMLab, The University of Hong Kong <sup>5</sup>National University of Singapore <sup>6</sup>Peking University<br>
|
| 32 |
-
<sup>*</sup>Equal contribution <sup>β </sup>Corresponding author <sup>β‘</sup>Work done while interning at miHoYo
|
| 33 |
</p>
|
|
|
|
| 34 |
<p align="center">
|
| 35 |
<img src="https://huggingface.co/THUSI-Lab/GameScaling/resolve/main/assets/logos/affiliations.png" alt="miHoYo Β· Tsinghua University Β· University of Chinese Academy of Sciences Β· The University of Hong Kong" width="100%" style="width:100%;max-width:100%;">
|
| 36 |
</p>
|
|
@@ -84,15 +85,15 @@ training code. Paper results and analysis are on the [project page](https://game
|
|
| 84 |
|
| 85 |
```text
|
| 86 |
THUSI-Lab/GameScaling
|
| 87 |
-
βββ models/
|
| 88 |
-
β βββ 0p8b_s1_1600h_gs6736/
|
| 89 |
-
β β βββ config.json
|
| 90 |
-
β β βββ model.safetensors
|
| 91 |
-
β β βββ chat_template.jinja
|
| 92 |
β β βββ tokenizer.json
|
| 93 |
β β βββ tokenizer_config.json
|
| 94 |
β β βββ generation_config.json
|
| 95 |
-
β β βββ preprocessor_config.json
|
| 96 |
β β βββ processor_config.json
|
| 97 |
β β βββ video_preprocessor_config.json
|
| 98 |
β βββ 0p8b_s3_1600h_gs6760/
|
|
@@ -103,22 +104,18 @@ THUSI-Lab/GameScaling
|
|
| 103 |
β βββ 27b_s1_1600h_gs6995/
|
| 104 |
β βββ 27b_s3_1600h_gs7020/
|
| 105 |
βββ prompts/
|
| 106 |
-
β βββ system_prompt_template.txt
|
| 107 |
-
β βββ example_doom_battle1.txt
|
| 108 |
-
βββ gamescaling/
|
| 109 |
-
β βββ
|
| 110 |
-
β βββ
|
| 111 |
-
β βββ
|
| 112 |
-
β
|
| 113 |
-
|
| 114 |
-
βββ
|
| 115 |
-
|
| 116 |
-
βββ
|
| 117 |
-
|
| 118 |
-
βββ assets/ images used in this card
|
| 119 |
-
βββ requirements.txt client dependencies
|
| 120 |
-
βββ LICENSE Apache License 2.0
|
| 121 |
-
βββ README.md
|
| 122 |
```
|
| 123 |
|
| 124 |
## 1. Download and serve
|
|
|
|
| 24 |
# Scaling in Games: Continued Pre-Training for Embodied Agents in Diverse Virtual Worlds
|
| 25 |
|
| 26 |
<p align="center" style="line-height:1.5;margin:0.4em 0 0.3em;">
|
| 27 |
+
<span style="white-space:nowrap;"><b>Kuan Zhang</b><sup>1,2,*,β‘</sup></span>, <span style="white-space:nowrap;"><b>Yukun Chen</b><sup>1,3,*,β‘</sup></span>, <span style="white-space:nowrap;"><b>Zhihao Yang</b><sup>1,3,*,β‘</sup></span>, <span style="white-space:nowrap;">Yue Su<sup>4</sup></span>, <span style="white-space:nowrap;">Xiangnan Wu<sup>3</sup></span>, <span style="white-space:nowrap;">Zirong Chen<sup>2</sup></span>, <span style="white-space:nowrap;">Run Luo<sup>1,5,β‘</sup></span>, <span style="white-space:nowrap;">Jinkun Hou<sup>6</sup></span>, <span style="white-space:nowrap;">Tao Tan<sup>1</sup></span>, <span style="white-space:nowrap;"><b>Yinhe Zheng</b><sup>1,β </sup></span>, <span style="white-space:nowrap;"><b>Yiming Li</b><sup>2,β </sup></span>
|
| 28 |
</p>
|
| 29 |
|
| 30 |
+
<p align="center" style="font-size:0.85em;line-height:1.5;margin:0 0 0.6em;">
|
| 31 |
+
<span style="white-space:nowrap;"><sup>1</sup>miHoYo Honkai AI R&D Team</span> <span style="white-space:nowrap;"><sup>2</sup>College AI, Tsinghua University</span> <span style="white-space:nowrap;"><sup>3</sup>University of Chinese Academy of Sciences</span> <span style="white-space:nowrap;"><sup>4</sup>MMLab, The University of Hong Kong</span> <span style="white-space:nowrap;"><sup>5</sup>National University of Singapore</span> <span style="white-space:nowrap;"><sup>6</sup>Peking University</span><br>
|
| 32 |
+
<span style="white-space:nowrap;"><sup>*</sup>Equal contribution</span> <span style="white-space:nowrap;"><sup>β </sup>Corresponding author</span> <span style="white-space:nowrap;"><sup>β‘</sup>Work done while interning at miHoYo</span>
|
| 33 |
</p>
|
| 34 |
+
|
| 35 |
<p align="center">
|
| 36 |
<img src="https://huggingface.co/THUSI-Lab/GameScaling/resolve/main/assets/logos/affiliations.png" alt="miHoYo Β· Tsinghua University Β· University of Chinese Academy of Sciences Β· The University of Hong Kong" width="100%" style="width:100%;max-width:100%;">
|
| 37 |
</p>
|
|
|
|
| 85 |
|
| 86 |
```text
|
| 87 |
THUSI-Lab/GameScaling
|
| 88 |
+
βββ models/ eight checkpoints, one folder each
|
| 89 |
+
β βββ 0p8b_s1_1600h_gs6736/
|
| 90 |
+
β β βββ config.json Qwen3.5 architecture, bfloat16
|
| 91 |
+
β β βββ model.safetensors weights (27B: 2 shards + index)
|
| 92 |
+
β β βββ chat_template.jinja required, renders history turns
|
| 93 |
β β βββ tokenizer.json
|
| 94 |
β β βββ tokenizer_config.json
|
| 95 |
β β βββ generation_config.json
|
| 96 |
+
β β βββ preprocessor_config.json
|
| 97 |
β β βββ processor_config.json
|
| 98 |
β β βββ video_preprocessor_config.json
|
| 99 |
β βββ 0p8b_s3_1600h_gs6760/
|
|
|
|
| 104 |
β βββ 27b_s1_1600h_gs6995/
|
| 105 |
β βββ 27b_s3_1600h_gs7020/
|
| 106 |
βββ prompts/
|
| 107 |
+
β βββ system_prompt_template.txt standard prompt, 3 slots (Β§2)
|
| 108 |
+
β βββ example_doom_battle1.txt filled-in example
|
| 109 |
+
βββ gamescaling/ inference client
|
| 110 |
+
β βββ prompt.py system prompt builders
|
| 111 |
+
β βββ policy.py client, presets, request body
|
| 112 |
+
β βββ action.py action format and parser
|
| 113 |
+
β βββ keymaps.py key names <-> browser keys
|
| 114 |
+
βββ scripts/serve_vllm.sh start a vLLM server
|
| 115 |
+
βββ tests/test_core.py offline tests (no GPU)
|
| 116 |
+
βββ assets/ images for this card
|
| 117 |
+
βββ requirements.txt client deps: requests, Pillow
|
| 118 |
+
βββ LICENSE Apache 2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
| 119 |
```
|
| 120 |
|
| 121 |
## 1. Download and serve
|