File size: 2,317 Bytes
be26d7f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
---
license: apache-2.0
base_model: Qwen/Qwen3.8-27B
pipeline_tag: image-text-to-text
library_name: transformers
tags:
  - robotics
  - humanoid
  - tool-use
---

# HITCH

The models of [HITCH](https://hitch.axell.top): vision-language models that operate a Unitree G1 humanoid
through the HITCH harness's tools. Both are fine-tuned from Qwen3.8-27B and answer without a reasoning trace.

[Project page](https://hitch.axell.top) · [Paper](https://arxiv.org/abs/2611.08039) · [Code](https://github.com/Axellwppr/HITCH)

| Folder | Model |
| --- | --- |
| `HITCH-27B/` | trained on the harness's task families; the model we run on the real robot |
| `HITCH-27B-SIMPLE/` | trained on the task families together with trajectories of the SIMPLE benchmark tasks |

## Use

Install vLLM 0.31.0 (CUDA 12.9 build), download one folder and serve it under the name `hitch`:

```bash
uv pip install --torch-backend cu129 \
  'https://github.com/vllm-project/vllm/releases/download/v0.31.0/vllm-0.31.0%2Bcu129-cp38-abi3-manylinux_2_28_x86_64.whl'
hf download Axellwppr/HITCH --include "HITCH-27B/*" --local-dir hitch
vllm serve hitch/HITCH-27B --served-model-name hitch --port 8000 \
  --dtype bfloat16 --gpu-memory-utilization 0.80 --max-model-len 262144 \
  --max-num-seqs 4 --max-num-batched-tokens 8192 \
  --limit-mm-per-prompt '{"image":512,"video":0}' \
  --reasoning-parser qwen3 --enable-auto-tool-choice --tool-call-parser qwen3_coder \
  --default-chat-template-kwargs '{"preserve_thinking":true,"reasoning_effort":"medium"}' \
  --enable-prefix-caching
```

These are the settings of our evaluations; with less GPU memory, add `--tensor-parallel-size 2` or more.

Then, in the [HITCH repository](https://github.com/Axellwppr/HITCH):

```bash
scripts/agent run tabletop_pick --backend hitch --seed 0 --viewer
```

## Licence

Apache-2.0, as the base model.

## Citation

```bibtex
@misc{lu2026hitch,
  title         = {{HITCH}: Teaching a Vision-Language Model to Operate a Humanoid through a Whole-Body Harness},
  author        = {Lu, Qingzhou and Liu, Chenxin and Wang, Xinming and Cao, Liu and Guo, Yanjiang and Xu, Mengdi and Chen, Jianyu},
  year          = {2026},
  eprint        = {2611.08039},
  archivePrefix = {arXiv},
  primaryClass  = {cs.RO},
  url           = {https://arxiv.org/abs/2611.08039}
}
```