Add model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,97 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
pretty_name: WebHarbor-4B
|
| 5 |
+
library_name: sglang
|
| 6 |
+
pipeline_tag: image-text-to-text
|
| 7 |
+
base_model: OpenWebRL/OpenWebRL-4B-SFT
|
| 8 |
+
datasets:
|
| 9 |
+
- ChilleD/WebHarbor
|
| 10 |
+
tags:
|
| 11 |
+
- webharbor
|
| 12 |
+
- web-agent
|
| 13 |
+
- gui-agent
|
| 14 |
+
- computer-use-agents
|
| 15 |
+
- reinforcement-learning
|
| 16 |
+
- qwen3-vl
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
<h1 align="center">WebHarbor: Docking Real Websites for Evolving GUI Agent Environments</h1>
|
| 20 |
+
|
| 21 |
+
<h2 align="center">WebHarbor-4B Model</h2>
|
| 22 |
+
|
| 23 |
+
<p align="center">
|
| 24 |
+
<a href="https://aiming-lab.github.io/WebHarbor/"><img src="https://img.shields.io/badge/Project-Page-0A7EA4.svg" alt="Project Page"></a>
|
| 25 |
+
<a href="https://github.com/aiming-lab/WebHarbor"><img src="https://img.shields.io/badge/Code-GitHub-181717.svg" alt="Code"></a>
|
| 26 |
+
<a href="https://huggingface.co/datasets/ChilleD/WebHarbor"><img src="https://img.shields.io/badge/๐ค-153_Environments-yellow.svg" alt="153 Environments"></a>
|
| 27 |
+
<a href="https://hub.docker.com/r/wildawm/webharbor"><img src="https://img.shields.io/badge/Docker-wildawm%2Fwebharbor-2496ED.svg" alt="Docker Images"></a>
|
| 28 |
+
</p>
|
| 29 |
+
|
| 30 |
+
<p align="left">
|
| 31 |
+
<b>WebHarbor-4B</b> is a GUI web agent trained with reinforcement learning entirely inside <a href="https://aiming-lab.github.io/WebHarbor/">WebHarbor</a>, 153 executable reconstructions of real websites with logins, carts, bookings and 3,518 tasks. It never touches the live web during RL training, yet it transfers there: it reaches a <b>75.8</b> average on WebVoyager and Online-Mind2Web, the best among the open-source web agents compared. The model is a 4B <a href="https://huggingface.co/Qwen/Qwen3-VL-4B-Thinking">Qwen3-VL</a> policy that starts from OpenWebRL-4B-SFT and acts through the <a href="https://github.com/OpenWebRL/OpenWebRL">OpenWebRL</a> browser interface.
|
| 32 |
+
</p>
|
| 33 |
+
|
| 34 |
+
---
|
| 35 |
+
|
| 36 |
+
## ๐ฎ Resources
|
| 37 |
+
|
| 38 |
+
| Resource | Link |
|
| 39 |
+
|---|---|
|
| 40 |
+
| ๐ Project page | [WebHarbor](https://aiming-lab.github.io/WebHarbor/) |
|
| 41 |
+
| ๐ป Code (environments, evaluation) | [WebHarbor repository](https://github.com/aiming-lab/WebHarbor) |
|
| 42 |
+
| ๐ฆ Environments | [ChilleD/WebHarbor](https://huggingface.co/datasets/ChilleD/WebHarbor) |
|
| 43 |
+
| ๐ณ Docker images | [wildawm/webharbor](https://hub.docker.com/r/wildawm/webharbor) |
|
| 44 |
+
| ๐ค WebHarbor-4B | [ChilleD/WebHarbor-4B](https://huggingface.co/ChilleD/WebHarbor-4B) |
|
| 45 |
+
|
| 46 |
+
## โจ Highlights
|
| 47 |
+
|
| 48 |
+
| Benchmark | OpenWebRL-4B-SFT | OpenWebRL-4B | **WebHarbor-4B** |
|
| 49 |
+
|---|:---:|:---:|:---:|
|
| 50 |
+
| WebVoyager | 60.2 | 74.1 | **81.2** |
|
| 51 |
+
| Online-Mind2Web | 47.0 | 67.0 | **70.4** |
|
| 52 |
+
| WebArena | 26.1 | 20.4 | **28.8** |
|
| 53 |
+
| WebArena without auto-login | 21.2 | 16.8 | **26.1** |
|
| 54 |
+
| WebHarbor test set | 29.1 | 19.7 | **30.0** |
|
| 55 |
+
|
| 56 |
+
- **Live web from offline training:** a 75.8 average on WebVoyager and Online-Mind2Web, ahead of GPT-5 (74.2) and every listed open-source agent.
|
| 57 |
+
- **Strongest on real-world workflows:** the largest gains are on logins, multi-page navigation, stateful operations and transactions, the workflows that live-web training rarely covers.
|
| 58 |
+
- **Unseen sites and tasks:** all 15 WebVoyager websites are held out of training, and Online-Mind2Web and WebArena tasks are not in the training data.
|
| 59 |
+
|
| 60 |
+
## ๐ฆ Setup
|
| 61 |
+
|
| 62 |
+
```bash
|
| 63 |
+
uv pip install "sglang==0.5.6.post2"
|
| 64 |
+
```
|
| 65 |
+
|
| 66 |
+
## ๐ฅ Serving
|
| 67 |
+
|
| 68 |
+
A single-GPU launch with the 32K context used in our evaluation:
|
| 69 |
+
|
| 70 |
+
```bash
|
| 71 |
+
python -m sglang.launch_server \
|
| 72 |
+
--model-path ChilleD/WebHarbor-4B \
|
| 73 |
+
--served-model-name webharbor-4b \
|
| 74 |
+
--host 0.0.0.0 --port 30000 \
|
| 75 |
+
--dtype bfloat16 \
|
| 76 |
+
--context-length 32768 \
|
| 77 |
+
--mem-fraction-static 0.9 \
|
| 78 |
+
--trust-remote-code \
|
| 79 |
+
--attention-backend flashinfer \
|
| 80 |
+
--mm-attention-backend triton_attn
|
| 81 |
+
```
|
| 82 |
+
|
| 83 |
+
This exposes an OpenAI-compatible Chat Completions endpoint at `http://localhost:30000/v1`. The chat template already opens the `<think>` block, so clients should not add their own. For the browser harness and to evaluate on WebHarbor, see the [WebHarbor repository](https://github.com/aiming-lab/WebHarbor).
|
| 84 |
+
|
| 85 |
+
## Citation
|
| 86 |
+
|
| 87 |
+
If you find this work useful, please cite:
|
| 88 |
+
|
| 89 |
+
```bibtex
|
| 90 |
+
@misc{webharbor2026,
|
| 91 |
+
title = {WebHarbor: Docking Real Websites for Evolving GUI Agent Environments},
|
| 92 |
+
author = {{WebHarbor Team and Contributors}},
|
| 93 |
+
year = {2026},
|
| 94 |
+
url = {https://aiming-lab.github.io/webharbor.github.io},
|
| 95 |
+
note = {Project website.}
|
| 96 |
+
}
|
| 97 |
+
```
|