Papers
arxiv:2611.16009

JustRUA: A Controlled Study of GPT-6 Robot-Use Agents

Published on Nov 11
· Submitted by
Zefan Wang
on Nov 13
Authors:
,
,
,
,
,
,
,
,
,
,

Abstract

A simplified evaluation harness that keeps full episode history and stops motions early substantially improves robot-use agent scores on RoboDojo, with scene geometry providing the largest additional benefit.

GPT-6 Astra can drive a robot arm directly through a fixed harness, and scores of such robot-use agents on RoboDojo have risen quickly since. Reported systems differ in harness and test subset and often change several designs at once, so it is hard to tell which choices produce the gains. We take these designs apart and test them in one framework, along the harness around the model, the action interface, the reuse of experience and the scene geometry given to the model. A lean harness that keeps the full episode history and stops each motion early goes a long way. Reusing experience changes how the model acts but is not a free lunch, and scene geometry helps most, even when depth is predicted from RGB alone. JustRUA starts from the official L3 harness and keeps only what matters most. Even with no learned policy, self-improvement loop or task-specific tuning, this simple harness raises the score on the RoboDojo simulation benchmark substantially, from 29.7 to 50.3.

Community

Paper author Paper submitter

JustRUA is a controlled study of GPT-6 Astra robot-use agents on RoboDojo. We take the designs recent systems add (harness, action interface, reuse of experience, scene geometry) and test them one at a time in one framework. The harness we end up with is simple and goes from 29.7 to 50.3, with no learned policy, self-improvement loop or task-specific tuning. Every configuration, with its score, cost and rollouts, is on the project page.

I love that the lean harness wins: full episode history plus stopping each motion early, and scene geometry helping most. It makes me wonder how much of the earlier gains were just extra layers. Is the geometry gain similar when depth is predicted from RGB alone?

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.16009
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.16009 in a model README.md to link it from this page.

Datasets citing this paper 1

Spaces citing this paper 1

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.