Papers
arxiv:2611.06817

Open-HumanScale: An Open Recipe for Scaling Human and Robot Experience for Embodied Foundation Models

Published on Nov 4
· Submitted by
mjc
on Nov 6
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

Egocentric human video offers a scalable source of manipulation priors for robot learning, yet translating raw data scale into generalizable robot policies demands rigorous data curation and training recipes. We introduce Open-HumanScale, the first fully open recipe for scaling egocentric pretraining to 50,000 hours, anchored by Open-HumanScale-50K---a curated egocentric video corpus densely annotated with hand motion and natural language. Leveraging this corpus, we systematically investigate pure human pretraining via closed-loop simulation evaluations and uncover an empirical log-linear scaling law linking pretraining data hours to downstream robot success rates. Grounded in these findings, we develop HumanWAM-Vanilla, a world--action model pretrained exclusively on 50k hours of egocentric human video. Upon robot post-training, HumanWAM-Vanilla reaches 92.08% success on RoboTwin 2.0 Clean2Clean and 68.88% on Clean2Random, alongside a 14.17% mean success rate and a 19.00 mean progress score on RoboDojo. To push the capability frontier further, we explore joint human--robot pretraining with HumanWAM-Goal, a visual-goal-conditioned world--action model. Hybrid data scaling unlocks broad zero-shot generalization across both simulation and physical benchmarks, propelling post-trained RoboTwin 2.0 performance to new state-of-the-art levels: 92.70% on Clean2Clean and a substantial leap to 84.60% on Clean2Random. On physical robots, HumanWAM-Goal further exhibits emergent embodied in-context learning, dynamically adapting its manipulation behavior to unseen visual goals without parameter updates. To support reproducible scaling research in embodied AI, we open-source the Open-HumanScale-50K corpus, data curation and pretraining pipelines, alongside the pretrained and post-trained HumanWAM checkpoints, inference code, and simulation evaluation suites.

Community

Paper submitter

Hi everyone! We’re the authors of Open-HumanWAM, an open recipe for scaling human and robot experience for embodied foundation models.

We study how human experience can improve robot learning, using Open-HumanWAM-50K, a 50,000-hour egocentric corpus with hand-motion and language annotations.

  • 📈 HumanWAM-Vanilla — scaling human experience: our exploration studies show that scaling egocentric pretraining improves generalization to unseen scenes and randomized environments. Greater data diversity strengthens the scaling trend, while human pretraining improves robot demonstration efficiency. The final model achieves 92.08% Clean / 68.88% Random, averaging 80.48% on RoboTwin 2.0.
  • 🤖 HumanWAM-Goal — zero-shot transfer: combining human and robot experience improves zero-shot generalization in simulation and the real world. Visual goals enable robots to follow human demonstrations and adapt their behavior through in-context conditioning, without target-task parameter updates.
  • 🏆 RoboTwin 2.0 Rank #1: after post-training, HumanWAM-Goal achieves 92.70% Clean / 84.60% Random, averaging 88.65%.

We’re releasing the corpus, checkpoints, and code, with uploads and documentation updates ongoing. We’d love to hear your thoughts and questions!

🌐 Project & demos · 💻 Code · 🤗 Corpus · 🤗 Models

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.06817
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 4

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.06817 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.06817 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.