| --- |
| license: other |
| license_name: openmdw-1.1 |
| license_link: https://github.com/NVIDIA/Cosmos/blob/main/LICENSE |
| pipeline_tag: image-to-video |
| tags: |
| - robotics |
| - world-model |
| - forward-dynamics |
| - image-to-video |
| --- |
| |
| <br/> |
| <h1 align="center" style="font-size: 1.7rem">SyncWorld: Visual Calibration Enables World Models as Zero-Shot Simulators</h1> |
| <p align="center"> |
| <a href="https://yyuncong.github.io/">Yuncong Yang</a>, |
| <a href="https://www.hanzht.com/">Zhengtao Han</a>, |
| <a href="https://www.linkedin.com/in/ozyurtf/">Furkan Özyurt</a>, |
| <a href="https://miicheyang.github.io/">Zeyuan Yang</a>, |
| <a href="https://hanyangclarence.github.io/">Han Yang</a>, |
| <a href="https://xjay18.github.io/">Junyi Cao</a>, |
| <a href="https://haoyuzhen.com/">Haoyu Zhen</a>, |
| <a href="https://yilundu.github.io/">Yilun Du</a>, |
| <a href="https://people.csail.mit.edu/ganchuang/">Chuang Gan</a> |
| </p> |
| <p align="center"> |
| <a href="https://arxiv.org/abs/2609.09155"> |
| <img src='https://img.shields.io/badge/Paper-PDF-red?style=flat&logo=arXiv&logoColor=red' alt='Paper PDF'> |
| </a> |
| <a href='https://umass-embodied-agi.github.io/SyncWorld/' style='padding-left: 0.5rem;'> |
| <img src='https://img.shields.io/badge/Project-Page-blue?style=flat&logo=Google%20chrome&logoColor=blue' alt='Project Page'> |
| </a> |
| <a href='https://github.com/UMass-Embodied-AGI/SyncWorld' style='padding-left: 0.5rem;'> |
| <img src='https://img.shields.io/badge/Code-GitHub-black?style=flat&logo=github&logoColor=white' alt='Code'> |
| </a> |
| </p> |
| |
|
|
| </p> |
|
|
|
|
| SyncWorld is an action-conditioned world model that serves as a zero-shot simulator across unseen |
| environments without any additional training. It leverages a visual calibration episode — paired |
| frames and actions that showcase all the controllable degrees of freedom — to specify the |
| setup-specific Action–Visual Mapping in context, and learns to interpret actions through visual |
| evidence and to fall back on interaction history when explicit calibration is unavailable. |
|
|
| ```shell |
| hf download yyuncong/SyncWorld --local-dir ./SyncWorld-ckpt |
| ``` |
|
|
| See the [SyncWorld repository](https://github.com/UMass-Embodied-AGI/SyncWorld) for installation and how to |
| run evaluation, and [`yyuncong/SyncWorld-Evaluation`](https://huggingface.co/datasets/yyuncong/SyncWorld-Evaluation) |
| for the evaluation sets. |
|
|
