serendipityAc2Win commited on
Commit
519c0df
·
verified ·
1 Parent(s): 0f59b23

Update model card: add arXiv link and citation

Browse files
Files changed (1) hide show
  1. README.md +16 -11
README.md CHANGED
@@ -1,23 +1,25 @@
1
  ---
2
  language:
3
- - en
4
  tags:
5
- - embodied-ai
6
- - world-model
7
- - mixture-of-experts
8
- - heterogeneous-action-control
9
- - model-weights
10
  license: other
11
  ---
12
 
13
  # Worldscape-MoE Model Weights
14
 
15
- This repository contains the model weights introduced in the paper: **Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control**.
16
 
17
  Worldscape-MoE is a Mixture-of-Experts world model for scalable heterogeneous action control. It unifies multiple control interfaces, including camera trajectories, robot actions, and hand-joint signals, within a shared world-dynamics backbone instead of treating each control modality as an isolated modeling problem.
18
 
19
  Built on Diffusion Transformers, Worldscape-MoE combines modality-aware control injection, shared and control-specific experts, and a progressive MoE tuning strategy to absorb heterogeneous action supervision while preserving a shared model of world dynamics. Across locomotion, robotic manipulation, and egocentric hand control, it shows that heterogeneous supervision can improve rather than interfere with individual control capabilities, while supporting out-of-distribution generalization and continual extension to new action modalities.
20
 
 
 
21
  For more details about the project, please refer to the project page: `https://worldscape-moe.com`
22
 
23
  Demo video: `https://youtu.be/c19iBwpdiv4`
@@ -28,9 +30,12 @@ If this work has contributed to your research, please consider citing:
28
 
29
  ```bibtex
30
  @misc{fang2026worldscapemoe,
31
- title = {Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control},
32
- author = {Jianjie Fang and Yongyan Xu and Ziyou Wang and Chen Gao and Yuchao Huang and Zhaolu Wang and Rongze Tang and Mingyuan Jia and Baining Zhao and Weichen Zhang and Xin Zhang and Haisheng Su and Yu Shang and Wei Wu and Xinlei Chen and Yong Li},
33
- year = {2026},
34
- note = {Project page: https://worldscape-moe.com}
 
 
 
35
  }
36
  ```
 
1
  ---
2
  language:
3
+ - en
4
  tags:
5
+ - embodied-ai
6
+ - world-model
7
+ - mixture-of-experts
8
+ - heterogeneous-action-control
9
+ - model-weights
10
  license: other
11
  ---
12
 
13
  # Worldscape-MoE Model Weights
14
 
15
+ This repository contains the model weights introduced in the paper: **[Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control](https://arxiv.org/abs/2607.03964)**.
16
 
17
  Worldscape-MoE is a Mixture-of-Experts world model for scalable heterogeneous action control. It unifies multiple control interfaces, including camera trajectories, robot actions, and hand-joint signals, within a shared world-dynamics backbone instead of treating each control modality as an isolated modeling problem.
18
 
19
  Built on Diffusion Transformers, Worldscape-MoE combines modality-aware control injection, shared and control-specific experts, and a progressive MoE tuning strategy to absorb heterogeneous action supervision while preserving a shared model of world dynamics. Across locomotion, robotic manipulation, and egocentric hand control, it shows that heterogeneous supervision can improve rather than interfere with individual control capabilities, while supporting out-of-distribution generalization and continual extension to new action modalities.
20
 
21
+ Paper: `https://arxiv.org/abs/2607.03964`
22
+
23
  For more details about the project, please refer to the project page: `https://worldscape-moe.com`
24
 
25
  Demo video: `https://youtu.be/c19iBwpdiv4`
 
30
 
31
  ```bibtex
32
  @misc{fang2026worldscapemoe,
33
+ title = {Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control},
34
+ author = {Jianjie Fang and Yongyan Xu and Ziyou Wang and Chen Gao and Yuchao Huang and Zhaolu Wang and Rongze Tang and Mingyuan Jia and Baining Zhao and Weichen Zhang and Xin Zhang and Haisheng Su and Yu Shang and Wei Wu and Xinlei Chen and Yong Li},
35
+ year = {2026},
36
+ eprint = {2607.03964},
37
+ archivePrefix = {arXiv},
38
+ primaryClass = {cs.RO},
39
+ url = {https://arxiv.org/abs/2607.03964}
40
  }
41
  ```