Instructions to use OpenMOSS-Team/RoboOmni-LIBERO-Spatial with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use OpenMOSS-Team/RoboOmni-LIBERO-Spatial with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMultimodalLM tokenizer = AutoTokenizer.from_pretrained("OpenMOSS-Team/RoboOmni-LIBERO-Spatial") model = AutoModelForMultimodalLM.from_pretrained("OpenMOSS-Team/RoboOmni-LIBERO-Spatial", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,14 @@ base_model:
|
|
| 14 |
</h1>
|
| 15 |
</div>
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |

|
| 19 |
|
|
@@ -38,4 +46,21 @@ At the heart of RoboOmni lies the Perceiver-Thinker-Talker-Executor architecture
|
|
| 38 |
|
| 39 |
|
| 40 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
|
|
|
|
| 14 |
</h1>
|
| 15 |
</div>
|
| 16 |
|
| 17 |
+
<p align="center">
|
| 18 |
+
📖 <a href="https://arxiv.org/abs/2510.23763"><strong>arXiv Paper</strong></a> |
|
| 19 |
+
🌐 <a href="https://OpenMOSS.github.io/RoboOmni"><strong>Website</strong></a> |
|
| 20 |
+
🤗 <a href="https://huggingface.co/fnlp/RoboOmni"><strong>Model</strong></a> |
|
| 21 |
+
🤗 <a href="https://huggingface.co/datasets/fnlp/OmniAction"><strong>Dataset</strong></a> |
|
| 22 |
+
🛠️ <a href="https://github.com/OpenMOSS/RoboOmni"><strong>Github</strong></a> |
|
| 23 |
+
</p>
|
| 24 |
+
|
| 25 |
|
| 26 |

|
| 27 |
|
|
|
|
| 46 |
|
| 47 |
|
| 48 |
|
| 49 |
+
## 👋 Citation
|
| 50 |
+
|
| 51 |
+
If you find our paper and code useful in your research, please cite our paper.
|
| 52 |
+
|
| 53 |
+
**BibTeX:**
|
| 54 |
+
|
| 55 |
+
```bibtex
|
| 56 |
+
@article{wang2025roboomni,
|
| 57 |
+
title={RoboOmni: Proactive Robot Manipulation in Omni-modal Context},
|
| 58 |
+
author={Siyin Wang and Jinlan Fu and Feihong Liu and Xinzhe He and Huangxuan Wu and Junhao Shi and Kexin Huang and Zhaoye Fei and Jingjing Gong and Zuxuan Wu and Yugang Jiang and See-Kiong Ng and Tat-Seng Chua and Xipeng Qiu},
|
| 59 |
+
journal={arXiv preprint arXiv:2510.23763},
|
| 60 |
+
year={2025},
|
| 61 |
+
url={https://arxiv.org/abs/2510.23763},
|
| 62 |
+
archivePrefix={arXiv},
|
| 63 |
+
primaryClass={cs.RO},
|
| 64 |
+
}
|
| 65 |
+
```
|
| 66 |
|