File size: 1,438 Bytes
4d50a2f be513a5 4d50a2f be513a5 4d50a2f be513a5 4d50a2f be513a5 4d50a2f be513a5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 | ---
pipeline_tag: robotics
tags:
- robotics
- human-to-robot
- video-generation
- inverse-dynamics
---
# RoboTryOn
Checkpoints for **Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On**.
[Paper](https://arxiv.org/abs/2611.05163) · [Project page](https://ryan-seungyong-lee.github.io/RoboTryOn) · [Code](https://github.com/ryan-seungyong-lee/RoboTryOn)
| Folder | Model | Base |
|---|---|---|
| `image/` | Keyframe translation (LoRA) | [FLUX.2-klein-base-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B) |
| `video/` | Video synthesis (in-context LoRA) | [LTX-2.5-Diffusers](https://huggingface.co/Lightricks/LTX-2.5-Diffusers) |
| `idm/` | Inverse dynamics model, shared by all embodiments | [Depth-Anything-V2-Large](https://huggingface.co/depth-anything/Depth-Anything-V2-Large-hf) |
All models are trained on teleoperated episodes of OpenArm, RB-Y1 and GR-1.
## Usage
```bash
hf download RyanL22/RoboTryOn --local-dir ckpt
python scripts/run_pipeline.py --config configs/pipeline.yaml ... \
checkpoints.image=ckpt/image checkpoints.video=ckpt/video checkpoints.idm=ckpt/idm
```
## Citation
```bibtex
@article{lee2026robotryon,
title={Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On},
author={Lee, Seungyong and Jang, Suhyeok and Kim, Minyoung and Shin, Jinwoo},
journal={arXiv preprint arXiv:2611.05163},
year={2026}
}
```
|