---
pipeline_tag: robotics
tags:
  - robotics
  - human-to-robot
  - video-generation
  - inverse-dynamics
---

# RoboTryOn

Checkpoints for **Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On**.

[Paper](https://arxiv.org/abs/2611.05163) · [Project page](https://ryan-seungyong-lee.github.io/RoboTryOn) · [Code](https://github.com/ryan-seungyong-lee/RoboTryOn)

| Folder | Model | Base |
|---|---|---|
| `image/` | Keyframe translation (LoRA) | [FLUX.2-klein-base-9B](https://huggingface.co/black-forest-labs/FLUX.2-klein-base-9B) |
| `video/` | Video synthesis (in-context LoRA) | [LTX-2.5-Diffusers](https://huggingface.co/Lightricks/LTX-2.5-Diffusers) |
| `idm/` | Inverse dynamics model, shared by all embodiments | [Depth-Anything-V2-Large](https://huggingface.co/depth-anything/Depth-Anything-V2-Large-hf) |

All models are trained on teleoperated episodes of OpenArm, RB-Y1 and GR-1.

## Usage

```bash
hf download RyanL22/RoboTryOn --local-dir ckpt
python scripts/run_pipeline.py --config configs/pipeline.yaml ... \
    checkpoints.image=ckpt/image checkpoints.video=ckpt/video checkpoints.idm=ckpt/idm
```

## Citation

```bibtex
@article{lee2026robotryon,
  title={Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On},
  author={Lee, Seungyong and Jang, Suhyeok and Kim, Minyoung and Shin, Jinwoo},
  journal={arXiv preprint arXiv:2611.05163},
  year={2026}
}
```