Add model card for OmniTryOn

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ pipeline_tag: image-to-video
3
+ ---
4
+
5
+ # OmniTryOn: Video Try-On Anything at Once!
6
+
7
+ OmniTryOn is an external-prior-free generative framework designed for the **Try-On Anything** task, which aims to simultaneously transfer diverse wearable objects onto a person in a video in a single inference pass.
8
+
9
+ - **Paper:** [OmniTryOn: Video Try-On Anything at Once!](https://huggingface.co/papers/2606.08514)
10
+ - **Project Page:** [https://xcltql666.github.io/OmniTryOnProj/](https://xcltql666.github.io/OmniTryOnProj/)
11
+ - **GitHub Repository:** [https://github.com/xcltql666/OminTryOn](https://github.com/xcltql666/OminTryOn)
12
+ - **Dataset:** [TryAny-Bench](https://huggingface.co/datasets/xcll/Try-Any-Bench)
13
+
14
+ ## Overview
15
+
16
+ OmniTryOn employs a First Frame Wearable Cache strategy to directly provide diverse wearable objects for the generation process through the initial video frame. To maintain consistency, it introduces Spatiotemporally Consistent RoPE (STC-RoPE), establishing spatiotemporal anchors to preserve complex human motions and background dynamics.
17
+
18
+ ## Usage
19
+
20
+ ### Installation
21
+
22
+ ```bash
23
+ conda create -n omnitryon python=3.12
24
+ conda activate omnitryon
25
+ ```
26
+
27
+ ### Training
28
+
29
+ ```bash
30
+ bash DiffSynth-Studio\examples\wanvideo\model_training\full\Video-As-Prompt-Wan2.1-14B.sh
31
+ ```
32
+
33
+ ### Inference
34
+
35
+ ```bash
36
+ python DiffSynth-Studio\examples\wanvideo\model_training\validate_full\Video-As-Prompt-Wan2.1-14B.py
37
+ ```
38
+
39
+ ## Citation
40
+
41
+ ```bibtex
42
+ @article{omnitryon2025,
43
+ title={OmniTryOn: Video Try-On Anything at Once!},
44
+ author={},
45
+ journal={arXiv preprint arXiv:2606.08514},
46
+ year={2025}
47
+ }
48
+ ```