🌸 FlowerDance

MeanFlow for Efficient and Refined 3D Dance Generation

Abstract: Music-to-dance generation translates auditory signals into expressive human motion, yet existing approaches still struggle to balance refined 3D motion quality with strict inference budgets. FlowerDance is designed for both physically plausible, artistically expressive motion and efficient generation in speed and memory usage.

FlowerDance combines MeanFlow with Physical Consistency Constraints for high-quality few-step sampling, and uses a lightweight non-autoregressive BiMamba backbone with Channel-Level Fusion for long-horizon music-to-dance synthesis. It also supports motion editing through time-decayed soft masking, enabling users to refine generated dance sequences interactively.

🎉 FlowerDance has been accepted to ECCV 2026! 🎉
✨ Training and inference code are now available. ✨

---

🚀 Code

The complete training, evaluation, and inference code is maintained in the GitHub repository.

🛠️ Set up the Environment

To set up the necessary environment for running this project, follow the steps below:

1. Clone the repository

   git clone https://github.com/XulongT/FlowerDance.git
   cd FlowerDance
   

2. Create a new conda environment

   conda create -n Flower_env python=3.10
   conda activate Flower_env
   

3. Install PyTorch (CUDA 12.8)

   pip install torch==2.7.1+cu128 torchvision==0.22.1+cu128 torchaudio==2.7.1+cu128 \
       --index-url https://download.pytorch.org/whl/cu128
   

4. Install remaining dependencies

   pip install -r requirements.txt
   

---

📦 Download Resources

• Download the complete preprocessed data archive from Hugging Face and extract it so that the preprocessed files are located under ./data/.
• The pretrained checkpoint is hosted in this model repository. Custom-music inference downloads it automatically when --checkpoint is omitted.

---

🧩 Directory Structure

After downloading the necessary files, ensure the directory structure follows the pattern below:

FlowerDance/
    │                
    ├── data/                 
    ├── dataset/             
    ├── model/                               
    ├── runs/  
    ├── requirements.txt
    ├── args.py  
    ├── EDGE.py
    ├── train.py
    ├── test.py
    ├── inference.py
    ├── inpaint.py
    └── vis.py     

---

🏋️ Training

export WANDB_MODE=offline
accelerate launch train.py --batch_size 128 --epochs 4000 --feature_type baseline

---

📏 Evaluation

🧪 Evaluate the Model

To evaluate the model:

python test.py --batch_size 128

---

🎵 Inference

Generate a genre-conditioned dance sequence of a custom length from your own music:

python inference.py path/to/music.wav \
    --genre Hiphop \
    --duration 32

List all supported dance genres:

python inference.py --list-genres

The checkpoint is downloaded automatically from Hugging Face when --checkpoint is omitted. Generated motions are saved to inference_outputs/.

---

🙏 Acknowledgements

This code is standing on the shoulders of giants. We want to thank the following contributors that our code is based on: EDGE, Adan-pytorch, denoising-diffusion-pytorch, Mamba, causal-conv1d, and fairmotion. The preprocessed data builds on AIST++ and FineDance.

---

📄 Citation

@article{yang2025flowerdance,
  title={FlowerDance: MeanFlow for Efficient and Refined 3D Dance Generation},
  author={Kaixing Yang and Xulong Tang and Ziqiao Peng and Xiangyue Zhang and Puwei Wang and Jun He and Hongyan Liu},
  journal={arXiv preprint arXiv:2511.21029},
  year={2025}
}