| --- |
| license: other |
| library_name: pytorch |
| tags: |
| - co-speech-gesture-generation |
| - co-speech-motion-generation |
| - speech-driven-motion |
| - diffusion-models |
| - long-horizon-generation |
| - beat2 |
| - smpl-x |
| - globaldiff |
| datasets: |
| - H-Liu1997/BEAT2 |
| --- |
| |
| # GlobalDiff official checkpoints |
|
|
| Official checkpoints for **Mitigating Error Accumulation in Co-Speech Motion Generation via Global Rotation Diffusion and Multi-Level Constraints** (AAAI 2026), a diffusion approach to long-horizon **co-speech gesture generation**. |
|
|
| - [Paper](https://arxiv.org/abs/2511.10076) 路 [Hugging Face Paper page](https://huggingface.co/papers/2511.10076) |
| - [Project page](https://xiangyuezhang.com/GlobalDiff/) 路 [Code](https://github.com/Xiangyue-Zhang/GlobalDiff) |
| - [Published version](https://doi.org/10.1609/aaai.v40i15.38281) |
| - [Generated inference data](https://huggingface.co/datasets/X-Zhang/GlobalDiff-Inference-Data) |
|
|
| ## Files |
|
|
| The checkpoint files mirror the official repository while preserving their repository-relative paths: |
|
|
| | Path | Role | |
| | --- | --- | |
| | `Scripts/VAE/ckpt/split/global/MaskedVAE2-HorizonFlip/best.pt` | Global rotation VAE checkpoint | |
| | `Scripts/VAE/ckpt/split/global/MaskedVAE3-HorizonFlip/best.pt` | Global rotation VAE checkpoint | |
| | `Scripts/FM/ckpt/split/SimpleSpeechModel/best.zip` | Speech model checkpoint archive | |
| | `Scripts/FM/EMAGE_VAE/AESKConv_240_100.bin` | Evaluation/representation asset | |
| See the code repository's environment checker and inference instructions for all runtime dependencies. |
|
|
| Verify the files from the repository root with `sha256sum -c SHA256SUMS`. |
|
|
| ## Terms |
|
|
| This repository mirrors research artifacts released by the authors. No new license is granted by this model card. Code, BEAT2, SMPL-X, pretrained encoders, and other third-party assets remain subject to their respective terms. |
|
|
| ## Citation |
|
|
| ```bibtex |
| @inproceedings{zhang2026globaldiff, |
| title={Mitigating Error Accumulation in Co-Speech Motion Generation via Global Rotation Diffusion and Multi-Level Constraints}, |
| author={Zhang, Xiangyue and Li, Jianfang and Ren, Jianqiang and Zhang, Jiaxu}, |
| booktitle={Proceedings of the AAAI Conference on Artificial Intelligence}, |
| volume={40}, |
| number={15}, |
| pages={12834--12842}, |
| year={2026}, |
| doi={10.1609/aaai.v40i15.38281} |
| } |
| ``` |
|
|
