Instructions to use Gaojunyao/MegaAvatar with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Wan2.2
How to use Gaojunyao/MegaAvatar with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
|
Download README.md from Gaojunyao/MegaAvatar: direct link, hf CLI and curl.
- Browser
- Download file 2.69 kB
-
https://huggingface.co/Gaojunyao/MegaAvatar/resolve/main/README.md
- Command line
-
hf download hf://Gaojunyao/MegaAvatar/README.md
-
curl -L -o README.md https://huggingface.co/Gaojunyao/MegaAvatar/resolve/main/README.md
2.69 kB
| pipeline_tag: image-to-video | |
| tags: | |
| - video-generation | |
| - talking-avatar | |
| - human-animation | |
| - audio-driven | |
| - smpl-x | |
| - wan2.2 | |
| <h1 align="center">MegaAvatar: Controllable Talking Avatar Generation</h1> | |
| <div align="center"> | |
| **Junyao Gao\*<sup>1,2</sup> Sibo Liu\*<sup>1</sup> Weidong Zhang<sup>1</sup> Cairong Zhao<sup>2‡</sup> Jun Zhang<sup>1‡</sup>** | |
| <sup>1</sup>Tencent AIPD <sup>2</sup>Tongji University \*Equal contribution ‡Corresponding authors | |
| [](https://github.com/Jeoyal/MegaAvatar) | |
| [](https://arxiv.org/abs/2609.39273) | |
| [](https://huggingface.co/datasets/Gaojunyao/MegaAvatar) | |
| </div> | |
| --- | |
| MegaAvatar is a controllable talking avatar generation framework built on top of **Wan2.2-TI2V-5B**. | |
| Given a reference portrait image, MegaAvatar generates talking avatar videos with: | |
| - controllable body and head motion using SMPL-X; | |
| - speech-synchronized lip motion and facial expressions using audio; | |
| - identity-preserving facial appearance. | |
| MegaAvatar supports both **SMPL-X-driven** and **audio-driven** generation. | |
| ## Model Download | |
| ```bash | |
| hf download Gaojunyao/MegaAvatar --include "checkpoints/*" --local-dir . | |
| ``` | |
| The released checkpoints include: | |
| ```text | |
| checkpoints/ | |
| ├── megaavatar.safetensors | |
| └── audio2smplx/ | |
| ``` | |
| - `megaavatar.safetensors`: MegaAvatar video generation model. | |
| - `audio2smplx/`: audio-to-SMPL-X components. | |
| ## Usage | |
| Please refer to the official GitHub repository for installation, inference, and training instructions: | |
| https://github.com/Jeoyal/MegaAvatar | |
| MegaAvatar supports: | |
| ```text | |
| Reference Image + SMPL-X + Audio → Talking Avatar Video | |
| Reference Image + Audio → SMPL-X → Talking Avatar Video | |
| ``` | |
| ## Related Resources | |
| - Code: https://github.com/Jeoyal/MegaAvatar | |
| - Model: https://huggingface.co/Gaojunyao/MegaAvatar | |
| - Dataset: https://huggingface.co/datasets/Gaojunyao/MegaAvatar | |
| - Paper: https://arxiv.org/abs/2609.39273 | |
| ## Acknowledgements | |
| This project benefits from [FantasyTalking](https://github.com/Fantasy-AMAP/fantasy-talking), [SpeakerVid-5M-Code](https://github.com/Dorniwang/SpeakerVid-5M-Code), and [DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio). | |
| ## Citation | |
| ```bibtex | |
| @article{gao2026megaavatar, | |
| title={MegaAvatar: Controllable Talking Avatar Generation}, | |
| author={Gao, Junyao and Liu, Sibo and Zhang, Weidong and Zhao, Cairong and Zhang, Jun}, | |
| journal={arXiv preprint arXiv:2609.39273}, | |
| year={2026} | |
| } | |
| ``` |