Project page: https://huggingface.co/spaces/Anirudh1950/VideoReTalk
Environment
git clone https://github.com/vinthony/video-retalking.git
cd video-retalking
conda create -n video_retalking python=3.8
conda activate video_retalking
conda install ffmpeg
# Please follow the instructions from https://pytorch.org/get-started/previous-versions/
# This installation command only works on CUDA 11.1
pip install torch==1.9.0+cu111 torchvision==0.10.0+cu111 -f https://download.pytorch.org/whl/torch_stable.html
pip install -r requirements.txt
Quick Inference
Pretrained Models
Please download our pre-trained models and put them in ./checkpoints.
Inference
python3 inference.py \
--face examples/face/1.mp4 \
--audio examples/audio/1.wav \
--outfile results/1_1.mp4
This script includes data preprocessing steps. You can test any talking face videos without manual alignment. But it is worth noting that DNet cannot handle extreme poses.
You can also control the expression by adding the following parameters:
--exp_img: Pre-defined expression template. The default is "neutral". You can choose "smile" or an image path.
--up_face: You can choose "surprise" or "angry" to modify the expression of upper face with GANimation.
Source code: https://github.com/rudzz1950/VideoReTalk
Run locally
pip install -r requirements.txt
python app.py
app.py is a Gradio app; the original project scripts are unchanged alongside it.
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support