Instructions to use lzphillipp/comfyui-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use lzphillipp/comfyui-models with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("lzphillipp/comfyui-models", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
|
Download checkpoints/README.md from lzphillipp/comfyui-models: direct link, hf CLI and curl.
- Browser
- Download file 878 Bytes
-
https://huggingface.co/lzphillipp/comfyui-models/resolve/main/checkpoints/README.md
- Command line
-
hf download hf://lzphillipp/comfyui-models/checkpoints/README.md
-
curl -L -o README.md https://huggingface.co/lzphillipp/comfyui-models/resolve/main/checkpoints/README.md
878 Bytes
metadata
license: openrail++
library_name: torchgeo
tags:
- lipsync
- video-editing
Paper: https://arxiv.org/abs/2412.09262
Code: https://github.com/bytedance/LatentSync
LatentSync 1.6
Many people have reported that the teeth and lips generated by LatentSync 1.5 are blurry. To address this issue, we trained LatentSync 1.6 on 512 x 512 resolution videos.
Notably, we did not make any changes to the model structure or training strategy; the only modification was upgrading the training dataset to 512 x 512 videos. Therefore, the current code is compatible with both LatentSync 1.5 and 1.6. To switch between versions, you only need to load the corresponding checkpoint and modify the resolution parameter in the U-Net config file.
You can view the demo in LatentSync's official GitHub repo.