Instructions to use lzphillipp/comfyui-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use lzphillipp/comfyui-models with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("lzphillipp/comfyui-models", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
|
Download checkpoints/README.md from lzphillipp/comfyui-models: direct link, hf CLI and curl.
- Browser
- Download file 878 Bytes
-
https://huggingface.co/lzphillipp/comfyui-models/resolve/main/checkpoints/README.md
- Command line
-
hf download hf://lzphillipp/comfyui-models/checkpoints/README.md
-
curl -L -o README.md https://huggingface.co/lzphillipp/comfyui-models/resolve/main/checkpoints/README.md
878 Bytes
| license: openrail++ | |
| library_name: torchgeo | |
| tags: | |
| - lipsync | |
| - video-editing | |
| Paper: https://arxiv.org/abs/2412.09262 | |
| Code: https://github.com/bytedance/LatentSync | |
| # LatentSync 1.6 | |
| Many people have reported that the teeth and lips generated by LatentSync 1.5 are blurry. To address this issue, we trained LatentSync 1.6 on 512 x 512 resolution videos. | |
| Notably, we did not make any changes to the model structure or training strategy; the only modification was upgrading the training dataset to 512 x 512 videos. Therefore, the current code is compatible with both LatentSync 1.5 and 1.6. To switch between versions, you only need to load the corresponding checkpoint and modify the `resolution` parameter in the U-Net config file. | |
| You can view the [demo](https://github.com/bytedance/LatentSync/blob/main/docs/changelog_v1.6.md) in LatentSync's official GitHub repo. |