Upload 24 files

uniAnimate/checkpoints/2dfan4.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1ceedb108439c7d7b3f92cfa2b25bdc69a1f5f6c8b41da228cb283ca98d4181d
+size 97904402

uniAnimate/checkpoints/Fourchannel_maskChannel_24w_normalize255_best_ckpt.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dcc067fd8771ed997dbee283d2b72ae6b70d059d28c195e119129e15e0ac7b82
+size 110367857

uniAnimate/checkpoints/README.md

@@ -0,0 +1,41 @@
+# UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation
+
+## This repo include the checkpoints for UniAnimate:
+
+- "models/dw-ll_ucoco_384.onnx": the checkpoint for dwpose extraction.
+
+- "models/open_clip_pytorch_model.bin": the checkpoint for clip embedding.
+
+- "models/unianimate_16f_32f_non_ema_223000.pth": the checkpoint for human image animation in UniAnimate (16/32 frames).
+
+- "models/yolox_l.onnx": the checkpoint for dwpose extraction.
+
+- "models/v2-1_512-ema-pruned.ckpt": the checkpoint for Stable Diffusion.
+
+
+
+
+## BibTeX
+
+If this repo is useful to you, please cite our corresponding technical paper.
+
+```bibtex
+@article{wang2024unianimate,
+      title={UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation},
+      author={Wang, Xiang and Zhang, Shiwei and Gao, Changxin and Wang, Jiayu and Zhou, Xiaoqiang and Zhang, Yingya and Yan, Luxin and Sang, Nong},
+      journal={arXiv preprint arXiv:2406.01188},
+      year={2024}
+}
+@inproceedings{TFT2V,
+      title={A Recipe for Scaling up Text-to-Video Generation with Text-free Videos},
+      author={Wang, Xiang and Zhang, Shiwei and Yuan, Hangjie and Qing, Zhiwu and Gong, Biao and Zhang, Yingya and Shen, Yujun and Gao, Changxin and Sang, Nong},
+      booktitle={CVPR},
+      year={2024}
+}
+@article{VideoComposer,
+      title={VideoComposer: Compositional Video Synthesis with Motion Controllability},
+      author={Wang, Xiang and Yuan, Hangjie and Zhang, Shiwei and Chen, Dayou and Wang, Jiuniu and Zhang, Yingya and Shen, Yujun and Zhao, Deli and Zhou, Jingren},
+      journal={NeurIPS},
+      year={2023}
+}
+```

uniAnimate/checkpoints/SodAnything_vits_24w_removeRelu_best_ckpt.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a92a82da6592d504ee909d41d6adb76b83bbca4d8c97c69afb7ecf7fd662231c
+size 99538915

uniAnimate/checkpoints/arcface_w600k_r50.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c06341c33c2ca1f86781dab0e829f88ad5b64be9fba56e56bc9ebdefc619e43
+size 174383860

uniAnimate/checkpoints/big-lama.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7ba7aa7ac37a4d41fdbbeba3a2af7ead18058552997e3a3cd1a3b2210c9e6b4c
+size 205803670

uniAnimate/checkpoints/configuration.json

@@ -0,0 +1 @@
+{"framework":"Pytorch","task":"text-to-video-synthesis"}

uniAnimate/checkpoints/dw-ll_ucoco_384.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:724f4ff2439ed61afb86fb8a1951ec39c6220682803b4a8bd4f598cd913b1843
+size 134399116

uniAnimate/checkpoints/iic/unianimate/.mv

@@ -0,0 +1 @@
+Revision:master,CreatedAt:1718280037

uniAnimate/checkpoints/inswapper_128.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4a3f08c753cb72d04e10aa0f7dbe3deebbf39567d4ead6dce08e98aa49e16af
+size 554253681

uniAnimate/checkpoints/models--LiheYoung--depth_anything_vits14/README.md

@@ -0,0 +1,58 @@
+---
+tags:
+- depth_anything
+- depth-estimation
+---
+
+# Depth Anything model, small
+
+The model card for our paper [Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data](https://arxiv.org/abs/2401.10891).
+
+You may also try our [demo](https://huggingface.co/spaces/LiheYoung/Depth-Anything) and visit our [project page](https://depth-anything.github.io/).
+
+## Installation
+
+First, install the Depth Anything package:
+```
+git clone https://github.com/LiheYoung/Depth-Anything
+cd Depth-Anything
+pip install -r requirements.txt
+```
+
+## Usage
+
+Here's how to run the model:
+
+```python
+import numpy as np
+from PIL import Image
+import cv2
+import torch
+
+from depth_anything.dpt import DepthAnything
+from depth_anything.util.transform import Resize, NormalizeImage, PrepareForNet
+from torchvision.transforms import Compose
+
+model = DepthAnything.from_pretrained("LiheYoung/depth_anything_vitl14")
+
+transform = Compose([
+        Resize(
+            width=518,
+            height=518,
+            resize_target=False,
+            keep_aspect_ratio=True,
+            ensure_multiple_of=14,
+            resize_method='lower_bound',
+            image_interpolation_method=cv2.INTER_CUBIC,
+        ),
+        NormalizeImage(mean=[0.485, 0.456, 0.406], std=[0.229, 0.224, 0.225]),
+        PrepareForNet(),
+    ])
+
+image = Image.open("...")
+image = np.array(image) / 255.0
+image = transform({'image': image})['image']
+image = torch.from_numpy(image).unsqueeze(0)
+
+depth = model(image)
+```

uniAnimate/checkpoints/models--LiheYoung--depth_anything_vits14/config.json

@@ -0,0 +1 @@
+{"encoder": "vits", "features": 64, "out_channels": [48, 96, 192, 384], "use_bn": false, "use_clstoken": false}

uniAnimate/checkpoints/models--LiheYoung--depth_anything_vits14/gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

uniAnimate/checkpoints/models--LiheYoung--depth_anything_vits14/pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ba0ab5365610467de4fea1ffe64b4ae3a756561a4df9e11bd7369205241f2082
+size 99232841

uniAnimate/checkpoints/open_clip_pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9a78ef8e8c73fd0df621682e7a8e8eb36c6916cb3c16b291a082ecd52ab79cc4
+size 3944692325

uniAnimate/checkpoints/portrate_selflabelFFinetune_fullAndCut_dp_size512_ImageANTIALIAS_adduserimage_best_ckpt.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c5be221ca1ac52d308634418abd430371a4473a0db5c7449cb63699ad4e8c675
+size 110366705

uniAnimate/checkpoints/unianimate_16f_32f_non_ema_223000.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b78e68c02d5974d9f8198b2e96f6868c1b17921dea3eb7f729ce6dacdc481b45
+size 5666897525

uniAnimate/checkpoints/v2-1_512-ema-pruned.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:88ecb782561455673c4b78d05093494b9c539fc6bfc08f3a9a4a0dd7b0b10f36
+size 5214865159

uniAnimate/checkpoints/yoloface_8n.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84d5bb985b0ea75fc851d7454483897b1494c71c211759b4fec3a22ac196d206
+size 12639351

uniAnimate/checkpoints/yolov8m.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6c25b0b63b1a433843f06d821a9ac1deb8d5805f74f0f38772c7308c5adc55a5
+size 52117635

uniAnimate/checkpoints/yolov8x.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c4d5a3f000d771762f03fc8b57ebd0aae324aeaefdd6e68492a9c4470f2d1e8b
+size 136867539

uniAnimate/checkpoints/yolox_l.onnx

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7860ae79de6c89a3c1eb72ae9a2756c0ccfbe04b7791bb5880afabd97855a411
+size 216746733