Image-to-Video
Diffusers
MLX
i2v
character-animation
video-generation
cross-identity-replacement
pose-driven
diffusion
apple-silicon
Instructions to use SceneWorks/scail2-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SceneWorks/scail2-mlx with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SceneWorks/scail2-mlx", dtype=torch.bfloat16, device_map="cuda") pipe.to("cuda") prompt = "A man with short gray hair plays a red electric guitar." image = load_image( "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png" ) output = pipe(image=image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - MLX
How to use SceneWorks/scail2-mlx with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download SceneWorks/scail2-mlx --local-dir scail2-mlx
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Add q4/q8/bf16 quant-matrix tier subdirs (sc-9944, epic 8506)
Browse files- bf16/clip.safetensors +3 -0
- bf16/config.json +15 -0
- bf16/dit.safetensors +3 -0
- bf16/t5_encoder.safetensors +3 -0
- bf16/tokenizer.json +3 -0
- bf16/vae.safetensors +3 -0
- q4/clip.safetensors +3 -0
- q4/config.json +19 -0
- q4/dit.safetensors +3 -0
- q4/t5_encoder.safetensors +3 -0
- q4/tokenizer.json +3 -0
- q4/vae.safetensors +3 -0
- q8/clip.safetensors +3 -0
- q8/config.json +19 -0
- q8/dit.safetensors +3 -0
- q8/t5_encoder.safetensors +3 -0
- q8/tokenizer.json +3 -0
- q8/vae.safetensors +3 -0
bf16/clip.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90ddb7ff2d56e640b8ef991f498ec1f597fd86794e5c4790eb91622c5f551a5d
|
| 3 |
+
size 2528346712
|
bf16/config.json
ADDED
|
@@ -0,0 +1,15 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_class_name": "WanSCAILModel",
|
| 3 |
+
"_diffusers_version": "0.30.0",
|
| 4 |
+
"dim": 5120,
|
| 5 |
+
"eps": 1e-06,
|
| 6 |
+
"ffn_dim": 13824,
|
| 7 |
+
"freq_dim": 256,
|
| 8 |
+
"in_dim": 20,
|
| 9 |
+
"mask_dim": 28,
|
| 10 |
+
"model_type": "i2v",
|
| 11 |
+
"num_heads": 40,
|
| 12 |
+
"num_layers": 40,
|
| 13 |
+
"out_dim": 16,
|
| 14 |
+
"text_len": 512
|
| 15 |
+
}
|
bf16/dit.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9cbb06d8c2ea7cac169a498cf4a5f3374a226e92de93c0733ab5ba1f7577f023
|
| 3 |
+
size 32791225720
|
bf16/t5_encoder.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:70e44fce2fef5e7bf70a519f65a6dfa3a16a000f489c8c492c913eea77167f0d
|
| 3 |
+
size 11361845504
|
bf16/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e197b4d3dbd71da14b4eb255f4fa91c9c1f2068b20a2de2472967ca3d22602b
|
| 3 |
+
size 16837417
|
bf16/vae.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:42159a8b571dbeb3ea40327b88a6161a5342c0511202af7c031360629757163d
|
| 3 |
+
size 507591212
|
q4/clip.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90ddb7ff2d56e640b8ef991f498ec1f597fd86794e5c4790eb91622c5f551a5d
|
| 3 |
+
size 2528346712
|
q4/config.json
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_class_name": "WanSCAILModel",
|
| 3 |
+
"_diffusers_version": "0.30.0",
|
| 4 |
+
"dim": 5120,
|
| 5 |
+
"eps": 1e-6,
|
| 6 |
+
"ffn_dim": 13824,
|
| 7 |
+
"freq_dim": 256,
|
| 8 |
+
"in_dim": 20,
|
| 9 |
+
"mask_dim": 28,
|
| 10 |
+
"model_type": "i2v",
|
| 11 |
+
"num_heads": 40,
|
| 12 |
+
"num_layers": 40,
|
| 13 |
+
"out_dim": 16,
|
| 14 |
+
"text_len": 512,
|
| 15 |
+
"quantization": {
|
| 16 |
+
"bits": 4,
|
| 17 |
+
"group_size": 64
|
| 18 |
+
}
|
| 19 |
+
}
|
q4/dit.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1a46f805cf22dc74efeab0d4eae6a21ee48f4234281c4d09cf0755378661f614
|
| 3 |
+
size 9578472129
|
q4/t5_encoder.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:70e44fce2fef5e7bf70a519f65a6dfa3a16a000f489c8c492c913eea77167f0d
|
| 3 |
+
size 11361845504
|
q4/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e197b4d3dbd71da14b4eb255f4fa91c9c1f2068b20a2de2472967ca3d22602b
|
| 3 |
+
size 16837417
|
q4/vae.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:42159a8b571dbeb3ea40327b88a6161a5342c0511202af7c031360629757163d
|
| 3 |
+
size 507591212
|
q8/clip.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:90ddb7ff2d56e640b8ef991f498ec1f597fd86794e5c4790eb91622c5f551a5d
|
| 3 |
+
size 2528346712
|
q8/config.json
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_class_name": "WanSCAILModel",
|
| 3 |
+
"_diffusers_version": "0.30.0",
|
| 4 |
+
"dim": 5120,
|
| 5 |
+
"eps": 1e-6,
|
| 6 |
+
"ffn_dim": 13824,
|
| 7 |
+
"freq_dim": 256,
|
| 8 |
+
"in_dim": 20,
|
| 9 |
+
"mask_dim": 28,
|
| 10 |
+
"model_type": "i2v",
|
| 11 |
+
"num_heads": 40,
|
| 12 |
+
"num_layers": 40,
|
| 13 |
+
"out_dim": 16,
|
| 14 |
+
"text_len": 512,
|
| 15 |
+
"quantization": {
|
| 16 |
+
"bits": 8,
|
| 17 |
+
"group_size": 64
|
| 18 |
+
}
|
| 19 |
+
}
|
q8/dit.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:85970fb862366af46fe5b102054b4717b3dbb3ec79dd460e732a1bdd1b1dbb2d
|
| 3 |
+
size 17652510092
|
q8/t5_encoder.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:70e44fce2fef5e7bf70a519f65a6dfa3a16a000f489c8c492c913eea77167f0d
|
| 3 |
+
size 11361845504
|
q8/tokenizer.json
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e197b4d3dbd71da14b4eb255f4fa91c9c1f2068b20a2de2472967ca3d22602b
|
| 3 |
+
size 16837417
|
q8/vae.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:42159a8b571dbeb3ea40327b88a6161a5342c0511202af7c031360629757163d
|
| 3 |
+
size 507591212
|