Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: circlestone-labs-non-commercial-license
|
| 4 |
+
base_model: Anima-Base-V1.0
|
| 5 |
+
tags:
|
| 6 |
+
- text-to-image
|
| 7 |
+
- controlnet
|
| 8 |
+
- depth
|
| 9 |
+
- anima
|
| 10 |
+
- cosmos-predict2
|
| 11 |
+
- vace
|
| 12 |
+
- comfyui
|
| 13 |
+
- sd-scripts
|
| 14 |
+
pipeline_tag: text-to-image
|
| 15 |
+
---
|
| 16 |
+
|
| 17 |
+
# Anima-ControlNet-VACE-Depth
|
| 18 |
+
|
| 19 |
+
A **depth ControlNet** for **Anima**,
|
| 20 |
+
trained with the **VACE** spaced-block-duplication + zero-conv architecture.
|
| 21 |
+
|
| 22 |
+
> ⚠️ **This release contains adapter weights only.** It is not a standalone
|
| 23 |
+
> model — you must load it together with the Anima base
|
| 24 |
+
> model.
|
| 25 |
+
|
| 26 |
+
---
|
| 27 |
+
|
| 28 |
+
## Training
|
| 29 |
+
|
| 30 |
+
Trained with sd-scripts by kohya-ss
|
| 31 |
+
|
| 32 |
+
| Setting | Value |
|
| 33 |
+
|---|---|
|
| 34 |
+
| Base Model | Anima-Base-V1.0 |
|
| 35 |
+
| Optimizer | AdamW (fp32 states), weight decay 0.01 |
|
| 36 |
+
| Learning rate | 5e-5, cosine, 500-step warmup |
|
| 37 |
+
| Effective batch | 16 |
|
| 38 |
+
| Steps | 20,000 |
|
| 39 |
+
| Resolution | 1024² |
|
| 40 |
+
| Precision | bf16 (full_bf16) |
|
| 41 |
+
| Flow shift | 5.0 (matches inference) |
|
| 42 |
+
| Loss | L2 on flow-matching velocity |
|
| 43 |
+
| Weighting | uniform |
|
| 44 |
+
|
| 45 |
+
## Tips
|
| 46 |
+
|
| 47 |
+
- **Depth source**: Use DepthAnything V2 for best performance, although this model is trained on a mix of different depth sources, and thus any popular depth preprocessor should in theory work.
|
| 48 |
+
|
| 49 |
+
## Credits
|
| 50 |
+
|
| 51 |
+
- **Anima** - Circlestone Labs
|
| 52 |
+
- **sd-scripts** — kohya-ss.
|
| 53 |
+
|