anima-ref-adapter / guide.ko.md
ElectronGirl's picture
Point links at the ArcAnima organization
b729afd verified
|
Raw History Blame Contribute Delete
8.19 kB
# Anima Reference Adapter ์‚ฌ์šฉ ๊ฐ€์ด๋“œ
[English](guide.en.md) ยท **ํ•œ๊ตญ์–ด** ยท [ๆ—ฅๆœฌ่ชž](guide.ja.md)
์ด ๊ฐ€์ด๋“œ๋Š” ComfyUI์— ์–ด๋Œ‘ํ„ฐ๋ฅผ ์„ค์น˜ํ•˜๊ณ , ์ฒซ ์ด๋ฏธ์ง€๋ฅผ ๋งŒ๋“ค๊ณ , ํ”„๋กฌํ”„ํŠธ๋ฅผ ์“ฐ๊ณ , ๋‘ ์บ๋ฆญํ„ฐ๋ฅผ ํ•จ๊ป˜ ๊ทธ๋ฆฌ๊ณ ,
์„ค์ •์„ ์กฐ์ ˆํ•˜๊ณ , ์ž์ฃผ ์ƒ๊ธฐ๋Š” ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ˆœ์„œ๋Œ€๋กœ ์„ค๋ช…ํ•ฉ๋‹ˆ๋‹ค. ์ž‘๋™ ์›๋ฆฌ์™€ ์ธก์ • ๊ฒฐ๊ณผ๋Š”
[README](https://github.com/ArcAnima/ComfyUI-Anima-Ref-Adapter/blob/main/README.ko.md)์— ์žˆ์Šต๋‹ˆ๋‹ค.
## 1. ์ค€๋น„๋ฌผ
- Anima๋ฅผ ๋Œ๋ฆด ์ˆ˜ ์žˆ๋Š” **ComfyUI**. ์ด๋ฏธ Anima๋กœ ์ด๋ฏธ์ง€๋ฅผ ๋งŒ๋“ค๊ณ  ์žˆ๋‹ค๋ฉด ์ค€๋น„๊ฐ€ ๋๋‚œ ๊ฒƒ์ž…๋‹ˆ๋‹ค.
- [circlestone-labs/Anima](https://huggingface.co/circlestone-labs/Anima)์—์„œ ๋ฐ›๋Š” Anima ํŒŒ์ผ 3๊ฐœ:
- `anima-base-v1.0.safetensors` โ†’ `ComfyUI/models/diffusion_models/`
- `qwen_3_06b_base.safetensors` โ†’ `ComfyUI/models/text_encoders/`
- `qwen_image_vae.safetensors` โ†’ `ComfyUI/models/vae/`
- Anima๋ฅผ ๋Œ๋ฆฌ๋Š” ๋ฐ ํ•„์š”ํ•œ VRAM ์™ธ์— ์•ฝ 1GB๊ฐ€ ๋” ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค. 1MP ๋ ˆํผ๋Ÿฐ์Šค์˜ key/value๋ฅผ ์บ์‹œํ•ด ๋‘๋Š” ๋ฐ ์“ฐ์ž…๋‹ˆ๋‹ค.
8GB์ธ RTX 3060 Ti์—์„œ ํ…Œ์ŠคํŠธํ–ˆ์Šต๋‹ˆ๋‹ค.
์–ด๋Œ‘ํ„ฐ ๊ฐ€์ค‘์น˜๋Š” ๋”ฐ๋กœ ๋ฐ›์ง€ ์•Š์•„๋„ ๋ฉ๋‹ˆ๋‹ค. ์ฒ˜์Œ ์‹คํ–‰ํ•  ๋•Œ ๋…ธ๋“œ๊ฐ€ ์ง์ ‘ ๋ฐ›์•„์˜ต๋‹ˆ๋‹ค.
## 2. ๋…ธ๋“œ ์„ค์น˜
```bash
cd ComfyUI/custom_nodes
git clone https://github.com/ArcAnima/ComfyUI-Anima-Ref-Adapter.git
```
ComfyUI๋ฅผ ์žฌ์‹œ์ž‘ํ•ฉ๋‹ˆ๋‹ค. git์ด ์—†๋‹ค๋ฉด GitHub์—์„œ ZIP์œผ๋กœ ๋ฐ›์•„(Code โ†’ Download ZIP)
`ComfyUI/custom_nodes/`์— ์••์ถ•์„ ํ’€๋ฉด ๋ฉ๋‹ˆ๋‹ค.
## 3. ์ฒซ ์ด๋ฏธ์ง€ ๋งŒ๋“ค๊ธฐ
1. [`anima_ref_adapter.json`](https://github.com/ArcAnima/ComfyUI-Anima-Ref-Adapter/blob/main/workflows/anima_ref_adapter.json)์„
๋ฐ›์•„์„œ ComfyUI ํ™”๋ฉด์— ๋Œ์–ด๋‹ค ๋†“์Šต๋‹ˆ๋‹ค. Anima์˜ ๊ธฐ๋ณธ text-to-image ์›Œํฌํ”Œ๋กœ์— **Anima Ref Adapter** ๋…ธ๋“œ
ํ•˜๋‚˜๋ฅผ ๋ชจ๋ธ ๋กœ๋”์™€ KSampler ์‚ฌ์ด์— ๋”ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค.
2. **Load Image** ๋…ธ๋“œ์—์„œ ๋ ˆํผ๋Ÿฐ์Šค ์ด๋ฏธ์ง€๋ฅผ ๊ณ ๋ฆ…๋‹ˆ๋‹ค.
3. ๊ธ์ • ํ”„๋กฌํ”„ํŠธ์—๋Š” ํ€„๋ฆฌํ‹ฐ ํƒœ๊ทธ๋ฅผ ๊ทธ๋Œ€๋กœ ๋‘๊ณ  ์žฅ๋ฉด๋งŒ ์”๋‹ˆ๋‹ค(4์žฅ ์ฐธ๊ณ ).
4. ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค. ์ฒ˜์Œ ์‹คํ–‰ํ•  ๋•Œ `anima_ref_adapter_v2_r64.safetensors`(183MB)๋ฅผ `ComfyUI/models/loras/`๋กœ
๋ฐ›์•„์˜ค๊ณ , ๊ทธ๋‹ค์Œ๋ถ€ํ„ฐ๋Š” ๋ฐ”๋กœ ์‹œ์ž‘ํ•ฉ๋‹ˆ๋‹ค.
<img src="https://raw.githubusercontent.com/ArcAnima/ComfyUI-Anima-Ref-Adapter/main/docs/showcase/v2_police.jpg" width="100%" alt="๋ ˆํผ๋Ÿฐ์Šค์™€ ๊ฒฐ๊ณผ">
## 4. ํ”„๋กฌํ”„ํŠธ ์“ฐ๋Š” ๋ฒ•
์บ๋ฆญํ„ฐ(์–ผ๊ตด, ๋จธ๋ฆฌ, ๋ˆˆ, ์˜์ƒ, ์žฅ์‹ ๊ตฌ)์™€ ๊ทธ๋ฆผ์ฒด์˜ ์ƒ๋‹น ๋ถ€๋ถ„์€ ๋ ˆํผ๋Ÿฐ์Šค์—์„œ ๊ฐ€์ ธ์˜ต๋‹ˆ๋‹ค. ๋‚˜๋จธ์ง€๋Š” ๋ชจ๋‘
ํ”„๋กฌํ”„ํŠธ์—์„œ ์ •ํ•ฉ๋‹ˆ๋‹ค.
| ์“ธ ๊ฒƒ | ์“ฐ์ง€ ์•Š์„ ๊ฒƒ |
|---|---|
| ํ€„๋ฆฌํ‹ฐ ํƒœ๊ทธ: `masterpiece, best quality, score_7, safe,` | ์บ๋ฆญํ„ฐ ์ด๋ฆ„ |
| `1girl` ๋˜๋Š” `1boy`, ๊ทธ๋ฆฌ๊ณ  `solo` | ์ž‘๊ฐ€ ํƒœ๊ทธ |
| ๊ตฌ๋„: `cowboy shot`, `full body`, `upper body`, `portrait` | ๋จธ๋ฆฌยท๋ˆˆยท์˜์ƒ ํƒœ๊ทธ(๋ช‡ ๊ฐœ ์ •๋„๋Š” ๊ดœ์ฐฎ์Šต๋‹ˆ๋‹ค) |
| ์ž์„ธ์™€ ๋™์ž‘: `sitting`, `lying, on side`, `holding cup` | |
| ํ‘œ์ •: `smile`, `sleepy`, `laughing` | |
| ์žฅ์†Œยท์‹œ๊ฐ„ยท์กฐ๋ช…: `cafe, indoors, day`, `beach, sunset` | |
์˜ˆ์‹œ: `masterpiece, best quality, score_7, safe, 1girl, solo, cowboy shot, sitting, cafe, holding cup, smile, looking at viewer, indoors, window, day`
๋„์›€์ด ๋˜๋Š” ์ :
- ๋ ˆํผ๋Ÿฐ์Šค์™€ ๋‹ค๋ฅธ ์ž์„ธ๋ฅผ ์“ฐ๋Š” ๊ฒƒ์ด ์ข‹์Šต๋‹ˆ๋‹ค. ์–ด๋Œ‘ํ„ฐ๋Š” ๋ ˆํผ๋Ÿฐ์Šค์˜ ์ž์„ธ๋ฅผ ๋”ฐ๋ผ ํ•˜์ง€ ์•Š๋„๋ก ํ•™์Šต๋˜์—ˆ๊ณ ,
ํ”„๋กฌํ”„ํŠธ์— ์ž์„ธ๊ฐ€ ๋ถ„๋ช…ํ•˜๊ฒŒ ์ ํ˜€ ์žˆ์œผ๋ฉด ๊ทธ ํšจ๊ณผ๊ฐ€ ๋” ํ™•์‹คํ•ด์ง‘๋‹ˆ๋‹ค.
- ๋ ˆํผ๋Ÿฐ์Šค์— ๋ณด์ด์ง€ ์•Š๋Š” ๋ถ€๋ถ„(์ƒ๋ฐ˜์‹  ์ด๋ฏธ์ง€์˜ ๋‹ค๋ฆฌ, ์˜์ƒ์˜ ๋’ท๋ฉด ๋“ฑ)์€ ๋ชจ๋ธ์ด ์ถ”์ธกํ•ด์„œ ๊ทธ๋ฆฝ๋‹ˆ๋‹ค.
์บ๋ฆญํ„ฐ ์ „์ฒด๊ฐ€ ๋ณด์ด๋Š” ๋ ˆํผ๋Ÿฐ์Šค๋ฅผ ์“ฐ๋ฉด ์˜์ƒ์ด ๋” ์ผ์ •ํ•˜๊ฒŒ ์œ ์ง€๋ฉ๋‹ˆ๋‹ค.
- ๋ถ€์ • ํ”„๋กฌํ”„ํŠธ๋Š” Anima ๋ชจ๋ธ ์นด๋“œ์— ์žˆ๋Š” ๊ฒƒ์„ ๊ทธ๋Œ€๋กœ ์“ฐ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
## 5. ๋‘ ์บ๋ฆญํ„ฐ ํ•จ๊ป˜ ๊ทธ๋ฆฌ๊ธฐ
<img src="https://raw.githubusercontent.com/ArcAnima/ComfyUI-Anima-Ref-Adapter/main/docs/showcase/v2_duo_police_mecha.jpg" width="100%" alt="๋ ˆํผ๋Ÿฐ์Šค ๋‘ ์žฅ๊ณผ ๊ฒฐ๊ณผ">
1. [`anima_ref_adapter_two_characters.json`](https://github.com/ArcAnima/ComfyUI-Anima-Ref-Adapter/blob/main/workflows/anima_ref_adapter_two_characters.json)์„
์—ฝ๋‹ˆ๋‹ค. **Load Image** ๋…ธ๋“œ ๋‘ ๊ฐœ๋ฅผ ๊ธฐ๋ณธ **Image Stitch** ๋…ธ๋“œ๊ฐ€ ์ขŒ์šฐ๋กœ ์ด์–ด ๋ถ™์ž…๋‹ˆ๋‹ค.
2. ์ฒซ ๋ฒˆ์งธ ์ด๋ฏธ์ง€์—๋Š” ์™ผ์ชฝ์— ์˜ฌ ์บ๋ฆญํ„ฐ๋ฅผ, ๋‘ ๋ฒˆ์งธ ์ด๋ฏธ์ง€์—๋Š” ์˜ค๋ฅธ์ชฝ์— ์˜ฌ ์บ๋ฆญํ„ฐ๋ฅผ ๋„ฃ์Šต๋‹ˆ๋‹ค.
3. `solo` ๋Œ€์‹  `2girls`(๋˜๋Š” `1boy, 1girl`, `2boys`)๋ฅผ ์“ฐ๊ณ , ๋ˆ„๊ฐ€ ์–ด๋А ์ชฝ์ธ์ง€ ๋ช‡ ๋‹จ์–ด๋กœ ์ ์Šต๋‹ˆ๋‹ค.
`2girls, the girl on the left is a policewoman with black hair over one eye, the girl on the right is a mecha girl with aqua hair and mechanical wings, standing side by side, peace sign, smile, city, street, day`
4. 1216x832์ฒ˜๋Ÿผ ๊ฐ€๋กœ๊ฐ€ ๊ธด ํฌ๊ธฐ๋ฅผ ์”๋‹ˆ๋‹ค.
๋‘ ์บ๋ฆญํ„ฐ๋Š” ์„ž์ด์ง€ ์•Š๊ณ  ๋”ฐ๋กœ ๊ทธ๋ ค์ง€์ง€๋งŒ, ๊ทธ๋ฆผ์ฒด๋Š” ๋‘˜์˜ ์ค‘๊ฐ„์ฏค์œผ๋กœ ํ•˜๋‚˜๋กœ ๋งž์ถฐ์ง€๋Š” ๊ฒฝํ–ฅ์ด ์žˆ์Šต๋‹ˆ๋‹ค.
## 6. ์„ค์ •
๋ชจ๋‘ **Anima Ref Adapter** ๋…ธ๋“œ์— ์žˆ์Šต๋‹ˆ๋‹ค.
| ์„ค์ • | ๊ธฐ๋ณธ๊ฐ’ | ์—ญํ•  |
|---|---|---|
| `ref_guidance` | 4.5 | ๋ ˆํผ๋Ÿฐ์Šค ์ชฝ์œผ๋กœ ๋ฏธ๋Š” ์„ธ๊ธฐ์ž…๋‹ˆ๋‹ค. ์บ๋ฆญํ„ฐ๊ฐ€ ๋‹ฌ๋ผ์ง€๋ฉด 5~6์œผ๋กœ ์˜ฌ๋ฆฌ๊ณ , ์ƒ‰์ด ๋„ˆ๋ฌด ์ง„ํ•ด์ง€๋ฉด ๋‚ฎ์ถฅ๋‹ˆ๋‹ค. 1๋กœ ๋‘๋ฉด ๋ชจ๋ธ์„ ํ•œ ๋ฒˆ ๋œ ํ˜ธ์ถœํ•˜๋ฏ€๋กœ ๋น ๋ฅด์ง€๋งŒ ์•ฝํ•ด์ง‘๋‹ˆ๋‹ค. |
| `correction` | `apg` | ๊ฐ€์ด๋˜์Šค๊ฐ€ ๋†’์„ ๋•Œ ์ƒ‰์ด ๊ณผํ•ด์ง€๋Š” ๊ฒƒ์„ ๋ง‰์Šต๋‹ˆ๋‹ค. `rescale`๋„ ์“ธ ์ˆ˜ ์žˆ๊ณ , `none`์€ ๋•๋‹ˆ๋‹ค. |
| `ref_end` | 1.0 | ์ƒ˜ํ”Œ๋ง ์ง„ํ–‰ ์ค‘ ์ด ์ง€์ ๋ถ€ํ„ฐ `ref_guidance`๋ฅผ ๋ฉˆ์ถฅ๋‹ˆ๋‹ค. ๋ ˆํผ๋Ÿฐ์Šค ์ž์ฒด๋Š” ๋๊นŒ์ง€ ์œ ์ง€๋ฉ๋‹ˆ๋‹ค. 0.6 ์ •๋„๋กœ ๋‘๋ฉด ๊ฑฐ์˜ ๊ฐ™์€ ๊ทธ๋ฆผ์„ ๋” ๋นจ๋ฆฌ ์–ป์Šต๋‹ˆ๋‹ค. |
| `ref_megapixels` | 1.0 | ๋ ˆํผ๋Ÿฐ์Šค๋ฅผ ์ค„์ด๊ฑฐ๋‚˜ ๋Š˜๋ฆฌ๋Š” ํฌ๊ธฐ์ž…๋‹ˆ๋‹ค. VRAM์ด ๋ถ€์กฑํ•˜๋ฉด 0.5~0.7๋กœ ๋‚ฎ์ถฅ๋‹ˆ๋‹ค. |
| `strength` | 1.0 | ์–ด๋Œ‘ํ„ฐ LoRA์˜ ์„ธ๊ธฐ์ž…๋‹ˆ๋‹ค. |
๋‹ค๋ฅธ LoRA(๊ทธ๋ฆผ์ฒด, ๋””ํ…Œ์ผ ๋“ฑ)๋Š” ์–ด๋Œ‘ํ„ฐ ๋…ธ๋“œ **์•ž**, ์ฆ‰ ๋ชจ๋ธ ๋กœ๋”์™€ Anima Ref Adapter ์‚ฌ์ด์— ๋‘ก๋‹ˆ๋‹ค.
## 7. ๋” ๋น ๋ฅด๊ฒŒ
| ๋ฐฉ๋ฒ• | ์„ค์ • | ํšจ๊ณผ (RTX 3060 Ti, 832x1216) |
|---|---|---|
| turbo LoRA | Anima base์šฉ turbo LoRA๋ฅผ ์–ด๋Œ‘ํ„ฐ ์•ž์— ๋‘๊ณ  10 steps, cfg 1, `ref_guidance` 1 | 67์ดˆ โ†’ 11์ดˆ. ๋ ˆํผ๋Ÿฐ์Šค ๊ทธ๋ฆผ์ฒด๋Š” ์•ฝํ•ด์ง‘๋‹ˆ๋‹ค. |
| `ref_guidance` 1 | ๋…ธ๋“œ์—์„œ ์„ค์ • | 67์ดˆ โ†’ 50์ดˆ |
| SageAttention | KJNodes์˜ **Patch Sage Attention**์„ ์–ด๋Œ‘ํ„ฐ ์•ž์— ๋‘  | ์•ฝ 7% |
| EasyCache | ๊ธฐ๋ณธ **EasyCache** ๋…ธ๋“œ๋ฅผ ์–ด๋Œ‘ํ„ฐ ๋’ค์— ๋‘  | ์•ฝ 7% |
| `ref_end` 0.6 | ๋…ธ๋“œ์—์„œ ์„ค์ • | ์•ฝ 7% |
## 8. ๋ฌธ์ œ ํ•ด๊ฒฐ
| ์ฆ์ƒ | ํ•ด๊ฒฐ ๋ฐฉ๋ฒ• |
|---|---|
| ๋ ˆํผ๋Ÿฐ์Šค๊ฐ€ ์•„๋‹ˆ๋ผ ํ‰๋ฒ”ํ•œ Anima ๊ทธ๋ฆผ์ด ๋‚˜์˜ต๋‹ˆ๋‹ค | KSampler์˜ `model` ์ž…๋ ฅ์ด ๋ชจ๋ธ ๋กœ๋”๊ฐ€ ์•„๋‹ˆ๋ผ **Anima Ref Adapter**์—์„œ ์˜ค๋Š”์ง€ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค. `ref_guidance`๋ฅผ ์˜ฌ๋ ค ๋ด…๋‹ˆ๋‹ค. |
| ์ƒ‰์ด ๋„ˆ๋ฌด ์ง„ํ•˜๊ฑฐ๋‚˜ ํƒ„ ๊ฒƒ์ฒ˜๋Ÿผ ๋ณด์ž…๋‹ˆ๋‹ค | `ref_guidance`๋ฅผ 3~4๋กœ ๋‚ฎ์ถ”๊ณ  `correction`์€ `apg`๋กœ ๋‘ก๋‹ˆ๋‹ค. |
| ๋ ˆํผ๋Ÿฐ์Šค์˜ ์ž์„ธ๋ฅผ ๊ทธ๋Œ€๋กœ ๋”ฐ๋ผ ํ•ฉ๋‹ˆ๋‹ค | ํ”„๋กฌํ”„ํŠธ์— ๋ ˆํผ๋Ÿฐ์Šค์™€ ๋‹ค๋ฅธ ์ž์„ธ์™€ ๊ตฌ๋„๋ฅผ ๋ถ„๋ช…ํ•˜๊ฒŒ ์”๋‹ˆ๋‹ค. |
| ๋ ˆํผ๋Ÿฐ์Šค ์บ๋ฆญํ„ฐ๊ฐ€ ์žฅ๋ฉด ์•ˆ์— ํฌ์Šคํ„ฐ๋‚˜ ํ”ผ๊ทœ์–ด๋กœ ๋‹ค์‹œ ๋‚˜์˜ต๋‹ˆ๋‹ค | ์•Œ๋ ค์ง„ ํ•œ๊ณ„์ž…๋‹ˆ๋‹ค. ์‹œ๋“œ๋ฅผ ๋ฐ”๊พธ๊ฑฐ๋‚˜ `ref_guidance`๋ฅผ ๋‚ฎ์ถฅ๋‹ˆ๋‹ค. |
| ์ž๋™ ๋‹ค์šด๋กœ๋“œ๊ฐ€ ์‹คํŒจํ•ฉ๋‹ˆ๋‹ค | [`anima_ref_adapter_v2_r64.safetensors`](https://huggingface.co/ElectronGirl/anima-ref-adapter/blob/main/anima_ref_adapter_v2_r64.safetensors)๋ฅผ ์ง์ ‘ ๋ฐ›์•„ `ComfyUI/models/loras/`์— ๋„ฃ์Šต๋‹ˆ๋‹ค. |
| ๋ฉ”๋ชจ๋ฆฌ๊ฐ€ ๋ถ€์กฑํ•ฉ๋‹ˆ๋‹ค | `ref_megapixels`๋ฅผ ๋‚ฎ์ถ”๊ฑฐ๋‚˜ ์ถœ๋ ฅ ํฌ๊ธฐ๋ฅผ ์ค„์ž…๋‹ˆ๋‹ค. |
| ํŒŒ์ผ๋Ÿฟ ์–ด๋Œ‘ํ„ฐ๋ฅผ ์“ฐ๊ณ  ์‹ถ์Šต๋‹ˆ๋‹ค | [`anima_ref_adapter_advanced.json`](https://github.com/ArcAnima/ComfyUI-Anima-Ref-Adapter/blob/main/workflows/anima_ref_adapter_advanced.json)์„ ์”๋‹ˆ๋‹ค. ํŒŒ์ผ๋Ÿฟ์€ ๋ ˆํผ๋Ÿฐ์Šค๊ฐ€ ์ถœ๋ ฅ๊ณผ ๊ฐ™์€ ํฌ๊ธฐ์—ฌ์•ผ ํ•ฉ๋‹ˆ๋‹ค. |
## 9. Forge Neo
Stable Diffusion WebUI Forge (Neo)์šฉ ํ™•์žฅ๋„ ์žˆ์Šต๋‹ˆ๋‹ค:
[sd-forge-anima-ref-adapter](https://github.com/ElectronGirl/sd-forge-anima-ref-adapter).