anima-ref-adapter / guide.ko.md
ElectronGirl's picture
Point links at the ArcAnima organization
b729afd verified
|
Raw History Blame Contribute Delete
8.19 kB

Anima Reference Adapter ์‚ฌ์šฉ ๊ฐ€์ด๋“œ

English ยท ํ•œ๊ตญ์–ด ยท ๆ—ฅๆœฌ่ชž

์ด ๊ฐ€์ด๋“œ๋Š” ComfyUI์— ์–ด๋Œ‘ํ„ฐ๋ฅผ ์„ค์น˜ํ•˜๊ณ , ์ฒซ ์ด๋ฏธ์ง€๋ฅผ ๋งŒ๋“ค๊ณ , ํ”„๋กฌํ”„ํŠธ๋ฅผ ์“ฐ๊ณ , ๋‘ ์บ๋ฆญํ„ฐ๋ฅผ ํ•จ๊ป˜ ๊ทธ๋ฆฌ๊ณ , ์„ค์ •์„ ์กฐ์ ˆํ•˜๊ณ , ์ž์ฃผ ์ƒ๊ธฐ๋Š” ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ˆœ์„œ๋Œ€๋กœ ์„ค๋ช…ํ•ฉ๋‹ˆ๋‹ค. ์ž‘๋™ ์›๋ฆฌ์™€ ์ธก์ • ๊ฒฐ๊ณผ๋Š” README์— ์žˆ์Šต๋‹ˆ๋‹ค.

1. ์ค€๋น„๋ฌผ

  • Anima๋ฅผ ๋Œ๋ฆด ์ˆ˜ ์žˆ๋Š” ComfyUI. ์ด๋ฏธ Anima๋กœ ์ด๋ฏธ์ง€๋ฅผ ๋งŒ๋“ค๊ณ  ์žˆ๋‹ค๋ฉด ์ค€๋น„๊ฐ€ ๋๋‚œ ๊ฒƒ์ž…๋‹ˆ๋‹ค.
  • circlestone-labs/Anima์—์„œ ๋ฐ›๋Š” Anima ํŒŒ์ผ 3๊ฐœ:
    • anima-base-v1.0.safetensors โ†’ ComfyUI/models/diffusion_models/
    • qwen_3_06b_base.safetensors โ†’ ComfyUI/models/text_encoders/
    • qwen_image_vae.safetensors โ†’ ComfyUI/models/vae/
  • Anima๋ฅผ ๋Œ๋ฆฌ๋Š” ๋ฐ ํ•„์š”ํ•œ VRAM ์™ธ์— ์•ฝ 1GB๊ฐ€ ๋” ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค. 1MP ๋ ˆํผ๋Ÿฐ์Šค์˜ key/value๋ฅผ ์บ์‹œํ•ด ๋‘๋Š” ๋ฐ ์“ฐ์ž…๋‹ˆ๋‹ค. 8GB์ธ RTX 3060 Ti์—์„œ ํ…Œ์ŠคํŠธํ–ˆ์Šต๋‹ˆ๋‹ค.

์–ด๋Œ‘ํ„ฐ ๊ฐ€์ค‘์น˜๋Š” ๋”ฐ๋กœ ๋ฐ›์ง€ ์•Š์•„๋„ ๋ฉ๋‹ˆ๋‹ค. ์ฒ˜์Œ ์‹คํ–‰ํ•  ๋•Œ ๋…ธ๋“œ๊ฐ€ ์ง์ ‘ ๋ฐ›์•„์˜ต๋‹ˆ๋‹ค.

2. ๋…ธ๋“œ ์„ค์น˜

cd ComfyUI/custom_nodes
git clone https://github.com/ArcAnima/ComfyUI-Anima-Ref-Adapter.git

ComfyUI๋ฅผ ์žฌ์‹œ์ž‘ํ•ฉ๋‹ˆ๋‹ค. git์ด ์—†๋‹ค๋ฉด GitHub์—์„œ ZIP์œผ๋กœ ๋ฐ›์•„(Code โ†’ Download ZIP) ComfyUI/custom_nodes/์— ์••์ถ•์„ ํ’€๋ฉด ๋ฉ๋‹ˆ๋‹ค.

3. ์ฒซ ์ด๋ฏธ์ง€ ๋งŒ๋“ค๊ธฐ

  1. anima_ref_adapter.json์„ ๋ฐ›์•„์„œ ComfyUI ํ™”๋ฉด์— ๋Œ์–ด๋‹ค ๋†“์Šต๋‹ˆ๋‹ค. Anima์˜ ๊ธฐ๋ณธ text-to-image ์›Œํฌํ”Œ๋กœ์— Anima Ref Adapter ๋…ธ๋“œ ํ•˜๋‚˜๋ฅผ ๋ชจ๋ธ ๋กœ๋”์™€ KSampler ์‚ฌ์ด์— ๋”ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค.
  2. Load Image ๋…ธ๋“œ์—์„œ ๋ ˆํผ๋Ÿฐ์Šค ์ด๋ฏธ์ง€๋ฅผ ๊ณ ๋ฆ…๋‹ˆ๋‹ค.
  3. ๊ธ์ • ํ”„๋กฌํ”„ํŠธ์—๋Š” ํ€„๋ฆฌํ‹ฐ ํƒœ๊ทธ๋ฅผ ๊ทธ๋Œ€๋กœ ๋‘๊ณ  ์žฅ๋ฉด๋งŒ ์”๋‹ˆ๋‹ค(4์žฅ ์ฐธ๊ณ ).
  4. ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค. ์ฒ˜์Œ ์‹คํ–‰ํ•  ๋•Œ anima_ref_adapter_v2_r64.safetensors(183MB)๋ฅผ ComfyUI/models/loras/๋กœ ๋ฐ›์•„์˜ค๊ณ , ๊ทธ๋‹ค์Œ๋ถ€ํ„ฐ๋Š” ๋ฐ”๋กœ ์‹œ์ž‘ํ•ฉ๋‹ˆ๋‹ค.
๋ ˆํผ๋Ÿฐ์Šค์™€ ๊ฒฐ๊ณผ

4. ํ”„๋กฌํ”„ํŠธ ์“ฐ๋Š” ๋ฒ•

์บ๋ฆญํ„ฐ(์–ผ๊ตด, ๋จธ๋ฆฌ, ๋ˆˆ, ์˜์ƒ, ์žฅ์‹ ๊ตฌ)์™€ ๊ทธ๋ฆผ์ฒด์˜ ์ƒ๋‹น ๋ถ€๋ถ„์€ ๋ ˆํผ๋Ÿฐ์Šค์—์„œ ๊ฐ€์ ธ์˜ต๋‹ˆ๋‹ค. ๋‚˜๋จธ์ง€๋Š” ๋ชจ๋‘ ํ”„๋กฌํ”„ํŠธ์—์„œ ์ •ํ•ฉ๋‹ˆ๋‹ค.

์“ธ ๊ฒƒ ์“ฐ์ง€ ์•Š์„ ๊ฒƒ
ํ€„๋ฆฌํ‹ฐ ํƒœ๊ทธ: masterpiece, best quality, score_7, safe, ์บ๋ฆญํ„ฐ ์ด๋ฆ„
1girl ๋˜๋Š” 1boy, ๊ทธ๋ฆฌ๊ณ  solo ์ž‘๊ฐ€ ํƒœ๊ทธ
๊ตฌ๋„: cowboy shot, full body, upper body, portrait ๋จธ๋ฆฌยท๋ˆˆยท์˜์ƒ ํƒœ๊ทธ(๋ช‡ ๊ฐœ ์ •๋„๋Š” ๊ดœ์ฐฎ์Šต๋‹ˆ๋‹ค)
์ž์„ธ์™€ ๋™์ž‘: sitting, lying, on side, holding cup
ํ‘œ์ •: smile, sleepy, laughing
์žฅ์†Œยท์‹œ๊ฐ„ยท์กฐ๋ช…: cafe, indoors, day, beach, sunset

์˜ˆ์‹œ: masterpiece, best quality, score_7, safe, 1girl, solo, cowboy shot, sitting, cafe, holding cup, smile, looking at viewer, indoors, window, day

๋„์›€์ด ๋˜๋Š” ์ :

  • ๋ ˆํผ๋Ÿฐ์Šค์™€ ๋‹ค๋ฅธ ์ž์„ธ๋ฅผ ์“ฐ๋Š” ๊ฒƒ์ด ์ข‹์Šต๋‹ˆ๋‹ค. ์–ด๋Œ‘ํ„ฐ๋Š” ๋ ˆํผ๋Ÿฐ์Šค์˜ ์ž์„ธ๋ฅผ ๋”ฐ๋ผ ํ•˜์ง€ ์•Š๋„๋ก ํ•™์Šต๋˜์—ˆ๊ณ , ํ”„๋กฌํ”„ํŠธ์— ์ž์„ธ๊ฐ€ ๋ถ„๋ช…ํ•˜๊ฒŒ ์ ํ˜€ ์žˆ์œผ๋ฉด ๊ทธ ํšจ๊ณผ๊ฐ€ ๋” ํ™•์‹คํ•ด์ง‘๋‹ˆ๋‹ค.
  • ๋ ˆํผ๋Ÿฐ์Šค์— ๋ณด์ด์ง€ ์•Š๋Š” ๋ถ€๋ถ„(์ƒ๋ฐ˜์‹  ์ด๋ฏธ์ง€์˜ ๋‹ค๋ฆฌ, ์˜์ƒ์˜ ๋’ท๋ฉด ๋“ฑ)์€ ๋ชจ๋ธ์ด ์ถ”์ธกํ•ด์„œ ๊ทธ๋ฆฝ๋‹ˆ๋‹ค. ์บ๋ฆญํ„ฐ ์ „์ฒด๊ฐ€ ๋ณด์ด๋Š” ๋ ˆํผ๋Ÿฐ์Šค๋ฅผ ์“ฐ๋ฉด ์˜์ƒ์ด ๋” ์ผ์ •ํ•˜๊ฒŒ ์œ ์ง€๋ฉ๋‹ˆ๋‹ค.
  • ๋ถ€์ • ํ”„๋กฌํ”„ํŠธ๋Š” Anima ๋ชจ๋ธ ์นด๋“œ์— ์žˆ๋Š” ๊ฒƒ์„ ๊ทธ๋Œ€๋กœ ์“ฐ๋ฉด ๋ฉ๋‹ˆ๋‹ค.

5. ๋‘ ์บ๋ฆญํ„ฐ ํ•จ๊ป˜ ๊ทธ๋ฆฌ๊ธฐ

๋ ˆํผ๋Ÿฐ์Šค ๋‘ ์žฅ๊ณผ ๊ฒฐ๊ณผ
  1. anima_ref_adapter_two_characters.json์„ ์—ฝ๋‹ˆ๋‹ค. Load Image ๋…ธ๋“œ ๋‘ ๊ฐœ๋ฅผ ๊ธฐ๋ณธ Image Stitch ๋…ธ๋“œ๊ฐ€ ์ขŒ์šฐ๋กœ ์ด์–ด ๋ถ™์ž…๋‹ˆ๋‹ค.
  2. ์ฒซ ๋ฒˆ์งธ ์ด๋ฏธ์ง€์—๋Š” ์™ผ์ชฝ์— ์˜ฌ ์บ๋ฆญํ„ฐ๋ฅผ, ๋‘ ๋ฒˆ์งธ ์ด๋ฏธ์ง€์—๋Š” ์˜ค๋ฅธ์ชฝ์— ์˜ฌ ์บ๋ฆญํ„ฐ๋ฅผ ๋„ฃ์Šต๋‹ˆ๋‹ค.
  3. solo ๋Œ€์‹  2girls(๋˜๋Š” 1boy, 1girl, 2boys)๋ฅผ ์“ฐ๊ณ , ๋ˆ„๊ฐ€ ์–ด๋А ์ชฝ์ธ์ง€ ๋ช‡ ๋‹จ์–ด๋กœ ์ ์Šต๋‹ˆ๋‹ค. 2girls, the girl on the left is a policewoman with black hair over one eye, the girl on the right is a mecha girl with aqua hair and mechanical wings, standing side by side, peace sign, smile, city, street, day
  4. 1216x832์ฒ˜๋Ÿผ ๊ฐ€๋กœ๊ฐ€ ๊ธด ํฌ๊ธฐ๋ฅผ ์”๋‹ˆ๋‹ค.

๋‘ ์บ๋ฆญํ„ฐ๋Š” ์„ž์ด์ง€ ์•Š๊ณ  ๋”ฐ๋กœ ๊ทธ๋ ค์ง€์ง€๋งŒ, ๊ทธ๋ฆผ์ฒด๋Š” ๋‘˜์˜ ์ค‘๊ฐ„์ฏค์œผ๋กœ ํ•˜๋‚˜๋กœ ๋งž์ถฐ์ง€๋Š” ๊ฒฝํ–ฅ์ด ์žˆ์Šต๋‹ˆ๋‹ค.

6. ์„ค์ •

๋ชจ๋‘ Anima Ref Adapter ๋…ธ๋“œ์— ์žˆ์Šต๋‹ˆ๋‹ค.

์„ค์ • ๊ธฐ๋ณธ๊ฐ’ ์—ญํ• 
ref_guidance 4.5 ๋ ˆํผ๋Ÿฐ์Šค ์ชฝ์œผ๋กœ ๋ฏธ๋Š” ์„ธ๊ธฐ์ž…๋‹ˆ๋‹ค. ์บ๋ฆญํ„ฐ๊ฐ€ ๋‹ฌ๋ผ์ง€๋ฉด 5~6์œผ๋กœ ์˜ฌ๋ฆฌ๊ณ , ์ƒ‰์ด ๋„ˆ๋ฌด ์ง„ํ•ด์ง€๋ฉด ๋‚ฎ์ถฅ๋‹ˆ๋‹ค. 1๋กœ ๋‘๋ฉด ๋ชจ๋ธ์„ ํ•œ ๋ฒˆ ๋œ ํ˜ธ์ถœํ•˜๋ฏ€๋กœ ๋น ๋ฅด์ง€๋งŒ ์•ฝํ•ด์ง‘๋‹ˆ๋‹ค.
correction apg ๊ฐ€์ด๋˜์Šค๊ฐ€ ๋†’์„ ๋•Œ ์ƒ‰์ด ๊ณผํ•ด์ง€๋Š” ๊ฒƒ์„ ๋ง‰์Šต๋‹ˆ๋‹ค. rescale๋„ ์“ธ ์ˆ˜ ์žˆ๊ณ , none์€ ๋•๋‹ˆ๋‹ค.
ref_end 1.0 ์ƒ˜ํ”Œ๋ง ์ง„ํ–‰ ์ค‘ ์ด ์ง€์ ๋ถ€ํ„ฐ ref_guidance๋ฅผ ๋ฉˆ์ถฅ๋‹ˆ๋‹ค. ๋ ˆํผ๋Ÿฐ์Šค ์ž์ฒด๋Š” ๋๊นŒ์ง€ ์œ ์ง€๋ฉ๋‹ˆ๋‹ค. 0.6 ์ •๋„๋กœ ๋‘๋ฉด ๊ฑฐ์˜ ๊ฐ™์€ ๊ทธ๋ฆผ์„ ๋” ๋นจ๋ฆฌ ์–ป์Šต๋‹ˆ๋‹ค.
ref_megapixels 1.0 ๋ ˆํผ๋Ÿฐ์Šค๋ฅผ ์ค„์ด๊ฑฐ๋‚˜ ๋Š˜๋ฆฌ๋Š” ํฌ๊ธฐ์ž…๋‹ˆ๋‹ค. VRAM์ด ๋ถ€์กฑํ•˜๋ฉด 0.5~0.7๋กœ ๋‚ฎ์ถฅ๋‹ˆ๋‹ค.
strength 1.0 ์–ด๋Œ‘ํ„ฐ LoRA์˜ ์„ธ๊ธฐ์ž…๋‹ˆ๋‹ค.

๋‹ค๋ฅธ LoRA(๊ทธ๋ฆผ์ฒด, ๋””ํ…Œ์ผ ๋“ฑ)๋Š” ์–ด๋Œ‘ํ„ฐ ๋…ธ๋“œ ์•ž, ์ฆ‰ ๋ชจ๋ธ ๋กœ๋”์™€ Anima Ref Adapter ์‚ฌ์ด์— ๋‘ก๋‹ˆ๋‹ค.

7. ๋” ๋น ๋ฅด๊ฒŒ

๋ฐฉ๋ฒ• ์„ค์ • ํšจ๊ณผ (RTX 3060 Ti, 832x1216)
turbo LoRA Anima base์šฉ turbo LoRA๋ฅผ ์–ด๋Œ‘ํ„ฐ ์•ž์— ๋‘๊ณ  10 steps, cfg 1, ref_guidance 1 67์ดˆ โ†’ 11์ดˆ. ๋ ˆํผ๋Ÿฐ์Šค ๊ทธ๋ฆผ์ฒด๋Š” ์•ฝํ•ด์ง‘๋‹ˆ๋‹ค.
ref_guidance 1 ๋…ธ๋“œ์—์„œ ์„ค์ • 67์ดˆ โ†’ 50์ดˆ
SageAttention KJNodes์˜ Patch Sage Attention์„ ์–ด๋Œ‘ํ„ฐ ์•ž์— ๋‘  ์•ฝ 7%
EasyCache ๊ธฐ๋ณธ EasyCache ๋…ธ๋“œ๋ฅผ ์–ด๋Œ‘ํ„ฐ ๋’ค์— ๋‘  ์•ฝ 7%
ref_end 0.6 ๋…ธ๋“œ์—์„œ ์„ค์ • ์•ฝ 7%

8. ๋ฌธ์ œ ํ•ด๊ฒฐ

์ฆ์ƒ ํ•ด๊ฒฐ ๋ฐฉ๋ฒ•
๋ ˆํผ๋Ÿฐ์Šค๊ฐ€ ์•„๋‹ˆ๋ผ ํ‰๋ฒ”ํ•œ Anima ๊ทธ๋ฆผ์ด ๋‚˜์˜ต๋‹ˆ๋‹ค KSampler์˜ model ์ž…๋ ฅ์ด ๋ชจ๋ธ ๋กœ๋”๊ฐ€ ์•„๋‹ˆ๋ผ Anima Ref Adapter์—์„œ ์˜ค๋Š”์ง€ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค. ref_guidance๋ฅผ ์˜ฌ๋ ค ๋ด…๋‹ˆ๋‹ค.
์ƒ‰์ด ๋„ˆ๋ฌด ์ง„ํ•˜๊ฑฐ๋‚˜ ํƒ„ ๊ฒƒ์ฒ˜๋Ÿผ ๋ณด์ž…๋‹ˆ๋‹ค ref_guidance๋ฅผ 3~4๋กœ ๋‚ฎ์ถ”๊ณ  correction์€ apg๋กœ ๋‘ก๋‹ˆ๋‹ค.
๋ ˆํผ๋Ÿฐ์Šค์˜ ์ž์„ธ๋ฅผ ๊ทธ๋Œ€๋กœ ๋”ฐ๋ผ ํ•ฉ๋‹ˆ๋‹ค ํ”„๋กฌํ”„ํŠธ์— ๋ ˆํผ๋Ÿฐ์Šค์™€ ๋‹ค๋ฅธ ์ž์„ธ์™€ ๊ตฌ๋„๋ฅผ ๋ถ„๋ช…ํ•˜๊ฒŒ ์”๋‹ˆ๋‹ค.
๋ ˆํผ๋Ÿฐ์Šค ์บ๋ฆญํ„ฐ๊ฐ€ ์žฅ๋ฉด ์•ˆ์— ํฌ์Šคํ„ฐ๋‚˜ ํ”ผ๊ทœ์–ด๋กœ ๋‹ค์‹œ ๋‚˜์˜ต๋‹ˆ๋‹ค ์•Œ๋ ค์ง„ ํ•œ๊ณ„์ž…๋‹ˆ๋‹ค. ์‹œ๋“œ๋ฅผ ๋ฐ”๊พธ๊ฑฐ๋‚˜ ref_guidance๋ฅผ ๋‚ฎ์ถฅ๋‹ˆ๋‹ค.
์ž๋™ ๋‹ค์šด๋กœ๋“œ๊ฐ€ ์‹คํŒจํ•ฉ๋‹ˆ๋‹ค anima_ref_adapter_v2_r64.safetensors๋ฅผ ์ง์ ‘ ๋ฐ›์•„ ComfyUI/models/loras/์— ๋„ฃ์Šต๋‹ˆ๋‹ค.
๋ฉ”๋ชจ๋ฆฌ๊ฐ€ ๋ถ€์กฑํ•ฉ๋‹ˆ๋‹ค ref_megapixels๋ฅผ ๋‚ฎ์ถ”๊ฑฐ๋‚˜ ์ถœ๋ ฅ ํฌ๊ธฐ๋ฅผ ์ค„์ž…๋‹ˆ๋‹ค.
ํŒŒ์ผ๋Ÿฟ ์–ด๋Œ‘ํ„ฐ๋ฅผ ์“ฐ๊ณ  ์‹ถ์Šต๋‹ˆ๋‹ค anima_ref_adapter_advanced.json์„ ์”๋‹ˆ๋‹ค. ํŒŒ์ผ๋Ÿฟ์€ ๋ ˆํผ๋Ÿฐ์Šค๊ฐ€ ์ถœ๋ ฅ๊ณผ ๊ฐ™์€ ํฌ๊ธฐ์—ฌ์•ผ ํ•ฉ๋‹ˆ๋‹ค.

9. Forge Neo

Stable Diffusion WebUI Forge (Neo)์šฉ ํ™•์žฅ๋„ ์žˆ์Šต๋‹ˆ๋‹ค: sd-forge-anima-ref-adapter.