anima-ref-adapter / README.ko.md
BZMLJQ's picture ElectronGirl's picture
Duplicate from ElectronGirl/anima-ref-adapter
6d60975
|
Raw History Blame Contribute Delete
12.7 kB
<div align="center">
<img src="showcase/banner.jpg" width="100%" alt="Anima Reference Adapter v2">
# Anima Reference Adapter (v2)
**๋ ˆํผ๋Ÿฐ์Šค ์ด๋ฏธ์ง€์—์„œ ์บ๋ฆญํ„ฐ์™€ ๊ทธ๋ฆผ์ฒด๋ฅผ, ํ”„๋กฌํ”„ํŠธ์—์„œ ์ž์„ธยท์žฅ์†Œยท๊ตฌ๋„๋ฅผ.**
[![Weights](https://img.shields.io/badge/%F0%9F%A4%97%20weights-anima--ref--adapter-ffcc4d)](https://huggingface.co/ElectronGirl/anima-ref-adapter)
[![Nodes](https://img.shields.io/badge/%F0%9F%A7%A9%20ComfyUI-nodes-1f6feb)](https://github.com/ElectronGirl/ComfyUI-Anima-Ref-Adapter)
[![Training code](https://img.shields.io/badge/%F0%9F%94%AC%20training-code-8a63d2)](https://github.com/ElectronGirl/anima-ref-adapter-research)
[![Ko-fi](https://img.shields.io/badge/Ko--fi-support%20training-ff5e5b?logo=ko-fi&logoColor=white)](https://ko-fi.com/electrongirl)
[์‡ผ์ผ€์ด์Šค](#์‡ผ์ผ€์ด์Šค) ยท [๋น ๋ฅธ ์‹œ์ž‘](#๋น ๋ฅธ-์‹œ์ž‘) ยท [์‚ฌ์šฉ ๊ฐ€์ด๋“œ](guide.ko.md) ยท [์†๋„](#์†๋„์™€-ํ˜ธํ™˜์„ฑ) ยท [ํ•™์Šต ์ฝ”๋“œ](https://github.com/ElectronGirl/anima-ref-adapter-research)
[English](README.md) ยท **ํ•œ๊ตญ์–ด** ยท [ๆ—ฅๆœฌ่ชž](README.ja.md)
</div>
<br>
[Anima](https://huggingface.co/circlestone-labs/Anima)์— ๋ ˆํผ๋Ÿฐ์Šค ์ด๋ฏธ์ง€ ํ•œ ์žฅ๊ณผ ์žฅ๋ฉด๋งŒ ์ ์€ ํ”„๋กฌํ”„ํŠธ๋ฅผ
์ฃผ๋ฉด, ์–ด๋Œ‘ํ„ฐ๊ฐ€ **๋ˆ„๊ตฌ๋ฅผ** ๊ทธ๋ฆฌ๋Š”์ง€(๋จธ๋ฆฌ, ๋ˆˆ, ์˜์ƒ, ์žฅ์‹ ๊ตฌ)์™€ **์–ด๋–ป๊ฒŒ** ๊ทธ๋ฆฌ๋Š”์ง€์˜ ์ƒ๋‹น ๋ถ€๋ถ„์„ ๋ ˆํผ๋Ÿฐ์Šค์—์„œ
๊ฐ€์ ธ์˜ต๋‹ˆ๋‹ค. **์ž์„ธ, ๋ฐฐ๊ฒฝ, ๊ตฌ๋„๋Š” ํ”„๋กฌํ”„ํŠธ๋ฅผ ๋”ฐ๋ฆ…๋‹ˆ๋‹ค.** ์บ๋ฆญํ„ฐ ์ด๋ฆ„์ด๋‚˜ ์ž‘๊ฐ€ยท์˜์ƒ ํƒœ๊ทธ๊ฐ€ ํ•„์š” ์—†์œผ๋ฏ€๋กœ
์˜ค๋ฆฌ์ง€๋„ ์บ๋ฆญํ„ฐ์—๋„ ์“ธ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋ ˆํผ๋Ÿฐ์Šค ๋‘ ์žฅ์„ ๋‚˜๋ž€ํžˆ ๋‘๋ฉด ๋‘ ์บ๋ฆญํ„ฐ๋ฅผ ํ•œ ์žฅ์— ๊ทธ๋ฆด ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
> **์ผ๋ฐ˜ LoRA๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค.** **[ElectronGirl/ComfyUI-Anima-Ref-Adapter](https://github.com/ElectronGirl/ComfyUI-Anima-Ref-Adapter)**์˜ **Anima Ref Adapter** ๋…ธ๋“œ๊ฐ€ ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.
> **์ž๊ธˆ ๋ถ€์กฑ์œผ๋กœ ๊ฐœ๋ฐœ์ด ์ค‘๋‹จ๋˜์—ˆ์Šต๋‹ˆ๋‹ค.** ์ง€๊ธˆ์€ ์ถ”๊ฐ€ ํ•™์Šต์„ ํ•  ์ˆ˜ ์—†๊ณ , ๊ณ„ํšํ–ˆ๋˜ ์บ๋ฆญํ„ฐยท๊ทธ๋ฆผ์ฒด ๋ถ„๋ฆฌ
> ๋ ˆํผ๋Ÿฐ์Šค๋Š” ๊ณต๊ฐœํ•˜์ง€ ๋ชปํ–ˆ์Šต๋‹ˆ๋‹ค. ํ•™์Šต ์ฝ”๋“œ์™€ ๋ฐ์ดํ„ฐ ์ƒ์„ฑ ์ฝ”๋“œ, ์‹คํ—˜ ๊ธฐ๋ก์€
> **[anima-ref-adapter-research](https://github.com/ElectronGirl/anima-ref-adapter-research)**์— ๊ณต๊ฐœ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. ์ถ”๊ฐ€ ํ•™์Šต์„ ํ›„์›ํ•˜๋ ค๋ฉด **[Ko-fi](https://ko-fi.com/electrongirl)**๋ฅผ ์ด์šฉํ•ด ์ฃผ์„ธ์š”.
## v2์˜ ์ƒˆ๋กœ์šด ์ 
| | |
|---|---|
| โšก **ํŒŒ์ผ๋Ÿฟ๋ณด๋‹ค ์•ฝ 2๋ฐฐ ๋น ๋ฆ„** | RTX PRO 6000์—์„œ ์ƒ˜ํ”Œ๋ง ์Šคํ…๋‹น 2.1๋ฐฐ ๋น ๋ฆ…๋‹ˆ๋‹ค. RTX 3060 Ti์—์„œ๋Š” 832x1216 ์ด๋ฏธ์ง€ ํ•œ ์žฅ์ด 105์ดˆ์—์„œ 65์ดˆ๋กœ ์ค„์—ˆ๊ณ , ๋ ˆํผ๋Ÿฐ์Šค ๋•Œ๋ฌธ์— ๋Š˜์–ด๋‚˜๋Š” ์‹œ๊ฐ„์€ 72์ดˆ์—์„œ 32์ดˆ๋กœ ์ค„์—ˆ์Šต๋‹ˆ๋‹ค. ๋ ˆํผ๋Ÿฐ์Šค์˜ KV๋ฅผ ์Šคํ…๋งˆ๋‹ค ๋‹ค์‹œ ๊ณ„์‚ฐํ•˜์ง€ ์•Š๊ณ  ์ด๋ฏธ์ง€๋‹น ํ•œ ๋ฒˆ๋งŒ ๊ณ„์‚ฐํ•ด ์บ์‹œํ•ฉ๋‹ˆ๋‹ค. |
| ๐Ÿงฉ **๋…ธ๋“œ ํ•˜๋‚˜** | **Anima Ref Adapter** ๋…ธ๋“œ ํ•˜๋‚˜๋ฅผ Anima ๊ธฐ๋ณธ ์›Œํฌํ”Œ๋กœ์— ๋ผ์šฐ๋ฉด KSampler๋ฅผ ๋น„๋กฏํ•œ ์–ด๋–ค ์ƒ˜ํ”Œ๋Ÿฌ์™€๋„ ๋™์ž‘ํ•ฉ๋‹ˆ๋‹ค. ๊ฐ€์ค‘์น˜๋Š” ์ฒ˜์Œ ์‹คํ–‰ํ•  ๋•Œ ์ž๋™์œผ๋กœ ๋ฐ›์•„์˜ต๋‹ˆ๋‹ค. |
| ๐Ÿ‘ฅ **๋‘ ์บ๋ฆญํ„ฐ** | ๋ ˆํผ๋Ÿฐ์Šค ๋‘ ์žฅ์„ ๋‚˜๋ž€ํžˆ ๋‘๊ณ , ํ”„๋กฌํ”„ํŠธ์— ๋ˆ„๊ฐ€ ์–ด๋А ์ชฝ์ธ์ง€ ์ ์œผ๋ฉด ๋ฉ๋‹ˆ๋‹ค. |
| ๐Ÿ“š **๋” ๋งŽ์€ ํ•™์Šต ๋ฐ์ดํ„ฐ** | ์บ๋ฆญํ„ฐ 2,300๋ช…, ์ž‘๊ฐ€ ๊ทธ๋ฆผ์ฒด 1,952๊ฐœ, ์ด๋ฏธ์ง€ 15,600์žฅ์œผ๋กœ ํ•™์Šตํ–ˆ์Šต๋‹ˆ๋‹ค(ํŒŒ์ผ๋Ÿฟ: ์ด๋ฏธ์ง€ 3,600์žฅ, ์บ๋ฆญํ„ฐ 300๋ช…). rank 64์ž…๋‹ˆ๋‹ค. |
## ์‡ผ์ผ€์ด์Šค
[๋…ธ๋“œ ํ•˜๋‚˜์งœ๋ฆฌ ์›Œํฌํ”Œ๋กœ](workflows/anima_ref_adapter.json)๋ฅผ Anima ๊ธฐ๋ณธ ์„ค์ •์œผ๋กœ ๋Œ๋ฆฐ ๊ฒฐ๊ณผ์ž…๋‹ˆ๋‹ค: er_sde, 30 steps,
cfg 4.5, `ref_guidance` 4.5 + APG, ํ”„๋กฌํ”„ํŠธ๋Š” `masterpiece, best quality, score_7, safe, 1girl, solo, <์žฅ๋ฉด>`, ๋ถ€์ • ํ”„๋กฌํ”„ํŠธ๋Š” Anima ๋ชจ๋ธ ์นด๋“œ์˜ ๊ฒƒ์„
์ผ์Šต๋‹ˆ๋‹ค. ๋‹ค๋ฅธ LoRA๋Š” ์“ฐ์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. ์ด๋ฏธ์ง€๋งˆ๋‹ค ์‹œ๋“œ ํ•˜๋‚˜๋งŒ ์ผ๊ณ  ๊ณจ๋ผ๋‚ด์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. ๋‹จ, ๋ˆ„์šด ์ž์„ธ๋Š” 6์žฅ ์ค‘
๊ฐ€์žฅ ๋‚˜์€ ๊ฒƒ์„ ๊ณจ๋ž์Šต๋‹ˆ๋‹ค.
### ๋ ˆํผ๋Ÿฐ์Šค ํ•œ ์žฅ
<img src="showcase/v2_police.jpg" width="100%" alt="reference and two scenes">
<sub><code>cowboy shot, sitting, cafe, holding cup, coffee, smile, looking at viewer, indoors, window, day</code> &nbsp;ยท&nbsp; <code>full body, lying, on side, on bed, head rest, looking at viewer, smile, bedroom, indoors, night, lamp light</code></sub>
<img src="showcase/v2_mecha.jpg" width="100%" alt="reference and two scenes">
<sub><code>full body, flying, from below, sky, clouds, sunlight, dynamic pose, outstretched arm</code> &nbsp;ยท&nbsp; <code>sitting, on floor, hugging own legs, sleepy, hangar, indoors, dim lighting</code></sub>
<img src="showcase/v2_swim.jpg" width="100%" alt="reference and two scenes">
<sub><code>cowboy shot, beach, ocean, sunset, wind, hand on own hat, sun hat, smile, looking back</code> &nbsp;ยท&nbsp; <code>upper body, sitting, poolside, legs in water, splashing, laughing, day</code></sub>
### ๋‘ ์บ๋ฆญํ„ฐ
๋ ˆํผ๋Ÿฐ์Šค ๋‘ ์žฅ์„ ํ•œ ์ด๋ฏธ์ง€์— ๋‚˜๋ž€ํžˆ ๋ถ™์ด๊ณ (๊ธฐ๋ณธ **Image Stitch** ๋…ธ๋“œ), ์™ผ์ชฝ๊ณผ ์˜ค๋ฅธ์ชฝ์ด ๊ฐ๊ฐ ๋ˆ„๊ตฌ์ธ์ง€ ๋ช‡ ๋‹จ์–ด๋กœ
์ ์Šต๋‹ˆ๋‹ค. `solo` ๋Œ€์‹  `2girls`๋‚˜ `1boy, 1girl`์„ ์“ฐ๊ณ , ๊ฐ€๋กœ๊ฐ€ ๊ธด ํฌ๊ธฐ๋ฅผ ์”๋‹ˆ๋‹ค. [์›Œํฌํ”Œ๋กœ](workflows/anima_ref_adapter_two_characters.json).
<img src="showcase/v2_duo_police_mecha.jpg" width="100%" alt="two references and the result">
<sub><code>2girls, the girl on the left is a policewoman with black hair over one eye, the girl on the right is a mecha girl with aqua hair and mechanical wings, standing side by side, peace sign, smile, city, street, day</code></sub>
<img src="showcase/v2_duo_police_swim.jpg" width="100%" alt="two references and the result">
<sub><code>2girls, the girl on the left is a policewoman with black hair over one eye, the girl on the right is a girl with short black hair in a blue frilled bikini, sitting together on a bench, eating ice cream, park, day</code></sub>
<img src="showcase/v2_duo_mecha_swim.jpg" width="100%" alt="two references and the result">
<sub><code>2girls, the girl on the left is a mecha girl with aqua hair and mechanical wings, the girl on the right is a girl with short black hair in a blue frilled bikini, high five, beach, ocean, day</code></sub>
## ๋น ๋ฅธ ์‹œ์ž‘
```bash
cd ComfyUI/custom_nodes
git clone https://github.com/ElectronGirl/ComfyUI-Anima-Ref-Adapter.git
```
1. Anima base v1.0, Qwen3-0.6B ํ…์ŠคํŠธ ์ธ์ฝ”๋”, Qwen-Image VAE๋ฅผ
[circlestone-labs/Anima](https://huggingface.co/circlestone-labs/Anima)์—์„œ ๋ฐ›์Šต๋‹ˆ๋‹ค. Anima๋ฅผ ์“ธ ๋•Œ์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค.
2. ComfyUI๋ฅผ ์žฌ์‹œ์ž‘ํ•˜๊ณ  [`workflows/anima_ref_adapter.json`](workflows/anima_ref_adapter.json)์„ ์—ฝ๋‹ˆ๋‹ค. Anima
text-to-image ์›Œํฌํ”Œ๋กœ์— ๋…ธ๋“œ ํ•˜๋‚˜๋ฅผ ๋”ํ•œ ๊ฒƒ์ด๋ฉฐ, ๋‹ค๋ฅธ ์ปค์Šคํ…€ ๋…ธ๋“œ๋Š” ํ•„์š” ์—†์Šต๋‹ˆ๋‹ค.
3. ๋ ˆํผ๋Ÿฐ์Šค ์ด๋ฏธ์ง€๋ฅผ ๋„ฃ๊ณ , ์žฅ๋ฉด๋งŒ ์ ์€ ํ”„๋กฌํ”„ํŠธ๋ฅผ ์“ฐ๊ณ , ์‹คํ–‰ํ•ฉ๋‹ˆ๋‹ค. ์ฒ˜์Œ ์‹คํ–‰ํ•  ๋•Œ `anima_ref_adapter_v2_r64.safetensors`(183MB)๋ฅผ
[Hugging Face](https://huggingface.co/ElectronGirl/anima-ref-adapter)์—์„œ `ComfyUI/models/loras/`๋กœ ๋ฐ›์•„์˜ต๋‹ˆ๋‹ค. ์ง์ ‘ ์„ค์น˜ํ•˜๋ ค๋ฉด
[์ด ํŒŒ์ผ](https://huggingface.co/ElectronGirl/anima-ref-adapter/blob/main/anima_ref_adapter_v2_r64.safetensors)์„ ๊ฐ™์€ ํด๋”์— ๋„ฃ์œผ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
**์ง์ ‘ ๋งŒ๋“  ์›Œํฌํ”Œ๋กœ์—์„œ๋Š”** **Anima Ref Adapter**๋ฅผ ๋ชจ๋ธ(๋‹ค๋ฅธ LoRA ๋’ค)๊ณผ ์ƒ˜ํ”Œ๋Ÿฌ ์‚ฌ์ด์— ๋‘๊ณ , VAE์™€ ๋ ˆํผ๋Ÿฐ์Šค
์ด๋ฏธ์ง€๋ฅผ ์—ฐ๊ฒฐํ•ฉ๋‹ˆ๋‹ค.
ํ”„๋กฌํ”„ํŠธ ์“ฐ๋Š” ๋ฒ•, ์„ค์ •, ๋ฌธ์ œ ํ•ด๊ฒฐ๊นŒ์ง€ ๋‹จ๊ณ„๋ณ„๋กœ ์ •๋ฆฌํ•œ **[์‚ฌ์šฉ ๊ฐ€์ด๋“œ](guide.ko.md)**๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค.
## ์†๋„์™€ ํ˜ธํ™˜์„ฑ
RTX 3060 Ti 8GB(fp16), 832x1216, ๋ ˆํผ๋Ÿฐ์Šค ํ•œ ์žฅ, ๋‘ ๋ฒˆ ์žฐ ๊ฒƒ ์ค‘ ๋น ๋ฅธ ์ชฝ:
| ์„ค์ • | ์ด๋ฏธ์ง€ ํ•œ ์žฅ |
|---|---|
| Anima base, er_sde 30 steps, cfg 4.5, **๋ ˆํผ๋Ÿฐ์Šค ์—†์Œ** | 33 ์ดˆ |
| + ํŒŒ์ผ๋Ÿฟ ์–ด๋Œ‘ํ„ฐ, `ref_guidance` 4.5 | 105 ์ดˆ |
| **+ v2 ์–ด๋Œ‘ํ„ฐ**, `ref_guidance` 4.5 | **65-67** ์ดˆ |
| `ref_guidance` 1 (์ถ”๊ฐ€ ๋ชจ๋ธ ํ˜ธ์ถœ ์—†์Œ) | 50 ์ดˆ |
| + SageAttention ([KJNodes](https://github.com/kijai/ComfyUI-KJNodes) Patch Sage Attention) | 62 ์ดˆ |
| + EasyCache (๊ธฐ๋ณธ ๋…ธ๋“œ) | 63 ์ดˆ |
| `ref_end` 0.6 | 62 ์ดˆ |
| **turbo LoRA**(strength 1), 10 steps, cfg 1, `ref_guidance` 1 | **11** ์ดˆ |
<img src="figures/v2_compat.jpg" width="100%" alt="speed settings with the same seed">
- SageAttention, EasyCache, `ref_end` 0.6์€ ์ด GPU์—์„œ ๊ฐ๊ฐ ์•ฝ 7%์”ฉ ๋นจ๋ผ์ง€๊ณ , ๊ทธ๋ฆผ์€ ๊ฑฐ์˜ ๊ฐ™์Šต๋‹ˆ๋‹ค.
- Anima base์šฉ **turbo LoRA**(ํ…Œ์ŠคํŠธํ•œ ํŒŒ์ผ: `anima-turbo-lora-v0.2`)๋Š” ์–ด๋Œ‘ํ„ฐ ์•ž์— ๋‘ก๋‹ˆ๋‹ค. ์บ๋ฆญํ„ฐ๋Š” ์œ ์ง€๋˜์ง€๋งŒ
๊ทธ๋ฆผ์ด turbo ํŠน์œ ์˜ ํ™”ํ’ ์ชฝ์œผ๋กœ ๋Œ๋ ค๊ฐ€์„œ, ๋ ˆํผ๋Ÿฐ์Šค์˜ ๊ทธ๋ฆผ์ฒด๋Š” ๋œ ๋ฐ˜์˜๋ฉ๋‹ˆ๋‹ค.
- ํ…Œ์ŠคํŠธํ•˜์ง€ ์•Š์€ ๊ฒƒ: Anima-TurboยทAnima-Aesthetic ์ „์ฒด ๋ชจ๋ธ, SamplerSPEED, torch.compile.
<details>
<summary>turbo LoRA๋กœ ๋งŒ๋“  ์‡ผ์ผ€์ด์Šค ์ „์ฒด (10 steps, cfg 1)</summary>
<img src="figures/v2_turbo.jpg" width="100%" alt="turbo LoRA">
</details>
## ๊ถŒ์žฅ ์„ค์ •
| | ๊ถŒ์žฅ๊ฐ’ | ์„ค๋ช… |
|---|---|---|
| ๊ธฐ๋ณธ ๋ชจ๋ธ | Anima base v1.0 | ์–ด๋Œ‘ํ„ฐ๋ฅผ ์ด ๋ชจ๋ธ๋กœ ํ•™์Šตํ–ˆ์Šต๋‹ˆ๋‹ค. turbo LoRA๋„ ๋™์ž‘ํ•ฉ๋‹ˆ๋‹ค. |
| ์ƒ˜ํ”Œ๋Ÿฌ | ์•„๋ฌด๊ฑฐ๋‚˜; er_sde๋‚˜ Euler, 30 steps, `simple` | ์–ด๋Œ‘ํ„ฐ ์—†์ด Anima๋ฅผ ์“ธ ๋•Œ์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค. |
| `cfg` | 4.5 | ํ…์ŠคํŠธ ๊ฐ€์ด๋˜์Šค์ž…๋‹ˆ๋‹ค. turbo LoRA๋ฅผ ์“ธ ๋•Œ๋Š” 1์ž…๋‹ˆ๋‹ค. |
| `ref_guidance` | 4.5 | 1์ด๋ฉด ๋น ๋ฅด์ง€๋งŒ ์•ฝํ•˜๊ณ , ๋†’์„์ˆ˜๋ก ์บ๋ฆญํ„ฐ ์„ธ๋ถ€์™€ ๊ทธ๋ฆผ์ฒด๊ฐ€ ๊ฐ•ํ•ด์ง€๋ฉฐ ์ฑ„๋„๋„ ์˜ฌ๋ผ๊ฐ‘๋‹ˆ๋‹ค. |
| `correction` | `apg` | ๋˜๋Š” `rescale` |
| `ref_end` | 1.0 | 0.6 ์ •๋„๋ฉด ๊ฑฐ์˜ ๊ฐ™์€ ๊ทธ๋ฆผ์„ ๋” ๋นจ๋ฆฌ ์–ป์Šต๋‹ˆ๋‹ค. |
| ํ”„๋กฌํ”„ํŠธ | ํ€„๋ฆฌํ‹ฐ + `1girl`/`1boy` + `solo` + ์žฅ๋ฉด ํƒœ๊ทธ | ์บ๋ฆญํ„ฐ ์ด๋ฆ„, ์ž‘๊ฐ€ ํƒœ๊ทธ, ์™ธ๋ชจ ํƒœ๊ทธ๋Š” ๋„ฃ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ์™ธ๋ชจ ํƒœ๊ทธ ๋ช‡ ๊ฐœ๋Š” ๊ดœ์ฐฎ์Šต๋‹ˆ๋‹ค. |
| ๋‹ค๋ฅธ LoRA | ์–ด๋Œ‘ํ„ฐ ๋…ธ๋“œ ์•ž | |
## ์ž‘๋™ ์›๋ฆฌ
๋ ˆํผ๋Ÿฐ์Šค ํ† ํฐ์€ ์ž๊ธฐ ์ž์‹ ๋งŒ ๋ณด๊ณ  ํ…์ŠคํŠธ cross-attention์„ ๊ฑด๋„ˆ๋›ฐ๋„๋ก, ์ƒ์„ฑ ์ค‘์ธ ์ด๋ฏธ์ง€์˜ ํ† ํฐ์€ ์ž๊ธฐ ์ž์‹ ๊ณผ
๋ ˆํผ๋Ÿฐ์Šค๋ฅผ ํ•จ๊ป˜ ๋ณด๋„๋ก ํ•™์Šตํ–ˆ์Šต๋‹ˆ๋‹ค(๋น„๋Œ€์นญ attention). ๊ทธ๋ž˜์„œ ๋ ˆํผ๋Ÿฐ์Šค ์ชฝ ๊ณ„์‚ฐ์€ ์Šคํ…ยทํ”„๋กฌํ”„ํŠธยทCFG ๋ถ„๊ธฐ์™€
๋ฌด๊ด€ํ•˜๊ณ , ๋ธ”๋ก๋ณ„ key/value๋ฅผ ์ด๋ฏธ์ง€๋‹น ํ•œ ๋ฒˆ๋งŒ ๊ณ„์‚ฐํ•ด ์žฌ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. ๋ ˆํผ๋Ÿฐ์Šค๋Š” ์ƒ์„ฑ ์ด๋ฏธ์ง€ ๊ฒฉ์ž ๋ฐ”๊นฅ์œผ๋กœ ๋ฐ€๋ฆฐ
RoPE ์ขŒํ‘œ์— ๋†“์ด๊ธฐ ๋•Œ๋ฌธ์—, ์ž์„ธ๋ฅผ ๊ทธ๋Œ€๋กœ ๋ฒ ๋ผ์ง€ ์•Š๊ณ  ์™ธํ˜•์œผ๋กœ ์ฝํž™๋‹ˆ๋‹ค. ์ž์„ธํ•œ ๋‚ด์šฉ์€
[English README](README.md#how-it-works)์™€ [๊ธฐ์ˆ  ๋ณด๊ณ ์„œ](report.md)(ํŒŒ์ผ๋Ÿฟ)๋ฅผ ์ฐธ๊ณ ํ•ด ์ฃผ์„ธ์š”.
## ํŒŒ์ผ๋Ÿฟ (v1)
ํŒŒ์ผ๋Ÿฟ(`anima_ref_adapter_pilot_r32.safetensors`, rank 32)๋„ ๊ณ„์† ๋ฐ›์„ ์ˆ˜ ์žˆ๊ณ ,
[advanced ์›Œํฌํ”Œ๋กœ](workflows/anima_ref_adapter_advanced.json)๋กœ ์“ธ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ํŒŒ์ผ๋Ÿฟ ๊ฐค๋Ÿฌ๋ฆฌ์™€ ํ•™์Šต์—์„œ ๋บ€ ์บ๋ฆญํ„ฐ์˜
๊ฒฐ๊ณผ๋Š” [English README](README.md#pilot-v1)์— ์žˆ์Šต๋‹ˆ๋‹ค.
## ํ•œ๊ณ„
- ์บ๋ฆญํ„ฐ๋Š” ๊ทธ๋ฆผ์ฒด๋ณด๋‹ค ํ›จ์”ฌ ์ž˜ ์˜ฎ๊ฒจ์ง‘๋‹ˆ๋‹ค. ๋ถ“์งˆ์ด ๊ฐ•ํ•œ ๊ทธ๋ฆผ์ฒด๋Š” ๊ฑฐ์˜ ์˜ฎ๊ฒจ์ง€์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
- ์ž‘์€ ๋ฌด๋Šฌ, ํ‰ํ„ฐ, ๊ท€๊ฑธ์ด, ํŠน์ดํ•œ ํ”ผ๋ถ€์ƒ‰์€ ์ž์ฃผ ๋น ์ง€๊ณ , ํฐ ์˜์ƒ์€ ์ƒ‰์ด ๋‹ฌ๋ผ์งˆ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
- ๋ ˆํผ๋Ÿฐ์Šค ์บ๋ฆญํ„ฐ๊ฐ€ ์žฅ๋ฉด ์•ˆ์— ์‚ฌ๋ฌผ(ํฌ์Šคํ„ฐ ๋“ฑ)๋กœ ๋‹ค์‹œ ๋‚˜ํƒ€๋‚  ๋•Œ๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค.
- Anima๊ฐ€ ์ƒ์„ฑํ•œ ์ด๋ฏธ์ง€๋กœ๋งŒ ํ•™์Šตํ–ˆ์œผ๋ฏ€๋กœ ๊ธฐ๋ณธ ๋ชจ๋ธ์˜ ํŽธํ–ฅ์„ ๊ทธ๋Œ€๋กœ ๊ฐ€์ง‘๋‹ˆ๋‹ค.
์ž‘๊ฐ€ ์ด๋ฆ„์€ ๋ฐ์ดํ„ฐ ์ƒ์„ฑ์šฉ ํƒœ๊ทธ๋กœ๋งŒ ์ผ์Šต๋‹ˆ๋‹ค. ์ž‘๊ฐ€๋ฅผ ์กด์ค‘ํ•ด ์ฃผ์„ธ์š”. ๋ชจ๋ฐฉํ•œ ๊ทธ๋ฆผ์„ ๊ทธ ์ž‘๊ฐ€์˜ ์ž‘ํ’ˆ์ธ ๊ฒƒ์ฒ˜๋Ÿผ ๋‚ด๋†“์ง€ ๋ง๊ณ , [LICENSE.md](LICENSE.md) 4์กฐ์˜ ์‚ฌ์šฉ ์ œํ•œ์„ ์ง€์ผœ ์ฃผ์„ธ์š”.
## ๋กœ๋“œ๋งต
| | |
|---|---|
| ๋ ˆํผ๋Ÿฐ์Šค ํ•œ ์žฅ์—์„œ ์บ๋ฆญํ„ฐ์™€ ๊ทธ๋ฆผ์ฒด | โœ… ํŒŒ์ผ๋Ÿฟ, v2 |
| ๋ ˆํผ๋Ÿฐ์Šค ์บ์‹œ๋ฅผ ์“ฐ๋Š” ๋น„๋Œ€์นญ attention | โœ… v2 |
| ๋ ˆํผ๋Ÿฐ์Šค ๋‘ ์žฅ์„ ๋‚˜๋ž€ํžˆ ๋‘์–ด ๋‘ ์บ๋ฆญํ„ฐ | โœ… v2 |
| ์บ๋ฆญํ„ฐยท๊ทธ๋ฆผ์ฒด ๋ถ„๋ฆฌ ๋ ˆํผ๋Ÿฐ์Šค | โธ๏ธ ์ค‘๋‹จ (์‹คํ—˜๋งŒ ์ง„ํ–‰) |
| ๊ณ ํ•ด์ƒ๋„ ํ•™์Šต, ๋ถ“์งˆ์ด ๊ฐ•ํ•œ ๊ทธ๋ฆผ์ฒด์™€ ์„ธ๋ถ€ ๊ฐœ์„  | โธ๏ธ ์ค‘๋‹จ |
## ํ›„์›
์ž๊ธˆ ๋ถ€์กฑ์œผ๋กœ ๊ฐœ๋ฐœ์ด ์ค‘๋‹จ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์ด ์–ด๋Œ‘ํ„ฐ๊ฐ€ ์œ ์šฉํ–ˆ๋‹ค๋ฉด **[Ko-fi](https://ko-fi.com/electrongirl)**์—์„œ ์ถ”๊ฐ€ ํ•™์Šต(๋” ๊ธด ํ•™์Šต, ์บ๋ฆญํ„ฐยท๊ทธ๋ฆผ์ฒด ๋ถ„๋ฆฌ ๋ ˆํผ๋Ÿฐ์Šค)์„ ํ›„์›ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
## ๋ผ์ด์„ ์Šค
**๋น„์ƒ์—…์šฉ์ž…๋‹ˆ๋‹ค.** ์ด ๊ฐ€์ค‘์น˜๋Š” CircleStone Model(Anima base v1.0)์„ ์ˆ˜์ •ํ•œ ํŒŒ์ƒ๋ฌผ์ด๋ฉฐ, CircleStone
Non-Commercial License([LICENSE.md](LICENSE.md), [NOTICE.txt](NOTICE.txt))๋กœ ๋ฐฐํฌํ•ฉ๋‹ˆ๋‹ค. ๋…๋ฆฝ ํ”„๋กœ์ ํŠธ์ด๋ฉฐ
CircleStone Labs์˜ ๊ณต์‹ ์ œํ’ˆ์ด ์•„๋‹ˆ๊ณ , CircleStone Labs์˜ ๋ณด์ฆ์„ ๋ฐ›์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค. ๋ฒ•์  ํšจ๋ ฅ์€ ์˜์–ด ์›๋ฌธ์— ์žˆ์Šต๋‹ˆ๋‹ค.