README / README.md
eastha's picture
Update README.md
7e94f16 verified
|
Raw History Blame Contribute Delete
1.57 kB
# VLADE
**Vision-Language-Action Distillation for Edge Deployment**
### ๋กœ๋ด‡์˜ ์ง€๋Šฅ์„ ์—ฃ์ง€๋กœ
VLADE๋Š” ๋Œ€๊ทœ๋ชจ Vision-Language-Action ๋ชจ๋ธ์˜ ์‹œ๊ฐยท์–ธ์–ด ์ดํ•ด์™€ ๋กœ๋ด‡ ์ œ์–ด ๋Šฅ๋ ฅ์„ ๊ฒฝ๋Ÿ‰ ๋ชจ๋ธ์— ์ „๋‹ฌํ•˜๋Š” ์—ฐ๊ตฌ ํ”„๋กœ์ ํŠธ์ž…๋‹ˆ๋‹ค. ์ œํ•œ๋œ ์—ฐ์‚ฐ ์ž์›์—์„œ๋„ ํ™œ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ๋กœ๋ด‡ ์ •์ฑ…์„ ๋ชฉํ‘œ๋กœ, ์ง€์‹ ์ฆ๋ฅ˜์™€ ์—ฃ์ง€ ๋ฐฐํฌ๋ฅผ ์—ฐ๊ตฌํ•ฉ๋‹ˆ๋‹ค.
## ์—ฐ๊ตฌ ๋ฐฉํ–ฅ
- **์ง€์‹ ์ฆ๋ฅ˜** โ€” Teacher์˜ ํ–‰๋™ ์ถœ๋ ฅ๊ณผ ๋‚ด๋ถ€ ํ‘œํ˜„์„ ํ™œ์šฉํ•œ ๊ฒฝ๋Ÿ‰ Student ํ•™์Šต
- **๋กœ๋ด‡ ์กฐ์ž‘๊ณผ ์ผ๋ฐ˜ํ™”** โ€” ์–ธ์–ด ์ง€์‹œ์— ๋”ฐ๋ฅธ ์ž‘์—… ์ˆ˜ํ–‰ ๋Šฅ๋ ฅ๊ณผ ํ™˜๊ฒฝ ๋ณ€ํ™”์— ๋Œ€ํ•œ ๊ฐ•๊ฑด์„ฑ ํ‰๊ฐ€
- **์—ฃ์ง€ ํšจ์œจ** โ€” ์ž‘์—… ์„ฑ๊ณต๋ฅ ๊ณผ ํ•จ๊ป˜ ๋ชจ๋ธ ํฌ๊ธฐ, ๋ฉ”๋ชจ๋ฆฌ ์‚ฌ์šฉ๋Ÿ‰, ์ถ”๋ก  ์ง€์—ฐ์‹œ๊ฐ„ ํ‰๊ฐ€
## ์‹คํ—˜๊ณผ ํ‰๊ฐ€
AVA-VLA์™€ OpenVLA-OFT๋ฅผ ๊ธฐ๋ฐ˜ ๋น„๊ต ๋ชจ๋ธ๋กœ ํ™œ์šฉํ•˜๋ฉฐ, ๋‹ค์Œ ๋ฒค์น˜๋งˆํฌ๋ฅผ ์ค‘์‹ฌ์œผ๋กœ ์‹คํ—˜์„ ์„ค๊ณ„ํ•ฉ๋‹ˆ๋‹ค.
| ๋ฒค์น˜๋งˆํฌ | ํ™œ์šฉ ๋ชฉ์  |
|---|---|
| LIBERO | ๊ธฐ๋ณธ ๋กœ๋ด‡ ์กฐ์ž‘ ์„ฑ๋Šฅ๊ณผ baseline ์žฌํ˜„ |
| LIBERO+ | ์ฃผ์š” ํ•™์Šตยท๋น„๊ต ์‹คํ—˜ |
| CALVIN | ํ›„์† ์ผ๋ฐ˜ํ™” ํ‰๊ฐ€ |
์ตœ์ข…์ ์œผ๋กœ Jetson Orin Nano๊ธ‰ ์—ฃ์ง€ ํ™˜๊ฒฝ์—์„œ ๊ฒฝ๋Ÿ‰ ์ •์ฑ…์˜ ๋ฐฐํฌ ๊ฐ€๋Šฅ์„ฑ์„ ํ‰๊ฐ€ํ•˜๋Š” ๊ฒƒ์„ ๋ชฉํ‘œ๋กœ ํ•ฉ๋‹ˆ๋‹ค.
## ํ”„๋กœ์ ํŠธ ์ž๋ฃŒ
[GitHub](https://github.com/eastha10/VLADE) ยท [Models](https://huggingface.co/VLADE-konkuk/models) ยท [Datasets](https://huggingface.co/VLADE-konkuk/datasets)
ํ”„๋กœ์ ํŠธ๋Š” ํ˜„์žฌ ์—ฐ๊ตฌยท๊ฐœ๋ฐœ ์ค‘์ž…๋‹ˆ๋‹ค. ๋ชจ๋ธ๋ณ„ ํ•™์Šต ์กฐ๊ฑด, ๊ฒ€์ฆ ๋ฒ”์œ„์™€ ํ‰๊ฐ€ ๊ฒฐ๊ณผ๋Š” ๊ฐ ์ €์žฅ์†Œ์˜ ์นด๋“œ์—์„œ ์•ˆ๋‚ดํ•ฉ๋‹ˆ๋‹ค.