sciedu_sim_rl_demo / README.md
leapshared's picture
๊ฐ•ํ™”ํ•™์Šต ์‹œ์—ฐ ์›๋ณธ(2026-11-12~13): ์ธก์ • ๋ฌธ์„œ "๊ฐ•ํ™”ํ•™์Šต ์‹œ์—ฐ" ์ ˆ์ด ์ฝ๋Š” ๊ณ„ํš ์ค„ยท๋ชจ๋ธยท๊ฒฌ์คŒ ์ค„
da376cd verified
|
Raw History Blame Contribute Delete
2.08 kB
---
license: apache-2.0
tags: [sciedu-bench, simulation, mujoco, openarm, reinforcement-learning]
---
# SciEdu sim RL demo โ€” ๊ฐ•ํ™”ํ•™์Šต ์‹œ์—ฐ ์›๋ณธ (2026-11-12 ~ 11-13)
OpenArm ์–‘ํŒ” ๋กœ๋ด‡ ๊ณผํ•™ ์‹คํ—˜ ์‹œ๋ฎฌ(MuJoCo)์—์„œ "IK ์ฝ”๋“œ ๊ณ„ํš ์œ„์˜ ์ž”์ฐจ ๊ฐ•ํ™”ํ•™์Šต"์œผ๋กœ ์‹œ์—ฐ์„ ๋งŒ๋“ค์–ด ๋ณธ ์‹คํ—˜์˜ ์›๋ณธ์ด๋‹ค.
์ธก์ • ๋ฌธ์„œ `docs/measurements/sim-train-augment.md`์˜ "๊ฐ•ํ™”ํ•™์Šต ์‹œ์—ฐ(gen=rl)" ์ ˆ์ด ์ฝ๋Š” ๊ณ„ํš ์ค„ยท๋ชจ๋ธยท๊ฒฌ์คŒ ์ค„์„ ๊ทธ๋Œ€๋กœ ๋‹ด์•˜๋‹ค.
**์•Œ์•„ ๋‘˜ ๊ฒƒ: ์˜› ์ฅ (์ฃผํ™ฉ ์†์žก์ด)ยท์˜› ์žฅ๋ฉด ํŒ์œผ๋กœ ์ง€์€ ์‹œ์—ฐ์ด๋‹ค. ์ƒˆ ์—์…‹ยท์ฒ ํŒ ์œ—๋ถ€๋ถ„ ์ฅ ์œผ๋กœ ๋‹ค์‹œ ์ง“๋Š”๋‹ค.**
ํ•™์Šต ๋ฐ์ดํ„ฐ๋กœ ์“ฐ์ง€ ๋ง๊ณ  ๊ทธ ์ ˆ์˜ ์ˆซ์ž๋ฅผ ๋˜์งš๋Š” ๋ฐ์—๋งŒ ์“ด๋‹ค.
| ํด๋” | ๋‚ด์šฉ |
|---|---|
| `redox_plate/<ํŒ>/` | ์‚ฐํ™”ํ™˜์› ํŒ ๋„ฃ๊ธฐ. ํŒ ๋‹ค์„ฏ(v1, v1b_straight_zeroinit, v1_two_phase, v2_wide, v2_wide_tp): `actor.safetensors`, `config.json`, `norm.json`, ํ•™์Šต ์ค„, `plans/plans.jsonl`๊ณผ ๋ช…๋ น ์—ด `.npz`, ์‹œ์ž‘ JSON |
| `redox_plate/*.jsonl`, `redox_plate/starts/` | ์ฝ”๋“œ๋งŒ(๊ณง์€ยท๋‘ ๊ฑธ์Œ) ๊ฒฌ์คŒ ์ค„, ๋„“์€ ์‹œ์ž‘ |
| `rod/` | ๊ฒ€์ „๊ธฐ ๋ง‰๋Œ€ ํ„ธ ๋ฌธ์ง€๋ฅด๊ธฐ. ํ•™์Šต ์ค„(`rub_train*.jsonl`), ์ฒดํฌํฌ์ธํŠธ ์ •์ฑ…(`rub_policy*_itNNN.json`), 53์นธ ๊ฒฌ์คŒ ์ค„(`rub_compare*.jsonl`, `_j010` = ์ƒˆ ํŒ์ • 0.10.0-draft), ๊ณก์„  ๊ทธ๋ฆผ, `rejudge.log` |
| `whole/` | ๋™์ž‘ ์ „์ฒด ์ค„(๋„ฃ๊ธฐยท๋‹ด๊ทธ๊ธฐ) ๊ฒฌ์คŒ |
| `mineral/` | ๊ด‘๋ฌผ ์กฐํ” ๊ธ‹๊ธฐ ๊ฒฌ์คŒ |
| `rod_shadow/outputs/`, `rod_shadow_judge010/outputs/` | ์˜› ํŒ์ •ยท์ƒˆ ํŒ์ • ์‚ฌ๋ณธ์—์„œ ๋Œ๋ฆฐ ๊ฒฐ๊ณผ(๊ฒฐ๊ณผ ํŒŒ์ผ๋งŒ) |
| `*_diag*.jsonl`, `MUJOCO_LOG_20261112.txt` | ์‹คํŒจ ์ง„๋‹จ ์ค„, ๋ฌผ๋ฆฌ ๊ฒฝ๊ณ  ๊ธฐ๋ก |
์˜ฌ๋ฆฌ์ง€ ์•Š์€ ๊ฒƒ(๋‹ค์‹œ ๋งŒ๋“ค ์ˆ˜ ์žˆ์Œ): ๊ทธ๋•Œ ์ €์žฅ์†Œ ์ฝ”๋“œ์˜ ์‚ฌ๋ณธ(`rod_shadow/`ยท`rod_shadow_judge010/`์˜ ์ฝ”๋“œ, `rod_3646e6d2.tar`, `mineral_shadow/scripts`)์€
์ €์žฅ์†Œ ๊ฐˆ๋ž˜ ์ปค๋ฐ‹ 3646e6d2ยท95c32236์—์„œ ๋‹ค์‹œ ๋งŒ๋“ ๋‹ค. ํ•™์Šต ๋กœ๊ทธ(`*.log`)์™€ ์ž„์‹œ ์Šคํฌ๋ฆฝํŠธ(`scratch/`)๋Š” ๋บ๋‹ค.
์ฝ”๋“œ: ์ €์žฅ์†Œ `scripts/sim/rl_demo*.py`, `scripts/sim/ppo_rim.py`, ์„ค์ • `config/rl_demo/*.yaml`.