mp_yam_code / doc /capabilities.md
yqi19's picture
docs split into doc/; scale-up generator; per-task frames and episode videos
000b008 verified
|
Raw
History Blame Contribute Delete
1.91 kB
# What this suite supports
## What this suite supports
**30 scripted bimanual manipulation tasks** on the YAM arm in Isaac Lab, built on RoboTwin 2.0
assets. Not a policy — every task ships a scripted solver, so it produces demonstrations and a
pass/fail signal you can trust.
| capability | what it means |
|---|---|
| **Skill families** | pick-and-place · multi-object · stacking · sorting · insertion · pushing (single and relay) · bimanual lift · handover · tool use (sweep, wipe) · pouring · constrained pull · articulated fixtures · deformable chain |
| **Both arms** | either arm alone, or both on one motion profile (`move_both`) — driving them in sequence parks the first in the second's path |
| **Randomization** | every object, fixture, container and marker takes `xy_jitter` / `yaw_jitter`; `--seed` reproduces an episode exactly. 52 of 56 spawn calls are randomized |
| **Articulated props** | SAPIEN mobility URDFs — hinged doors, sliding drawers, lids, toggles. Joint values are first-class state and can be success conditions |
| **Chains / rope** | a rope as a jointed chain, judged on its own geometry (end-to-end span) rather than on a placement |
| **Configuration** | class attribute → per-task YAML → `--set key=value`, resolved *before* the simulator starts |
| **Asset pipeline** | rigid → USD, hollow containers, articulated URDFs, plus procedurally generated meshes (ring, rope, pot lid) |
| **Agentic verification** | rendered contact sheets + review prompts for a vision agent, verdicts fed back into concrete parameter fixes, and task proposal from the asset library — `scripts/yam_agent_loop.py` |
| **Verification** | strict numeric conditions **plus** the visual check above; `scripts/status.py` regenerates the status table from run logs |
| **Outputs** | per-episode MP4 with an action/state HUD, contact sheets, single-frame scene renders |