WillXH commited on
Commit
c348baa
Β·
verified Β·
1 Parent(s): f631def

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +18 -8
README.md CHANGED
@@ -25,7 +25,11 @@ carry and presents the policy with the same commands and stage flag it trained
25
  under. The observation and action layouts are frozen in `interface.py`; running
26
  the network under any other layout produces garbage rather than an error.
27
  Pinned stack: Isaac Sim 5.1.0, Isaac Lab v2.3.2, rsl_rl 3.1.2, torch 2.7.0+cu128
28
- (see `configs/versions.lock` in the repository).
 
 
 
 
29
 
30
  ## Files
31
 
@@ -52,16 +56,18 @@ from bank states.
52
 
53
  ## Results (`chain.pt` with the repository's commander)
54
 
55
- All numbers use this one checkpoint (training seed 42), three evaluation
56
- seeds, 500 episodes each. Strict full-chain success requires reaching the
 
57
  carry phase, keeping the elevated basket to episode timeout, and moving it at
58
  least 1.0 m after the carry begins.
59
 
60
  - Strict, 10 s episodes (the training horizon): **1,216 of 1,500 β€” 81.1 %**
61
  (95 % Wilson CI 79.0–83.0 %; per-seed 80.8 / 81.0 / 81.4 %). The shortfall
62
  against the softer metric is the episode clock: carry distances have a median
63
- of 1.4 m with no mass near zero, and with 15 s episodes on the same spawns
64
- strict success is **99.4 %** (median carry distance 3.2 m).
 
65
  - Reached the carry phase and retained the elevated basket through timeout (no
66
  distance requirement): 1,476 of 1,500 β€” 98.4 % (97.6–98.9 %; per-seed
67
  98.4 / 97.8 / 99.0 %).
@@ -70,9 +76,12 @@ We observed zero falls, zero basket knock-away events, and three transient
70
  retention-latch loss events (0.002 per episode); an episode can re-establish
71
  retention after a latch loss.
72
 
73
- | | Walk | Carry | Lift | Thread | **Full chain** |
 
 
 
74
  |---|---|---|---|---|---|
75
- | Success | 98.7 % | 95.9 % | 98.9 % | 82.2 % | **98.4 %** |
76
 
77
  Robustness (one policy, no retraining): mean success per tested handle opening
78
  stayed at or above 95.5 % across 15–35 cm (lowest single evaluation seed:
@@ -90,7 +99,8 @@ over 500 episodes.
90
  Things the numbers do not show: the 3 seeds are evaluation seeds of one trained
91
  policy (retraining variance was not measured); the evaluation environment turns
92
  off Isaac Lab's proprioceptive noise and pushes (under full training conditions
93
- the chain scores 100 % / 500 episodes); the state machine's constants were tuned
 
94
  on the training spawn distribution. The repository README has the full
95
  discussion, sweep plots, and ablations.
96
 
 
25
  under. The observation and action layouts are frozen in `interface.py`; running
26
  the network under any other layout produces garbage rather than an error.
27
  Pinned stack: Isaac Sim 5.1.0, Isaac Lab v2.3.2, rsl_rl 3.1.2, torch 2.7.0+cu128
28
+ (see `configs/versions.lock` in the repository). Scope: simulated whole-body
29
+ loco-manipulation with a hybrid PPO + state-machine controller; basket pose is
30
+ read from the simulator with synthetic noise β€” vision-based perception and
31
+ sim-to-real transfer are out of scope. SHA-256 hashes of these files are in the
32
+ repository's `results/manifest.json`.
33
 
34
  ## Files
35
 
 
56
 
57
  ## Results (`chain.pt` with the repository's commander)
58
 
59
+ All numbers use this one checkpoint (training seed 42); the baseline uses
60
+ three evaluation seeds of 500 episodes each; the 15 s, held-out and
61
+ training-conditions checks use one seed each. Strict full-chain success requires reaching the
62
  carry phase, keeping the elevated basket to episode timeout, and moving it at
63
  least 1.0 m after the carry begins.
64
 
65
  - Strict, 10 s episodes (the training horizon): **1,216 of 1,500 β€” 81.1 %**
66
  (95 % Wilson CI 79.0–83.0 %; per-seed 80.8 / 81.0 / 81.4 %). The shortfall
67
  against the softer metric is the episode clock: carry distances have a median
68
+ of 1.4 m (10th percentile 0.87 m), and with 15 s episodes on the same spawn
69
+ distribution (one evaluation seed, 500 episodes) strict success is **99.4 %**
70
+ (median carry distance 3.2 m).
71
  - Reached the carry phase and retained the elevated basket through timeout (no
72
  distance requirement): 1,476 of 1,500 β€” 98.4 % (97.6–98.9 %; per-seed
73
  98.4 / 97.8 / 99.0 %).
 
76
  retention-latch loss events (0.002 per episode); an episode can re-establish
77
  retention after a latch loss.
78
 
79
+ Per-stage evaluation β€” reached-phase/retention metrics, no carry-distance
80
+ requirement (strict full-chain numbers are above):
81
+
82
+ | | Walk | Carry | Lift | Thread | Full chain (reached-carry) |
83
  |---|---|---|---|---|---|
84
+ | Success | 98.9 % | 95.9 % | 98.9 % | 82.2 % | 98.4 % |
85
 
86
  Robustness (one policy, no retraining): mean success per tested handle opening
87
  stayed at or above 95.5 % across 15–35 cm (lowest single evaluation seed:
 
99
  Things the numbers do not show: the 3 seeds are evaluation seeds of one trained
100
  policy (retraining variance was not measured); the evaluation environment turns
101
  off Isaac Lab's proprioceptive noise and pushes (under full training conditions
102
+ the chain scores 87.6 % strict / 100 % reached-carry over 500 episodes, one
103
+ evaluation seed); the state machine's constants were tuned
104
  on the training spawn distribution. The repository README has the full
105
  discussion, sweep plots, and ablations.
106