hmkang commited on
Commit
a91ad2d
·
verified ·
1 Parent(s): 9dfdfac

card: RoboCasa Kitchen success-rate table (arm x step), generated from metrics/eval_metrics.json

Browse files
Files changed (1) hide show
  1. README.md +18 -3
README.md CHANGED
@@ -15,9 +15,24 @@ EMA weights (video DiT + action head), `seed42av`, `N_ENVS=1`, dropcur=1, budget
15
  Per-task numbers and the full protocol: [`metrics/eval_metrics.json`](metrics/eval_metrics.json).
16
  **†** = partial cell, fewer than 24 tasks at 50 episodes — not comparable with the bolded ones.
17
 
18
- Read the arms against each other at the SAME step only: these are single-seed cells, and the
19
- `N_ENVS=1` render setting is what keeps the EGL buffer-swap contamination at 0.3% of episodes
20
- (all of them already failures) instead of the 5.9% of render calls seen at `N_ENVS=5`.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  <!-- KITCHEN-SR:END -->
22
 
23
  # WAM_DIT4DIT — context pooling on the **finalized B-method** base (RoboCasa kitchen)
 
15
  Per-task numbers and the full protocol: [`metrics/eval_metrics.json`](metrics/eval_metrics.json).
16
  **†** = partial cell, fewer than 24 tasks at 50 episodes — not comparable with the bolded ones.
17
 
18
+ Read the arms against each other at the SAME step only: these are single-seed cells.
19
+
20
+ **Why `N_ENVS=1`.** Rendering several MuJoCo envs through one EGL context mis-serves frames —
21
+ a camera is handed another camera's buffer (`wrist<-right`, `left<-right`, `right<-left`), with
22
+ BGR channel swaps, persisting ~16 steps. Measured rate, per render call:
23
+
24
+ | setting | mis-served | of |
25
+ |---|---|---|
26
+ | `N_ENVS=5` (n5free) | **5.9%** | 1,338 / 22,491 |
27
+ | `N_ENVS=1` | **0.05%** | 11 / 22,485 |
28
+
29
+ `make_current()` before `read_pixels` and a verify-retry both failed to move it in a 250-episode
30
+ A/B, so the setting is the mitigation, not a code fix. Every cell above ran `N_ENVS=1`.
31
+
32
+ **Audit, `xattn_L3` 60k (2026-09-15).** All 58 task logs report `N_ENVS=1`, `EVAL_WEIGHTS=ema`,
33
+ zero `live`; 24/24 tasks hold exactly 50 finished episodes; no suffix-less (interrupted) videos,
34
+ no truncated files, no exceptions or OOM. Note this is the *setting* argument — the verify-retry
35
+ counter was not enabled in these runs, so mis-serves were not counted directly.
36
  <!-- KITCHEN-SR:END -->
37
 
38
  # WAM_DIT4DIT — context pooling on the **finalized B-method** base (RoboCasa kitchen)