hmkang commited on
Commit
39994ff
Β·
verified Β·
1 Parent(s): 8450490

README: ctxpool on the finalized B-method base

Browse files
Files changed (1) hide show
  1. README.md +0 -54
README.md CHANGED
@@ -2,60 +2,6 @@
2
  license: apache-2.0
3
  tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
4
  ---
5
- <!-- KITCHEN-SR:BEGIN -->
6
- ### RoboCasa Kitchen β€” success rate (24 tasks x 50 episodes = 1200)
7
-
8
- | arm | pooling | 20k | 40k | 60k | 80k | 100k |
9
- |---|---|---|---|---|---|---|
10
- | `xattn_ffn_L3` | xattn + FFN refine @ L3 | β€” | β€” | **61.92%** | **64.50%** | **65.92%** |
11
- | `xattn_L3` | xattn (no FFN) @ L3 | β€” | β€” | **61.42%** | 77.78%<sup>†0/24</sup> | β€” |
12
- | `avg_L3` | avg @ L3 | β€” | β€” | **60.50%** | β€” | β€” |
13
-
14
- EMA weights (video DiT + action head), `seed42av`, `N_ENVS=1`, dropcur=1, budget 50 ep/task.
15
- Per-task numbers and the full protocol: [`metrics/eval_metrics.json`](metrics/eval_metrics.json).
16
- **†** = partial cell, fewer than 24 tasks at 50 episodes β€” not comparable with the bolded ones.
17
-
18
- Read the arms against each other at the SAME step only: these are single-seed cells.
19
-
20
- **Why `N_ENVS=1`.** Rendering several MuJoCo envs through one EGL context mis-serves frames β€”
21
- a camera is handed another camera's buffer (`wrist<-right`, `left<-right`, `right<-left`), with
22
- BGR channel swaps, persisting ~16 steps. Measured rate, per render call:
23
-
24
- | setting | mis-served | of |
25
- |---|---|---|
26
- | `N_ENVS=5` (n5free) | **5.9%** | 1,338 / 22,491 |
27
- | `N_ENVS=1` | **0.05%** | 11 / 22,485 |
28
-
29
- `make_current()` before `read_pixels` and a verify-retry both failed to move it in a 250-episode
30
- A/B, so the setting is the mitigation, not a code fix. Every cell above ran `N_ENVS=1`.
31
-
32
- **Audit, `xattn_L3` 60k (2026-09-15).** All 58 task logs report `N_ENVS=1`, `EVAL_WEIGHTS=ema`,
33
- zero `live`; 24/24 tasks hold exactly 50 finished episodes; no suffix-less (interrupted) videos,
34
- no truncated files, no exceptions or OOM. Note this is the *setting* argument β€” the verify-retry
35
- counter was not enabled in these runs, so mis-serves were not counted directly.
36
-
37
- ### ⚠ These cells are not comparable with previously published Wan2.2 cells
38
-
39
- `N_ENVS` does two jobs at once, and dropping it to 1 gave up the second one:
40
-
41
- | | concurrency | scene seeds |
42
- |---|---|---|
43
- | protocol (`N_ENVS=5`) | 5 renderers at once | **5 scenes Γ— 10 episodes**, `env_seed = SEED + idx` |
44
- | what ran here (`N_ENVS=1`) | 1 renderer | **1 scene Γ— 50 episodes**, `env_seed = 42` only |
45
-
46
- `eval_wam_dit4dit_kitchen.sh:308` states the 5Γ—10 grid *is* the measurement protocol and that
47
- lowering `N_ENVS` breaks comparability; its `seq-env` escape keeps the grid and only serialises
48
- the renderers (`N_ENVS itself never drops in either mode`). These runs took neither path β€” the
49
- local wrapper set `N_ENVS=1` on the parallel path, and every episode file is `env00`. The
50
- wrapper also exported an `ENV_LAYOUT=5` that the eval script never reads, so the banner printed
51
- `layout=5/1` and the grid looked intact while the seed set was a fifth of what it should be.
52
-
53
- So: **the arm-vs-arm ordering above holds** β€” all eight cells ran the identical single-scene
54
- setting β€” but each absolute number is "on this one scene", not a 5-scene average. Re-runs under
55
- the real protocol are in flight as separate `_env5` cells; until they land, do not place these
56
- numbers beside cells measured with the grid.
57
- <!-- KITCHEN-SR:END -->
58
-
59
  # WAM_DIT4DIT β€” context pooling on the **finalized B-method** base (RoboCasa kitchen)
60
 
61
  Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized
 
2
  license: apache-2.0
3
  tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
4
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  # WAM_DIT4DIT β€” context pooling on the **finalized B-method** base (RoboCasa kitchen)
6
 
7
  Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized