hmkang commited on
Commit
9c0d2d0
Β·
verified Β·
1 Parent(s): a91ad2d

README: ctxpool on the finalized B-method base

Browse files
Files changed (1) hide show
  1. README.md +0 -33
README.md CHANGED
@@ -2,39 +2,6 @@
2
  license: apache-2.0
3
  tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
4
  ---
5
- <!-- KITCHEN-SR:BEGIN -->
6
- ### RoboCasa Kitchen β€” success rate (24 tasks x 50 episodes = 1200)
7
-
8
- | arm | pooling | 20k | 40k | 60k | 80k | 100k |
9
- |---|---|---|---|---|---|---|
10
- | `xattn_ffn_L3` | xattn + FFN refine @ L3 | β€” | β€” | **61.92%** | **64.50%** | **65.92%** |
11
- | `xattn_L3` | xattn (no FFN) @ L3 | β€” | β€” | **61.42%** | 77.78%<sup>†0/24</sup> | β€” |
12
- | `avg_L3` | avg @ L3 | β€” | β€” | **60.50%** | β€” | β€” |
13
-
14
- EMA weights (video DiT + action head), `seed42av`, `N_ENVS=1`, dropcur=1, budget 50 ep/task.
15
- Per-task numbers and the full protocol: [`metrics/eval_metrics.json`](metrics/eval_metrics.json).
16
- **†** = partial cell, fewer than 24 tasks at 50 episodes β€” not comparable with the bolded ones.
17
-
18
- Read the arms against each other at the SAME step only: these are single-seed cells.
19
-
20
- **Why `N_ENVS=1`.** Rendering several MuJoCo envs through one EGL context mis-serves frames β€”
21
- a camera is handed another camera's buffer (`wrist<-right`, `left<-right`, `right<-left`), with
22
- BGR channel swaps, persisting ~16 steps. Measured rate, per render call:
23
-
24
- | setting | mis-served | of |
25
- |---|---|---|
26
- | `N_ENVS=5` (n5free) | **5.9%** | 1,338 / 22,491 |
27
- | `N_ENVS=1` | **0.05%** | 11 / 22,485 |
28
-
29
- `make_current()` before `read_pixels` and a verify-retry both failed to move it in a 250-episode
30
- A/B, so the setting is the mitigation, not a code fix. Every cell above ran `N_ENVS=1`.
31
-
32
- **Audit, `xattn_L3` 60k (2026-09-15).** All 58 task logs report `N_ENVS=1`, `EVAL_WEIGHTS=ema`,
33
- zero `live`; 24/24 tasks hold exactly 50 finished episodes; no suffix-less (interrupted) videos,
34
- no truncated files, no exceptions or OOM. Note this is the *setting* argument β€” the verify-retry
35
- counter was not enabled in these runs, so mis-serves were not counted directly.
36
- <!-- KITCHEN-SR:END -->
37
-
38
  # WAM_DIT4DIT β€” context pooling on the **finalized B-method** base (RoboCasa kitchen)
39
 
40
  Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized
 
2
  license: apache-2.0
3
  tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
4
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  # WAM_DIT4DIT β€” context pooling on the **finalized B-method** base (RoboCasa kitchen)
6
 
7
  Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized