hmkang commited on
Commit
9dfdfac
Β·
verified Β·
1 Parent(s): 6ca1744

card: RoboCasa Kitchen success-rate table (arm x step), generated from metrics/eval_metrics.json

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -2,6 +2,24 @@
2
  license: apache-2.0
3
  tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
4
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  # WAM_DIT4DIT β€” context pooling on the **finalized B-method** base (RoboCasa kitchen)
6
 
7
  Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized
 
2
  license: apache-2.0
3
  tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
4
  ---
5
+ <!-- KITCHEN-SR:BEGIN -->
6
+ ### RoboCasa Kitchen β€” success rate (24 tasks x 50 episodes = 1200)
7
+
8
+ | arm | pooling | 20k | 40k | 60k | 80k | 100k |
9
+ |---|---|---|---|---|---|---|
10
+ | `xattn_ffn_L3` | xattn + FFN refine @ L3 | β€” | β€” | **61.92%** | **64.50%** | **65.92%** |
11
+ | `xattn_L3` | xattn (no FFN) @ L3 | β€” | β€” | **61.42%** | 77.78%<sup>†0/24</sup> | β€” |
12
+ | `avg_L3` | avg @ L3 | β€” | β€” | **60.50%** | β€” | β€” |
13
+
14
+ EMA weights (video DiT + action head), `seed42av`, `N_ENVS=1`, dropcur=1, budget 50 ep/task.
15
+ Per-task numbers and the full protocol: [`metrics/eval_metrics.json`](metrics/eval_metrics.json).
16
+ **†** = partial cell, fewer than 24 tasks at 50 episodes β€” not comparable with the bolded ones.
17
+
18
+ Read the arms against each other at the SAME step only: these are single-seed cells, and the
19
+ `N_ENVS=1` render setting is what keeps the EGL buffer-swap contamination at 0.3% of episodes
20
+ (all of them already failures) instead of the 5.9% of render calls seen at `N_ENVS=5`.
21
+ <!-- KITCHEN-SR:END -->
22
+
23
  # WAM_DIT4DIT β€” context pooling on the **finalized B-method** base (RoboCasa kitchen)
24
 
25
  Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized