AlexWortega commited on
Commit
c25bc9b
·
verified ·
1 Parent(s): ada945e

Complete section 11: all 5 RoboCasa tasks, zero-shot 0/60 on arm-only tasks

Browse files
Files changed (1) hide show
  1. ablation.md +3 -1
ablation.md CHANGED
@@ -458,8 +458,10 @@ rest. Semantic refresh 1 Hz, `n_action_steps=1`, 15 episodes/task.
458
  | `CloseFridge` | 900 | lightwheel | 0/15 | 0.0-20.4 | — |
459
  | `OpenDrawer` | 750 | lightwheel | 0/15 | 0.0-20.4 | — |
460
  | `NavigateKitchen` | 450 | lightwheel | 0/15 | 0.0-20.4 | requires mobile-base motion; harness holds base_motion at zero |
 
 
461
 
462
- **Zero-shot transfer is a complete failure: 0/30 across the 2 arm-only tasks (95% Wilson 0.0-11.4%).** Not a partial-credit
463
  result to be tuned up — nothing succeeds anywhere.
464
 
465
  Two failure modes are visible in the saved videos (`results/robocasa_ft4/`), and
 
458
  | `CloseFridge` | 900 | lightwheel | 0/15 | 0.0-20.4 | — |
459
  | `OpenDrawer` | 750 | lightwheel | 0/15 | 0.0-20.4 | — |
460
  | `NavigateKitchen` | 450 | lightwheel | 0/15 | 0.0-20.4 | requires mobile-base motion; harness holds base_motion at zero |
461
+ | `TurnOnMicrowave` | 450 | lightwheel+objaverse+aigen | 0/15 | 0.0-20.4 | — |
462
+ | `PickPlaceCounterToStove` | 600 | lightwheel+objaverse+aigen | 0/15 | 0.0-20.4 | — |
463
 
464
+ **Zero-shot transfer is a complete failure: 0/60 across the 4 arm-only tasks (95% Wilson 0.0-6.0%).** Not a partial-credit
465
  result to be tuned up — nothing succeeds anywhere.
466
 
467
  Two failure modes are visible in the saved videos (`results/robocasa_ft4/`), and