File size: 947 Bytes
3ed11ae | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 | # RoboCasa Wave1 — last tasks
Protocol: literal-5 seeds `10000..10004`, `-n 1 --n_test 50`, OAT8, BoN N=8 vote.
Δ = mean(BoN)−mean(base); SEM_Δ = sqrt(SEM_b²+SEM_m²).
## Table P (Wave1)
| task | baseline mean±SEM | BoN N=8 | Δ_BoN±SEM_Δ | status |
|------|-------------------|---------|-------------|--------|
| `turn_off_sink_faucet` | **52.4±2.5%** | **56.0±3.4%** | **+3.6±4.2 pp** | DONE |
| `turn_off_microwave` | *(pending)* | *(pending)* | — | BoN RUNNING — watcher will finalize |
## Sink per-seed SR (%)
- baseline: `{'10000': 52.0, '10001': 58.0, '10002': 58.0, '10003': 46.0, '10004': 48.0}`
- BoN8: `{'10000': 54.0, '10001': 58.0, '10002': 64.0, '10003': 60.0, '10004': 44.0}`
## Artifacts
```text
robocasa/<task>/
summary_literal5.json
baseline_seed{10000..10004}/eval_log.json
bon_n8_seed{10000..10004}/eval_log.json
```
Ckpts not in this repo (~0.9GB) — see `hackhackhack66666/rc-model-two-last`.
|