Instructions to use hmkang/wam_ctxpool_bmethod with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Wan2.2
How to use hmkang/wam_ctxpool_bmethod with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
README: ctxpool on the finalized B-method base
Browse files
README.md
CHANGED
|
@@ -2,39 +2,6 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
|
| 4 |
---
|
| 5 |
-
<!-- KITCHEN-SR:BEGIN -->
|
| 6 |
-
### RoboCasa Kitchen β success rate (24 tasks x 50 episodes = 1200)
|
| 7 |
-
|
| 8 |
-
| arm | pooling | 20k | 40k | 60k | 80k | 100k |
|
| 9 |
-
|---|---|---|---|---|---|---|
|
| 10 |
-
| `xattn_ffn_L3` | xattn + FFN refine @ L3 | β | β | **61.92%** | **64.50%** | **65.92%** |
|
| 11 |
-
| `xattn_L3` | xattn (no FFN) @ L3 | β | β | **61.42%** | 77.78%<sup>β 0/24</sup> | β |
|
| 12 |
-
| `avg_L3` | avg @ L3 | β | β | **60.50%** | β | β |
|
| 13 |
-
|
| 14 |
-
EMA weights (video DiT + action head), `seed42av`, `N_ENVS=1`, dropcur=1, budget 50 ep/task.
|
| 15 |
-
Per-task numbers and the full protocol: [`metrics/eval_metrics.json`](metrics/eval_metrics.json).
|
| 16 |
-
**β ** = partial cell, fewer than 24 tasks at 50 episodes β not comparable with the bolded ones.
|
| 17 |
-
|
| 18 |
-
Read the arms against each other at the SAME step only: these are single-seed cells.
|
| 19 |
-
|
| 20 |
-
**Why `N_ENVS=1`.** Rendering several MuJoCo envs through one EGL context mis-serves frames β
|
| 21 |
-
a camera is handed another camera's buffer (`wrist<-right`, `left<-right`, `right<-left`), with
|
| 22 |
-
BGR channel swaps, persisting ~16 steps. Measured rate, per render call:
|
| 23 |
-
|
| 24 |
-
| setting | mis-served | of |
|
| 25 |
-
|---|---|---|
|
| 26 |
-
| `N_ENVS=5` (n5free) | **5.9%** | 1,338 / 22,491 |
|
| 27 |
-
| `N_ENVS=1` | **0.05%** | 11 / 22,485 |
|
| 28 |
-
|
| 29 |
-
`make_current()` before `read_pixels` and a verify-retry both failed to move it in a 250-episode
|
| 30 |
-
A/B, so the setting is the mitigation, not a code fix. Every cell above ran `N_ENVS=1`.
|
| 31 |
-
|
| 32 |
-
**Audit, `xattn_L3` 60k (2026-09-15).** All 58 task logs report `N_ENVS=1`, `EVAL_WEIGHTS=ema`,
|
| 33 |
-
zero `live`; 24/24 tasks hold exactly 50 finished episodes; no suffix-less (interrupted) videos,
|
| 34 |
-
no truncated files, no exceptions or OOM. Note this is the *setting* argument β the verify-retry
|
| 35 |
-
counter was not enabled in these runs, so mis-serves were not counted directly.
|
| 36 |
-
<!-- KITCHEN-SR:END -->
|
| 37 |
-
|
| 38 |
# WAM_DIT4DIT β context pooling on the **finalized B-method** base (RoboCasa kitchen)
|
| 39 |
|
| 40 |
Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
|
| 4 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
# WAM_DIT4DIT β context pooling on the **finalized B-method** base (RoboCasa kitchen)
|
| 6 |
|
| 7 |
Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized
|