Instructions to use hmkang/wam_ctxpool_bmethod with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Wan2.2
How to use hmkang/wam_ctxpool_bmethod with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
card: RoboCasa Kitchen success-rate table (arm x step), generated from metrics/eval_metrics.json
Browse files
README.md
CHANGED
|
@@ -2,6 +2,24 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
|
| 4 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
# WAM_DIT4DIT β context pooling on the **finalized B-method** base (RoboCasa kitchen)
|
| 6 |
|
| 7 |
Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
tags: [video-world-model, robotics, robocasa, wan2.2, context-pooling, ibot]
|
| 4 |
---
|
| 5 |
+
<!-- KITCHEN-SR:BEGIN -->
|
| 6 |
+
### RoboCasa Kitchen β success rate (24 tasks x 50 episodes = 1200)
|
| 7 |
+
|
| 8 |
+
| arm | pooling | 20k | 40k | 60k | 80k | 100k |
|
| 9 |
+
|---|---|---|---|---|---|---|
|
| 10 |
+
| `xattn_ffn_L3` | xattn + FFN refine @ L3 | β | β | **61.92%** | **64.50%** | **65.92%** |
|
| 11 |
+
| `xattn_L3` | xattn (no FFN) @ L3 | β | β | **61.42%** | 77.78%<sup>β 0/24</sup> | β |
|
| 12 |
+
| `avg_L3` | avg @ L3 | β | β | **60.50%** | β | β |
|
| 13 |
+
|
| 14 |
+
EMA weights (video DiT + action head), `seed42av`, `N_ENVS=1`, dropcur=1, budget 50 ep/task.
|
| 15 |
+
Per-task numbers and the full protocol: [`metrics/eval_metrics.json`](metrics/eval_metrics.json).
|
| 16 |
+
**β ** = partial cell, fewer than 24 tasks at 50 episodes β not comparable with the bolded ones.
|
| 17 |
+
|
| 18 |
+
Read the arms against each other at the SAME step only: these are single-seed cells, and the
|
| 19 |
+
`N_ENVS=1` render setting is what keeps the EGL buffer-swap contamination at 0.3% of episodes
|
| 20 |
+
(all of them already failures) instead of the 5.9% of render calls seen at `N_ENVS=5`.
|
| 21 |
+
<!-- KITCHEN-SR:END -->
|
| 22 |
+
|
| 23 |
# WAM_DIT4DIT β context pooling on the **finalized B-method** base (RoboCasa kitchen)
|
| 24 |
|
| 25 |
Wan2.2-TI2V-5B video DiT + 48-joint action head, `training_mode=joint`. The base is suhyeok's finalized
|