Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -25,6 +25,7 @@ checkpoints + full test-eval metrics for every stage.
|
|
| 25 |
| `stage3/` | **Stage-3 JOINT** | init from GATE, **unfreeze** head + let the gated-final gradient co-train it (0.1Γ LR) |
|
| 26 |
|
| 27 |
Each `stageX/` has `best_model.pth` (+ `last_model.pth` for stage2a/stage3), and `eval/stageX/test_{seen,unseen}_metrics.json`.
|
|
|
|
| 28 |
|
| 29 |
## Test eval β grid space, threshold @0.05, per-seq pooled (179 seen / 85 unseen)
|
| 30 |
Contact metrics for the pressure models are on the **final pressure** map; Stage-1 scores `p_c>0.5` vs `gt>0.05`.
|
|
@@ -42,6 +43,7 @@ Contact metrics for the pressure models are on the **final pressure** map; Stage
|
|
| 42 |
- **Stage-2a** (conditioning) improves *seen* but its from-scratch DiT overfits seen magnitude and **degrades unseen** (0.4647, below the head) β the DiT re-learns localization from scratch.
|
| 43 |
- **Stage-2 GATE** (learned in-loop gate) is the **best-balanced two-stage model**: it fixes Stage-2a's OOD collapse (unseen +.009 *and* seen +.016 vs 2a) and beats the whole contact-prior family + a post-hoc late-fusion gate. It trails single-stage v2_dit but ties it on unseen.
|
| 44 |
- **Stage-3 JOINT** (unfreeze + co-train the head) gives the **best in-distribution** numbers (seen cIoU 0.568, edging v2_dit on seen T.Acc/MAE) and lifts the head's own contact cIoU 0.518β0.55, **but sacrifices OOD** β unseen drops to the family's lowest (0.4631). A clean demonstration that freezing the contact prior protects generalization.
|
|
|
|
| 45 |
|
| 46 |
**Takeaway:** the two-stage contact-prior closes most of the gap to a well-optimized single-stage flow model but does not overtake it; among two-stage variants, **freeze-the-head (GATE)** is the right default for OOD, while **co-training (Stage-3)** trades OOD robustness for in-distribution accuracy.
|
| 47 |
|
|
|
|
| 25 |
| `stage3/` | **Stage-3 JOINT** | init from GATE, **unfreeze** head + let the gated-final gradient co-train it (0.1Γ LR) |
|
| 26 |
|
| 27 |
Each `stageX/` has `best_model.pth` (+ `last_model.pth` for stage2a/stage3), and `eval/stageX/test_{seen,unseen}_metrics.json`.
|
| 28 |
+
The two reference baselines' full evals (same protocol) are in `eval/v2_dit/` and `eval/ta_base/` (`test_{seen,unseen}_metrics.json`), for direct comparison with the c2p line.
|
| 29 |
|
| 30 |
## Test eval β grid space, threshold @0.05, per-seq pooled (179 seen / 85 unseen)
|
| 31 |
Contact metrics for the pressure models are on the **final pressure** map; Stage-1 scores `p_c>0.5` vs `gt>0.05`.
|
|
|
|
| 43 |
- **Stage-2a** (conditioning) improves *seen* but its from-scratch DiT overfits seen magnitude and **degrades unseen** (0.4647, below the head) β the DiT re-learns localization from scratch.
|
| 44 |
- **Stage-2 GATE** (learned in-loop gate) is the **best-balanced two-stage model**: it fixes Stage-2a's OOD collapse (unseen +.009 *and* seen +.016 vs 2a) and beats the whole contact-prior family + a post-hoc late-fusion gate. It trails single-stage v2_dit but ties it on unseen.
|
| 45 |
- **Stage-3 JOINT** (unfreeze + co-train the head) gives the **best in-distribution** numbers (seen cIoU 0.568, edging v2_dit on seen T.Acc/MAE) and lifts the head's own contact cIoU 0.518β0.55, **but sacrifices OOD** β unseen drops to the family's lowest (0.4631). A clean demonstration that freezing the contact prior protects generalization.
|
| 46 |
+
- **Cross-model failure analysis** (per-task cIoU, GATE vs v2_dit vs ta_base): all three heads bottom out on the *same* tasks β `press_multimeter_button`, `move_toolbox`, `fold_clothes_and_bag`, `shop_for_fruit`, `organize_kitchen_items`, `toss_and_catch_tennis_ball` β in nearly the same rank order, so the long left tail is **task-intrinsic** (small / occluded / dynamic / OOD contact), not model-specific. The one sharp exception: on OOD `move_toolbox` the **GATE is uniquely worst** (0.326 vs v2_dit 0.361 / ta_base 0.360) β the frozen head under-localizes the occluded heavy-grip and the multiplicative gate *enforces* it, while the un-gated v2_dit and the area-over-predicting regression baseline both escape it. The concrete cost of the freeze.
|
| 47 |
|
| 48 |
**Takeaway:** the two-stage contact-prior closes most of the gap to a well-optimized single-stage flow model but does not overtake it; among two-stage variants, **freeze-the-head (GATE)** is the right default for OOD, while **co-training (Stage-3)** trades OOD robustness for in-distribution accuracy.
|
| 49 |
|