qqyang commited on
Commit
ff5e340
Β·
verified Β·
1 Parent(s): 38d240a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -25,6 +25,7 @@ checkpoints + full test-eval metrics for every stage.
25
  | `stage3/` | **Stage-3 JOINT** | init from GATE, **unfreeze** head + let the gated-final gradient co-train it (0.1Γ— LR) |
26
 
27
  Each `stageX/` has `best_model.pth` (+ `last_model.pth` for stage2a/stage3), and `eval/stageX/test_{seen,unseen}_metrics.json`.
 
28
 
29
  ## Test eval β€” grid space, threshold @0.05, per-seq pooled (179 seen / 85 unseen)
30
  Contact metrics for the pressure models are on the **final pressure** map; Stage-1 scores `p_c>0.5` vs `gt>0.05`.
@@ -42,6 +43,7 @@ Contact metrics for the pressure models are on the **final pressure** map; Stage
42
  - **Stage-2a** (conditioning) improves *seen* but its from-scratch DiT overfits seen magnitude and **degrades unseen** (0.4647, below the head) β€” the DiT re-learns localization from scratch.
43
  - **Stage-2 GATE** (learned in-loop gate) is the **best-balanced two-stage model**: it fixes Stage-2a's OOD collapse (unseen +.009 *and* seen +.016 vs 2a) and beats the whole contact-prior family + a post-hoc late-fusion gate. It trails single-stage v2_dit but ties it on unseen.
44
  - **Stage-3 JOINT** (unfreeze + co-train the head) gives the **best in-distribution** numbers (seen cIoU 0.568, edging v2_dit on seen T.Acc/MAE) and lifts the head's own contact cIoU 0.518β†’0.55, **but sacrifices OOD** β€” unseen drops to the family's lowest (0.4631). A clean demonstration that freezing the contact prior protects generalization.
 
45
 
46
  **Takeaway:** the two-stage contact-prior closes most of the gap to a well-optimized single-stage flow model but does not overtake it; among two-stage variants, **freeze-the-head (GATE)** is the right default for OOD, while **co-training (Stage-3)** trades OOD robustness for in-distribution accuracy.
47
 
 
25
  | `stage3/` | **Stage-3 JOINT** | init from GATE, **unfreeze** head + let the gated-final gradient co-train it (0.1Γ— LR) |
26
 
27
  Each `stageX/` has `best_model.pth` (+ `last_model.pth` for stage2a/stage3), and `eval/stageX/test_{seen,unseen}_metrics.json`.
28
+ The two reference baselines' full evals (same protocol) are in `eval/v2_dit/` and `eval/ta_base/` (`test_{seen,unseen}_metrics.json`), for direct comparison with the c2p line.
29
 
30
  ## Test eval β€” grid space, threshold @0.05, per-seq pooled (179 seen / 85 unseen)
31
  Contact metrics for the pressure models are on the **final pressure** map; Stage-1 scores `p_c>0.5` vs `gt>0.05`.
 
43
  - **Stage-2a** (conditioning) improves *seen* but its from-scratch DiT overfits seen magnitude and **degrades unseen** (0.4647, below the head) β€” the DiT re-learns localization from scratch.
44
  - **Stage-2 GATE** (learned in-loop gate) is the **best-balanced two-stage model**: it fixes Stage-2a's OOD collapse (unseen +.009 *and* seen +.016 vs 2a) and beats the whole contact-prior family + a post-hoc late-fusion gate. It trails single-stage v2_dit but ties it on unseen.
45
  - **Stage-3 JOINT** (unfreeze + co-train the head) gives the **best in-distribution** numbers (seen cIoU 0.568, edging v2_dit on seen T.Acc/MAE) and lifts the head's own contact cIoU 0.518β†’0.55, **but sacrifices OOD** β€” unseen drops to the family's lowest (0.4631). A clean demonstration that freezing the contact prior protects generalization.
46
+ - **Cross-model failure analysis** (per-task cIoU, GATE vs v2_dit vs ta_base): all three heads bottom out on the *same* tasks β€” `press_multimeter_button`, `move_toolbox`, `fold_clothes_and_bag`, `shop_for_fruit`, `organize_kitchen_items`, `toss_and_catch_tennis_ball` β€” in nearly the same rank order, so the long left tail is **task-intrinsic** (small / occluded / dynamic / OOD contact), not model-specific. The one sharp exception: on OOD `move_toolbox` the **GATE is uniquely worst** (0.326 vs v2_dit 0.361 / ta_base 0.360) β€” the frozen head under-localizes the occluded heavy-grip and the multiplicative gate *enforces* it, while the un-gated v2_dit and the area-over-predicting regression baseline both escape it. The concrete cost of the freeze.
47
 
48
  **Takeaway:** the two-stage contact-prior closes most of the gap to a well-optimized single-stage flow model but does not overtake it; among two-stage variants, **freeze-the-head (GATE)** is the right default for OOD, while **co-training (Stage-3)** trades OOD robustness for in-distribution accuracy.
49