Linslab commited on
Commit
7a52dfb
·
verified ·
1 Parent(s): 25c3ca1

README: single_task pi05 LoRA models

Browse files
Files changed (1) hide show
  1. README.md +84 -0
README.md CHANGED
@@ -1,3 +1,87 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+
5
+ # ManiLadder PI0.5 LoRA models
6
+
7
+ ## single_task
8
+
9
+ One PI0.5 LoRA checkpoint per ManiLadder task (60 tasks), each finetuned on that task's 20 demos.
10
+ For every task, all saved checkpoints (steps 5k–40k, every 5k) were re-evaluated for **50 episodes**
11
+ with fixed episode seeds 1000–1049 (identical across checkpoints of a task), and the checkpoint with the
12
+ highest success rate is published here (ties → earliest step).
13
+
14
+ Each `single_task/<task>/` folder contains:
15
+
16
+ - `lora_step_XXXXXXX.npz` — LoRA + trainable weights
17
+ - `norm_stats.json` — normalization statistics used in training
18
+ - `eval_result.json` — 50-episode evaluation of this checkpoint
19
+
20
+ `single_task/results.csv` lists the selected checkpoint per task; `single_task/all_checkpoints_eval.csv` has the
21
+ 50-episode result of every evaluated checkpoint (477 total).
22
+
23
+ Evaluation: `exec_steps=16`, `sample_steps=10`. Tasks whose checkpoints all scored 0/50 are still included;
24
+ for them the step choice is arbitrary.
25
+
26
+ | task | level | step | success (50 ep) |
27
+ |---|---|---|---|
28
+ | DualArmButtonPress-v1 | 1 | 5000 | 0.98 |
29
+ | DualArmCoverCloth-v1 | 1 | 15000 | 0.80 |
30
+ | DualArmFoldHandKerchief-v1 | 1 | 5000 | 0.74 |
31
+ | DualArmOpenPen-v1 | 1 | 35000 | 0.36 |
32
+ | DualArmRopeCylinderWarpping-v1 | 1 | 10000 | 0.62 |
33
+ | DualArmRopeStretch-v1 | 1 | 10000 | 0.92 |
34
+ | GraspCylinder-v1 | 1 | 15000 | 0.94 |
35
+ | LiftBucket-v1 | 1 | 40000 | 0.96 |
36
+ | OpenDoor-v1 | 1 | 5000 | 0.30 |
37
+ | PickPlacePen-v1 | 1 | 20000 | 0.36 |
38
+ | PushSoccer-v1 | 1 | 40000 | 0.80 |
39
+ | RopePalmCageHoldDex-v1 | 1 | 5000 | 0.94 |
40
+ | TurnOnFaucet-v1 | 1 | 10000 | 0.92 |
41
+ | ClothWipe-v1 | 2 | 25000 | 0.52 |
42
+ | DualArmClothAlign-v1 | 2 | 40000 | 0.38 |
43
+ | DualArmOpenBottle-v1 | 2 | 30000 | 0.06 |
44
+ | DualArmOpenLaptop-v1 | 2 | 25000 | 0.42 |
45
+ | DualArmPegInHole-v1 | 2 | 5000 | 0.18 |
46
+ | DualArmPlaceRopeOverRod-v1 | 2 | 40000 | 0.46 |
47
+ | DualArmStuffCloth-v1 | 2 | 15000 | 0.40 |
48
+ | DualArmThrowBlock-v1 | 2 | 5000 | 0.00 |
49
+ | FoldShirt-v1 | 2 | 40000 | 0.72 |
50
+ | GraspTwoBlocks-v1 | 2 | 5000 | 0.72 |
51
+ | HammerNailOut-v1 | 2 | 40000 | 0.44 |
52
+ | HangMug-v1 | 2 | 10000 | 0.70 |
53
+ | KitAssembly-v1 | 2 | 15000 | 0.06 |
54
+ | PivotBook-v1 | 2 | 15000 | 0.38 |
55
+ | ReorientPen-v1 | 2 | 25000 | 0.38 |
56
+ | RollingPin-v1 | 2 | 25000 | 0.96 |
57
+ | StraightenTwoRopesSequential-v1 | 2 | 15000 | 0.36 |
58
+ | DualArmOpenFridge-v1 | 3 | 5000 | 0.00 |
59
+ | DualArmPingpongBalance-v1 | 3 | 15000 | 0.20 |
60
+ | DualArmSetupTable-v1 | 3 | 25000 | 0.04 |
61
+ | DualArmShapeDoll-v1 | 3 | 30000 | 0.04 |
62
+ | DualArmThreadRopeThroughTube-v1 | 3 | 35000 | 0.16 |
63
+ | DualArmWeaveCloth-v1 | 3 | 20000 | 0.32 |
64
+ | HammerNail-v1 | 3 | 35000 | 0.12 |
65
+ | HitBox-v1 | 3 | 25000 | 0.06 |
66
+ | LiquidMeasuring-v1 | 3 | 35000 | 0.32 |
67
+ | MobilePickPlace-v1 | 3 | 15000 | 0.08 |
68
+ | Stack6Blocks-v1 | 3 | 5000 | 0.00 |
69
+ | TweezersPickPlace-v1 | 3 | 5000 | 0.00 |
70
+ | BuildTent-v1 | 4 | 10000 | 0.06 |
71
+ | DualArmBallClassify-v1 | 4 | 10000 | 0.00 |
72
+ | DualArmBilliardBridge-v1 | 4 | 5000 | 0.00 |
73
+ | DualArmClothHanger-v1 | 4 | 5000 | 0.00 |
74
+ | DualArmFlipTable-v1 | 4 | 5000 | 0.00 |
75
+ | DualArmJumpRope-v1 | 4 | 20000 | 0.02 |
76
+ | DualArmKeyboardType-v1 | 4 | 5000 | 0.00 |
77
+ | DualArmMahjongSetup-v1 | 4 | 5000 | 0.02 |
78
+ | DualArmSendPingpong-v1 | 4 | 40000 | 0.08 |
79
+ | DualArmShootBasketball-v1 | 4 | 5000 | 0.00 |
80
+ | FitnessBall-v1 | 4 | 5000 | 0.00 |
81
+ | FlipPan-v1 | 4 | 40000 | 0.04 |
82
+ | HitBilliard-v1 | 4 | 5000 | 0.00 |
83
+ | PingPongBallTransport-v1 | 4 | 40000 | 0.16 |
84
+ | RingTossing-v1 | 4 | 5000 | 0.00 |
85
+ | RodThroughHoles-v1 | 4 | 5000 | 0.02 |
86
+ | SpinPenHora-v1 | 4 | 5000 | 0.00 |
87
+ | TennisRally-v1 | 4 | 15000 | 0.06 |