harrywang01 commited on
Commit
2a736fc
Β·
verified Β·
1 Parent(s): 73e460e

README: larger section headings

Browse files
Files changed (1) hide show
  1. README.md +16 -16
README.md CHANGED
@@ -11,7 +11,7 @@ tags:
11
  - robotwin
12
  ---
13
 
14
- ## πŸ“– Overview
15
 
16
  **CAMP** (Compressed Action Memory Policy) gives a visuomotor policy a *behavioral memory*. A recurrent memory
17
  is pretrained to reconstruct a compressed (DCT) summary of the robot's own past actions, so its hidden state
@@ -26,7 +26,7 @@ policy is trained from the official RMBench demonstrations
26
  and evaluated with RMBench's own protocol.
27
  The files contain inference weights only.
28
 
29
- ## πŸ“Š Results
30
 
31
  Success rate over **100 test episodes** per task. We follow RMBench's evaluation protocol: the `demo_clean`
32
  configuration, test seeds from 100000 that the scripted expert can solve, and the per-task step limit.
@@ -43,7 +43,7 @@ configuration, test seeds from 100000 that the scripted expert can solve, and th
43
  | [`observe_and_pickup`](#observe_and_pickup) | a past observation | 250 | 9% |
44
  | [`press_button`](#press_button) | counting | 1500 | 5% |
45
 
46
- ## 🎬 Tasks
47
 
48
  Each preview is a **demonstration by RMBench's scripted expert**: the first of the 50 released demonstrations of
49
  the task, re-rendered so each task and its success condition can be seen clearly. It is filmed from the head
@@ -54,7 +54,7 @@ The full-resolution MP4 files are in [`previews/`](previews). Success rates in t
54
  100-episode policy evaluations.
55
 
56
  <a id="rearrange_blocks"></a>
57
- ### rearrange_blocks: 100%
58
 
59
  <p align="center"><img src="previews/rearrange_blocks.gif" width="70%"></p>
60
 
@@ -66,7 +66,7 @@ mat and presses the button. It then moves the second block off its mat to the sp
66
  between the mats. The button has been pressed exactly once and the gripper is open.
67
 
68
  <a id="blocks_ranking_try"></a>
69
- ### blocks_ranking_try: 100%
70
 
71
  <p align="center"><img src="previews/blocks_ranking_try.gif" width="70%"></p>
72
 
@@ -80,7 +80,7 @@ and tests again, working through the orders until the button accepts one.
80
  been pressed.
81
 
82
  <a id="put_back_block"></a>
83
- ### put_back_block: 100%
84
 
85
  <p align="center"><img src="previews/put_back_block.gif" width="70%"></p>
86
 
@@ -93,7 +93,7 @@ puts the block back on the mat it came from.
93
  3 cm of its original mat and the gripper is open.
94
 
95
  <a id="battery_try"></a>
96
- ### battery_try: 97%
97
 
98
  <p align="center"><img src="previews/battery_try.gif" width="70%"></p>
99
 
@@ -104,7 +104,7 @@ combination is correct. If it is not, the robot takes a battery out and re-inser
104
  - **Success:** both batteries are seated in the slot in the correct orientation and the dashboard turns on.
105
 
106
  <a id="swap_t"></a>
107
- ### swap_T: 24%
108
 
109
  <p align="center"><img src="previews/swap_T.gif" width="70%"></p>
110
 
@@ -116,7 +116,7 @@ and orientation.
116
  table, and both grippers are open.
117
 
118
  <a id="swap_blocks"></a>
119
- ### swap_blocks: 19%
120
 
121
  <p align="center"><img src="previews/swap_blocks.gif" width="70%"></p>
122
 
@@ -128,7 +128,7 @@ block. It swaps the two blocks using the spare tray as a buffer, then presses th
128
  and the gripper is open.
129
 
130
  <a id="cover_blocks"></a>
131
- ### cover_blocks: 17%
132
 
133
  <p align="center"><img src="previews/cover_blocks.gif" width="70%"></p>
134
 
@@ -140,7 +140,7 @@ blocks from left to right. Then it lifts the lids again in the order red, green,
140
  lifted.
141
 
142
  <a id="observe_and_pickup"></a>
143
- ### observe_and_pickup: 9%
144
 
145
  <p align="center"><img src="previews/observe_and_pickup.gif" width="70%"></p>
146
 
@@ -155,7 +155,7 @@ up the matching object from several distractors on the table.
155
  the single frame that shows the target would be skipped.
156
 
157
  <a id="press_button"></a>
158
- ### press_button: 5%
159
 
160
  <p align="center"><img src="previews/press_button.gif" width="70%"></p>
161
 
@@ -165,7 +165,7 @@ the middle button as many times as the right card shows, then presses the right
165
  - **Memory:** how many presses each button has received so far. A button looks the same after every press.
166
  - **Success:** both press counts match the cards exactly and the confirm button has been pressed.
167
 
168
- ## πŸ“¦ Files
169
 
170
  ```
171
  <task>/
@@ -179,7 +179,7 @@ previews/<task>.gif | .mp4 # expert demonstrations shown above (1920Γ—1440 MP4
179
  The checkpoints hold only what inference needs. There is no optimizer or scheduler state and no training
180
  bookkeeping.
181
 
182
- ## 🧠 Training recipe
183
 
184
  | | |
185
  |:--|:--|
@@ -191,7 +191,7 @@ bookkeeping.
191
  | Augmentation | joint noise 0.01, image noise 0.02, brightness and contrast jitter 0.15 |
192
  | Checkpoint | the best of the evaluated epochs per task (every 100 epochs) |
193
 
194
- ## πŸš€ Usage
195
 
196
  Evaluation code, training launcher and full instructions are in the
197
  [RMBench section of the CAMP repository](https://github.com/KuanchengWang/CAMP#-rmbench). To evaluate
@@ -217,7 +217,7 @@ $E/docker_rmbench.sh python /workspace/$E/rmbench_eval.py eval --task $T --ckpt
217
  To retrain a task from the official demonstrations with the same settings, run
218
  `bash scripts/rmbench/train_rmbench.sh <task>` inside the `camp` container.
219
 
220
- ## πŸ“ Citation
221
 
222
  If you find CAMP useful, please cite:
223
 
 
11
  - robotwin
12
  ---
13
 
14
+ # πŸ“– Overview
15
 
16
  **CAMP** (Compressed Action Memory Policy) gives a visuomotor policy a *behavioral memory*. A recurrent memory
17
  is pretrained to reconstruct a compressed (DCT) summary of the robot's own past actions, so its hidden state
 
26
  and evaluated with RMBench's own protocol.
27
  The files contain inference weights only.
28
 
29
+ # πŸ“Š Results
30
 
31
  Success rate over **100 test episodes** per task. We follow RMBench's evaluation protocol: the `demo_clean`
32
  configuration, test seeds from 100000 that the scripted expert can solve, and the per-task step limit.
 
43
  | [`observe_and_pickup`](#observe_and_pickup) | a past observation | 250 | 9% |
44
  | [`press_button`](#press_button) | counting | 1500 | 5% |
45
 
46
+ # 🎬 Tasks
47
 
48
  Each preview is a **demonstration by RMBench's scripted expert**: the first of the 50 released demonstrations of
49
  the task, re-rendered so each task and its success condition can be seen clearly. It is filmed from the head
 
54
  100-episode policy evaluations.
55
 
56
  <a id="rearrange_blocks"></a>
57
+ ## rearrange_blocks: 100%
58
 
59
  <p align="center"><img src="previews/rearrange_blocks.gif" width="70%"></p>
60
 
 
66
  between the mats. The button has been pressed exactly once and the gripper is open.
67
 
68
  <a id="blocks_ranking_try"></a>
69
+ ## blocks_ranking_try: 100%
70
 
71
  <p align="center"><img src="previews/blocks_ranking_try.gif" width="70%"></p>
72
 
 
80
  been pressed.
81
 
82
  <a id="put_back_block"></a>
83
+ ## put_back_block: 100%
84
 
85
  <p align="center"><img src="previews/put_back_block.gif" width="70%"></p>
86
 
 
93
  3 cm of its original mat and the gripper is open.
94
 
95
  <a id="battery_try"></a>
96
+ ## battery_try: 97%
97
 
98
  <p align="center"><img src="previews/battery_try.gif" width="70%"></p>
99
 
 
104
  - **Success:** both batteries are seated in the slot in the correct orientation and the dashboard turns on.
105
 
106
  <a id="swap_t"></a>
107
+ ## swap_T: 24%
108
 
109
  <p align="center"><img src="previews/swap_T.gif" width="70%"></p>
110
 
 
116
  table, and both grippers are open.
117
 
118
  <a id="swap_blocks"></a>
119
+ ## swap_blocks: 19%
120
 
121
  <p align="center"><img src="previews/swap_blocks.gif" width="70%"></p>
122
 
 
128
  and the gripper is open.
129
 
130
  <a id="cover_blocks"></a>
131
+ ## cover_blocks: 17%
132
 
133
  <p align="center"><img src="previews/cover_blocks.gif" width="70%"></p>
134
 
 
140
  lifted.
141
 
142
  <a id="observe_and_pickup"></a>
143
+ ## observe_and_pickup: 9%
144
 
145
  <p align="center"><img src="previews/observe_and_pickup.gif" width="70%"></p>
146
 
 
155
  the single frame that shows the target would be skipped.
156
 
157
  <a id="press_button"></a>
158
+ ## press_button: 5%
159
 
160
  <p align="center"><img src="previews/press_button.gif" width="70%"></p>
161
 
 
165
  - **Memory:** how many presses each button has received so far. A button looks the same after every press.
166
  - **Success:** both press counts match the cards exactly and the confirm button has been pressed.
167
 
168
+ # πŸ“¦ Files
169
 
170
  ```
171
  <task>/
 
179
  The checkpoints hold only what inference needs. There is no optimizer or scheduler state and no training
180
  bookkeeping.
181
 
182
+ # 🧠 Training recipe
183
 
184
  | | |
185
  |:--|:--|
 
191
  | Augmentation | joint noise 0.01, image noise 0.02, brightness and contrast jitter 0.15 |
192
  | Checkpoint | the best of the evaluated epochs per task (every 100 epochs) |
193
 
194
+ # πŸš€ Usage
195
 
196
  Evaluation code, training launcher and full instructions are in the
197
  [RMBench section of the CAMP repository](https://github.com/KuanchengWang/CAMP#-rmbench). To evaluate
 
217
  To retrain a task from the official demonstrations with the same settings, run
218
  `bash scripts/rmbench/train_rmbench.sh <task>` inside the `camp` container.
219
 
220
+ # πŸ“ Citation
221
 
222
  If you find CAMP useful, please cite:
223