yucxia commited on
Commit
d643655
·
verified ·
1 Parent(s): c6452ed

diffusion_policy_20251205-223536_mixedcubes-02+03

Browse files
Files changed (1) hide show
  1. config.yaml +350 -0
config.yaml ADDED
@@ -0,0 +1,350 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ image_encoders:
2
+ encoder_cfg:
3
+ type: timm
4
+ resize_shape:
5
+ - 224
6
+ - 224
7
+ crop_shape: null
8
+ vision_backbone_id: dinov2-vit-l
9
+ image_resize_strategy: resize-naive
10
+ finetune: norm
11
+ proj_type: mlp
12
+ action_representation:
13
+ policy_translator:
14
+ _target_: srl_il.algo.base_algo.PolicyTranslatorRelative2Absolute
15
+ translate_rot: false
16
+ in_ee_frame: false
17
+ action_pose_key: actions_arm
18
+ current_pose_key: qpos_arm
19
+ r6d_repr: true
20
+ action_arm_dim: 9
21
+ data_augment:
22
+ outname: actions_arm
23
+ inputname:
24
+ - actions_arm
25
+ - qpos_arm
26
+ type: abs_action_pose_2_rela
27
+ translate_rot: false
28
+ in_ee_frame: false
29
+ r6d_repr: true
30
+ action_arm_normalizer:
31
+ type: augmentor_stats
32
+ min_max: true
33
+ max_data_points: 30000
34
+ batch_size: 72
35
+ seed: 43
36
+ debugrun: false
37
+ dataset_name: mixedcubes-02+03
38
+ wandb_cfg:
39
+ project: rwr2025task2
40
+ run_name: diffusion_policy_20251205-223536_mixedcubes-02+03
41
+ entity: rwr25
42
+ tags:
43
+ - diffusion_policy
44
+ - dino
45
+ - relative_no_rot_6d
46
+ - mixedcubes-02+03
47
+ mode: online
48
+ output_dir: runs/diffusion_policy_20251205-223536_mixedcubes-02+03
49
+ pipeline:
50
+ _target_: srl_il.pipeline.imitation_learning.ImitationLearningPipeline
51
+ dataset_cfg:
52
+ data:
53
+ _target_: srl_il.dataset.faive_dataset_zarr.faive_train_val_test
54
+ data_directory: /mnt/datadisk/dataset/mixedcubes-02+03/
55
+ data_filter_keys: []
56
+ rgb_keys:
57
+ - oakd_wrist_view/color
58
+ - oakd_side_view/color
59
+ rgb_resize_to:
60
+ - 224
61
+ - 224
62
+ rgb_crop_dict:
63
+ oakd_wrist_view:
64
+ top: 0
65
+ left: 0
66
+ bottom: null
67
+ right: null
68
+ oakd_side_view:
69
+ top: 0
70
+ left: 0
71
+ bottom: null
72
+ right: null
73
+ zarr_cfgs:
74
+ n_reader_workers: 1
75
+ n_writer_workers: 4
76
+ cache_root: /mnt/datadisk/dataset/.cache
77
+ dataset_name: mixedcubes-02+03
78
+ overwrite: false
79
+ test_fraction: 0.15
80
+ val_fraction: 0.15
81
+ window_size_train: 21
82
+ window_size_test: 21
83
+ keys_traj:
84
+ - - actions_arm
85
+ - qpos_arm
86
+ - 1
87
+ - null
88
+ - - actions_hand
89
+ - actions_hand
90
+ - 1
91
+ - null
92
+ - - qpos_arm
93
+ - qpos_arm
94
+ - 0
95
+ - 1
96
+ - - qpos_hand
97
+ - qpos_hand
98
+ - 0
99
+ - 1
100
+ - - side_view_images
101
+ - oakd_side_view/color
102
+ - 0
103
+ - 1
104
+ - - wrist_view_images
105
+ - oakd_wrist_view/color
106
+ - 0
107
+ - 1
108
+ keys_global:
109
+ - task_description
110
+ pad_before: false
111
+ pad_after: false
112
+ pad_type: near
113
+ random_seed: 43
114
+ batch_size: 72
115
+ pin_memory: true
116
+ num_workers: 4
117
+ persistent_workers: true
118
+ algo_cfg:
119
+ _target_: srl_il.algo.diffusion_policy.DiffusionPolicyTrainer
120
+ algo_cfg:
121
+ device: cuda
122
+ target_dims:
123
+ actions_arm: 9
124
+ actions_hand: 17
125
+ T_target: 20
126
+ network_is_causal: true
127
+ network_group_keys:
128
+ - qpos
129
+ - side_view_images
130
+ - wrist_view_images
131
+ network_cfg:
132
+ d_model: 512
133
+ nhead: 8
134
+ num_blocks: 6
135
+ dim_feedforward: 2048
136
+ dropout: 0.1
137
+ scheduler_cfg:
138
+ scheduler_type: ddim
139
+ num_train_timesteps: 100
140
+ num_inference_steps: 16
141
+ beta_schedule: squaredcos_cap_v2
142
+ clip_sample: true
143
+ beta_start: 0.0001
144
+ beta_end: 0.02
145
+ trainer_cfg:
146
+ loss_params: null
147
+ optimizer_cfg:
148
+ network:
149
+ optm_cls: torch.optim.Adam
150
+ lr: 0.0002
151
+ weight_decay: 0.0001
152
+ color_head:
153
+ optm_cls: torch.optim.Adam
154
+ lr: 0.0002
155
+ weight_decay: 0.0001
156
+ obs_encoder:
157
+ optm_cls: torch.optim.Adam
158
+ lr: 0.0002
159
+ weight_decay: 0.0001
160
+ obs_encoder_cfg:
161
+ output_dim: 512
162
+ obs_groups_cfg:
163
+ qpos:
164
+ datakeys:
165
+ - qpos_arm
166
+ - qpos_hand
167
+ encoder_cfg:
168
+ type: lowdim_concat
169
+ input_dim_total: 24
170
+ posemb_cfg:
171
+ type: none
172
+ side_view_images:
173
+ datakeys:
174
+ - side_view_images
175
+ backbone_instance_name: side_img_backbone
176
+ encoder_cfg:
177
+ type: timm
178
+ resize_shape:
179
+ - 224
180
+ - 224
181
+ crop_shape: null
182
+ vision_backbone_id: dinov2-vit-l
183
+ image_resize_strategy: resize-naive
184
+ finetune: norm
185
+ proj_type: mlp
186
+ posemb_cfg:
187
+ type: none
188
+ wrist_view_images:
189
+ datakeys:
190
+ - wrist_view_images
191
+ backbone_instance_name: wrist_img_backbone
192
+ encoder_cfg:
193
+ type: timm
194
+ resize_shape:
195
+ - 224
196
+ - 224
197
+ crop_shape: null
198
+ vision_backbone_id: dinov2-vit-l
199
+ image_resize_strategy: resize-naive
200
+ finetune: norm
201
+ proj_type: mlp
202
+ posemb_cfg:
203
+ type: none
204
+ group_emb_cfg:
205
+ type: each_group_learned
206
+ policy_cfg:
207
+ policy_bs: 1
208
+ policy_translator:
209
+ _target_: srl_il.algo.base_algo.PolicyTranslatorRelative2Absolute
210
+ translate_rot: false
211
+ in_ee_frame: false
212
+ action_pose_key: actions_arm
213
+ current_pose_key: qpos_arm
214
+ r6d_repr: true
215
+ policy_aggregator_cfg:
216
+ type: temporal_aggr
217
+ update_every: 20
218
+ k: 0.01
219
+ policy_obs_list:
220
+ - - qpos_arm
221
+ - 1
222
+ - - qpos_hand
223
+ - 1
224
+ - - side_view_images
225
+ - 1
226
+ - - wrist_view_images
227
+ - 1
228
+ lr_scheduler_cfg:
229
+ network:
230
+ type: diffusers
231
+ name: cosine
232
+ params:
233
+ num_warmup_steps: 1000
234
+ num_training_steps: 500000
235
+ step_with_metrics: false
236
+ obs_encoder:
237
+ type: diffusers
238
+ name: cosine
239
+ params:
240
+ num_warmup_steps: 1000
241
+ num_training_steps: 500000
242
+ step_with_metrics: false
243
+ training_cfg:
244
+ num_epochs: 500
245
+ num_steps_per_epoch: 100
246
+ num_eval_steps_per_epoch: 10
247
+ num_test_steps_per_epoch: 10
248
+ steps_saving: 50
249
+ rollout:
250
+ enabled: false
251
+ visualization:
252
+ enabled: true
253
+ num_samples: 1
254
+ every_n_epoch: 1
255
+ visualizations:
256
+ - type: action_projector
257
+ video: false
258
+ visualization_prefix: wrist_position
259
+ - type: joints
260
+ video: false
261
+ visualization_prefix: hand_joints
262
+ normalizer_cfg:
263
+ actions_arm:
264
+ type: augmentor_stats
265
+ min_max: true
266
+ max_data_points: 30000
267
+ actions_hand:
268
+ type: dataset_stats
269
+ min_max: true
270
+ dataname: actions_hand
271
+ qpos_arm:
272
+ type: dataset_stats
273
+ dataname: qpos_arm
274
+ qpos_hand:
275
+ type: dataset_stats
276
+ dataname: qpos_hand
277
+ side_view_images:
278
+ type: hardcode
279
+ mean: 0.0
280
+ std: 1.0
281
+ wrist_view_images:
282
+ type: hardcode
283
+ mean: 0.0
284
+ std: 1.0
285
+ data_augmentation_cfg:
286
+ data_augments:
287
+ - outname: actions_arm
288
+ inputname:
289
+ - actions_arm
290
+ - qpos_arm
291
+ type: abs_action_pose_2_rela
292
+ translate_rot: false
293
+ in_ee_frame: false
294
+ r6d_repr: true
295
+ - outname: qpos_hand
296
+ type: gaussian_noise
297
+ mean: 0.0
298
+ std: 0.01
299
+ - outname: wrist_view_images
300
+ type: color_jitter
301
+ brightness: 0.1
302
+ contrast: 0.05
303
+ saturation: 0.05
304
+ hue: 0.05
305
+ - outname: side_view_images
306
+ type: color_jitter
307
+ brightness: 0.1
308
+ contrast: 0.05
309
+ saturation: 0.05
310
+ hue: 0.05
311
+ sim_env_cfg: {}
312
+ visualizer_cfg:
313
+ action_projector:
314
+ action_key: actions_arm
315
+ img_views:
316
+ side_view_images:
317
+ extrinsics_key: null
318
+ intrinsics_key: null
319
+ wrist_view_images:
320
+ extrinsics_key: null
321
+ intrinsics_key: null
322
+ visualizations:
323
+ - reference_frame: null
324
+ viz_args:
325
+ keypoints_indexes:
326
+ - 0
327
+ joints:
328
+ action_key: actions_hand
329
+ visualizations:
330
+ - viz_args: null
331
+ joints_indexes:
332
+ - 0
333
+ - 1
334
+ - 2
335
+ - 3
336
+ - 4
337
+ - 5
338
+ - 6
339
+ - 7
340
+ - 8
341
+ - 9
342
+ - 10
343
+ - 11
344
+ - 12
345
+ - 13
346
+ - 14
347
+ - 15
348
+ - 16
349
+ accelerator_cfg:
350
+ enabled: false