yucxia commited on
Commit
2716169
·
verified ·
1 Parent(s): 3703f7e

diffusion_policy_20251203-002740_20251202-redcube

Browse files
Files changed (1) hide show
  1. config.yaml +342 -0
config.yaml ADDED
@@ -0,0 +1,342 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ image_encoders:
2
+ encoder_cfg:
3
+ type: timm
4
+ resize_shape:
5
+ - 224
6
+ - 224
7
+ crop_shape: null
8
+ vision_backbone_id: dinov2-vit-l
9
+ image_resize_strategy: resize-naive
10
+ finetune: norm
11
+ action_representation:
12
+ policy_translator:
13
+ _target_: srl_il.algo.base_algo.PolicyTranslatorRelative2Absolute
14
+ translate_rot: false
15
+ in_ee_frame: false
16
+ action_pose_key: actions_arm
17
+ current_pose_key: qpos_arm
18
+ r6d_repr: true
19
+ action_arm_dim: 9
20
+ data_augment:
21
+ outname: actions_arm
22
+ inputname:
23
+ - actions_arm
24
+ - qpos_arm
25
+ type: abs_action_pose_2_rela
26
+ translate_rot: false
27
+ in_ee_frame: false
28
+ r6d_repr: true
29
+ action_arm_normalizer:
30
+ type: augmentor_stats
31
+ min_max: true
32
+ max_data_points: 30000
33
+ batch_size: 72
34
+ seed: 43
35
+ debugrun: false
36
+ dataset_name: 20251202-redcube
37
+ wandb_cfg:
38
+ project: rwr2025task2
39
+ run_name: diffusion_policy_20251203-002740_20251202-redcube
40
+ entity: rwr25
41
+ tags:
42
+ - diffusion_policy
43
+ - dino
44
+ - relative_no_rot_6d
45
+ - 20251202-redcube
46
+ mode: online
47
+ output_dir: runs/diffusion_policy_20251203-002740_20251202-redcube
48
+ pipeline:
49
+ _target_: srl_il.pipeline.imitation_learning.ImitationLearningPipeline
50
+ dataset_cfg:
51
+ data:
52
+ _target_: srl_il.dataset.faive_dataset_zarr.faive_train_val_test
53
+ data_directory: /mnt/datadisk/dataset/20251202-redcube/
54
+ data_filter_keys: []
55
+ rgb_keys:
56
+ - oakd_wrist_view/color
57
+ - oakd_side_view/color
58
+ rgb_resize_to:
59
+ - 224
60
+ - 224
61
+ rgb_crop_dict:
62
+ oakd_wrist_view:
63
+ top: 0
64
+ left: 0
65
+ bottom: null
66
+ right: null
67
+ oakd_side_view:
68
+ top: 0
69
+ left: 0
70
+ bottom: null
71
+ right: null
72
+ zarr_cfgs:
73
+ n_reader_workers: 1
74
+ n_writer_workers: 4
75
+ cache_root: /mnt/datadisk/dataset/.cache
76
+ dataset_name: 20251202-redcube
77
+ overwrite: false
78
+ test_fraction: 0.15
79
+ val_fraction: 0.15
80
+ window_size_train: 21
81
+ window_size_test: 21
82
+ keys_traj:
83
+ - - actions_arm
84
+ - qpos_arm
85
+ - 1
86
+ - null
87
+ - - actions_hand
88
+ - actions_hand
89
+ - 1
90
+ - null
91
+ - - qpos_arm
92
+ - qpos_arm
93
+ - 0
94
+ - 1
95
+ - - qpos_hand
96
+ - qpos_hand
97
+ - 0
98
+ - 1
99
+ - - side_view_images
100
+ - oakd_side_view/color
101
+ - 0
102
+ - 1
103
+ - - wrist_view_images
104
+ - oakd_wrist_view/color
105
+ - 0
106
+ - 1
107
+ keys_global: []
108
+ pad_before: false
109
+ pad_after: false
110
+ pad_type: near
111
+ random_seed: 43
112
+ batch_size: 72
113
+ pin_memory: true
114
+ num_workers: 4
115
+ persistent_workers: true
116
+ algo_cfg:
117
+ _target_: srl_il.algo.diffusion_policy.DiffusionPolicyTrainer
118
+ algo_cfg:
119
+ device: cuda
120
+ target_dims:
121
+ actions_arm: 9
122
+ actions_hand: 17
123
+ T_target: 20
124
+ network_is_causal: true
125
+ network_group_keys:
126
+ - qpos
127
+ - side_view_images
128
+ - wrist_view_images
129
+ network_cfg:
130
+ d_model: 512
131
+ nhead: 8
132
+ num_blocks: 6
133
+ dim_feedforward: 2048
134
+ dropout: 0.1
135
+ scheduler_cfg:
136
+ scheduler_type: ddim
137
+ num_train_timesteps: 100
138
+ num_inference_steps: 20
139
+ beta_schedule: squaredcos_cap_v2
140
+ clip_sample: true
141
+ beta_start: 0.0001
142
+ beta_end: 0.02
143
+ trainer_cfg:
144
+ loss_params: null
145
+ optimizer_cfg:
146
+ network:
147
+ optm_cls: torch.optim.Adam
148
+ lr: 0.0002
149
+ weight_decay: 0.0001
150
+ obs_encoder:
151
+ optm_cls: torch.optim.Adam
152
+ lr: 0.0002
153
+ weight_decay: 0.0001
154
+ obs_encoder_cfg:
155
+ output_dim: 512
156
+ obs_groups_cfg:
157
+ qpos:
158
+ datakeys:
159
+ - qpos_arm
160
+ - qpos_hand
161
+ encoder_cfg:
162
+ type: lowdim_concat
163
+ input_dim_total: 24
164
+ posemb_cfg:
165
+ type: none
166
+ side_view_images:
167
+ datakeys:
168
+ - side_view_images
169
+ backbone_instance_name: side_img_backbone
170
+ encoder_cfg:
171
+ type: timm
172
+ resize_shape:
173
+ - 224
174
+ - 224
175
+ crop_shape: null
176
+ vision_backbone_id: dinov2-vit-l
177
+ image_resize_strategy: resize-naive
178
+ finetune: norm
179
+ posemb_cfg:
180
+ type: none
181
+ wrist_view_images:
182
+ datakeys:
183
+ - wrist_view_images
184
+ backbone_instance_name: wrist_img_backbone
185
+ encoder_cfg:
186
+ type: timm
187
+ resize_shape:
188
+ - 224
189
+ - 224
190
+ crop_shape: null
191
+ vision_backbone_id: dinov2-vit-l
192
+ image_resize_strategy: resize-naive
193
+ finetune: norm
194
+ posemb_cfg:
195
+ type: none
196
+ group_emb_cfg:
197
+ type: whole_seq_sine
198
+ policy_cfg:
199
+ policy_bs: 1
200
+ policy_translator:
201
+ _target_: srl_il.algo.base_algo.PolicyTranslatorRelative2Absolute
202
+ translate_rot: false
203
+ in_ee_frame: false
204
+ action_pose_key: actions_arm
205
+ current_pose_key: qpos_arm
206
+ r6d_repr: true
207
+ policy_aggregator_cfg:
208
+ type: temporal_aggr
209
+ update_every: 10
210
+ k: 0.01
211
+ policy_obs_list:
212
+ - - qpos_arm
213
+ - 1
214
+ - - qpos_hand
215
+ - 1
216
+ - - side_view_images
217
+ - 1
218
+ - - wrist_view_images
219
+ - 1
220
+ lr_scheduler_cfg:
221
+ network:
222
+ type: diffusers
223
+ name: cosine
224
+ params:
225
+ num_warmup_steps: 1000
226
+ num_training_steps: 500000
227
+ step_with_metrics: false
228
+ obs_encoder:
229
+ type: diffusers
230
+ name: cosine
231
+ params:
232
+ num_warmup_steps: 1000
233
+ num_training_steps: 500000
234
+ step_with_metrics: false
235
+ training_cfg:
236
+ num_epochs: 500
237
+ num_steps_per_epoch: 100
238
+ num_eval_steps_per_epoch: 10
239
+ num_test_steps_per_epoch: 10
240
+ steps_saving: 50
241
+ rollout:
242
+ enabled: false
243
+ visualization:
244
+ enabled: true
245
+ num_samples: 1
246
+ every_n_epoch: 1
247
+ visualizations:
248
+ - type: action_projector
249
+ video: false
250
+ visualization_prefix: wrist_position
251
+ - type: joints
252
+ video: false
253
+ visualization_prefix: hand_joints
254
+ normalizer_cfg:
255
+ actions_arm:
256
+ type: augmentor_stats
257
+ min_max: true
258
+ max_data_points: 30000
259
+ actions_hand:
260
+ type: dataset_stats
261
+ min_max: true
262
+ dataname: actions_hand
263
+ qpos_arm:
264
+ type: dataset_stats
265
+ dataname: qpos_arm
266
+ qpos_hand:
267
+ type: dataset_stats
268
+ dataname: qpos_hand
269
+ side_view_images:
270
+ type: hardcode
271
+ mean: 0.0
272
+ std: 1.0
273
+ wrist_view_images:
274
+ type: hardcode
275
+ mean: 0.0
276
+ std: 1.0
277
+ data_augmentation_cfg:
278
+ data_augments:
279
+ - outname: actions_arm
280
+ inputname:
281
+ - actions_arm
282
+ - qpos_arm
283
+ type: abs_action_pose_2_rela
284
+ translate_rot: false
285
+ in_ee_frame: false
286
+ r6d_repr: true
287
+ - outname: qpos_hand
288
+ type: gaussian_noise
289
+ mean: 0.0
290
+ std: 0.01
291
+ - outname: wrist_view_images
292
+ type: color_jitter
293
+ brightness: 0.1
294
+ contrast: 0.05
295
+ saturation: 0.05
296
+ hue: 0.05
297
+ - outname: side_view_images
298
+ type: color_jitter
299
+ brightness: 0.1
300
+ contrast: 0.05
301
+ saturation: 0.05
302
+ hue: 0.05
303
+ sim_env_cfg: {}
304
+ visualizer_cfg:
305
+ action_projector:
306
+ action_key: actions_arm
307
+ img_views:
308
+ side_view_images:
309
+ extrinsics_key: null
310
+ intrinsics_key: null
311
+ wrist_view_images:
312
+ extrinsics_key: null
313
+ intrinsics_key: null
314
+ visualizations:
315
+ - reference_frame: null
316
+ viz_args:
317
+ keypoints_indexes:
318
+ - 0
319
+ joints:
320
+ action_key: actions_hand
321
+ visualizations:
322
+ - viz_args: null
323
+ joints_indexes:
324
+ - 0
325
+ - 1
326
+ - 2
327
+ - 3
328
+ - 4
329
+ - 5
330
+ - 6
331
+ - 7
332
+ - 8
333
+ - 9
334
+ - 10
335
+ - 11
336
+ - 12
337
+ - 13
338
+ - 14
339
+ - 15
340
+ - 16
341
+ accelerator_cfg:
342
+ enabled: false