Kyry10 commited on
Commit
8532c07
·
verified ·
1 Parent(s): 17a9369

Add RFCP policy (ONNX)

Browse files
MODEL_CARD.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Model card: SONIC Catwalk, a fine-tuned SONIC policy (Unitree G1)
2
+
3
+ **Team:** Ghost Couture (Kent State Advanced Telerobotics Research Lab) · Ghost Trial 04, Performance Arts track
4
+
5
+ **What it does:** it tracks the m7 runway performance (walk, turn + pose, walk back) much closer to its path and turn point than stock SONIC.
6
+ - m7 path error (mpjpe_g): 365.8 → 218.4 mm (−40%).
7
+ - End drift: 0.61 → 0.27 m.
8
+ - Turn + pose segment: 502 → 458 mm.
9
+ - All 30 control clips succeed (standard eval).
10
+ - With domain randomization and pushes on, it completes all 5 m7 runs (stock 4 of 5).
11
+ - It runs in MuJoCo sim2sim without falling.
12
+
13
+ ## Files (this folder)
14
+ - `sonic_catwalk_g1.onnx`: the main policy (G1-joint encoder + decoder). Input `obs_dict` [1, 1570] = [tokenizer obs | proprioception], output [1, 29] joint actions.
15
+ - `sonic_catwalk_encoder.onnx`: all encoders, input [1, 1751], output token [1, 64].
16
+ - `sonic_catwalk_decoder.onnx`: decoder only, input [1, 994], output [1, 29].
17
+ - `config.yaml`: the resolved training config. `model_config.yaml`: the env/algo config written by the ONNX export.
18
+ - `onnx_verify.json`: the ONNX Runtime vs torch check. On 100 recorded observations the g1 model's max abs diff is 8.6e-6 (tolerance 1e-4, pass).
19
+ - `SHA256SUMS`: checksums of every file.
20
+
21
+ The ONNX files follow the SONIC deployment layout (`gear_sonic_deploy`).
22
+
23
+ ## How it was trained
24
+ - **Start:** fine-tuned from the released SONIC checkpoint `sonic_release/last.pt` (Hugging Face `nvidia/GEAR-SONIC`, sha256 e6bdab3f…). There is no other warm start.
25
+ - **Algorithm:** SONIC's own PPO fine-tuning (`gear_sonic/train_agent_trl.py +exp=manager/universal_token/all_modes/sonic_release`) in Isaac Lab on 1 GPU. The release config is unchanged except for:
26
+ - the motion file (30 control clips + 14 copies of m7);
27
+ - `smpl_motion_file=dummy` (G1 only);
28
+ - `num_envs`;
29
+ - the checkpoint frequency;
30
+ - the wandb project.
31
+ - **Checkpoint selection:** the lowest m7 path error that passes all hard constraints versus stock:
32
+ - m7 success = 1.0;
33
+ - controls success ≥ stock − 0.02;
34
+ - walk/turn control mpjpe_l ≤ stock + 2 mm;
35
+ - jitter ≤ 1.1 × stock;
36
+ - self-collision frames ≤ stock.
37
+ - **Exact configuration and commands:** `03_training_config/`.
38
+
39
+ ## Data
40
+ The m7 runway performance (683 frames at 30 fps) plus 30 BONES-SEED control clips; see `02_dataset/DATASET_CARD.md`.
41
+
42
+ ## Before / after (stock SONIC and ours on the same machine, same procedure)
43
+ | Metric | Stock SONIC | Ours |
44
+ |---|---|---|
45
+ | m7 success rate | 1.00 | 1.00 |
46
+ | m7 path error mpjpe_g (mm) | 365.8 | 218.4 |
47
+ | m7 pose error mpjpe_l (mm) | 26.0 | 26.9 |
48
+ | m7 walk / turn + pose / walk back / idle mpjpe_g (mm) | 260.7 / 501.5 / 369.9 / 652.4 | 132.6 / 457.5 / 183.1 / 220.7 |
49
+ | root drift at end (m) | 0.61 | 0.27 |
50
+ | max root xy error (m) | 1.03 | 0.79 |
51
+ | step width, walking (m; target 0.033) | 0.112 | 0.127 |
52
+ | jitter (rad) | 0.00458 | 0.00462 |
53
+ | self-collision frames (approx.) / joint-limit violations | 0 / 0 | 0 / 0 |
54
+ | controls success (30 clips) | 1.00 | 1.00 |
55
+ | controls walk / turn / idle mpjpe_l (mm) | 25.0 / 23.8 / 28.1 | 23.7 / 22.6 / 30.3 |
56
+ | unseen clips (5): success / mpjpe_l / mpjpe_g | 1.00 / 22.2 / 284.8 | 1.00 / 25.8 / 259.7 |
57
+ | randomization + pushes, m7 (5 runs): success / mpjpe_g | 4/5 / 482.9 ± 105.9 | 5/5 / 473.0 ± 248.9 |
58
+ | randomization + pushes, controls (150 runs): success | 150/150 | 146/150 |
59
+ | MuJoCo sim2sim (m7, walk, turn): falls | 0 | 0 |
60
+
61
+ The first rows (m7 and controls) come from the training machine (H100). The unseen-clip, randomization and sim2sim rows come from a second machine (Quadro RTX 6000). On that machine, m7 path error is 389.3 mm for stock vs 281.7 mm for ours.
62
+
63
+ ## License
64
+ This policy is a derivative of the NVIDIA SONIC (GEAR-SONIC) weights and is subject to the **NVIDIA Open Model License**. The control clips come from BONES-SEED (Motion Data by Bones Studio) and are not redistributed.
README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: nvidia-open-model-license
4
+ tags: [robotics, humanoid, unitree-g1, onnx, sonic, catwalk]
5
+ ---
6
+
7
+ # RFCP: Robot Fashion Catwalk Policy
8
+
9
+ A SONIC fine-tune that makes the Unitree G1 walk a fashion runway: down the catwalk, turn, pose, walk back.
10
+
11
+ - `*_g1.onnx`: the policy
12
+ - `*_encoder.onnx`, `*_decoder.onnx`: SONIC's split export
13
+ - `config.yaml`, `model_config.yaml`: the config it was trained and exported with
14
+
15
+ | vs stock SONIC | Stock | RFCP |
16
+ |---|---|---|
17
+ | Path error | 366 mm | 218 mm |
18
+ | End drift | 0.61 m | 0.27 m |
19
+
20
+ Fine-tuned from NVIDIA SONIC (GR00T-WholeBodyControl) weights under the NVIDIA Open Model License.
21
+
22
+ Team ATR · Motion Data by Bones Studio · Dataset: https://huggingface.co/datasets/Kyry10/rfcp-dataset
SHA256SUMS ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ aebf0c26e2c5cebb81583848eb8d0412779eed0bd86faedb89d3a0b67edb5277 sonic_catwalk_decoder.onnx
2
+ f7015d9e6ee972bbe1a2e46054008c21087db97e2be283267400e28dcdf83f04 sonic_catwalk_encoder.onnx
3
+ f9937b9ab675e644cdc9f89175db3f8af2f31eddfc3ea9fafaf1e6513bb84962 sonic_catwalk_g1.onnx
4
+ 136d30f8cb18a1c4823a09c22425a9f17460bb20d91ecaf8edb372ee1e6f7d1f config.yaml
5
+ adff7e175b591da425ca0b8cc206a3e8bbad21098e3e710663af9407c53c555f model_config.yaml
6
+ 76974d391533b662d132f8093290b4f45050f186ba1bafa713b556fa688cfaa5 onnx_verify.json
7
+ afe967a76f9d45620379c2b856097dbd2fddafff67f2ed5c569530a21dd9719a MODEL_CARD.md
config.yaml ADDED
@@ -0,0 +1,903 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ num_gpus: 1
2
+ max_retries: 1
3
+ seed: 0
4
+ codebase_version: 1.0
5
+ headless: true
6
+ num_envs: 4096
7
+ auto_load_latest: false
8
+ checkpoint: sonic_release/last.pt
9
+ project_name: ghost04
10
+ experiment_name: ${exp_base}_${exp_var}
11
+ base_dir: logs_rl
12
+ timestamp: ${now:%Y%m%d_%H%M%S}
13
+ experiment_dir: ${base_dir}/${project_name}/${experiment_name}-${timestamp}
14
+ save_dir: ${experiment_dir}/.hydra
15
+ force_flat_terrain: false
16
+ use_wandb: true
17
+ log_task_name: TEST
18
+ multi_gpu: false
19
+ global_rank: 0
20
+ sim_type: isaacsim
21
+ env_spacing: 20
22
+ output_dir: ${experiment_dir}/output
23
+ eval_overrides:
24
+ headless: false
25
+ num_envs: 1
26
+ auto_load_latest: false
27
+ use_wandb: false
28
+ algo:
29
+ trl:
30
+ dataset_name: dummy
31
+ output_dir: logs_rl/ghost04/manager/universal_token/all_modes/sonic_release_ft_m7_B-20260927_014418
32
+ learning_rate: ${algo.config.actor_learning_rate}
33
+ num_total_batches: ${algo.config.num_learning_iterations}
34
+ total_episodes: null
35
+ num_ppo_epochs: ${algo.config.num_learning_epochs}
36
+ num_mini_batches: ${algo.config.num_mini_batches}
37
+ per_device_train_batch_size: null
38
+ gradient_accumulation_steps: 1
39
+ report_to: none
40
+ gamma: ${algo.config.gamma}
41
+ lam: ${algo.config.lam}
42
+ vf_coef: ${algo.config.value_loss_coef}
43
+ max_grad_norm: ${algo.config.max_grad_norm}
44
+ lr_scheduler_type: constant
45
+ save_strategy: 'no'
46
+ disable_tqdm: true
47
+ config:
48
+ critic:
49
+ _target_: gear_sonic.trl.modules.actor_critic_modules.Critic
50
+ running_mean_std: true
51
+ backbone:
52
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
53
+ process_output_dim: true
54
+ module_config_dict:
55
+ type: MLP
56
+ input_dim:
57
+ - critic_obs
58
+ output_dim:
59
+ - 1
60
+ layer_config:
61
+ type: MLP
62
+ hidden_dims:
63
+ - 2048
64
+ - 2048
65
+ - 1024
66
+ - 1024
67
+ - 512
68
+ - 512
69
+ activation: SiLU
70
+ actor:
71
+ backbone:
72
+ quantizer:
73
+ _target_: vector_quantize_pytorch.FSQ
74
+ encoders:
75
+ g1:
76
+ inputs:
77
+ - command_multi_future_nonflat
78
+ - motion_anchor_ori_b_mf_nonflat
79
+ params:
80
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
81
+ input_dim: null
82
+ output_dim: null
83
+ num_input_temporal_dims: ${manager_env.commands.motion.num_future_frames}
84
+ num_output_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
85
+ module_config_dict:
86
+ layer_config:
87
+ type: MLP
88
+ hidden_dims:
89
+ - 2048
90
+ - 1024
91
+ - 512
92
+ - 512
93
+ activation: SiLU
94
+ teleop:
95
+ inputs:
96
+ - command_multi_future_lower_body
97
+ - vr_3point_local_target
98
+ - vr_3point_local_orn_target
99
+ - motion_anchor_ori_b
100
+ params:
101
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
102
+ input_dim: null
103
+ output_dim: null
104
+ num_input_temporal_dims: null
105
+ num_output_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
106
+ module_config_dict:
107
+ layer_config:
108
+ type: MLP
109
+ hidden_dims:
110
+ - 2048
111
+ - 1024
112
+ - 512
113
+ - 512
114
+ activation: SiLU
115
+ smpl:
116
+ inputs:
117
+ - smpl_joints_multi_future_local_nonflat
118
+ - smpl_root_ori_b_multi_future
119
+ - joint_pos_multi_future_wrist_for_smpl
120
+ params:
121
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
122
+ input_dim: null
123
+ output_dim: null
124
+ num_input_temporal_dims: ${manager_env.commands.motion.smpl_num_future_frames}
125
+ num_output_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
126
+ module_config_dict:
127
+ layer_config:
128
+ type: MLP
129
+ hidden_dims:
130
+ - 2048
131
+ - 1024
132
+ - 512
133
+ - 512
134
+ activation: SiLU
135
+ decoders:
136
+ g1_dyn:
137
+ inputs:
138
+ - token_flattened
139
+ - proprioception
140
+ outputs:
141
+ - action
142
+ has_temporal_dim: false
143
+ params:
144
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
145
+ input_dim: null
146
+ output_dim: null
147
+ num_input_temporal_dims: null
148
+ num_output_temporal_dims: null
149
+ module_config_dict:
150
+ layer_config:
151
+ type: MLP
152
+ hidden_dims:
153
+ - 2048
154
+ - 2048
155
+ - 1024
156
+ - 1024
157
+ - 512
158
+ - 512
159
+ activation: SiLU
160
+ g1_kin:
161
+ inputs:
162
+ - token
163
+ outputs:
164
+ - command_multi_future_nonflat
165
+ - motion_anchor_ori_b_mf_nonflat
166
+ has_temporal_dim: true
167
+ params:
168
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
169
+ input_dim: null
170
+ output_dim: null
171
+ num_input_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
172
+ num_output_temporal_dims: ${manager_env.commands.motion.num_future_frames}
173
+ module_config_dict:
174
+ layer_config:
175
+ type: MLP
176
+ hidden_dims:
177
+ - 2048
178
+ - 1024
179
+ - 512
180
+ - 512
181
+ activation: SiLU
182
+ _target_: gear_sonic.trl.modules.universal_token_modules.UniversalTokenModule
183
+ num_future_frames: ${manager_env.commands.motion.num_future_frames}
184
+ proprioception_features:
185
+ - actor_obs
186
+ encoder_sample_probs: ${manager_env.commands.motion.encoder_sample_probs}
187
+ num_fsq_levels: 32
188
+ fsq_level_list: 32
189
+ max_num_tokens: 2
190
+ aux_loss_func:
191
+ g1_recon:
192
+ _target_: gear_sonic.trl.losses.token_losses.G1ReconLoss
193
+ loss_type: mse
194
+ g1_smpl_latent:
195
+ _target_: gear_sonic.trl.losses.token_losses.G1SmplLatentLoss
196
+ loss_type: mse
197
+ g1_teleop_latent:
198
+ _target_: gear_sonic.trl.losses.token_losses.G1TeleopLatentLoss
199
+ loss_type: mse
200
+ teleop_smpl_latent:
201
+ _target_: gear_sonic.trl.losses.token_losses.TeleopSmplLatentLoss
202
+ loss_type: mse
203
+ detach_teleop_target: true
204
+ reencoded_smpl_g1_latent:
205
+ _target_: gear_sonic.trl.losses.token_losses.ReencodedSmplG1LatentLoss
206
+ loss_type: mse
207
+ aux_loss_coef:
208
+ g1_recon: 0.01
209
+ g1_smpl_latent: 1.0
210
+ g1_teleop_latent: 1.0
211
+ teleop_smpl_latent: 1.0
212
+ reencoded_smpl_g1_latent: 1.0
213
+ reencode_smpl_g1_recon: true
214
+ _target_: gear_sonic.trl.modules.actor_critic_modules.Actor
215
+ running_mean_std: false
216
+ input_obs_dict: true
217
+ has_aux_loss: true
218
+ num_learning_epochs: 5
219
+ num_mini_batches: 4
220
+ clip_param: 0.2
221
+ gamma: 0.99
222
+ lam: 0.95
223
+ value_loss_coef: 1.0
224
+ entropy_coef: 0.01
225
+ actor_learning_rate: 2.0e-05
226
+ critic_learning_rate: 0.001
227
+ max_grad_norm: 0.1
228
+ use_clipped_value_loss: true
229
+ schedule: adaptive
230
+ desired_kl: 0.01
231
+ adaptive_lr_min: 1.0e-05
232
+ adaptive_lr_max: 0.0002
233
+ use_new_actor_critic: true
234
+ use_padding_mask: false
235
+ ppo_shuffle_every_epoch: true
236
+ sync_advantage_normalization: true
237
+ empty_cache_every_n_ppo_epoch: -1
238
+ num_steps_per_env: 24
239
+ save_interval: 500
240
+ eval_frequency: 500
241
+ load_optimizer: true
242
+ init_noise_std: 0.05
243
+ num_learning_iterations: 100000
244
+ init_at_random_ep_len: true
245
+ global_rank: 0
246
+ world_size: 1
247
+ use_clampped_std: true
248
+ std_clamp_min: 0.001
249
+ std_clamp_max: 0.5
250
+ _recursive_: false
251
+ env: ???
252
+ terrain: ???
253
+ callbacks:
254
+ model_save:
255
+ _target_: gear_sonic.trl.callbacks.model_save_callback.ModelSaveCallback
256
+ save_dir: ${experiment_dir}
257
+ save_frequency: 25
258
+ max_disk_usage: 14.8
259
+ wandb:
260
+ _target_: gear_sonic.trl.callbacks.wandb_callback.WandbCallback
261
+ read_eval:
262
+ _target_: gear_sonic.trl.callbacks.read_eval_callback.ReadEvalCallback
263
+ eval_dir: ${experiment_dir}/eval
264
+ check_interval: 1
265
+ im_resample:
266
+ _target_: gear_sonic.trl.callbacks.im_resample_callback.ImResampleCallback
267
+ motion_resample_frequency: 250
268
+ trainer:
269
+ _target_: gear_sonic.trl.trainer.ppo_trainer_aux_loss.TRLAuxLossPPOTrainer
270
+ wandb:
271
+ wandb_project: ghost04
272
+ wandb_tags: online
273
+ wandb_group: null
274
+ wandb_id: null
275
+ wandb_entity: null
276
+ wandb_dir: /data/kkolesni/GR00T-WholeBodyControl/data/ghost04/wandb
277
+ manager_env:
278
+ commands:
279
+ motion:
280
+ encoder_sample_probs:
281
+ g1: 1.0
282
+ teleop: 1.0
283
+ smpl: 1.0
284
+ _target_: gear_sonic.envs.manager_env.mdp.commands.TrackingCommandCfg
285
+ asset_name: robot
286
+ motion_lib_cfg:
287
+ motion_file: /data/kkolesni/GR00T-WholeBodyControl/data/ghost04/m7data/train_B
288
+ smpl_motion_file: dummy
289
+ asset:
290
+ assetRoot: gear_sonic/data/assets/robot_description/mjcf/
291
+ assetFileName: g1_29dof_rev_1_0.xml
292
+ urdfFileName: ''
293
+ extend_config: []
294
+ target_fps: 50
295
+ multi_thread: true
296
+ filter_motion_keys: null
297
+ adaptive_sampling:
298
+ enable: true
299
+ bin_size: 50
300
+ sequence_length_agnostic: true
301
+ init_num_failures: 1
302
+ uniform_sampling_rate: 0.1
303
+ pre_failure_sample_window: 200
304
+ use_failure_rate_decay: false
305
+ decay_gamma: 0.8
306
+ adp_samp_failure_rate_max_over_mean: 200
307
+ upper_body_augment_prefixes:
308
+ - '2025'
309
+ - sonic_mixed_walking_running
310
+ - sonic_squating_different_height_switching
311
+ - sonic_running
312
+ - sonic_walking
313
+ - sonic_squating_different_height_hold
314
+ - sonic_walking_other_style
315
+ - balance
316
+ smpl_y_up: true
317
+ resampling_time_range:
318
+ - 1000000000.0
319
+ - 1000000000.0
320
+ debug_vis: true
321
+ dt_future_ref_frames: 0.1
322
+ num_future_frames: 10
323
+ pose_range:
324
+ x:
325
+ - -0.05
326
+ - 0.05
327
+ 'y':
328
+ - -0.05
329
+ - 0.05
330
+ z:
331
+ - -0.01
332
+ - 0.01
333
+ roll:
334
+ - -0.1
335
+ - 0.1
336
+ pitch:
337
+ - -0.1
338
+ - 0.1
339
+ yaw:
340
+ - -0.2
341
+ - 0.2
342
+ velocity_range:
343
+ x:
344
+ - -0.5
345
+ - 0.5
346
+ 'y':
347
+ - -0.5
348
+ - 0.5
349
+ z:
350
+ - -0.2
351
+ - 0.2
352
+ roll:
353
+ - -0.52
354
+ - 0.52
355
+ pitch:
356
+ - -0.52
357
+ - 0.52
358
+ yaw:
359
+ - -0.78
360
+ - 0.78
361
+ joint_position_range:
362
+ - -0.1
363
+ - 0.1
364
+ joint_velocity_range:
365
+ - 0
366
+ - 0
367
+ anchor_body: pelvis
368
+ vr_3point_body:
369
+ - left_wrist_yaw_link
370
+ - right_wrist_yaw_link
371
+ - torso_link
372
+ vr_3point_body_offset:
373
+ - - 0.18
374
+ - -0.025
375
+ - 0.0
376
+ - - 0.18
377
+ - 0.025
378
+ - 0.0
379
+ - - 0.0
380
+ - 0.0
381
+ - 0.35
382
+ reward_point_body:
383
+ - torso_link
384
+ - left_wrist_yaw_link
385
+ - right_wrist_yaw_link
386
+ reward_point_body_offset:
387
+ - - 0.0
388
+ - 0.0
389
+ - 0.5
390
+ - - 0.0
391
+ - -0.0
392
+ - 0.0
393
+ - - 0.0
394
+ - -0.0
395
+ - 0.0
396
+ body_names:
397
+ - pelvis
398
+ - left_hip_roll_link
399
+ - left_knee_link
400
+ - left_ankle_roll_link
401
+ - right_hip_roll_link
402
+ - right_knee_link
403
+ - right_ankle_roll_link
404
+ - torso_link
405
+ - left_shoulder_roll_link
406
+ - left_elbow_link
407
+ - left_wrist_yaw_link
408
+ - right_shoulder_roll_link
409
+ - right_elbow_link
410
+ - right_wrist_yaw_link
411
+ smpl_num_future_frames: 10
412
+ smpl_dt_future_ref_frames: 0.02
413
+ cat_upper_body_poses: true
414
+ cat_upper_body_poses_prob: 0.5
415
+ freeze_frame_aug: true
416
+ teleop_sample_prob_when_smpl: 0.5
417
+ _target_: gear_sonic.envs.manager_env.mdp.commands.CommandsCfg
418
+ actions:
419
+ joint_pos:
420
+ _target_: isaaclab.envs.mdp.actions.JointPositionActionCfg
421
+ asset_name: robot
422
+ joint_names:
423
+ - .*
424
+ use_default_offset: true
425
+ _target_: gear_sonic.envs.manager_env.mdp.actions.ActionsCfg
426
+ observations:
427
+ policy:
428
+ gravity_dir:
429
+ _target_: isaaclab.managers.ObservationTermCfg
430
+ func: gear_sonic.envs.manager_env.mdp:gravity_dir
431
+ params:
432
+ command_name: motion
433
+ history_length: ${actor_prop_history_length}
434
+ noise:
435
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
436
+ n_min: -0.05
437
+ n_max: 0.05
438
+ base_ang_vel:
439
+ _target_: isaaclab.managers.ObservationTermCfg
440
+ func: gear_sonic.envs.manager_env.mdp:base_ang_vel
441
+ history_length: ${actor_prop_history_length}
442
+ noise:
443
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
444
+ n_min: -0.2
445
+ n_max: 0.2
446
+ joint_pos:
447
+ _target_: isaaclab.managers.ObservationTermCfg
448
+ func: gear_sonic.envs.manager_env.mdp:joint_pos_rel
449
+ history_length: ${actor_prop_history_length}
450
+ noise:
451
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
452
+ n_min: -0.01
453
+ n_max: 0.01
454
+ joint_vel:
455
+ _target_: isaaclab.managers.ObservationTermCfg
456
+ func: gear_sonic.envs.manager_env.mdp:joint_vel_rel
457
+ history_length: ${actor_prop_history_length}
458
+ noise:
459
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
460
+ n_min: -0.5
461
+ n_max: 0.5
462
+ actions:
463
+ _target_: isaaclab.managers.ObservationTermCfg
464
+ func: gear_sonic.envs.manager_env.mdp:last_action
465
+ history_length: ${actor_actions_history_length}
466
+ _target_: gear_sonic.envs.manager_env.mdp.observations.PolicyCfg
467
+ enable_corruption: true
468
+ concatenate_terms: true
469
+ critic:
470
+ command_multi_future:
471
+ _target_: isaaclab.managers.ObservationTermCfg
472
+ func: gear_sonic.envs.manager_env.mdp:command_multi_future
473
+ params:
474
+ command_name: motion
475
+ motion_anchor_pos_b:
476
+ _target_: isaaclab.managers.ObservationTermCfg
477
+ func: gear_sonic.envs.manager_env.mdp:motion_anchor_pos_b
478
+ params:
479
+ command_name: motion
480
+ motion_anchor_ori_b:
481
+ _target_: isaaclab.managers.ObservationTermCfg
482
+ func: gear_sonic.envs.manager_env.mdp:motion_anchor_ori_b
483
+ params:
484
+ command_name: motion
485
+ body_pos:
486
+ _target_: isaaclab.managers.ObservationTermCfg
487
+ func: gear_sonic.envs.manager_env.mdp:robot_body_pos_b
488
+ params:
489
+ command_name: motion
490
+ body_ori:
491
+ _target_: isaaclab.managers.ObservationTermCfg
492
+ func: gear_sonic.envs.manager_env.mdp:robot_body_ori_b
493
+ params:
494
+ command_name: motion
495
+ base_lin_vel:
496
+ _target_: isaaclab.managers.ObservationTermCfg
497
+ func: gear_sonic.envs.manager_env.mdp:base_lin_vel
498
+ history_length: ${critic_prop_history_length}
499
+ base_ang_vel:
500
+ _target_: isaaclab.managers.ObservationTermCfg
501
+ func: gear_sonic.envs.manager_env.mdp:base_ang_vel
502
+ history_length: ${critic_prop_history_length}
503
+ joint_pos:
504
+ _target_: isaaclab.managers.ObservationTermCfg
505
+ func: gear_sonic.envs.manager_env.mdp:joint_pos_rel
506
+ history_length: ${critic_prop_history_length}
507
+ joint_vel:
508
+ _target_: isaaclab.managers.ObservationTermCfg
509
+ func: gear_sonic.envs.manager_env.mdp:joint_vel_rel
510
+ history_length: ${critic_prop_history_length}
511
+ actions:
512
+ _target_: isaaclab.managers.ObservationTermCfg
513
+ func: gear_sonic.envs.manager_env.mdp:last_action
514
+ history_length: ${critic_actions_history_length}
515
+ _target_: gear_sonic.envs.manager_env.mdp.observations.PrivilegedCfg
516
+ tokenizer:
517
+ encoder_index:
518
+ _target_: isaaclab.managers.ObservationTermCfg
519
+ func: gear_sonic.envs.manager_env.mdp:get_command_obs
520
+ params:
521
+ command_name: motion
522
+ obs_name: episode_encoder_index
523
+ command_multi_future_nonflat:
524
+ _target_: isaaclab.managers.ObservationTermCfg
525
+ func: gear_sonic.envs.manager_env.mdp:command_multi_future
526
+ params:
527
+ command_name: motion
528
+ non_flatten: true
529
+ command_z_multi_future_nonflat:
530
+ _target_: isaaclab.managers.ObservationTermCfg
531
+ func: gear_sonic.envs.manager_env.mdp:command_z_multi_future
532
+ params:
533
+ command_name: motion
534
+ non_flatten: true
535
+ motion_anchor_ori_b_mf_nonflat:
536
+ _target_: isaaclab.managers.ObservationTermCfg
537
+ func: gear_sonic.envs.manager_env.mdp:motion_anchor_ori_b_mf
538
+ params:
539
+ command_name: motion
540
+ non_flatten: true
541
+ noise:
542
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
543
+ n_min: -0.05
544
+ n_max: 0.05
545
+ command_multi_future_lower_body:
546
+ _target_: isaaclab.managers.ObservationTermCfg
547
+ func: gear_sonic.envs.manager_env.mdp:command_multi_future_lower_body
548
+ params:
549
+ command_name: motion
550
+ vr_3point_local_target:
551
+ _target_: isaaclab.managers.ObservationTermCfg
552
+ func: gear_sonic.envs.manager_env.mdp:vr_3point_local_target
553
+ params:
554
+ command_name: motion
555
+ vr_3point_local_orn_target:
556
+ _target_: isaaclab.managers.ObservationTermCfg
557
+ func: gear_sonic.envs.manager_env.mdp:vr_3point_local_orn_target
558
+ params:
559
+ command_name: motion
560
+ motion_anchor_ori_b:
561
+ _target_: isaaclab.managers.ObservationTermCfg
562
+ func: gear_sonic.envs.manager_env.mdp:motion_anchor_ori_b
563
+ params:
564
+ command_name: motion
565
+ noise:
566
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
567
+ n_min: -0.05
568
+ n_max: 0.05
569
+ command_z:
570
+ _target_: isaaclab.managers.ObservationTermCfg
571
+ func: gear_sonic.envs.manager_env.mdp:command_z
572
+ params:
573
+ command_name: motion
574
+ smpl_joints_multi_future_local_nonflat:
575
+ _target_: isaaclab.managers.ObservationTermCfg
576
+ func: gear_sonic.envs.manager_env.mdp:smpl_joints_multi_future_local
577
+ params:
578
+ command_name: motion
579
+ non_flatten: true
580
+ noise:
581
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
582
+ n_min: -0.05
583
+ n_max: 0.05
584
+ smpl_root_ori_b_multi_future:
585
+ _target_: isaaclab.managers.ObservationTermCfg
586
+ func: gear_sonic.envs.manager_env.mdp:smpl_root_ori_b_mf
587
+ params:
588
+ command_name: motion
589
+ non_flatten: true
590
+ noise:
591
+ _target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
592
+ n_min: -0.05
593
+ n_max: 0.05
594
+ joint_pos_multi_future_wrist_for_smpl:
595
+ _target_: isaaclab.managers.ObservationTermCfg
596
+ func: gear_sonic.envs.manager_env.mdp:joint_pos_multi_future_select_joints_for_smpl
597
+ params:
598
+ command_name: motion
599
+ joints_idx:
600
+ - 23
601
+ - 24
602
+ - 25
603
+ - 26
604
+ - 27
605
+ - 28
606
+ _target_: gear_sonic.envs.manager_env.mdp.observations.TokenizerCfg
607
+ enable_corruption: true
608
+ concatenate_terms: false
609
+ _target_: gear_sonic.envs.manager_env.mdp.observations.ObservationsCfg
610
+ rewards:
611
+ tracking_anchor_pos:
612
+ _target_: isaaclab.managers.RewardTermCfg
613
+ func: gear_sonic.envs.manager_env.mdp:tracking_anchor_pos_error
614
+ weight: 0.5
615
+ params:
616
+ command_name: motion
617
+ std: 0.3
618
+ tracking_anchor_ori:
619
+ _target_: isaaclab.managers.RewardTermCfg
620
+ func: gear_sonic.envs.manager_env.mdp:tracking_anchor_ori_error
621
+ weight: 0.5
622
+ params:
623
+ command_name: motion
624
+ std: 0.4
625
+ tracking_relative_body_pos:
626
+ _target_: isaaclab.managers.RewardTermCfg
627
+ func: gear_sonic.envs.manager_env.mdp:tracking_relative_body_pos_error
628
+ weight: 1.0
629
+ params:
630
+ command_name: motion
631
+ std: 0.3
632
+ tracking_relative_body_ori:
633
+ _target_: isaaclab.managers.RewardTermCfg
634
+ func: gear_sonic.envs.manager_env.mdp:tracking_relative_body_ori_error
635
+ weight: 1.0
636
+ params:
637
+ command_name: motion
638
+ std: 0.4
639
+ tracking_body_linvel:
640
+ _target_: isaaclab.managers.RewardTermCfg
641
+ func: gear_sonic.envs.manager_env.mdp:tracking_body_linvel_error
642
+ weight: 1.0
643
+ params:
644
+ command_name: motion
645
+ std: 1.0
646
+ tracking_body_angvel:
647
+ _target_: isaaclab.managers.RewardTermCfg
648
+ func: gear_sonic.envs.manager_env.mdp:tracking_body_angvel_error
649
+ weight: 1.0
650
+ params:
651
+ command_name: motion
652
+ std: 3.14
653
+ action_rate_l2:
654
+ _target_: isaaclab.managers.RewardTermCfg
655
+ func: gear_sonic.envs.manager_env.mdp:action_rate_l2
656
+ weight: -0.1
657
+ joint_limit:
658
+ _target_: isaaclab.managers.RewardTermCfg
659
+ func: gear_sonic.envs.manager_env.mdp:joint_pos_limits
660
+ weight: -10.0
661
+ params:
662
+ asset_cfg:
663
+ _target_: isaaclab.managers.SceneEntityCfg
664
+ name: robot
665
+ joint_names:
666
+ - .*
667
+ undesired_contacts:
668
+ _target_: isaaclab.managers.RewardTermCfg
669
+ func: gear_sonic.envs.manager_env.mdp:undesired_contacts
670
+ weight: -0.1
671
+ params:
672
+ sensor_cfg:
673
+ _target_: isaaclab.managers.SceneEntityCfg
674
+ name: contact_forces
675
+ body_names:
676
+ - ^(?!left_ankle_roll_link$)(?!right_ankle_roll_link$)(?!left_wrist_yaw_link$)(?!right_wrist_yaw_link$)(?!left_elbow_link$)(?!right_elbow_link$).+$
677
+ threshold: 1.0
678
+ anti_shake_ang_vel:
679
+ _target_: isaaclab.managers.RewardTermCfg
680
+ func: gear_sonic.envs.manager_env.mdp:anti_shake_ang_vel_l2
681
+ weight: -0.005
682
+ params:
683
+ command_name: motion
684
+ threshold: 1.5
685
+ body_names:
686
+ - left_wrist_yaw_link
687
+ - right_wrist_yaw_link
688
+ - head_link
689
+ tracking_vr_5point_local:
690
+ _target_: isaaclab.managers.RewardTermCfg
691
+ func: gear_sonic.envs.manager_env.mdp:tracking_local_vr_5point_error
692
+ weight: 2.0
693
+ params:
694
+ command_name: motion
695
+ std: 0.1
696
+ feet_acc:
697
+ _target_: isaaclab.managers.RewardTermCfg
698
+ func: gear_sonic.envs.manager_env.mdp:joint_acc_l2
699
+ weight: -2.5e-06
700
+ params:
701
+ asset_cfg:
702
+ _target_: isaaclab.managers.SceneEntityCfg
703
+ name: robot
704
+ joint_names:
705
+ - .*ankle.*
706
+ _target_: gear_sonic.envs.manager_env.mdp.rewards.RewardsCfg
707
+ terminations:
708
+ anchor_pos:
709
+ _target_: isaaclab.managers.TerminationTermCfg
710
+ func: gear_sonic.envs.manager_env.mdp:exceeded_anchor_height
711
+ params:
712
+ command_name: motion
713
+ threshold: 0.15
714
+ threshold_adaptive: true
715
+ down_threshold: 0.75
716
+ root_height_threshold: 0.5
717
+ anchor_ori_full:
718
+ _target_: isaaclab.managers.TerminationTermCfg
719
+ func: gear_sonic.envs.manager_env.mdp:exceeded_anchor_ori
720
+ params:
721
+ asset_cfg:
722
+ _target_: isaaclab.managers.SceneEntityCfg
723
+ name: robot
724
+ command_name: motion
725
+ threshold: 0.2
726
+ ee_body_pos:
727
+ _target_: isaaclab.managers.TerminationTermCfg
728
+ func: gear_sonic.envs.manager_env.mdp:exceeded_body_height
729
+ params:
730
+ command_name: motion
731
+ threshold: 0.15
732
+ threshold_adaptive: true
733
+ down_threshold: 0.75
734
+ root_height_threshold: 0.5
735
+ body_names:
736
+ - left_ankle_roll_link
737
+ - right_ankle_roll_link
738
+ - left_wrist_yaw_link
739
+ - right_wrist_yaw_link
740
+ time_out:
741
+ _target_: isaaclab.managers.TerminationTermCfg
742
+ func: gear_sonic.envs.manager_env.mdp:tracking_time_out
743
+ time_out: true
744
+ params:
745
+ command_name: motion
746
+ foot_pos_xyz:
747
+ _target_: isaaclab.managers.TerminationTermCfg
748
+ func: gear_sonic.envs.manager_env.mdp:exceeded_body_pos
749
+ params:
750
+ command_name: motion
751
+ threshold: 0.2
752
+ body_names:
753
+ - left_ankle_roll_link
754
+ - right_ankle_roll_link
755
+ _target_: gear_sonic.envs.manager_env.mdp.terminations.TerminationsCfg
756
+ events:
757
+ physics_material:
758
+ _target_: isaaclab.managers.EventTermCfg
759
+ func: gear_sonic.envs.manager_env.mdp:randomize_rigid_body_material
760
+ mode: startup
761
+ params:
762
+ asset_cfg:
763
+ _target_: isaaclab.managers.SceneEntityCfg
764
+ name: robot
765
+ body_names: .*
766
+ static_friction_range:
767
+ - 0.3
768
+ - 1.6
769
+ dynamic_friction_range:
770
+ - 0.3
771
+ - 1.2
772
+ restitution_range:
773
+ - 0.0
774
+ - 0.5
775
+ num_buckets: 64
776
+ add_joint_default_pos:
777
+ _target_: isaaclab.managers.EventTermCfg
778
+ func: gear_sonic.envs.manager_env.mdp:randomize_joint_default_pos
779
+ mode: startup
780
+ params:
781
+ asset_cfg:
782
+ _target_: isaaclab.managers.SceneEntityCfg
783
+ name: robot
784
+ joint_names:
785
+ - .*
786
+ pos_distribution_params:
787
+ - -0.01
788
+ - 0.01
789
+ operation: add
790
+ base_com:
791
+ _target_: isaaclab.managers.EventTermCfg
792
+ func: gear_sonic.envs.manager_env.mdp:randomize_rigid_body_com
793
+ mode: startup
794
+ params:
795
+ asset_cfg:
796
+ _target_: isaaclab.managers.SceneEntityCfg
797
+ name: robot
798
+ body_names: torso_link
799
+ com_range:
800
+ x:
801
+ - -0.025
802
+ - 0.025
803
+ 'y':
804
+ - -0.05
805
+ - 0.05
806
+ z:
807
+ - -0.05
808
+ - 0.05
809
+ push_robot:
810
+ _target_: isaaclab.managers.EventTermCfg
811
+ func: gear_sonic.envs.manager_env.mdp:push_by_setting_velocity
812
+ mode: interval
813
+ interval_range_s:
814
+ - 4.0
815
+ - 6.0
816
+ params:
817
+ velocity_range:
818
+ x:
819
+ - -0.5
820
+ - 0.5
821
+ 'y':
822
+ - -0.5
823
+ - 0.5
824
+ z:
825
+ - -0.2
826
+ - 0.2
827
+ roll:
828
+ - -0.52
829
+ - 0.52
830
+ pitch:
831
+ - -0.52
832
+ - 0.52
833
+ yaw:
834
+ - -0.78
835
+ - 0.78
836
+ randomize_rigid_body_mass:
837
+ _target_: isaaclab.managers.EventTermCfg
838
+ func: gear_sonic.envs.manager_env.mdp:randomize_rigid_body_mass
839
+ mode: startup
840
+ params:
841
+ asset_cfg:
842
+ _target_: isaaclab.managers.SceneEntityCfg
843
+ name: robot
844
+ body_names: .*wrist_yaw.*|torso_link
845
+ mass_distribution_params:
846
+ - 0.8
847
+ - 2.5
848
+ operation: scale
849
+ _target_: gear_sonic.envs.manager_env.mdp.events.EventCfg
850
+ curriculum:
851
+ _target_: gear_sonic.envs.manager_env.mdp.curriculum.CurriculumCfg
852
+ recorders:
853
+ _target_: gear_sonic.envs.manager_env.mdp.recorders.RecordersCfg
854
+ _target_: gear_sonic.envs.manager_env.modular_tracking_env_cfg.ModularTrackingEnvCfg
855
+ config:
856
+ num_envs: ${num_envs}
857
+ env_spacing: 2.0
858
+ decimation: 4
859
+ episode_length_s: 10.0
860
+ sim_dt: 0.005
861
+ viewer_eye:
862
+ - 4.5
863
+ - 0.0
864
+ - 6.0
865
+ viewer_lookat:
866
+ - 0.0
867
+ - 0.0
868
+ - 2.0
869
+ render_results: false
870
+ save_rendering_dir: ${experiment_dir}/renderings_training
871
+ experiment_dir: ${experiment_dir}
872
+ terrain_type: trimesh
873
+ object_mass: null
874
+ table_offset: null
875
+ eval_camera_offset:
876
+ - 2
877
+ - 2
878
+ - 1
879
+ action_transform_module_cfg: null
880
+ action_transform_module_checkpoint: null
881
+ meta_action_dim: null
882
+ needs_policy_atm: true
883
+ obs:
884
+ obs_dict: {}
885
+ obs_dims: {}
886
+ group_obs_dims: {}
887
+ group_obs_names: {}
888
+ action_clip_value: 20.0
889
+ robot:
890
+ type: g1_model_12_dex
891
+ algo_obs_dim_dict: {}
892
+ rewards:
893
+ num_critics: 1
894
+ train_only_events:
895
+ - push_robot
896
+ - compliance_force_push
897
+ use_manager_env: true
898
+ exp_base: ${hydra:runtime.choices.exp}
899
+ exp_var: ft_m7_B
900
+ actor_prop_history_length: 10
901
+ actor_actions_history_length: 10
902
+ critic_prop_history_length: 10
903
+ critic_actions_history_length: 10
model_config.yaml ADDED
@@ -0,0 +1,317 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ algo_config:
2
+ actor:
3
+ _target_: gear_sonic.trl.modules.actor_critic_modules.Actor
4
+ backbone:
5
+ _target_: gear_sonic.trl.modules.universal_token_modules.UniversalTokenModule
6
+ aux_loss_coef:
7
+ g1_recon: 0.01
8
+ g1_smpl_latent: 1.0
9
+ g1_teleop_latent: 1.0
10
+ reencoded_smpl_g1_latent: 1.0
11
+ teleop_smpl_latent: 1.0
12
+ aux_loss_func:
13
+ g1_recon:
14
+ _target_: gear_sonic.trl.losses.token_losses.G1ReconLoss
15
+ loss_type: mse
16
+ g1_smpl_latent:
17
+ _target_: gear_sonic.trl.losses.token_losses.G1SmplLatentLoss
18
+ loss_type: mse
19
+ g1_teleop_latent:
20
+ _target_: gear_sonic.trl.losses.token_losses.G1TeleopLatentLoss
21
+ loss_type: mse
22
+ reencoded_smpl_g1_latent:
23
+ _target_: gear_sonic.trl.losses.token_losses.ReencodedSmplG1LatentLoss
24
+ loss_type: mse
25
+ teleop_smpl_latent:
26
+ _target_: gear_sonic.trl.losses.token_losses.TeleopSmplLatentLoss
27
+ detach_teleop_target: true
28
+ loss_type: mse
29
+ decoders:
30
+ g1_dyn:
31
+ has_temporal_dim: false
32
+ inputs:
33
+ - token_flattened
34
+ - proprioception
35
+ outputs:
36
+ - action
37
+ params:
38
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
39
+ input_dim: null
40
+ module_config_dict:
41
+ layer_config:
42
+ activation: SiLU
43
+ hidden_dims:
44
+ - 2048
45
+ - 2048
46
+ - 1024
47
+ - 1024
48
+ - 512
49
+ - 512
50
+ type: MLP
51
+ num_input_temporal_dims: null
52
+ num_output_temporal_dims: null
53
+ output_dim: null
54
+ g1_kin:
55
+ has_temporal_dim: true
56
+ inputs:
57
+ - token
58
+ outputs:
59
+ - command_multi_future_nonflat
60
+ - motion_anchor_ori_b_mf_nonflat
61
+ params:
62
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
63
+ input_dim: null
64
+ module_config_dict:
65
+ layer_config:
66
+ activation: SiLU
67
+ hidden_dims:
68
+ - 2048
69
+ - 1024
70
+ - 512
71
+ - 512
72
+ type: MLP
73
+ num_input_temporal_dims: 2
74
+ num_output_temporal_dims: 10
75
+ output_dim: null
76
+ encoder_sample_probs:
77
+ g1: 1.0
78
+ smpl: 1.0
79
+ teleop: 1.0
80
+ encoders:
81
+ g1:
82
+ inputs:
83
+ - command_multi_future_nonflat
84
+ - motion_anchor_ori_b_mf_nonflat
85
+ params:
86
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
87
+ input_dim: null
88
+ module_config_dict:
89
+ layer_config:
90
+ activation: SiLU
91
+ hidden_dims:
92
+ - 2048
93
+ - 1024
94
+ - 512
95
+ - 512
96
+ type: MLP
97
+ num_input_temporal_dims: 10
98
+ num_output_temporal_dims: 2
99
+ output_dim: null
100
+ smpl:
101
+ inputs:
102
+ - smpl_joints_multi_future_local_nonflat
103
+ - smpl_root_ori_b_multi_future
104
+ - joint_pos_multi_future_wrist_for_smpl
105
+ params:
106
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
107
+ input_dim: null
108
+ module_config_dict:
109
+ layer_config:
110
+ activation: SiLU
111
+ hidden_dims:
112
+ - 2048
113
+ - 1024
114
+ - 512
115
+ - 512
116
+ type: MLP
117
+ num_input_temporal_dims: 10
118
+ num_output_temporal_dims: 2
119
+ output_dim: null
120
+ teleop:
121
+ inputs:
122
+ - command_multi_future_lower_body
123
+ - vr_3point_local_target
124
+ - vr_3point_local_orn_target
125
+ - motion_anchor_ori_b
126
+ params:
127
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
128
+ input_dim: null
129
+ module_config_dict:
130
+ layer_config:
131
+ activation: SiLU
132
+ hidden_dims:
133
+ - 2048
134
+ - 1024
135
+ - 512
136
+ - 512
137
+ type: MLP
138
+ num_input_temporal_dims: null
139
+ num_output_temporal_dims: 2
140
+ output_dim: null
141
+ fsq_level_list: 32
142
+ max_num_tokens: 2
143
+ num_fsq_levels: 32
144
+ num_future_frames: 10
145
+ proprioception_features:
146
+ - actor_obs
147
+ quantizer:
148
+ _target_: vector_quantize_pytorch.FSQ
149
+ reencode_smpl_g1_recon: true
150
+ has_aux_loss: true
151
+ input_obs_dict: true
152
+ running_mean_std: false
153
+ actor_learning_rate: 2.0e-05
154
+ adaptive_lr_max: 0.0002
155
+ adaptive_lr_min: 1.0e-05
156
+ clip_param: 0.2
157
+ critic:
158
+ _target_: gear_sonic.trl.modules.actor_critic_modules.Critic
159
+ backbone:
160
+ _target_: gear_sonic.trl.modules.base_module.BaseModule
161
+ module_config_dict:
162
+ input_dim:
163
+ - critic_obs
164
+ layer_config:
165
+ activation: SiLU
166
+ hidden_dims:
167
+ - 2048
168
+ - 2048
169
+ - 1024
170
+ - 1024
171
+ - 512
172
+ - 512
173
+ type: MLP
174
+ output_dim:
175
+ - 1
176
+ type: MLP
177
+ process_output_dim: true
178
+ running_mean_std: true
179
+ critic_learning_rate: 0.001
180
+ desired_kl: 0.01
181
+ empty_cache_every_n_ppo_epoch: -1
182
+ entropy_coef: 0.01
183
+ eval:
184
+ num_eval_episodes: 150
185
+ num_save_episodes: 200
186
+ save_goal_reached_only: true
187
+ save_trajectories: false
188
+ save_videos: false
189
+ video_save_prob: 1.0
190
+ eval_frequency: 500
191
+ gamma: 0.99
192
+ global_rank: 0
193
+ init_at_random_ep_len: true
194
+ init_noise_std: 0.05
195
+ lam: 0.95
196
+ load_optimizer: true
197
+ max_grad_norm: 0.1
198
+ num_learning_epochs: 5
199
+ num_learning_iterations: 100000
200
+ num_mini_batches: 4
201
+ num_steps_per_env: 24
202
+ ppo_shuffle_every_epoch: true
203
+ save_interval: 500
204
+ schedule: adaptive
205
+ std_clamp_max: 0.5
206
+ std_clamp_min: 0.001
207
+ sync_advantage_normalization: true
208
+ use_clampped_std: true
209
+ use_clipped_value_loss: true
210
+ use_new_actor_critic: true
211
+ use_padding_mask: false
212
+ value_loss_coef: 1.0
213
+ world_size: 1
214
+ env_config:
215
+ action_clip_value: 20.0
216
+ action_transform_module_cfg: null
217
+ action_transform_module_checkpoint: null
218
+ decimation: 4
219
+ env_spacing: 2.0
220
+ episode_length_s: 10.0
221
+ eval_camera_offset:
222
+ - 2
223
+ - 2
224
+ - 1
225
+ experiment_dir: !!python/object/apply:pathlib.PosixPath
226
+ - /
227
+ - data
228
+ - kkolesni
229
+ - GR00T-WholeBodyControl
230
+ - logs_rl
231
+ - ghost04
232
+ - manager
233
+ - universal_token
234
+ - all_modes
235
+ - sonic_release_ft_m7_B-20260927_014418
236
+ headless: true
237
+ meta_action_dim: null
238
+ needs_policy_atm: true
239
+ num_envs: 1
240
+ object_mass: null
241
+ obs:
242
+ group_obs_dims:
243
+ tokenizer:
244
+ command_multi_future_lower_body:
245
+ - 240
246
+ command_multi_future_nonflat:
247
+ - 10
248
+ - 58
249
+ command_z:
250
+ - 1
251
+ command_z_multi_future_nonflat:
252
+ - 10
253
+ - 1
254
+ encoder_index:
255
+ - 3
256
+ joint_pos_multi_future_wrist_for_smpl:
257
+ - 10
258
+ - 6
259
+ motion_anchor_ori_b:
260
+ - 6
261
+ motion_anchor_ori_b_mf_nonflat:
262
+ - 10
263
+ - 6
264
+ smpl_joints_multi_future_local_nonflat:
265
+ - 10
266
+ - 72
267
+ smpl_root_ori_b_multi_future:
268
+ - 10
269
+ - 6
270
+ vr_3point_local_orn_target:
271
+ - 12
272
+ vr_3point_local_target:
273
+ - 9
274
+ group_obs_names:
275
+ tokenizer:
276
+ - encoder_index
277
+ - command_multi_future_nonflat
278
+ - command_z_multi_future_nonflat
279
+ - command_z
280
+ - motion_anchor_ori_b
281
+ - motion_anchor_ori_b_mf_nonflat
282
+ - command_multi_future_lower_body
283
+ - vr_3point_local_target
284
+ - vr_3point_local_orn_target
285
+ - smpl_joints_multi_future_local_nonflat
286
+ - smpl_root_ori_b_multi_future
287
+ - joint_pos_multi_future_wrist_for_smpl
288
+ obs_dict: {}
289
+ obs_dims:
290
+ actor_obs: 930
291
+ critic_obs: 1645
292
+ tokenizer: 1761
293
+ render_results: false
294
+ rewards:
295
+ num_critics: 1
296
+ robot:
297
+ actions_dim: 29
298
+ algo_obs_dim_dict:
299
+ actor_obs: 930
300
+ critic_obs: 1645
301
+ tokenizer: 1761
302
+ type: g1_model_12_dex
303
+ save_rendering_dir: /data/kkolesni/GR00T-WholeBodyControl/logs_rl/ghost04/manager/universal_token/all_modes/sonic_release_ft_m7_B-20260927_014418/renderings_training
304
+ sim_dt: 0.005
305
+ table_offset: null
306
+ terrain_type: trimesh
307
+ train_only_events:
308
+ - push_robot
309
+ - compliance_force_push
310
+ viewer_eye:
311
+ - 4.5
312
+ - 0.0
313
+ - 6.0
314
+ viewer_lookat:
315
+ - 0.0
316
+ - 0.0
317
+ - 2.0
onnx_verify.json ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "n_recorded_obs": 100,
3
+ "tolerance": 0.0001,
4
+ "recorded_obs_max_abs_diff": {
5
+ "sonic_catwalk_g1.onnx": 8.58306884765625e-06
6
+ },
7
+ "recorded_obs_pass": true,
8
+ "files": {
9
+ "sonic_catwalk_g1.onnx": {
10
+ "loads": true,
11
+ "example_max_abs_diff": 2.384185791015625e-06,
12
+ "input_shape": [
13
+ 1,
14
+ 1570
15
+ ],
16
+ "output_shape": [
17
+ 1,
18
+ 29
19
+ ]
20
+ },
21
+ "sonic_catwalk_encoder.onnx": {
22
+ "loads": true,
23
+ "example_max_abs_diff": 0.0,
24
+ "input_shape": [
25
+ 1,
26
+ 1751
27
+ ],
28
+ "output_shape": [
29
+ 1,
30
+ 64
31
+ ]
32
+ },
33
+ "sonic_catwalk_decoder.onnx": {
34
+ "loads": true,
35
+ "example_max_abs_diff": 1.0728836059570312e-06,
36
+ "input_shape": [
37
+ 1,
38
+ 994
39
+ ],
40
+ "output_shape": [
41
+ 1,
42
+ 29
43
+ ]
44
+ }
45
+ }
46
+ }
sonic_catwalk_decoder.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aebf0c26e2c5cebb81583848eb8d0412779eed0bd86faedb89d3a0b67edb5277
3
+ size 40931482
sonic_catwalk_encoder.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7015d9e6ee972bbe1a2e46054008c21087db97e2be283267400e28dcdf83f04
3
+ size 50220408
sonic_catwalk_g1.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9937b9ab675e644cdc9f89175db3f8af2f31eddfc3ea9fafaf1e6513bb84962
3
+ size 58075937