robomotic commited on
Commit
1646bc6
·
verified ·
1 Parent(s): 1598012

Add 5 Luwu quadruped locomotion policies (Mini2S/Mini2SW/Lite3 walk+turn, PPO/RSL-RL via mjlab)

Browse files
README.md ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - reinforcement-learning
5
+ - robotics
6
+ - legged-locomotion
7
+ - quadruped
8
+ - mujoco
9
+ - mjlab
10
+ - rsl-rl
11
+ - ppo
12
+ - onnx
13
+ pipeline_tag: reinforcement-learning
14
+ ---
15
+
16
+ # XGO — Luwu Dynamics Quadruped Locomotion Policies
17
+
18
+ PPO locomotion policies for the Luwu Dynamics (陆吾智能, [xgorobot.com](https://www.xgorobot.com/)) quadruped robots **Mini2S**, **Mini2SW** (wheeled variant), and **Lite3**, trained with [RSL-RL](https://github.com/leggedrobotics/rsl_rl) in [mjlab](https://github.com/mujocolab/mjlab) (Isaac-Lab-style APIs on GPU-accelerated MuJoCo Warp) via the [luwu_mjlab](https://github.com/LuwuDynamics/luwu_mjlab) training environment.
19
+
20
+ ## Policies
21
+
22
+ | Folder | Task ID | Robot | Behavior | Iterations | Final mean reward |
23
+ |---|---|---|---|---|---|
24
+ | `mini2s_walk/` | `Mini2S-Walk-Flat` | Mini2S | Flat-terrain velocity-tracking walk | 1500 | 87.1 |
25
+ | `mini2s_turn/` | `Mini2S-Turn-Flat` | Mini2S | Fall recovery / turn-over | 1500 | 112.9 |
26
+ | `mini2sw_walk/` | `Mini2SW-Walk-Flat` | Mini2SW (wheeled) | Flat-terrain velocity-tracking walk | 1500 | 89.4 |
27
+ | `mini2sw_turn/` | `Mini2SW-Turn-Flat` | Mini2SW (wheeled) | Fall recovery / turn-over | 1500 | 97.6 |
28
+ | `lite3_walk/` | `Lite3-Walk-Flat` | Lite3 | Flat-terrain velocity-tracking walk | 1500 | 69.3 |
29
+
30
+ Each folder contains:
31
+ - `policy.onnx` — exported inference-only policy (observation → action), robot- and deployment-framework agnostic.
32
+ - `model_1499.pt` — final RSL-RL PPO checkpoint (actor-critic weights + optimizer state), for resuming training or loading in `luwu_mjlab`/`rsl_rl`.
33
+ - `params/env.yaml`, `params/agent.yaml` — the exact environment and PPO hyperparameters used for that run.
34
+
35
+ ## Training setup
36
+
37
+ - Trained on a single NVIDIA GPU, 4096 parallel environments, 1500 PPO iterations per policy.
38
+ - Simulator: MuJoCo 3.6.0 / mujoco-warp 3.6.0 (GPU-accelerated).
39
+ - Framework: [mjlab](https://github.com/mujocolab/mjlab) v1.2.0 + [rsl-rl-lib](https://github.com/leggedrobotics/rsl_rl) 5.0.1.
40
+ - Task source: [luwu_mjlab](https://github.com/LuwuDynamics/luwu_mjlab) `src/tasks/velocity/`.
41
+
42
+ ## Usage
43
+
44
+ With `luwu_mjlab` installed, evaluate a checkpoint:
45
+
46
+ ```bash
47
+ python scripts/play.py Mini2S-Walk-Flat \
48
+ --checkpoint-file /path/to/mini2s_walk/model_1499.pt
49
+ ```
50
+
51
+ Or run the exported ONNX policy directly with `onnxruntime` for deployment (input/output tensor names and shapes are defined by `luwu_mjlab`'s observation/action manager for each task — see `params/env.yaml` in the matching folder).
52
+
53
+ ## Disclaimer
54
+
55
+ These policies were trained in simulation only and have not been validated on hardware. Evaluate carefully (and add safety measures) before any real-robot deployment.
lite3_walk/model_1499.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cca3a020163309790f8dc8ecb7553ff0e98e75d02e78a1773ad3734ca535a67c
3
+ size 4819061
lite3_walk/params/agent.yaml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ seed: 42
2
+ num_steps_per_env: 24
3
+ max_iterations: 1500
4
+ obs_groups:
5
+ actor: !!python/tuple
6
+ - actor
7
+ critic: !!python/tuple
8
+ - critic
9
+ save_interval: 100
10
+ experiment_name: lite3_velocity_walk
11
+ run_name: ''
12
+ logger: tensorboard
13
+ wandb_project: mjlab
14
+ wandb_tags: !!python/tuple []
15
+ resume: false
16
+ load_run: .*
17
+ load_checkpoint: model_.*.pt
18
+ clip_actions: null
19
+ upload_model: true
20
+ class_name: OnPolicyRunner
21
+ actor:
22
+ hidden_dims: !!python/tuple
23
+ - 512
24
+ - 256
25
+ - 128
26
+ activation: elu
27
+ obs_normalization: true
28
+ distribution_cfg:
29
+ init_std: 1.0
30
+ std_type: scalar
31
+ critic:
32
+ hidden_dims: !!python/tuple
33
+ - 512
34
+ - 256
35
+ - 128
36
+ activation: elu
37
+ obs_normalization: true
38
+ algorithm:
39
+ num_learning_epochs: 5
40
+ num_mini_batches: 4
41
+ learning_rate: 0.001
42
+ schedule: adaptive
43
+ gamma: 0.99
44
+ lam: 0.95
45
+ entropy_coef: 0.01
46
+ desired_kl: 0.01
47
+ max_grad_norm: 1.0
48
+ value_loss_coef: 1.0
49
+ use_clipped_value_loss: true
50
+ clip_param: 0.2
51
+ normalize_advantage_per_mini_batch: false
52
+ optimizer: adam
53
+ rnd_cfg: null
54
+ symmetry_cfg: null
55
+ multi_gpu: null
lite3_walk/params/env.yaml ADDED
@@ -0,0 +1,1419 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ decimation: 5
2
+ scene:
3
+ num_envs: 4096
4
+ env_spacing: 2.0
5
+ terrain:
6
+ init_state:
7
+ pos: !!python/tuple
8
+ - 0.0
9
+ - 0.0
10
+ - 0.0
11
+ rot: !!python/tuple
12
+ - 1.0
13
+ - 0.0
14
+ - 0.0
15
+ - 0.0
16
+ lin_vel: !!python/tuple
17
+ - 0.0
18
+ - 0.0
19
+ - 0.0
20
+ ang_vel: !!python/tuple
21
+ - 0.0
22
+ - 0.0
23
+ - 0.0
24
+ joint_pos:
25
+ .*: 0.0
26
+ joint_vel:
27
+ .*: 0.0
28
+ spec_fn: !!python/name:mjlab.entity.entity.%3Clambda%3E ''
29
+ articulation: null
30
+ sort_actuators: false
31
+ lights: !!python/tuple
32
+ - name: sun
33
+ body: world
34
+ mode: fixed
35
+ target: null
36
+ type: directional
37
+ castshadow: true
38
+ pos: !!python/tuple
39
+ - 0.0
40
+ - 0.0
41
+ - 1.5
42
+ dir: !!python/tuple
43
+ - 0.0
44
+ - 0.0
45
+ - -1.0
46
+ cutoff: 45.0
47
+ exponent: 10.0
48
+ cameras: !!python/tuple []
49
+ textures: !!python/tuple
50
+ - name: groundplane
51
+ type: 2d
52
+ builtin: checker
53
+ rgb1: !!python/tuple
54
+ - 0.2
55
+ - 0.3
56
+ - 0.4
57
+ rgb2: !!python/tuple
58
+ - 0.1
59
+ - 0.2
60
+ - 0.3
61
+ width: 300
62
+ height: 300
63
+ mark: edge
64
+ markrgb: !!python/tuple
65
+ - 0.8
66
+ - 0.8
67
+ - 0.8
68
+ materials: !!python/tuple
69
+ - name: groundplane
70
+ rgba: !!python/tuple
71
+ - 1.0
72
+ - 1.0
73
+ - 1.0
74
+ - 1.0
75
+ texuniform: true
76
+ texrepeat: !!python/tuple
77
+ - 4.0
78
+ - 4.0
79
+ reflectance: 0.2
80
+ texture: groundplane
81
+ geom_names_expr: !!python/tuple
82
+ - terrain$
83
+ collisions: !!python/tuple []
84
+ terrain_type: plane
85
+ terrain_generator: null
86
+ env_spacing: 2.0
87
+ max_init_terrain_level: 5
88
+ num_envs: 4096
89
+ entities:
90
+ robot:
91
+ init_state:
92
+ pos: !!python/tuple
93
+ - 0.0
94
+ - 0.0
95
+ - 0.1
96
+ rot: !!python/tuple
97
+ - 1.0
98
+ - 0.0
99
+ - 0.0
100
+ - 0.0
101
+ lin_vel: !!python/tuple
102
+ - 0.0
103
+ - 0.0
104
+ - 0.0
105
+ ang_vel: !!python/tuple
106
+ - 0.0
107
+ - 0.0
108
+ - 0.0
109
+ joint_pos:
110
+ ^(FL|FR|RR|RL)_thigh_joint$: 0.95
111
+ ^(FL|FR|RR|RL)_shank_joint$: 0.0
112
+ ^(FL|FR|RR|RL)_hip_joint$: 0.0
113
+ mainarm_joint: -1.55
114
+ forearm_joint: 1.3
115
+ joint_vel:
116
+ .*: 0.0
117
+ spec_fn: !!python/name:src.assets.robots.lite3.lite3_constants.get_spec ''
118
+ articulation:
119
+ actuators: !!python/tuple
120
+ - target_names_expr: !!python/tuple
121
+ - .*
122
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
123
+ - joint
124
+ armature: 0.0
125
+ frictionloss: 0.0
126
+ base_cfg:
127
+ target_names_expr: !!python/tuple
128
+ - .*
129
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
130
+ - joint
131
+ armature: 0.0
132
+ frictionloss: 0.0
133
+ delay_target: position
134
+ delay_min_lag: 1
135
+ delay_max_lag: 2
136
+ delay_hold_prob: 0.0
137
+ delay_update_period: 0
138
+ delay_per_env_phase: true
139
+ soft_joint_pos_limit_factor: 0.9
140
+ sort_actuators: false
141
+ lights: !!python/tuple []
142
+ cameras: !!python/tuple []
143
+ textures: !!python/tuple []
144
+ materials: !!python/tuple []
145
+ collisions: !!python/tuple
146
+ - geom_names_expr: !!python/tuple
147
+ - ^(FL|FR|RR|RL)_shank_collision$
148
+ contype: 0
149
+ conaffinity: 1
150
+ condim: 3
151
+ priority: 1
152
+ friction: !!python/tuple
153
+ - 0.6
154
+ solref: null
155
+ solimp: !!python/tuple
156
+ - 0.9
157
+ - 0.95
158
+ - 0.023
159
+ disable_other_geoms: true
160
+ sensors: !!python/tuple
161
+ - name: feet_ground_contact
162
+ primary:
163
+ mode: geom
164
+ pattern: !!python/tuple
165
+ - FL_shank_collision
166
+ - FR_shank_collision
167
+ - RL_shank_collision
168
+ - RR_shank_collision
169
+ entity: robot
170
+ exclude: !!python/tuple []
171
+ secondary:
172
+ mode: body
173
+ pattern: terrain
174
+ entity: null
175
+ exclude: !!python/tuple []
176
+ fields: !!python/tuple
177
+ - found
178
+ - force
179
+ reduce: netforce
180
+ num_slots: 1
181
+ secondary_policy: first
182
+ track_air_time: true
183
+ global_frame: false
184
+ history_length: 0
185
+ debug: false
186
+ - name: nonfoot_ground_touch
187
+ primary:
188
+ mode: geom
189
+ pattern: .*
190
+ entity: robot
191
+ exclude: !!python/tuple
192
+ - FL_shank_collision
193
+ - FR_shank_collision
194
+ - RL_shank_collision
195
+ - RR_shank_collision
196
+ secondary:
197
+ mode: body
198
+ pattern: terrain
199
+ entity: null
200
+ exclude: !!python/tuple []
201
+ fields: !!python/tuple
202
+ - found
203
+ - force
204
+ reduce: none
205
+ num_slots: 1
206
+ secondary_policy: first
207
+ track_air_time: false
208
+ global_frame: false
209
+ history_length: 4
210
+ debug: false
211
+ extent: 2.0
212
+ spec_fn: null
213
+ observations:
214
+ actor:
215
+ terms:
216
+ base_ang_vel:
217
+ func: &id001 !!python/name:mjlab.envs.mdp.observations.builtin_sensor ''
218
+ params:
219
+ sensor_name: robot/imu_ang_vel
220
+ noise:
221
+ operation: add
222
+ _tensor_cache: {}
223
+ n_min: -1.0
224
+ n_max: 1.0
225
+ clip: null
226
+ scale: null
227
+ delay_min_lag: 0
228
+ delay_max_lag: 0
229
+ delay_per_env: true
230
+ delay_hold_prob: 0.0
231
+ delay_update_period: 0
232
+ delay_per_env_phase: true
233
+ history_length: 0
234
+ flatten_history_dim: true
235
+ projected_gravity:
236
+ func: &id002 !!python/name:mjlab.envs.mdp.observations.projected_gravity ''
237
+ params: {}
238
+ noise:
239
+ operation: add
240
+ _tensor_cache: {}
241
+ n_min: -0.1
242
+ n_max: 0.1
243
+ clip: null
244
+ scale: null
245
+ delay_min_lag: 0
246
+ delay_max_lag: 0
247
+ delay_per_env: true
248
+ delay_hold_prob: 0.0
249
+ delay_update_period: 0
250
+ delay_per_env_phase: true
251
+ history_length: 0
252
+ flatten_history_dim: true
253
+ command:
254
+ func: &id003 !!python/name:mjlab.envs.mdp.observations.generated_commands ''
255
+ params:
256
+ command_name: twist
257
+ noise: null
258
+ clip: null
259
+ scale: null
260
+ delay_min_lag: 0
261
+ delay_max_lag: 0
262
+ delay_per_env: true
263
+ delay_hold_prob: 0.0
264
+ delay_update_period: 0
265
+ delay_per_env_phase: true
266
+ history_length: 0
267
+ flatten_history_dim: true
268
+ phase:
269
+ func: &id004 !!python/name:src.tasks.velocity.mdp.observations.phase ''
270
+ params:
271
+ period: 0.4
272
+ command_name: twist
273
+ noise: null
274
+ clip: null
275
+ scale: null
276
+ delay_min_lag: 0
277
+ delay_max_lag: 0
278
+ delay_per_env: true
279
+ delay_hold_prob: 0.0
280
+ delay_update_period: 0
281
+ delay_per_env_phase: true
282
+ history_length: 0
283
+ flatten_history_dim: true
284
+ joint_pos:
285
+ func: &id005 !!python/name:mjlab.envs.mdp.observations.joint_pos_rel ''
286
+ params: {}
287
+ noise:
288
+ operation: add
289
+ _tensor_cache: {}
290
+ n_min: -0.1
291
+ n_max: 0.1
292
+ clip: null
293
+ scale: null
294
+ delay_min_lag: 1
295
+ delay_max_lag: 2
296
+ delay_per_env: true
297
+ delay_hold_prob: 0.0
298
+ delay_update_period: 0
299
+ delay_per_env_phase: true
300
+ history_length: 0
301
+ flatten_history_dim: true
302
+ joint_vel:
303
+ func: &id006 !!python/name:mjlab.envs.mdp.observations.joint_vel_rel ''
304
+ params: {}
305
+ noise:
306
+ operation: add
307
+ _tensor_cache: {}
308
+ n_min: -2.0
309
+ n_max: 2.0
310
+ clip: null
311
+ scale: null
312
+ delay_min_lag: 1
313
+ delay_max_lag: 2
314
+ delay_per_env: true
315
+ delay_hold_prob: 0.0
316
+ delay_update_period: 0
317
+ delay_per_env_phase: true
318
+ history_length: 0
319
+ flatten_history_dim: true
320
+ actions:
321
+ func: &id007 !!python/name:mjlab.envs.mdp.observations.last_action ''
322
+ params: {}
323
+ noise: null
324
+ clip: null
325
+ scale: null
326
+ delay_min_lag: 0
327
+ delay_max_lag: 0
328
+ delay_per_env: true
329
+ delay_hold_prob: 0.0
330
+ delay_update_period: 0
331
+ delay_per_env_phase: true
332
+ history_length: 0
333
+ flatten_history_dim: true
334
+ concatenate_terms: true
335
+ concatenate_dim: -1
336
+ enable_corruption: true
337
+ history_length: 1
338
+ flatten_history_dim: true
339
+ nan_policy: disabled
340
+ nan_check_per_term: true
341
+ critic:
342
+ terms:
343
+ base_ang_vel:
344
+ func: *id001
345
+ params:
346
+ sensor_name: robot/imu_ang_vel
347
+ noise:
348
+ operation: add
349
+ _tensor_cache: {}
350
+ n_min: -1.0
351
+ n_max: 1.0
352
+ clip: null
353
+ scale: null
354
+ delay_min_lag: 0
355
+ delay_max_lag: 0
356
+ delay_per_env: true
357
+ delay_hold_prob: 0.0
358
+ delay_update_period: 0
359
+ delay_per_env_phase: true
360
+ history_length: 0
361
+ flatten_history_dim: true
362
+ projected_gravity:
363
+ func: *id002
364
+ params: {}
365
+ noise:
366
+ operation: add
367
+ _tensor_cache: {}
368
+ n_min: -0.1
369
+ n_max: 0.1
370
+ clip: null
371
+ scale: null
372
+ delay_min_lag: 0
373
+ delay_max_lag: 0
374
+ delay_per_env: true
375
+ delay_hold_prob: 0.0
376
+ delay_update_period: 0
377
+ delay_per_env_phase: true
378
+ history_length: 0
379
+ flatten_history_dim: true
380
+ command:
381
+ func: *id003
382
+ params:
383
+ command_name: twist
384
+ noise: null
385
+ clip: null
386
+ scale: null
387
+ delay_min_lag: 0
388
+ delay_max_lag: 0
389
+ delay_per_env: true
390
+ delay_hold_prob: 0.0
391
+ delay_update_period: 0
392
+ delay_per_env_phase: true
393
+ history_length: 0
394
+ flatten_history_dim: true
395
+ phase:
396
+ func: *id004
397
+ params:
398
+ period: 0.4
399
+ command_name: twist
400
+ noise: null
401
+ clip: null
402
+ scale: null
403
+ delay_min_lag: 0
404
+ delay_max_lag: 0
405
+ delay_per_env: true
406
+ delay_hold_prob: 0.0
407
+ delay_update_period: 0
408
+ delay_per_env_phase: true
409
+ history_length: 0
410
+ flatten_history_dim: true
411
+ joint_pos:
412
+ func: *id005
413
+ params: {}
414
+ noise:
415
+ operation: add
416
+ _tensor_cache: {}
417
+ n_min: -0.1
418
+ n_max: 0.1
419
+ clip: null
420
+ scale: null
421
+ delay_min_lag: 1
422
+ delay_max_lag: 2
423
+ delay_per_env: true
424
+ delay_hold_prob: 0.0
425
+ delay_update_period: 0
426
+ delay_per_env_phase: true
427
+ history_length: 0
428
+ flatten_history_dim: true
429
+ joint_vel:
430
+ func: *id006
431
+ params: {}
432
+ noise:
433
+ operation: add
434
+ _tensor_cache: {}
435
+ n_min: -2.0
436
+ n_max: 2.0
437
+ clip: null
438
+ scale: null
439
+ delay_min_lag: 1
440
+ delay_max_lag: 2
441
+ delay_per_env: true
442
+ delay_hold_prob: 0.0
443
+ delay_update_period: 0
444
+ delay_per_env_phase: true
445
+ history_length: 0
446
+ flatten_history_dim: true
447
+ actions:
448
+ func: *id007
449
+ params: {}
450
+ noise: null
451
+ clip: null
452
+ scale: null
453
+ delay_min_lag: 0
454
+ delay_max_lag: 0
455
+ delay_per_env: true
456
+ delay_hold_prob: 0.0
457
+ delay_update_period: 0
458
+ delay_per_env_phase: true
459
+ history_length: 0
460
+ flatten_history_dim: true
461
+ base_lin_vel:
462
+ func: *id001
463
+ params:
464
+ sensor_name: robot/imu_lin_vel
465
+ noise:
466
+ operation: add
467
+ _tensor_cache: {}
468
+ n_min: -1.0
469
+ n_max: 1.0
470
+ clip: null
471
+ scale: null
472
+ delay_min_lag: 0
473
+ delay_max_lag: 0
474
+ delay_per_env: true
475
+ delay_hold_prob: 0.0
476
+ delay_update_period: 0
477
+ delay_per_env_phase: true
478
+ history_length: 0
479
+ flatten_history_dim: true
480
+ foot_height:
481
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_height ''
482
+ params:
483
+ asset_cfg:
484
+ name: robot
485
+ joint_names: null
486
+ joint_ids: !!python/object/apply:builtins.slice
487
+ - null
488
+ - null
489
+ - null
490
+ body_names: null
491
+ body_ids: !!python/object/apply:builtins.slice
492
+ - null
493
+ - null
494
+ - null
495
+ geom_names: null
496
+ geom_ids: !!python/object/apply:builtins.slice
497
+ - null
498
+ - null
499
+ - null
500
+ site_names: !!python/tuple
501
+ - FL
502
+ - FR
503
+ - RL
504
+ - RR
505
+ site_ids: !!python/object/apply:builtins.slice
506
+ - null
507
+ - null
508
+ - null
509
+ actuator_names: null
510
+ actuator_ids: !!python/object/apply:builtins.slice
511
+ - null
512
+ - null
513
+ - null
514
+ tendon_names: null
515
+ tendon_ids: !!python/object/apply:builtins.slice
516
+ - null
517
+ - null
518
+ - null
519
+ camera_names: null
520
+ camera_ids: !!python/object/apply:builtins.slice
521
+ - null
522
+ - null
523
+ - null
524
+ light_names: null
525
+ light_ids: !!python/object/apply:builtins.slice
526
+ - null
527
+ - null
528
+ - null
529
+ material_names: null
530
+ material_ids: !!python/object/apply:builtins.slice
531
+ - null
532
+ - null
533
+ - null
534
+ preserve_order: false
535
+ noise: null
536
+ clip: null
537
+ scale: null
538
+ delay_min_lag: 0
539
+ delay_max_lag: 0
540
+ delay_per_env: true
541
+ delay_hold_prob: 0.0
542
+ delay_update_period: 0
543
+ delay_per_env_phase: true
544
+ history_length: 0
545
+ flatten_history_dim: true
546
+ foot_air_time:
547
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_air_time ''
548
+ params:
549
+ sensor_name: feet_ground_contact
550
+ noise: null
551
+ clip: null
552
+ scale: null
553
+ delay_min_lag: 0
554
+ delay_max_lag: 0
555
+ delay_per_env: true
556
+ delay_hold_prob: 0.0
557
+ delay_update_period: 0
558
+ delay_per_env_phase: true
559
+ history_length: 0
560
+ flatten_history_dim: true
561
+ foot_contact:
562
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_contact ''
563
+ params:
564
+ sensor_name: feet_ground_contact
565
+ noise: null
566
+ clip: null
567
+ scale: null
568
+ delay_min_lag: 0
569
+ delay_max_lag: 0
570
+ delay_per_env: true
571
+ delay_hold_prob: 0.0
572
+ delay_update_period: 0
573
+ delay_per_env_phase: true
574
+ history_length: 0
575
+ flatten_history_dim: true
576
+ foot_contact_forces:
577
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_contact_forces ''
578
+ params:
579
+ sensor_name: feet_ground_contact
580
+ noise: null
581
+ clip: null
582
+ scale: null
583
+ delay_min_lag: 0
584
+ delay_max_lag: 0
585
+ delay_per_env: true
586
+ delay_hold_prob: 0.0
587
+ delay_update_period: 0
588
+ delay_per_env_phase: true
589
+ history_length: 0
590
+ flatten_history_dim: true
591
+ concatenate_terms: true
592
+ concatenate_dim: -1
593
+ enable_corruption: false
594
+ history_length: 1
595
+ flatten_history_dim: true
596
+ nan_policy: disabled
597
+ nan_check_per_term: true
598
+ actions:
599
+ joint_pos:
600
+ entity_name: robot
601
+ clip: null
602
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
603
+ - joint
604
+ actuator_names: !!python/tuple
605
+ - .*
606
+ scale: 0.25
607
+ offset: 0.0
608
+ preserve_order: false
609
+ use_default_offset: true
610
+ events:
611
+ reset_base:
612
+ func: !!python/name:mjlab.envs.mdp.events.reset_root_state_uniform ''
613
+ params:
614
+ pose_range:
615
+ x: !!python/tuple
616
+ - -0.5
617
+ - 0.5
618
+ y: !!python/tuple
619
+ - -0.5
620
+ - 0.5
621
+ z: !!python/tuple
622
+ - 0.0
623
+ - 0.0
624
+ yaw: !!python/tuple
625
+ - -3.14
626
+ - 3.14
627
+ velocity_range: {}
628
+ mode: reset
629
+ interval_range_s: null
630
+ is_global_time: false
631
+ min_step_count_between_reset: 0
632
+ reset_robot_joints:
633
+ func: !!python/name:mjlab.envs.mdp.events.reset_joints_by_offset ''
634
+ params:
635
+ position_range: !!python/tuple
636
+ - -0.0
637
+ - 0.0
638
+ velocity_range: !!python/tuple
639
+ - -0.0
640
+ - 0.0
641
+ asset_cfg:
642
+ name: robot
643
+ joint_names: !!python/tuple
644
+ - .*
645
+ joint_ids: !!python/object/apply:builtins.slice
646
+ - null
647
+ - null
648
+ - null
649
+ body_names: null
650
+ body_ids: !!python/object/apply:builtins.slice
651
+ - null
652
+ - null
653
+ - null
654
+ geom_names: null
655
+ geom_ids: !!python/object/apply:builtins.slice
656
+ - null
657
+ - null
658
+ - null
659
+ site_names: null
660
+ site_ids: !!python/object/apply:builtins.slice
661
+ - null
662
+ - null
663
+ - null
664
+ actuator_names: null
665
+ actuator_ids: !!python/object/apply:builtins.slice
666
+ - null
667
+ - null
668
+ - null
669
+ tendon_names: null
670
+ tendon_ids: !!python/object/apply:builtins.slice
671
+ - null
672
+ - null
673
+ - null
674
+ camera_names: null
675
+ camera_ids: !!python/object/apply:builtins.slice
676
+ - null
677
+ - null
678
+ - null
679
+ light_names: null
680
+ light_ids: !!python/object/apply:builtins.slice
681
+ - null
682
+ - null
683
+ - null
684
+ material_names: null
685
+ material_ids: !!python/object/apply:builtins.slice
686
+ - null
687
+ - null
688
+ - null
689
+ preserve_order: false
690
+ mode: reset
691
+ interval_range_s: null
692
+ is_global_time: false
693
+ min_step_count_between_reset: 0
694
+ push_robot:
695
+ func: !!python/name:mjlab.envs.mdp.events.push_by_setting_velocity ''
696
+ params:
697
+ velocity_range:
698
+ x: !!python/tuple
699
+ - -0.5
700
+ - 0.5
701
+ y: !!python/tuple
702
+ - -0.5
703
+ - 0.5
704
+ z: !!python/tuple
705
+ - -0.4
706
+ - 0.4
707
+ roll: !!python/tuple
708
+ - -0.52
709
+ - 0.52
710
+ pitch: !!python/tuple
711
+ - -0.52
712
+ - 0.52
713
+ yaw: !!python/tuple
714
+ - -0.78
715
+ - 0.78
716
+ mode: interval
717
+ interval_range_s: !!python/tuple
718
+ - 5.0
719
+ - 6.0
720
+ is_global_time: false
721
+ min_step_count_between_reset: 0
722
+ foot_friction:
723
+ func: !!python/name:mjlab.envs.mdp.dr.geom.geom_friction ''
724
+ params:
725
+ asset_cfg:
726
+ name: robot
727
+ joint_names: null
728
+ joint_ids: !!python/object/apply:builtins.slice
729
+ - null
730
+ - null
731
+ - null
732
+ body_names: null
733
+ body_ids: !!python/object/apply:builtins.slice
734
+ - null
735
+ - null
736
+ - null
737
+ geom_names: !!python/tuple
738
+ - FL_shank_collision
739
+ - FR_shank_collision
740
+ - RL_shank_collision
741
+ - RR_shank_collision
742
+ geom_ids: !!python/object/apply:builtins.slice
743
+ - null
744
+ - null
745
+ - null
746
+ site_names: null
747
+ site_ids: !!python/object/apply:builtins.slice
748
+ - null
749
+ - null
750
+ - null
751
+ actuator_names: null
752
+ actuator_ids: !!python/object/apply:builtins.slice
753
+ - null
754
+ - null
755
+ - null
756
+ tendon_names: null
757
+ tendon_ids: !!python/object/apply:builtins.slice
758
+ - null
759
+ - null
760
+ - null
761
+ camera_names: null
762
+ camera_ids: !!python/object/apply:builtins.slice
763
+ - null
764
+ - null
765
+ - null
766
+ light_names: null
767
+ light_ids: !!python/object/apply:builtins.slice
768
+ - null
769
+ - null
770
+ - null
771
+ material_names: null
772
+ material_ids: !!python/object/apply:builtins.slice
773
+ - null
774
+ - null
775
+ - null
776
+ preserve_order: false
777
+ operation: abs
778
+ ranges: !!python/tuple
779
+ - 0.2
780
+ - 3.0
781
+ shared_random: true
782
+ mode: startup
783
+ interval_range_s: null
784
+ is_global_time: false
785
+ min_step_count_between_reset: 0
786
+ encoder_bias:
787
+ func: !!python/name:mjlab.envs.mdp.dr.joint.encoder_bias ''
788
+ params:
789
+ asset_cfg:
790
+ name: robot
791
+ joint_names: null
792
+ joint_ids: !!python/object/apply:builtins.slice
793
+ - null
794
+ - null
795
+ - null
796
+ body_names: null
797
+ body_ids: !!python/object/apply:builtins.slice
798
+ - null
799
+ - null
800
+ - null
801
+ geom_names: null
802
+ geom_ids: !!python/object/apply:builtins.slice
803
+ - null
804
+ - null
805
+ - null
806
+ site_names: null
807
+ site_ids: !!python/object/apply:builtins.slice
808
+ - null
809
+ - null
810
+ - null
811
+ actuator_names: null
812
+ actuator_ids: !!python/object/apply:builtins.slice
813
+ - null
814
+ - null
815
+ - null
816
+ tendon_names: null
817
+ tendon_ids: !!python/object/apply:builtins.slice
818
+ - null
819
+ - null
820
+ - null
821
+ camera_names: null
822
+ camera_ids: !!python/object/apply:builtins.slice
823
+ - null
824
+ - null
825
+ - null
826
+ light_names: null
827
+ light_ids: !!python/object/apply:builtins.slice
828
+ - null
829
+ - null
830
+ - null
831
+ material_names: null
832
+ material_ids: !!python/object/apply:builtins.slice
833
+ - null
834
+ - null
835
+ - null
836
+ preserve_order: false
837
+ bias_range: !!python/tuple
838
+ - -0.04
839
+ - 0.04
840
+ mode: startup
841
+ interval_range_s: null
842
+ is_global_time: false
843
+ min_step_count_between_reset: 0
844
+ base_com:
845
+ func: !!python/name:mjlab.envs.mdp.dr.body.body_com_offset ''
846
+ params:
847
+ asset_cfg:
848
+ name: robot
849
+ joint_names: null
850
+ joint_ids: !!python/object/apply:builtins.slice
851
+ - null
852
+ - null
853
+ - null
854
+ body_names: !!python/tuple
855
+ - body
856
+ body_ids: !!python/object/apply:builtins.slice
857
+ - null
858
+ - null
859
+ - null
860
+ geom_names: null
861
+ geom_ids: !!python/object/apply:builtins.slice
862
+ - null
863
+ - null
864
+ - null
865
+ site_names: null
866
+ site_ids: !!python/object/apply:builtins.slice
867
+ - null
868
+ - null
869
+ - null
870
+ actuator_names: null
871
+ actuator_ids: !!python/object/apply:builtins.slice
872
+ - null
873
+ - null
874
+ - null
875
+ tendon_names: null
876
+ tendon_ids: !!python/object/apply:builtins.slice
877
+ - null
878
+ - null
879
+ - null
880
+ camera_names: null
881
+ camera_ids: !!python/object/apply:builtins.slice
882
+ - null
883
+ - null
884
+ - null
885
+ light_names: null
886
+ light_ids: !!python/object/apply:builtins.slice
887
+ - null
888
+ - null
889
+ - null
890
+ material_names: null
891
+ material_ids: !!python/object/apply:builtins.slice
892
+ - null
893
+ - null
894
+ - null
895
+ preserve_order: false
896
+ operation: add
897
+ ranges:
898
+ 0: !!python/tuple
899
+ - -0.035
900
+ - 0.035
901
+ 1: !!python/tuple
902
+ - -0.02
903
+ - 0.02
904
+ 2: !!python/tuple
905
+ - -0.02
906
+ - 0.02
907
+ mode: startup
908
+ interval_range_s: null
909
+ is_global_time: false
910
+ min_step_count_between_reset: 0
911
+ seed: 42
912
+ sim:
913
+ nconmax: null
914
+ njmax: 300
915
+ ls_parallel: true
916
+ contact_sensor_maxmatch: 64
917
+ mujoco:
918
+ timestep: 0.004
919
+ integrator: implicitfast
920
+ impratio: 1.0
921
+ cone: pyramidal
922
+ jacobian: auto
923
+ solver: newton
924
+ iterations: 10
925
+ tolerance: 1.0e-08
926
+ ls_iterations: 20
927
+ ls_tolerance: 0.01
928
+ ccd_iterations: 50
929
+ gravity: !!python/tuple
930
+ - 0.0
931
+ - 0.0
932
+ - -9.81
933
+ multiccd: false
934
+ nan_guard:
935
+ enabled: false
936
+ buffer_size: 100
937
+ output_dir: /tmp/mjlab/nan_dumps
938
+ max_envs_to_dump: 5
939
+ viewer:
940
+ lookat: !!python/tuple
941
+ - 0.0
942
+ - 0.0
943
+ - 0.0
944
+ distance: 1.5
945
+ fovy: null
946
+ elevation: -10.0
947
+ azimuth: 90.0
948
+ origin_type: !!python/object/apply:mjlab.viewer.viewer_config.OriginType
949
+ - 4
950
+ entity_name: robot
951
+ body_name: body
952
+ env_idx: 0
953
+ max_extra_envs: 2
954
+ enable_reflections: true
955
+ enable_shadows: true
956
+ height: 240
957
+ width: 320
958
+ episode_length_s: 20.0
959
+ rewards:
960
+ track_linear_velocity:
961
+ func: !!python/name:src.tasks.velocity.mdp.rewards.track_linear_velocity ''
962
+ params:
963
+ command_name: twist
964
+ std: 0.15
965
+ weight: 4.0
966
+ track_angular_velocity:
967
+ func: !!python/name:src.tasks.velocity.mdp.rewards.track_angular_velocity ''
968
+ params:
969
+ command_name: twist
970
+ std: 0.15
971
+ weight: 4.0
972
+ body_orientation_l2:
973
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_orientation_l2 ''
974
+ params:
975
+ asset_cfg:
976
+ name: robot
977
+ joint_names: null
978
+ joint_ids: !!python/object/apply:builtins.slice
979
+ - null
980
+ - null
981
+ - null
982
+ body_names: !!python/tuple
983
+ - body
984
+ body_ids: !!python/object/apply:builtins.slice
985
+ - null
986
+ - null
987
+ - null
988
+ geom_names: null
989
+ geom_ids: !!python/object/apply:builtins.slice
990
+ - null
991
+ - null
992
+ - null
993
+ site_names: null
994
+ site_ids: !!python/object/apply:builtins.slice
995
+ - null
996
+ - null
997
+ - null
998
+ actuator_names: null
999
+ actuator_ids: !!python/object/apply:builtins.slice
1000
+ - null
1001
+ - null
1002
+ - null
1003
+ tendon_names: null
1004
+ tendon_ids: !!python/object/apply:builtins.slice
1005
+ - null
1006
+ - null
1007
+ - null
1008
+ camera_names: null
1009
+ camera_ids: !!python/object/apply:builtins.slice
1010
+ - null
1011
+ - null
1012
+ - null
1013
+ light_names: null
1014
+ light_ids: !!python/object/apply:builtins.slice
1015
+ - null
1016
+ - null
1017
+ - null
1018
+ material_names: null
1019
+ material_ids: !!python/object/apply:builtins.slice
1020
+ - null
1021
+ - null
1022
+ - null
1023
+ preserve_order: false
1024
+ weight: -2.0
1025
+ pose:
1026
+ func: !!python/name:src.tasks.velocity.mdp.rewards.variable_posture ''
1027
+ params:
1028
+ asset_cfg:
1029
+ name: robot
1030
+ joint_names: .*
1031
+ joint_ids: !!python/object/apply:builtins.slice
1032
+ - null
1033
+ - null
1034
+ - null
1035
+ body_names: null
1036
+ body_ids: !!python/object/apply:builtins.slice
1037
+ - null
1038
+ - null
1039
+ - null
1040
+ geom_names: null
1041
+ geom_ids: !!python/object/apply:builtins.slice
1042
+ - null
1043
+ - null
1044
+ - null
1045
+ site_names: null
1046
+ site_ids: !!python/object/apply:builtins.slice
1047
+ - null
1048
+ - null
1049
+ - null
1050
+ actuator_names: null
1051
+ actuator_ids: !!python/object/apply:builtins.slice
1052
+ - null
1053
+ - null
1054
+ - null
1055
+ tendon_names: null
1056
+ tendon_ids: !!python/object/apply:builtins.slice
1057
+ - null
1058
+ - null
1059
+ - null
1060
+ camera_names: null
1061
+ camera_ids: !!python/object/apply:builtins.slice
1062
+ - null
1063
+ - null
1064
+ - null
1065
+ light_names: null
1066
+ light_ids: !!python/object/apply:builtins.slice
1067
+ - null
1068
+ - null
1069
+ - null
1070
+ material_names: null
1071
+ material_ids: !!python/object/apply:builtins.slice
1072
+ - null
1073
+ - null
1074
+ - null
1075
+ preserve_order: false
1076
+ command_name: twist
1077
+ std_standing:
1078
+ .*(FL|FR|RL|RR)_hip_joint.*: 0.05
1079
+ .*(FL|FR|RL|RR)_thigh_joint.*: 0.1
1080
+ .*(FL|FR|RL|RR)_shank_joint.*: 0.15
1081
+ ^mainarm_joint$: 0.1
1082
+ ^forearm_joint$: 0.1
1083
+ std_walking:
1084
+ .*(FL|FR|RL|RR)_hip_joint.*: 0.2
1085
+ .*(FL|FR|RL|RR)_thigh_joint.*: 0.4
1086
+ .*(FL|FR|RL|RR)_shank_joint.*: 0.4
1087
+ ^mainarm_joint$: 0.1
1088
+ ^forearm_joint$: 0.1
1089
+ std_running:
1090
+ .*(FL|FR|RL|RR)_hip_joint.*: 0.25
1091
+ .*(FL|FR|RL|RR)_thigh_joint.*: 0.6
1092
+ .*(FL|FR|RL|RR)_shank_joint.*: 0.6
1093
+ ^mainarm_joint$: 0.1
1094
+ ^forearm_joint$: 0.1
1095
+ walking_threshold: 0.05
1096
+ running_threshold: 0.2
1097
+ weight: 1.0
1098
+ body_ang_vel:
1099
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_angular_velocity_penalty ''
1100
+ params:
1101
+ asset_cfg:
1102
+ name: robot
1103
+ joint_names: null
1104
+ joint_ids: !!python/object/apply:builtins.slice
1105
+ - null
1106
+ - null
1107
+ - null
1108
+ body_names: !!python/tuple
1109
+ - body
1110
+ body_ids: !!python/object/apply:builtins.slice
1111
+ - null
1112
+ - null
1113
+ - null
1114
+ geom_names: null
1115
+ geom_ids: !!python/object/apply:builtins.slice
1116
+ - null
1117
+ - null
1118
+ - null
1119
+ site_names: null
1120
+ site_ids: !!python/object/apply:builtins.slice
1121
+ - null
1122
+ - null
1123
+ - null
1124
+ actuator_names: null
1125
+ actuator_ids: !!python/object/apply:builtins.slice
1126
+ - null
1127
+ - null
1128
+ - null
1129
+ tendon_names: null
1130
+ tendon_ids: !!python/object/apply:builtins.slice
1131
+ - null
1132
+ - null
1133
+ - null
1134
+ camera_names: null
1135
+ camera_ids: !!python/object/apply:builtins.slice
1136
+ - null
1137
+ - null
1138
+ - null
1139
+ light_names: null
1140
+ light_ids: !!python/object/apply:builtins.slice
1141
+ - null
1142
+ - null
1143
+ - null
1144
+ material_names: null
1145
+ material_ids: !!python/object/apply:builtins.slice
1146
+ - null
1147
+ - null
1148
+ - null
1149
+ preserve_order: false
1150
+ weight: -0.08
1151
+ angular_momentum:
1152
+ func: !!python/name:src.tasks.velocity.mdp.rewards.angular_momentum_penalty ''
1153
+ params:
1154
+ sensor_name: robot/root_angmom
1155
+ weight: -0.03
1156
+ is_terminated:
1157
+ func: !!python/name:mjlab.envs.mdp.rewards.is_terminated ''
1158
+ params: {}
1159
+ weight: -200.0
1160
+ joint_acc_l2:
1161
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_acc_l2 ''
1162
+ params: {}
1163
+ weight: -2.5e-07
1164
+ joint_pos_limits:
1165
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_pos_limits ''
1166
+ params: {}
1167
+ weight: -10.0
1168
+ action_rate_l2:
1169
+ func: !!python/name:mjlab.envs.mdp.rewards.action_rate_l2 ''
1170
+ params: {}
1171
+ weight: -0.15
1172
+ foot_gait:
1173
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_gait ''
1174
+ params:
1175
+ period: 0.4
1176
+ offset:
1177
+ - 0.0
1178
+ - 0.5
1179
+ - 0.0
1180
+ - 0.5
1181
+ threshold: 0.56
1182
+ command_threshold: 0.1
1183
+ command_name: twist
1184
+ sensor_name: feet_ground_contact
1185
+ weight: 1.0
1186
+ foot_clearance:
1187
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_clearance ''
1188
+ params:
1189
+ target_height: 0.02
1190
+ command_name: twist
1191
+ command_threshold: 0.1
1192
+ asset_cfg:
1193
+ name: robot
1194
+ joint_names: null
1195
+ joint_ids: !!python/object/apply:builtins.slice
1196
+ - null
1197
+ - null
1198
+ - null
1199
+ body_names: null
1200
+ body_ids: !!python/object/apply:builtins.slice
1201
+ - null
1202
+ - null
1203
+ - null
1204
+ geom_names: null
1205
+ geom_ids: !!python/object/apply:builtins.slice
1206
+ - null
1207
+ - null
1208
+ - null
1209
+ site_names: !!python/tuple
1210
+ - FL
1211
+ - FR
1212
+ - RL
1213
+ - RR
1214
+ site_ids: !!python/object/apply:builtins.slice
1215
+ - null
1216
+ - null
1217
+ - null
1218
+ actuator_names: null
1219
+ actuator_ids: !!python/object/apply:builtins.slice
1220
+ - null
1221
+ - null
1222
+ - null
1223
+ tendon_names: null
1224
+ tendon_ids: !!python/object/apply:builtins.slice
1225
+ - null
1226
+ - null
1227
+ - null
1228
+ camera_names: null
1229
+ camera_ids: !!python/object/apply:builtins.slice
1230
+ - null
1231
+ - null
1232
+ - null
1233
+ light_names: null
1234
+ light_ids: !!python/object/apply:builtins.slice
1235
+ - null
1236
+ - null
1237
+ - null
1238
+ material_names: null
1239
+ material_ids: !!python/object/apply:builtins.slice
1240
+ - null
1241
+ - null
1242
+ - null
1243
+ preserve_order: false
1244
+ weight: -0.5
1245
+ foot_slip:
1246
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_slip ''
1247
+ params:
1248
+ sensor_name: feet_ground_contact
1249
+ command_name: twist
1250
+ command_threshold: 0.1
1251
+ asset_cfg:
1252
+ name: robot
1253
+ joint_names: null
1254
+ joint_ids: !!python/object/apply:builtins.slice
1255
+ - null
1256
+ - null
1257
+ - null
1258
+ body_names: null
1259
+ body_ids: !!python/object/apply:builtins.slice
1260
+ - null
1261
+ - null
1262
+ - null
1263
+ geom_names: null
1264
+ geom_ids: !!python/object/apply:builtins.slice
1265
+ - null
1266
+ - null
1267
+ - null
1268
+ site_names: !!python/tuple
1269
+ - FL
1270
+ - FR
1271
+ - RL
1272
+ - RR
1273
+ site_ids: !!python/object/apply:builtins.slice
1274
+ - null
1275
+ - null
1276
+ - null
1277
+ actuator_names: null
1278
+ actuator_ids: !!python/object/apply:builtins.slice
1279
+ - null
1280
+ - null
1281
+ - null
1282
+ tendon_names: null
1283
+ tendon_ids: !!python/object/apply:builtins.slice
1284
+ - null
1285
+ - null
1286
+ - null
1287
+ camera_names: null
1288
+ camera_ids: !!python/object/apply:builtins.slice
1289
+ - null
1290
+ - null
1291
+ - null
1292
+ light_names: null
1293
+ light_ids: !!python/object/apply:builtins.slice
1294
+ - null
1295
+ - null
1296
+ - null
1297
+ material_names: null
1298
+ material_ids: !!python/object/apply:builtins.slice
1299
+ - null
1300
+ - null
1301
+ - null
1302
+ preserve_order: false
1303
+ weight: -0.05
1304
+ soft_landing:
1305
+ func: !!python/name:src.tasks.velocity.mdp.rewards.soft_landing ''
1306
+ params:
1307
+ sensor_name: feet_ground_contact
1308
+ command_name: twist
1309
+ command_threshold: 0.1
1310
+ weight: -0.001
1311
+ stand_still:
1312
+ func: !!python/name:src.tasks.velocity.mdp.rewards.stand_still ''
1313
+ params:
1314
+ command_name: twist
1315
+ command_threshold: 0.1
1316
+ asset_cfg:
1317
+ name: robot
1318
+ joint_names: .*
1319
+ joint_ids: !!python/object/apply:builtins.slice
1320
+ - null
1321
+ - null
1322
+ - null
1323
+ body_names: null
1324
+ body_ids: !!python/object/apply:builtins.slice
1325
+ - null
1326
+ - null
1327
+ - null
1328
+ geom_names: null
1329
+ geom_ids: !!python/object/apply:builtins.slice
1330
+ - null
1331
+ - null
1332
+ - null
1333
+ site_names: null
1334
+ site_ids: !!python/object/apply:builtins.slice
1335
+ - null
1336
+ - null
1337
+ - null
1338
+ actuator_names: null
1339
+ actuator_ids: !!python/object/apply:builtins.slice
1340
+ - null
1341
+ - null
1342
+ - null
1343
+ tendon_names: null
1344
+ tendon_ids: !!python/object/apply:builtins.slice
1345
+ - null
1346
+ - null
1347
+ - null
1348
+ camera_names: null
1349
+ camera_ids: !!python/object/apply:builtins.slice
1350
+ - null
1351
+ - null
1352
+ - null
1353
+ light_names: null
1354
+ light_ids: !!python/object/apply:builtins.slice
1355
+ - null
1356
+ - null
1357
+ - null
1358
+ material_names: null
1359
+ material_ids: !!python/object/apply:builtins.slice
1360
+ - null
1361
+ - null
1362
+ - null
1363
+ preserve_order: false
1364
+ weight: -1.0
1365
+ nonfoot_contact:
1366
+ func: &id008 !!python/name:mjlab.tasks.velocity.mdp.terminations.illegal_contact ''
1367
+ params:
1368
+ sensor_name: nonfoot_ground_touch
1369
+ force_threshold: 0.5
1370
+ weight: -3
1371
+ terminations:
1372
+ time_out:
1373
+ func: !!python/name:mjlab.envs.mdp.terminations.time_out ''
1374
+ params: {}
1375
+ time_out: true
1376
+ fell_over:
1377
+ func: !!python/name:mjlab.envs.mdp.terminations.bad_orientation ''
1378
+ params:
1379
+ limit_angle: 1.2217304763960306
1380
+ time_out: false
1381
+ illegal_contact:
1382
+ func: *id008
1383
+ params:
1384
+ sensor_name: nonfoot_ground_touch
1385
+ force_threshold: 10.0
1386
+ time_out: false
1387
+ commands:
1388
+ twist:
1389
+ resampling_time_range: !!python/tuple
1390
+ - 3.0
1391
+ - 8.0
1392
+ debug_vis: true
1393
+ entity_name: robot
1394
+ heading_command: false
1395
+ heading_control_stiffness: 0.5
1396
+ rel_standing_envs: 0.0
1397
+ rel_heading_envs: 0.1
1398
+ init_velocity_prob: 0.0
1399
+ ranges:
1400
+ lin_vel_x: !!python/tuple
1401
+ - -0.2
1402
+ - 0.4
1403
+ lin_vel_y: !!python/tuple
1404
+ - -0.15
1405
+ - 0.15
1406
+ ang_vel_z: !!python/tuple
1407
+ - -0.8
1408
+ - 0.8
1409
+ heading: null
1410
+ viz:
1411
+ z_offset: 0.2
1412
+ scale: 0.5
1413
+ curriculum: {}
1414
+ metrics:
1415
+ mean_action_acc:
1416
+ func: !!python/name:mjlab.envs.mdp.metrics.mean_action_acc ''
1417
+ params: {}
1418
+ is_finite_horizon: false
1419
+ scale_rewards_by_dt: true
lite3_walk/policy.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:773a1bbd0fee45ec38604d979d5fd6fb339ae15d13bfb5d6e2056a171d2a3422
3
+ size 777245
mini2s_turn/model_1499.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79cce272d822f73e8016cd7febd351944a5aab07149685aad4fc717ce277c3e1
3
+ size 4857461
mini2s_turn/params/agent.yaml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ seed: 42
2
+ num_steps_per_env: 24
3
+ max_iterations: 1500
4
+ obs_groups:
5
+ actor: !!python/tuple
6
+ - actor
7
+ critic: !!python/tuple
8
+ - critic
9
+ save_interval: 100
10
+ experiment_name: mini2s_velocity_turn
11
+ run_name: ''
12
+ logger: tensorboard
13
+ wandb_project: mjlab
14
+ wandb_tags: !!python/tuple []
15
+ resume: false
16
+ load_run: .*
17
+ load_checkpoint: model_.*.pt
18
+ clip_actions: null
19
+ upload_model: true
20
+ class_name: OnPolicyRunner
21
+ actor:
22
+ hidden_dims: !!python/tuple
23
+ - 512
24
+ - 256
25
+ - 128
26
+ activation: elu
27
+ obs_normalization: true
28
+ distribution_cfg:
29
+ init_std: 2.0
30
+ std_type: scalar
31
+ critic:
32
+ hidden_dims: !!python/tuple
33
+ - 512
34
+ - 256
35
+ - 128
36
+ activation: elu
37
+ obs_normalization: true
38
+ algorithm:
39
+ num_learning_epochs: 5
40
+ num_mini_batches: 4
41
+ learning_rate: 0.001
42
+ schedule: adaptive
43
+ gamma: 0.993
44
+ lam: 0.95
45
+ entropy_coef: 0.01
46
+ desired_kl: 0.01
47
+ max_grad_norm: 1.0
48
+ value_loss_coef: 1.0
49
+ use_clipped_value_loss: true
50
+ clip_param: 0.2
51
+ normalize_advantage_per_mini_batch: false
52
+ optimizer: adam
53
+ rnd_cfg: null
54
+ symmetry_cfg: null
55
+ multi_gpu: null
mini2s_turn/params/env.yaml ADDED
@@ -0,0 +1,1176 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ decimation: 10
2
+ scene:
3
+ num_envs: 4096
4
+ env_spacing: 2.0
5
+ terrain:
6
+ init_state:
7
+ pos: !!python/tuple
8
+ - 0.0
9
+ - 0.0
10
+ - 0.0
11
+ rot: !!python/tuple
12
+ - 1.0
13
+ - 0.0
14
+ - 0.0
15
+ - 0.0
16
+ lin_vel: !!python/tuple
17
+ - 0.0
18
+ - 0.0
19
+ - 0.0
20
+ ang_vel: !!python/tuple
21
+ - 0.0
22
+ - 0.0
23
+ - 0.0
24
+ joint_pos:
25
+ .*: 0.0
26
+ joint_vel:
27
+ .*: 0.0
28
+ spec_fn: !!python/name:mjlab.entity.entity.%3Clambda%3E ''
29
+ articulation: null
30
+ sort_actuators: false
31
+ lights: !!python/tuple
32
+ - name: sun
33
+ body: world
34
+ mode: fixed
35
+ target: null
36
+ type: directional
37
+ castshadow: true
38
+ pos: !!python/tuple
39
+ - 0.0
40
+ - 0.0
41
+ - 1.5
42
+ dir: !!python/tuple
43
+ - 0.0
44
+ - 0.0
45
+ - -1.0
46
+ cutoff: 45.0
47
+ exponent: 10.0
48
+ cameras: !!python/tuple []
49
+ textures: !!python/tuple
50
+ - name: groundplane
51
+ type: 2d
52
+ builtin: checker
53
+ rgb1: !!python/tuple
54
+ - 0.2
55
+ - 0.3
56
+ - 0.4
57
+ rgb2: !!python/tuple
58
+ - 0.1
59
+ - 0.2
60
+ - 0.3
61
+ width: 300
62
+ height: 300
63
+ mark: edge
64
+ markrgb: !!python/tuple
65
+ - 0.8
66
+ - 0.8
67
+ - 0.8
68
+ materials: !!python/tuple
69
+ - name: groundplane
70
+ rgba: !!python/tuple
71
+ - 1.0
72
+ - 1.0
73
+ - 1.0
74
+ - 1.0
75
+ texuniform: true
76
+ texrepeat: !!python/tuple
77
+ - 4.0
78
+ - 4.0
79
+ reflectance: 0.2
80
+ texture: groundplane
81
+ geom_names_expr: !!python/tuple
82
+ - terrain$
83
+ collisions: !!python/tuple []
84
+ terrain_type: plane
85
+ terrain_generator: null
86
+ env_spacing: 2.0
87
+ max_init_terrain_level: 5
88
+ num_envs: 4096
89
+ entities:
90
+ robot:
91
+ init_state:
92
+ pos: !!python/tuple
93
+ - 0.0
94
+ - 0.0
95
+ - 0.2
96
+ rot: !!python/tuple
97
+ - 1.0
98
+ - 0.0
99
+ - 0.0
100
+ - 0.0
101
+ lin_vel: !!python/tuple
102
+ - 0.0
103
+ - 0.0
104
+ - 0.0
105
+ ang_vel: !!python/tuple
106
+ - 0.0
107
+ - 0.0
108
+ - 0.0
109
+ joint_pos:
110
+ ^(fl|fr|bl|br)_thigh_joint$: 1
111
+ ^(fl|fr|bl|br)_calf_joint$: 0.0
112
+ ^(fl|fr|bl|br)_hip_joint$: 0.0
113
+ arm_yaw_joint: 0.0
114
+ arm_thigh_joint: -1.57
115
+ arm_calf_joint: 1.35
116
+ joint_vel:
117
+ .*: 0.0
118
+ spec_fn: !!python/name:src.assets.robots.mini2s.mini2s_constants.get_spec ''
119
+ articulation:
120
+ actuators: !!python/tuple
121
+ - target_names_expr: !!python/tuple
122
+ - .*
123
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
124
+ - joint
125
+ armature: 0.0
126
+ frictionloss: 0.0
127
+ base_cfg:
128
+ target_names_expr: !!python/tuple
129
+ - .*
130
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
131
+ - joint
132
+ armature: 0.0
133
+ frictionloss: 0.0
134
+ delay_target: position
135
+ delay_min_lag: 1
136
+ delay_max_lag: 2
137
+ delay_hold_prob: 0.0
138
+ delay_update_period: 0
139
+ delay_per_env_phase: true
140
+ soft_joint_pos_limit_factor: 0.9
141
+ sort_actuators: false
142
+ lights: !!python/tuple []
143
+ cameras: !!python/tuple []
144
+ textures: !!python/tuple []
145
+ materials: !!python/tuple []
146
+ collisions: !!python/tuple
147
+ - geom_names_expr: !!python/tuple
148
+ - .*_collision
149
+ contype: 1
150
+ conaffinity: 0
151
+ condim:
152
+ ^(fl|fr|bl|br)_calf_collision$: 3
153
+ .*_collision: 1
154
+ priority:
155
+ ^(fl|fr|bl|br)_calf_collision$: 1
156
+ friction:
157
+ ^(fl|fr|bl|br)_calf_collision$: !!python/tuple
158
+ - 0.6
159
+ solref: null
160
+ solimp:
161
+ ^(fl|fr|bl|br)_calf_collision$: !!python/tuple
162
+ - 0.9
163
+ - 0.95
164
+ - 0.023
165
+ disable_other_geoms: false
166
+ sensors: !!python/tuple
167
+ - name: nonfoot_ground_touch
168
+ primary:
169
+ mode: geom
170
+ pattern: .*
171
+ entity: robot
172
+ exclude: !!python/tuple
173
+ - fl_calf_collision
174
+ - fr_calf_collision
175
+ - bl_calf_collision
176
+ - br_calf_collision
177
+ secondary:
178
+ mode: body
179
+ pattern: terrain
180
+ entity: null
181
+ exclude: !!python/tuple []
182
+ fields: !!python/tuple
183
+ - found
184
+ - force
185
+ reduce: none
186
+ num_slots: 1
187
+ secondary_policy: first
188
+ track_air_time: false
189
+ global_frame: false
190
+ history_length: 4
191
+ debug: false
192
+ extent: 2.0
193
+ spec_fn: null
194
+ observations:
195
+ actor:
196
+ terms:
197
+ base_ang_vel:
198
+ func: &id001 !!python/name:mjlab.envs.mdp.observations.builtin_sensor ''
199
+ params:
200
+ sensor_name: robot/imu_ang_vel
201
+ noise:
202
+ operation: add
203
+ _tensor_cache: {}
204
+ n_min: -1.0
205
+ n_max: 1.0
206
+ clip: null
207
+ scale: null
208
+ delay_min_lag: 0
209
+ delay_max_lag: 0
210
+ delay_per_env: true
211
+ delay_hold_prob: 0.0
212
+ delay_update_period: 0
213
+ delay_per_env_phase: true
214
+ history_length: 0
215
+ flatten_history_dim: true
216
+ projected_gravity:
217
+ func: &id002 !!python/name:mjlab.envs.mdp.observations.projected_gravity ''
218
+ params: {}
219
+ noise:
220
+ operation: add
221
+ _tensor_cache: {}
222
+ n_min: -0.1
223
+ n_max: 0.1
224
+ clip: null
225
+ scale: null
226
+ delay_min_lag: 0
227
+ delay_max_lag: 0
228
+ delay_per_env: true
229
+ delay_hold_prob: 0.0
230
+ delay_update_period: 0
231
+ delay_per_env_phase: true
232
+ history_length: 0
233
+ flatten_history_dim: true
234
+ command:
235
+ func: &id003 !!python/name:mjlab.envs.mdp.observations.generated_commands ''
236
+ params:
237
+ command_name: twist
238
+ noise: null
239
+ clip: null
240
+ scale: null
241
+ delay_min_lag: 0
242
+ delay_max_lag: 0
243
+ delay_per_env: true
244
+ delay_hold_prob: 0.0
245
+ delay_update_period: 0
246
+ delay_per_env_phase: true
247
+ history_length: 0
248
+ flatten_history_dim: true
249
+ phase:
250
+ func: &id004 !!python/name:src.tasks.velocity.mdp.observations.phase ''
251
+ params:
252
+ period: 0.4
253
+ command_name: twist
254
+ noise: null
255
+ clip: null
256
+ scale: null
257
+ delay_min_lag: 0
258
+ delay_max_lag: 0
259
+ delay_per_env: true
260
+ delay_hold_prob: 0.0
261
+ delay_update_period: 0
262
+ delay_per_env_phase: true
263
+ history_length: 0
264
+ flatten_history_dim: true
265
+ joint_pos:
266
+ func: &id005 !!python/name:mjlab.envs.mdp.observations.joint_pos_rel ''
267
+ params: {}
268
+ noise:
269
+ operation: add
270
+ _tensor_cache: {}
271
+ n_min: -0.1
272
+ n_max: 0.1
273
+ clip: null
274
+ scale: null
275
+ delay_min_lag: 1
276
+ delay_max_lag: 2
277
+ delay_per_env: true
278
+ delay_hold_prob: 0.0
279
+ delay_update_period: 0
280
+ delay_per_env_phase: true
281
+ history_length: 0
282
+ flatten_history_dim: true
283
+ joint_vel:
284
+ func: &id006 !!python/name:mjlab.envs.mdp.observations.joint_vel_rel ''
285
+ params: {}
286
+ noise:
287
+ operation: add
288
+ _tensor_cache: {}
289
+ n_min: -2.0
290
+ n_max: 2.0
291
+ clip: null
292
+ scale: null
293
+ delay_min_lag: 1
294
+ delay_max_lag: 2
295
+ delay_per_env: true
296
+ delay_hold_prob: 0.0
297
+ delay_update_period: 0
298
+ delay_per_env_phase: true
299
+ history_length: 0
300
+ flatten_history_dim: true
301
+ actions:
302
+ func: &id007 !!python/name:mjlab.envs.mdp.observations.last_action ''
303
+ params: {}
304
+ noise: null
305
+ clip: null
306
+ scale: null
307
+ delay_min_lag: 0
308
+ delay_max_lag: 0
309
+ delay_per_env: true
310
+ delay_hold_prob: 0.0
311
+ delay_update_period: 0
312
+ delay_per_env_phase: true
313
+ history_length: 0
314
+ flatten_history_dim: true
315
+ concatenate_terms: true
316
+ concatenate_dim: -1
317
+ enable_corruption: true
318
+ history_length: 1
319
+ flatten_history_dim: true
320
+ nan_policy: disabled
321
+ nan_check_per_term: true
322
+ critic:
323
+ terms:
324
+ base_ang_vel:
325
+ func: *id001
326
+ params:
327
+ sensor_name: robot/imu_ang_vel
328
+ noise:
329
+ operation: add
330
+ _tensor_cache: {}
331
+ n_min: -1.0
332
+ n_max: 1.0
333
+ clip: null
334
+ scale: null
335
+ delay_min_lag: 0
336
+ delay_max_lag: 0
337
+ delay_per_env: true
338
+ delay_hold_prob: 0.0
339
+ delay_update_period: 0
340
+ delay_per_env_phase: true
341
+ history_length: 0
342
+ flatten_history_dim: true
343
+ projected_gravity:
344
+ func: *id002
345
+ params: {}
346
+ noise:
347
+ operation: add
348
+ _tensor_cache: {}
349
+ n_min: -0.1
350
+ n_max: 0.1
351
+ clip: null
352
+ scale: null
353
+ delay_min_lag: 0
354
+ delay_max_lag: 0
355
+ delay_per_env: true
356
+ delay_hold_prob: 0.0
357
+ delay_update_period: 0
358
+ delay_per_env_phase: true
359
+ history_length: 0
360
+ flatten_history_dim: true
361
+ command:
362
+ func: *id003
363
+ params:
364
+ command_name: twist
365
+ noise: null
366
+ clip: null
367
+ scale: null
368
+ delay_min_lag: 0
369
+ delay_max_lag: 0
370
+ delay_per_env: true
371
+ delay_hold_prob: 0.0
372
+ delay_update_period: 0
373
+ delay_per_env_phase: true
374
+ history_length: 0
375
+ flatten_history_dim: true
376
+ phase:
377
+ func: *id004
378
+ params:
379
+ period: 0.4
380
+ command_name: twist
381
+ noise: null
382
+ clip: null
383
+ scale: null
384
+ delay_min_lag: 0
385
+ delay_max_lag: 0
386
+ delay_per_env: true
387
+ delay_hold_prob: 0.0
388
+ delay_update_period: 0
389
+ delay_per_env_phase: true
390
+ history_length: 0
391
+ flatten_history_dim: true
392
+ joint_pos:
393
+ func: *id005
394
+ params: {}
395
+ noise:
396
+ operation: add
397
+ _tensor_cache: {}
398
+ n_min: -0.1
399
+ n_max: 0.1
400
+ clip: null
401
+ scale: null
402
+ delay_min_lag: 1
403
+ delay_max_lag: 2
404
+ delay_per_env: true
405
+ delay_hold_prob: 0.0
406
+ delay_update_period: 0
407
+ delay_per_env_phase: true
408
+ history_length: 0
409
+ flatten_history_dim: true
410
+ joint_vel:
411
+ func: *id006
412
+ params: {}
413
+ noise:
414
+ operation: add
415
+ _tensor_cache: {}
416
+ n_min: -2.0
417
+ n_max: 2.0
418
+ clip: null
419
+ scale: null
420
+ delay_min_lag: 1
421
+ delay_max_lag: 2
422
+ delay_per_env: true
423
+ delay_hold_prob: 0.0
424
+ delay_update_period: 0
425
+ delay_per_env_phase: true
426
+ history_length: 0
427
+ flatten_history_dim: true
428
+ actions:
429
+ func: *id007
430
+ params: {}
431
+ noise: null
432
+ clip: null
433
+ scale: null
434
+ delay_min_lag: 0
435
+ delay_max_lag: 0
436
+ delay_per_env: true
437
+ delay_hold_prob: 0.0
438
+ delay_update_period: 0
439
+ delay_per_env_phase: true
440
+ history_length: 0
441
+ flatten_history_dim: true
442
+ base_lin_vel:
443
+ func: *id001
444
+ params:
445
+ sensor_name: robot/imu_lin_vel
446
+ noise:
447
+ operation: add
448
+ _tensor_cache: {}
449
+ n_min: -1.0
450
+ n_max: 1.0
451
+ clip: null
452
+ scale: null
453
+ delay_min_lag: 0
454
+ delay_max_lag: 0
455
+ delay_per_env: true
456
+ delay_hold_prob: 0.0
457
+ delay_update_period: 0
458
+ delay_per_env_phase: true
459
+ history_length: 0
460
+ flatten_history_dim: true
461
+ foot_height:
462
+ func: &id008 !!python/name:src.tasks.velocity.mdp.observations.constant_zeros ''
463
+ params:
464
+ size: 4
465
+ noise: null
466
+ clip: null
467
+ scale: null
468
+ delay_min_lag: 0
469
+ delay_max_lag: 0
470
+ delay_per_env: true
471
+ delay_hold_prob: 0.0
472
+ delay_update_period: 0
473
+ delay_per_env_phase: true
474
+ history_length: 0
475
+ flatten_history_dim: true
476
+ foot_air_time:
477
+ func: *id008
478
+ params:
479
+ size: 4
480
+ noise: null
481
+ clip: null
482
+ scale: null
483
+ delay_min_lag: 0
484
+ delay_max_lag: 0
485
+ delay_per_env: true
486
+ delay_hold_prob: 0.0
487
+ delay_update_period: 0
488
+ delay_per_env_phase: true
489
+ history_length: 0
490
+ flatten_history_dim: true
491
+ foot_contact:
492
+ func: *id008
493
+ params:
494
+ size: 4
495
+ noise: null
496
+ clip: null
497
+ scale: null
498
+ delay_min_lag: 0
499
+ delay_max_lag: 0
500
+ delay_per_env: true
501
+ delay_hold_prob: 0.0
502
+ delay_update_period: 0
503
+ delay_per_env_phase: true
504
+ history_length: 0
505
+ flatten_history_dim: true
506
+ foot_contact_forces:
507
+ func: *id008
508
+ params:
509
+ size: 12
510
+ noise: null
511
+ clip: null
512
+ scale: null
513
+ delay_min_lag: 0
514
+ delay_max_lag: 0
515
+ delay_per_env: true
516
+ delay_hold_prob: 0.0
517
+ delay_update_period: 0
518
+ delay_per_env_phase: true
519
+ history_length: 0
520
+ flatten_history_dim: true
521
+ concatenate_terms: true
522
+ concatenate_dim: -1
523
+ enable_corruption: false
524
+ history_length: 1
525
+ flatten_history_dim: true
526
+ nan_policy: disabled
527
+ nan_check_per_term: true
528
+ actions:
529
+ joint_pos:
530
+ entity_name: robot
531
+ clip: null
532
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
533
+ - joint
534
+ actuator_names: !!python/tuple
535
+ - .*
536
+ scale: 0.25
537
+ offset: 0.0
538
+ preserve_order: false
539
+ use_default_offset: true
540
+ hold_duration_s: 1.0
541
+ events:
542
+ reset_base:
543
+ func: !!python/name:mjlab.envs.mdp.events.reset_root_state_uniform ''
544
+ params:
545
+ pose_range:
546
+ x: !!python/tuple
547
+ - -0.2
548
+ - 0.2
549
+ y: !!python/tuple
550
+ - -0.2
551
+ - 0.2
552
+ z: !!python/tuple
553
+ - 0.05
554
+ - 0.05
555
+ roll: !!python/tuple
556
+ - -3.141592653589793
557
+ - 3.141592653589793
558
+ pitch: !!python/tuple
559
+ - -3.141592653589793
560
+ - 3.141592653589793
561
+ yaw: !!python/tuple
562
+ - -3.141592653589793
563
+ - 3.141592653589793
564
+ velocity_range: {}
565
+ mode: reset
566
+ interval_range_s: null
567
+ is_global_time: false
568
+ min_step_count_between_reset: 0
569
+ reset_robot_joints:
570
+ func: !!python/name:mjlab.envs.mdp.events.reset_joints_by_offset ''
571
+ params:
572
+ position_range: !!python/tuple
573
+ - -0.3
574
+ - 0.3
575
+ velocity_range: !!python/tuple
576
+ - -0.05
577
+ - 0.05
578
+ asset_cfg:
579
+ name: robot
580
+ joint_names: !!python/tuple
581
+ - .*
582
+ joint_ids: !!python/object/apply:builtins.slice
583
+ - null
584
+ - null
585
+ - null
586
+ body_names: null
587
+ body_ids: !!python/object/apply:builtins.slice
588
+ - null
589
+ - null
590
+ - null
591
+ geom_names: null
592
+ geom_ids: !!python/object/apply:builtins.slice
593
+ - null
594
+ - null
595
+ - null
596
+ site_names: null
597
+ site_ids: !!python/object/apply:builtins.slice
598
+ - null
599
+ - null
600
+ - null
601
+ actuator_names: null
602
+ actuator_ids: !!python/object/apply:builtins.slice
603
+ - null
604
+ - null
605
+ - null
606
+ tendon_names: null
607
+ tendon_ids: !!python/object/apply:builtins.slice
608
+ - null
609
+ - null
610
+ - null
611
+ camera_names: null
612
+ camera_ids: !!python/object/apply:builtins.slice
613
+ - null
614
+ - null
615
+ - null
616
+ light_names: null
617
+ light_ids: !!python/object/apply:builtins.slice
618
+ - null
619
+ - null
620
+ - null
621
+ material_names: null
622
+ material_ids: !!python/object/apply:builtins.slice
623
+ - null
624
+ - null
625
+ - null
626
+ preserve_order: false
627
+ mode: reset
628
+ interval_range_s: null
629
+ is_global_time: false
630
+ min_step_count_between_reset: 0
631
+ foot_friction:
632
+ func: !!python/name:mjlab.envs.mdp.dr.geom.geom_friction ''
633
+ params:
634
+ asset_cfg:
635
+ name: robot
636
+ joint_names: null
637
+ joint_ids: !!python/object/apply:builtins.slice
638
+ - null
639
+ - null
640
+ - null
641
+ body_names: null
642
+ body_ids: !!python/object/apply:builtins.slice
643
+ - null
644
+ - null
645
+ - null
646
+ geom_names: !!python/tuple
647
+ - fl_calf_collision
648
+ - fr_calf_collision
649
+ - bl_calf_collision
650
+ - br_calf_collision
651
+ geom_ids: !!python/object/apply:builtins.slice
652
+ - null
653
+ - null
654
+ - null
655
+ site_names: null
656
+ site_ids: !!python/object/apply:builtins.slice
657
+ - null
658
+ - null
659
+ - null
660
+ actuator_names: null
661
+ actuator_ids: !!python/object/apply:builtins.slice
662
+ - null
663
+ - null
664
+ - null
665
+ tendon_names: null
666
+ tendon_ids: !!python/object/apply:builtins.slice
667
+ - null
668
+ - null
669
+ - null
670
+ camera_names: null
671
+ camera_ids: !!python/object/apply:builtins.slice
672
+ - null
673
+ - null
674
+ - null
675
+ light_names: null
676
+ light_ids: !!python/object/apply:builtins.slice
677
+ - null
678
+ - null
679
+ - null
680
+ material_names: null
681
+ material_ids: !!python/object/apply:builtins.slice
682
+ - null
683
+ - null
684
+ - null
685
+ preserve_order: false
686
+ operation: abs
687
+ ranges: !!python/tuple
688
+ - 0.2
689
+ - 3.0
690
+ shared_random: true
691
+ mode: startup
692
+ interval_range_s: null
693
+ is_global_time: false
694
+ min_step_count_between_reset: 0
695
+ encoder_bias:
696
+ func: !!python/name:mjlab.envs.mdp.dr.joint.encoder_bias ''
697
+ params:
698
+ asset_cfg:
699
+ name: robot
700
+ joint_names: null
701
+ joint_ids: !!python/object/apply:builtins.slice
702
+ - null
703
+ - null
704
+ - null
705
+ body_names: null
706
+ body_ids: !!python/object/apply:builtins.slice
707
+ - null
708
+ - null
709
+ - null
710
+ geom_names: null
711
+ geom_ids: !!python/object/apply:builtins.slice
712
+ - null
713
+ - null
714
+ - null
715
+ site_names: null
716
+ site_ids: !!python/object/apply:builtins.slice
717
+ - null
718
+ - null
719
+ - null
720
+ actuator_names: null
721
+ actuator_ids: !!python/object/apply:builtins.slice
722
+ - null
723
+ - null
724
+ - null
725
+ tendon_names: null
726
+ tendon_ids: !!python/object/apply:builtins.slice
727
+ - null
728
+ - null
729
+ - null
730
+ camera_names: null
731
+ camera_ids: !!python/object/apply:builtins.slice
732
+ - null
733
+ - null
734
+ - null
735
+ light_names: null
736
+ light_ids: !!python/object/apply:builtins.slice
737
+ - null
738
+ - null
739
+ - null
740
+ material_names: null
741
+ material_ids: !!python/object/apply:builtins.slice
742
+ - null
743
+ - null
744
+ - null
745
+ preserve_order: false
746
+ bias_range: !!python/tuple
747
+ - -0.04
748
+ - 0.04
749
+ mode: startup
750
+ interval_range_s: null
751
+ is_global_time: false
752
+ min_step_count_between_reset: 0
753
+ base_com:
754
+ func: !!python/name:mjlab.envs.mdp.dr.body.body_com_offset ''
755
+ params:
756
+ asset_cfg:
757
+ name: robot
758
+ joint_names: null
759
+ joint_ids: !!python/object/apply:builtins.slice
760
+ - null
761
+ - null
762
+ - null
763
+ body_names: !!python/tuple
764
+ - base
765
+ body_ids: !!python/object/apply:builtins.slice
766
+ - null
767
+ - null
768
+ - null
769
+ geom_names: null
770
+ geom_ids: !!python/object/apply:builtins.slice
771
+ - null
772
+ - null
773
+ - null
774
+ site_names: null
775
+ site_ids: !!python/object/apply:builtins.slice
776
+ - null
777
+ - null
778
+ - null
779
+ actuator_names: null
780
+ actuator_ids: !!python/object/apply:builtins.slice
781
+ - null
782
+ - null
783
+ - null
784
+ tendon_names: null
785
+ tendon_ids: !!python/object/apply:builtins.slice
786
+ - null
787
+ - null
788
+ - null
789
+ camera_names: null
790
+ camera_ids: !!python/object/apply:builtins.slice
791
+ - null
792
+ - null
793
+ - null
794
+ light_names: null
795
+ light_ids: !!python/object/apply:builtins.slice
796
+ - null
797
+ - null
798
+ - null
799
+ material_names: null
800
+ material_ids: !!python/object/apply:builtins.slice
801
+ - null
802
+ - null
803
+ - null
804
+ preserve_order: false
805
+ operation: add
806
+ ranges:
807
+ 0: !!python/tuple
808
+ - -0.035
809
+ - 0.035
810
+ 1: !!python/tuple
811
+ - -0.02
812
+ - 0.02
813
+ 2: !!python/tuple
814
+ - -0.02
815
+ - 0.02
816
+ mode: startup
817
+ interval_range_s: null
818
+ is_global_time: false
819
+ min_step_count_between_reset: 0
820
+ seed: 42
821
+ sim:
822
+ nconmax: 64
823
+ njmax: 2000
824
+ ls_parallel: true
825
+ contact_sensor_maxmatch: 128
826
+ mujoco:
827
+ timestep: 0.002
828
+ integrator: implicitfast
829
+ impratio: 1.0
830
+ cone: pyramidal
831
+ jacobian: auto
832
+ solver: newton
833
+ iterations: 10
834
+ tolerance: 1.0e-08
835
+ ls_iterations: 20
836
+ ls_tolerance: 0.01
837
+ ccd_iterations: 50
838
+ gravity: !!python/tuple
839
+ - 0.0
840
+ - 0.0
841
+ - -9.81
842
+ multiccd: false
843
+ nan_guard:
844
+ enabled: false
845
+ buffer_size: 100
846
+ output_dir: /tmp/mjlab/nan_dumps
847
+ max_envs_to_dump: 5
848
+ viewer:
849
+ lookat: !!python/tuple
850
+ - 0.0
851
+ - 0.0
852
+ - 0.0
853
+ distance: 1.5
854
+ fovy: null
855
+ elevation: -10.0
856
+ azimuth: 90.0
857
+ origin_type: !!python/object/apply:mjlab.viewer.viewer_config.OriginType
858
+ - 4
859
+ entity_name: robot
860
+ body_name: base
861
+ env_idx: 0
862
+ max_extra_envs: 2
863
+ enable_reflections: true
864
+ enable_shadows: true
865
+ height: 240
866
+ width: 320
867
+ episode_length_s: 8.0
868
+ rewards:
869
+ body_orientation_l2:
870
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_orientation_l2 ''
871
+ params:
872
+ asset_cfg:
873
+ name: robot
874
+ joint_names: null
875
+ joint_ids: !!python/object/apply:builtins.slice
876
+ - null
877
+ - null
878
+ - null
879
+ body_names: !!python/tuple
880
+ - base
881
+ body_ids: !!python/object/apply:builtins.slice
882
+ - null
883
+ - null
884
+ - null
885
+ geom_names: null
886
+ geom_ids: !!python/object/apply:builtins.slice
887
+ - null
888
+ - null
889
+ - null
890
+ site_names: null
891
+ site_ids: !!python/object/apply:builtins.slice
892
+ - null
893
+ - null
894
+ - null
895
+ actuator_names: null
896
+ actuator_ids: !!python/object/apply:builtins.slice
897
+ - null
898
+ - null
899
+ - null
900
+ tendon_names: null
901
+ tendon_ids: !!python/object/apply:builtins.slice
902
+ - null
903
+ - null
904
+ - null
905
+ camera_names: null
906
+ camera_ids: !!python/object/apply:builtins.slice
907
+ - null
908
+ - null
909
+ - null
910
+ light_names: null
911
+ light_ids: !!python/object/apply:builtins.slice
912
+ - null
913
+ - null
914
+ - null
915
+ material_names: null
916
+ material_ids: !!python/object/apply:builtins.slice
917
+ - null
918
+ - null
919
+ - null
920
+ preserve_order: false
921
+ weight: -0.1
922
+ pose:
923
+ func: !!python/name:src.tasks.velocity.mdp.rewards.gravity_gated_variable_posture ''
924
+ params:
925
+ asset_cfg:
926
+ name: robot
927
+ joint_names: !!python/tuple
928
+ - ^(fl|fr|bl|br)_(hip|thigh|calf)_joint$
929
+ - ^arm_(yaw|thigh|calf)_joint$
930
+ joint_ids: !!python/object/apply:builtins.slice
931
+ - null
932
+ - null
933
+ - null
934
+ body_names: null
935
+ body_ids: !!python/object/apply:builtins.slice
936
+ - null
937
+ - null
938
+ - null
939
+ geom_names: null
940
+ geom_ids: !!python/object/apply:builtins.slice
941
+ - null
942
+ - null
943
+ - null
944
+ site_names: null
945
+ site_ids: !!python/object/apply:builtins.slice
946
+ - null
947
+ - null
948
+ - null
949
+ actuator_names: null
950
+ actuator_ids: !!python/object/apply:builtins.slice
951
+ - null
952
+ - null
953
+ - null
954
+ tendon_names: null
955
+ tendon_ids: !!python/object/apply:builtins.slice
956
+ - null
957
+ - null
958
+ - null
959
+ camera_names: null
960
+ camera_ids: !!python/object/apply:builtins.slice
961
+ - null
962
+ - null
963
+ - null
964
+ light_names: null
965
+ light_ids: !!python/object/apply:builtins.slice
966
+ - null
967
+ - null
968
+ - null
969
+ material_names: null
970
+ material_ids: !!python/object/apply:builtins.slice
971
+ - null
972
+ - null
973
+ - null
974
+ preserve_order: false
975
+ command_name: twist
976
+ std_standing:
977
+ ^(fl|fr|bl|br)_hip_joint$: 0.08
978
+ ^(fl|fr|bl|br)_thigh_joint$: 0.15
979
+ ^(fl|fr|bl|br)_calf_joint$: 0.2
980
+ ^arm_yaw_joint$: 0.2
981
+ ^arm_thigh_joint$: 0.25
982
+ ^arm_calf_joint$: 1.0
983
+ std_walking:
984
+ ^(fl|fr|bl|br)_hip_joint$: 0.12
985
+ ^(fl|fr|bl|br)_thigh_joint$: 0.25
986
+ ^(fl|fr|bl|br)_calf_joint$: 0.3
987
+ ^arm_yaw_joint$: 0.28
988
+ ^arm_thigh_joint$: 0.32
989
+ ^arm_calf_joint$: 1.0
990
+ std_running:
991
+ ^(fl|fr|bl|br)_hip_joint$: 0.12
992
+ ^(fl|fr|bl|br)_thigh_joint$: 0.3
993
+ ^(fl|fr|bl|br)_calf_joint$: 0.35
994
+ ^arm_yaw_joint$: 0.32
995
+ ^arm_thigh_joint$: 0.36
996
+ ^arm_calf_joint$: 1.0
997
+ walking_threshold: 0.1
998
+ running_threshold: 1.5
999
+ gravity_z_threshold: -0.75
1000
+ weight: 10.0
1001
+ body_ang_vel:
1002
+ func: !!python/name:src.tasks.velocity.mdp.rewards.gravity_gated_body_ang_vel_penalty ''
1003
+ params:
1004
+ asset_cfg:
1005
+ name: robot
1006
+ joint_names: null
1007
+ joint_ids: !!python/object/apply:builtins.slice
1008
+ - null
1009
+ - null
1010
+ - null
1011
+ body_names: !!python/tuple
1012
+ - base
1013
+ body_ids: !!python/object/apply:builtins.slice
1014
+ - null
1015
+ - null
1016
+ - null
1017
+ geom_names: null
1018
+ geom_ids: !!python/object/apply:builtins.slice
1019
+ - null
1020
+ - null
1021
+ - null
1022
+ site_names: null
1023
+ site_ids: !!python/object/apply:builtins.slice
1024
+ - null
1025
+ - null
1026
+ - null
1027
+ actuator_names: null
1028
+ actuator_ids: !!python/object/apply:builtins.slice
1029
+ - null
1030
+ - null
1031
+ - null
1032
+ tendon_names: null
1033
+ tendon_ids: !!python/object/apply:builtins.slice
1034
+ - null
1035
+ - null
1036
+ - null
1037
+ camera_names: null
1038
+ camera_ids: !!python/object/apply:builtins.slice
1039
+ - null
1040
+ - null
1041
+ - null
1042
+ light_names: null
1043
+ light_ids: !!python/object/apply:builtins.slice
1044
+ - null
1045
+ - null
1046
+ - null
1047
+ material_names: null
1048
+ material_ids: !!python/object/apply:builtins.slice
1049
+ - null
1050
+ - null
1051
+ - null
1052
+ preserve_order: false
1053
+ gravity_z_threshold: 1.0
1054
+ weight: -0.2
1055
+ angular_momentum:
1056
+ func: !!python/name:src.tasks.velocity.mdp.rewards.gravity_gated_angular_momentum_penalty ''
1057
+ params:
1058
+ sensor_name: robot/root_angmom
1059
+ gravity_z_threshold: -0.4
1060
+ weight: -0.2
1061
+ is_terminated:
1062
+ func: !!python/name:mjlab.envs.mdp.rewards.is_terminated ''
1063
+ params: {}
1064
+ weight: -200.0
1065
+ joint_acc_l2:
1066
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_acc_l2 ''
1067
+ params: {}
1068
+ weight: -2.5e-07
1069
+ joint_pos_limits:
1070
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_pos_limits ''
1071
+ params: {}
1072
+ weight: -10.0
1073
+ action_rate_l2:
1074
+ func: !!python/name:mjlab.envs.mdp.rewards.action_rate_l2 ''
1075
+ params: {}
1076
+ weight: -0.2
1077
+ joint_vel_l2:
1078
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_vel_l2 ''
1079
+ params: {}
1080
+ weight: -0.03
1081
+ recovery_progress:
1082
+ func: !!python/name:src.tasks.velocity.mdp.rewards.recovery_progress ''
1083
+ params:
1084
+ asset_cfg:
1085
+ name: robot
1086
+ joint_names: null
1087
+ joint_ids: !!python/object/apply:builtins.slice
1088
+ - null
1089
+ - null
1090
+ - null
1091
+ body_names: null
1092
+ body_ids: !!python/object/apply:builtins.slice
1093
+ - null
1094
+ - null
1095
+ - null
1096
+ geom_names: null
1097
+ geom_ids: !!python/object/apply:builtins.slice
1098
+ - null
1099
+ - null
1100
+ - null
1101
+ site_names: null
1102
+ site_ids: !!python/object/apply:builtins.slice
1103
+ - null
1104
+ - null
1105
+ - null
1106
+ actuator_names: null
1107
+ actuator_ids: !!python/object/apply:builtins.slice
1108
+ - null
1109
+ - null
1110
+ - null
1111
+ tendon_names: null
1112
+ tendon_ids: !!python/object/apply:builtins.slice
1113
+ - null
1114
+ - null
1115
+ - null
1116
+ camera_names: null
1117
+ camera_ids: !!python/object/apply:builtins.slice
1118
+ - null
1119
+ - null
1120
+ - null
1121
+ light_names: null
1122
+ light_ids: !!python/object/apply:builtins.slice
1123
+ - null
1124
+ - null
1125
+ - null
1126
+ material_names: null
1127
+ material_ids: !!python/object/apply:builtins.slice
1128
+ - null
1129
+ - null
1130
+ - null
1131
+ preserve_order: false
1132
+ weight: 10.0
1133
+ nonfoot_contact:
1134
+ func: !!python/name:mjlab.tasks.velocity.mdp.terminations.illegal_contact ''
1135
+ params:
1136
+ sensor_name: nonfoot_ground_touch
1137
+ force_threshold: 0.5
1138
+ weight: -0.5
1139
+ terminations:
1140
+ time_out:
1141
+ func: !!python/name:mjlab.envs.mdp.terminations.time_out ''
1142
+ params: {}
1143
+ time_out: true
1144
+ commands:
1145
+ twist:
1146
+ resampling_time_range: !!python/tuple
1147
+ - 10.0
1148
+ - 10.0
1149
+ debug_vis: true
1150
+ entity_name: robot
1151
+ heading_command: false
1152
+ heading_control_stiffness: 0.5
1153
+ rel_standing_envs: 1.0
1154
+ rel_heading_envs: 0.0
1155
+ init_velocity_prob: 0.0
1156
+ ranges:
1157
+ lin_vel_x: !!python/tuple
1158
+ - 0.0
1159
+ - 0.0
1160
+ lin_vel_y: !!python/tuple
1161
+ - 0.0
1162
+ - 0.0
1163
+ ang_vel_z: !!python/tuple
1164
+ - 0.0
1165
+ - 0.0
1166
+ heading: null
1167
+ viz:
1168
+ z_offset: 0.2
1169
+ scale: 0.5
1170
+ curriculum: {}
1171
+ metrics:
1172
+ mean_action_acc:
1173
+ func: !!python/name:mjlab.envs.mdp.metrics.mean_action_acc ''
1174
+ params: {}
1175
+ is_finite_horizon: false
1176
+ scale_rewards_by_dt: true
mini2s_turn/policy.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd56be635e37b1acd3519fba6b526e1420195b6e2eecf506891b7eba6bc91d56
3
+ size 783960
mini2s_walk/model_1499.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b45b5aff05e1ce4023775ec62c5dc8c234573ed1707dd77571d0a502157be637
3
+ size 4857461
mini2s_walk/params/agent.yaml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ seed: 42
2
+ num_steps_per_env: 24
3
+ max_iterations: 1500
4
+ obs_groups:
5
+ actor: !!python/tuple
6
+ - actor
7
+ critic: !!python/tuple
8
+ - critic
9
+ save_interval: 100
10
+ experiment_name: mini2s_velocity_walk
11
+ run_name: ''
12
+ logger: tensorboard
13
+ wandb_project: mjlab
14
+ wandb_tags: !!python/tuple []
15
+ resume: false
16
+ load_run: .*
17
+ load_checkpoint: model_.*.pt
18
+ clip_actions: null
19
+ upload_model: true
20
+ class_name: OnPolicyRunner
21
+ actor:
22
+ hidden_dims: !!python/tuple
23
+ - 512
24
+ - 256
25
+ - 128
26
+ activation: elu
27
+ obs_normalization: true
28
+ distribution_cfg:
29
+ init_std: 1.0
30
+ std_type: scalar
31
+ critic:
32
+ hidden_dims: !!python/tuple
33
+ - 512
34
+ - 256
35
+ - 128
36
+ activation: elu
37
+ obs_normalization: true
38
+ algorithm:
39
+ num_learning_epochs: 5
40
+ num_mini_batches: 4
41
+ learning_rate: 0.001
42
+ schedule: adaptive
43
+ gamma: 0.99
44
+ lam: 0.95
45
+ entropy_coef: 0.01
46
+ desired_kl: 0.01
47
+ max_grad_norm: 1.0
48
+ value_loss_coef: 1.0
49
+ use_clipped_value_loss: true
50
+ clip_param: 0.2
51
+ normalize_advantage_per_mini_batch: false
52
+ optimizer: adam
53
+ rnd_cfg: null
54
+ symmetry_cfg: null
55
+ multi_gpu: null
mini2s_walk/params/env.yaml ADDED
@@ -0,0 +1,1423 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ decimation: 5
2
+ scene:
3
+ num_envs: 4096
4
+ env_spacing: 2.0
5
+ terrain:
6
+ init_state:
7
+ pos: !!python/tuple
8
+ - 0.0
9
+ - 0.0
10
+ - 0.0
11
+ rot: !!python/tuple
12
+ - 1.0
13
+ - 0.0
14
+ - 0.0
15
+ - 0.0
16
+ lin_vel: !!python/tuple
17
+ - 0.0
18
+ - 0.0
19
+ - 0.0
20
+ ang_vel: !!python/tuple
21
+ - 0.0
22
+ - 0.0
23
+ - 0.0
24
+ joint_pos:
25
+ .*: 0.0
26
+ joint_vel:
27
+ .*: 0.0
28
+ spec_fn: !!python/name:mjlab.entity.entity.%3Clambda%3E ''
29
+ articulation: null
30
+ sort_actuators: false
31
+ lights: !!python/tuple
32
+ - name: sun
33
+ body: world
34
+ mode: fixed
35
+ target: null
36
+ type: directional
37
+ castshadow: true
38
+ pos: !!python/tuple
39
+ - 0.0
40
+ - 0.0
41
+ - 1.5
42
+ dir: !!python/tuple
43
+ - 0.0
44
+ - 0.0
45
+ - -1.0
46
+ cutoff: 45.0
47
+ exponent: 10.0
48
+ cameras: !!python/tuple []
49
+ textures: !!python/tuple
50
+ - name: groundplane
51
+ type: 2d
52
+ builtin: checker
53
+ rgb1: !!python/tuple
54
+ - 0.2
55
+ - 0.3
56
+ - 0.4
57
+ rgb2: !!python/tuple
58
+ - 0.1
59
+ - 0.2
60
+ - 0.3
61
+ width: 300
62
+ height: 300
63
+ mark: edge
64
+ markrgb: !!python/tuple
65
+ - 0.8
66
+ - 0.8
67
+ - 0.8
68
+ materials: !!python/tuple
69
+ - name: groundplane
70
+ rgba: !!python/tuple
71
+ - 1.0
72
+ - 1.0
73
+ - 1.0
74
+ - 1.0
75
+ texuniform: true
76
+ texrepeat: !!python/tuple
77
+ - 4.0
78
+ - 4.0
79
+ reflectance: 0.2
80
+ texture: groundplane
81
+ geom_names_expr: !!python/tuple
82
+ - terrain$
83
+ collisions: !!python/tuple []
84
+ terrain_type: plane
85
+ terrain_generator: null
86
+ env_spacing: 2.0
87
+ max_init_terrain_level: 5
88
+ num_envs: 4096
89
+ entities:
90
+ robot:
91
+ init_state:
92
+ pos: !!python/tuple
93
+ - 0.0
94
+ - 0.0
95
+ - 0.2
96
+ rot: !!python/tuple
97
+ - 1.0
98
+ - 0.0
99
+ - 0.0
100
+ - 0.0
101
+ lin_vel: !!python/tuple
102
+ - 0.0
103
+ - 0.0
104
+ - 0.0
105
+ ang_vel: !!python/tuple
106
+ - 0.0
107
+ - 0.0
108
+ - 0.0
109
+ joint_pos:
110
+ ^(fl|fr|bl|br)_thigh_joint$: 1
111
+ ^(fl|fr|bl|br)_calf_joint$: 0.0
112
+ ^(fl|fr|bl|br)_hip_joint$: 0.0
113
+ arm_yaw_joint: 0.0
114
+ arm_thigh_joint: -1.57
115
+ arm_calf_joint: 1.35
116
+ joint_vel:
117
+ .*: 0.0
118
+ spec_fn: !!python/name:src.assets.robots.mini2s.mini2s_constants.get_spec ''
119
+ articulation:
120
+ actuators: !!python/tuple
121
+ - target_names_expr: !!python/tuple
122
+ - .*
123
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
124
+ - joint
125
+ armature: 0.0
126
+ frictionloss: 0.0
127
+ base_cfg:
128
+ target_names_expr: !!python/tuple
129
+ - .*
130
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
131
+ - joint
132
+ armature: 0.0
133
+ frictionloss: 0.0
134
+ delay_target: position
135
+ delay_min_lag: 1
136
+ delay_max_lag: 2
137
+ delay_hold_prob: 0.0
138
+ delay_update_period: 0
139
+ delay_per_env_phase: true
140
+ soft_joint_pos_limit_factor: 0.9
141
+ sort_actuators: false
142
+ lights: !!python/tuple []
143
+ cameras: !!python/tuple []
144
+ textures: !!python/tuple []
145
+ materials: !!python/tuple []
146
+ collisions: !!python/tuple
147
+ - geom_names_expr: !!python/tuple
148
+ - ^(fl|fr|bl|br)_calf_collision$
149
+ contype: 0
150
+ conaffinity: 1
151
+ condim: 3
152
+ priority: 1
153
+ friction: !!python/tuple
154
+ - 0.6
155
+ solref: null
156
+ solimp: !!python/tuple
157
+ - 0.9
158
+ - 0.95
159
+ - 0.023
160
+ disable_other_geoms: true
161
+ sensors: !!python/tuple
162
+ - name: feet_ground_contact
163
+ primary:
164
+ mode: geom
165
+ pattern: !!python/tuple
166
+ - fl_calf_collision
167
+ - fr_calf_collision
168
+ - bl_calf_collision
169
+ - br_calf_collision
170
+ entity: robot
171
+ exclude: !!python/tuple []
172
+ secondary:
173
+ mode: body
174
+ pattern: terrain
175
+ entity: null
176
+ exclude: !!python/tuple []
177
+ fields: !!python/tuple
178
+ - found
179
+ - force
180
+ reduce: netforce
181
+ num_slots: 1
182
+ secondary_policy: first
183
+ track_air_time: true
184
+ global_frame: false
185
+ history_length: 0
186
+ debug: false
187
+ - name: nonfoot_ground_touch
188
+ primary:
189
+ mode: geom
190
+ pattern: .*
191
+ entity: robot
192
+ exclude: !!python/tuple
193
+ - fl_calf_collision
194
+ - fr_calf_collision
195
+ - bl_calf_collision
196
+ - br_calf_collision
197
+ secondary:
198
+ mode: body
199
+ pattern: terrain
200
+ entity: null
201
+ exclude: !!python/tuple []
202
+ fields: !!python/tuple
203
+ - found
204
+ - force
205
+ reduce: none
206
+ num_slots: 1
207
+ secondary_policy: first
208
+ track_air_time: false
209
+ global_frame: false
210
+ history_length: 4
211
+ debug: false
212
+ extent: 2.0
213
+ spec_fn: null
214
+ observations:
215
+ actor:
216
+ terms:
217
+ base_ang_vel:
218
+ func: &id001 !!python/name:mjlab.envs.mdp.observations.builtin_sensor ''
219
+ params:
220
+ sensor_name: robot/imu_ang_vel
221
+ noise:
222
+ operation: add
223
+ _tensor_cache: {}
224
+ n_min: -1.0
225
+ n_max: 1.0
226
+ clip: null
227
+ scale: null
228
+ delay_min_lag: 0
229
+ delay_max_lag: 0
230
+ delay_per_env: true
231
+ delay_hold_prob: 0.0
232
+ delay_update_period: 0
233
+ delay_per_env_phase: true
234
+ history_length: 0
235
+ flatten_history_dim: true
236
+ projected_gravity:
237
+ func: &id002 !!python/name:mjlab.envs.mdp.observations.projected_gravity ''
238
+ params: {}
239
+ noise:
240
+ operation: add
241
+ _tensor_cache: {}
242
+ n_min: -0.1
243
+ n_max: 0.1
244
+ clip: null
245
+ scale: null
246
+ delay_min_lag: 0
247
+ delay_max_lag: 0
248
+ delay_per_env: true
249
+ delay_hold_prob: 0.0
250
+ delay_update_period: 0
251
+ delay_per_env_phase: true
252
+ history_length: 0
253
+ flatten_history_dim: true
254
+ command:
255
+ func: &id003 !!python/name:mjlab.envs.mdp.observations.generated_commands ''
256
+ params:
257
+ command_name: twist
258
+ noise: null
259
+ clip: null
260
+ scale: null
261
+ delay_min_lag: 0
262
+ delay_max_lag: 0
263
+ delay_per_env: true
264
+ delay_hold_prob: 0.0
265
+ delay_update_period: 0
266
+ delay_per_env_phase: true
267
+ history_length: 0
268
+ flatten_history_dim: true
269
+ phase:
270
+ func: &id004 !!python/name:src.tasks.velocity.mdp.observations.phase ''
271
+ params:
272
+ period: 0.4
273
+ command_name: twist
274
+ noise: null
275
+ clip: null
276
+ scale: null
277
+ delay_min_lag: 0
278
+ delay_max_lag: 0
279
+ delay_per_env: true
280
+ delay_hold_prob: 0.0
281
+ delay_update_period: 0
282
+ delay_per_env_phase: true
283
+ history_length: 0
284
+ flatten_history_dim: true
285
+ joint_pos:
286
+ func: &id005 !!python/name:mjlab.envs.mdp.observations.joint_pos_rel ''
287
+ params: {}
288
+ noise:
289
+ operation: add
290
+ _tensor_cache: {}
291
+ n_min: -0.1
292
+ n_max: 0.1
293
+ clip: null
294
+ scale: null
295
+ delay_min_lag: 1
296
+ delay_max_lag: 2
297
+ delay_per_env: true
298
+ delay_hold_prob: 0.0
299
+ delay_update_period: 0
300
+ delay_per_env_phase: true
301
+ history_length: 0
302
+ flatten_history_dim: true
303
+ joint_vel:
304
+ func: &id006 !!python/name:mjlab.envs.mdp.observations.joint_vel_rel ''
305
+ params: {}
306
+ noise:
307
+ operation: add
308
+ _tensor_cache: {}
309
+ n_min: -2.0
310
+ n_max: 2.0
311
+ clip: null
312
+ scale: null
313
+ delay_min_lag: 1
314
+ delay_max_lag: 2
315
+ delay_per_env: true
316
+ delay_hold_prob: 0.0
317
+ delay_update_period: 0
318
+ delay_per_env_phase: true
319
+ history_length: 0
320
+ flatten_history_dim: true
321
+ actions:
322
+ func: &id007 !!python/name:mjlab.envs.mdp.observations.last_action ''
323
+ params: {}
324
+ noise: null
325
+ clip: null
326
+ scale: null
327
+ delay_min_lag: 0
328
+ delay_max_lag: 0
329
+ delay_per_env: true
330
+ delay_hold_prob: 0.0
331
+ delay_update_period: 0
332
+ delay_per_env_phase: true
333
+ history_length: 0
334
+ flatten_history_dim: true
335
+ concatenate_terms: true
336
+ concatenate_dim: -1
337
+ enable_corruption: true
338
+ history_length: 1
339
+ flatten_history_dim: true
340
+ nan_policy: disabled
341
+ nan_check_per_term: true
342
+ critic:
343
+ terms:
344
+ base_ang_vel:
345
+ func: *id001
346
+ params:
347
+ sensor_name: robot/imu_ang_vel
348
+ noise:
349
+ operation: add
350
+ _tensor_cache: {}
351
+ n_min: -1.0
352
+ n_max: 1.0
353
+ clip: null
354
+ scale: null
355
+ delay_min_lag: 0
356
+ delay_max_lag: 0
357
+ delay_per_env: true
358
+ delay_hold_prob: 0.0
359
+ delay_update_period: 0
360
+ delay_per_env_phase: true
361
+ history_length: 0
362
+ flatten_history_dim: true
363
+ projected_gravity:
364
+ func: *id002
365
+ params: {}
366
+ noise:
367
+ operation: add
368
+ _tensor_cache: {}
369
+ n_min: -0.1
370
+ n_max: 0.1
371
+ clip: null
372
+ scale: null
373
+ delay_min_lag: 0
374
+ delay_max_lag: 0
375
+ delay_per_env: true
376
+ delay_hold_prob: 0.0
377
+ delay_update_period: 0
378
+ delay_per_env_phase: true
379
+ history_length: 0
380
+ flatten_history_dim: true
381
+ command:
382
+ func: *id003
383
+ params:
384
+ command_name: twist
385
+ noise: null
386
+ clip: null
387
+ scale: null
388
+ delay_min_lag: 0
389
+ delay_max_lag: 0
390
+ delay_per_env: true
391
+ delay_hold_prob: 0.0
392
+ delay_update_period: 0
393
+ delay_per_env_phase: true
394
+ history_length: 0
395
+ flatten_history_dim: true
396
+ phase:
397
+ func: *id004
398
+ params:
399
+ period: 0.4
400
+ command_name: twist
401
+ noise: null
402
+ clip: null
403
+ scale: null
404
+ delay_min_lag: 0
405
+ delay_max_lag: 0
406
+ delay_per_env: true
407
+ delay_hold_prob: 0.0
408
+ delay_update_period: 0
409
+ delay_per_env_phase: true
410
+ history_length: 0
411
+ flatten_history_dim: true
412
+ joint_pos:
413
+ func: *id005
414
+ params: {}
415
+ noise:
416
+ operation: add
417
+ _tensor_cache: {}
418
+ n_min: -0.1
419
+ n_max: 0.1
420
+ clip: null
421
+ scale: null
422
+ delay_min_lag: 1
423
+ delay_max_lag: 2
424
+ delay_per_env: true
425
+ delay_hold_prob: 0.0
426
+ delay_update_period: 0
427
+ delay_per_env_phase: true
428
+ history_length: 0
429
+ flatten_history_dim: true
430
+ joint_vel:
431
+ func: *id006
432
+ params: {}
433
+ noise:
434
+ operation: add
435
+ _tensor_cache: {}
436
+ n_min: -2.0
437
+ n_max: 2.0
438
+ clip: null
439
+ scale: null
440
+ delay_min_lag: 1
441
+ delay_max_lag: 2
442
+ delay_per_env: true
443
+ delay_hold_prob: 0.0
444
+ delay_update_period: 0
445
+ delay_per_env_phase: true
446
+ history_length: 0
447
+ flatten_history_dim: true
448
+ actions:
449
+ func: *id007
450
+ params: {}
451
+ noise: null
452
+ clip: null
453
+ scale: null
454
+ delay_min_lag: 0
455
+ delay_max_lag: 0
456
+ delay_per_env: true
457
+ delay_hold_prob: 0.0
458
+ delay_update_period: 0
459
+ delay_per_env_phase: true
460
+ history_length: 0
461
+ flatten_history_dim: true
462
+ base_lin_vel:
463
+ func: *id001
464
+ params:
465
+ sensor_name: robot/imu_lin_vel
466
+ noise:
467
+ operation: add
468
+ _tensor_cache: {}
469
+ n_min: -1.0
470
+ n_max: 1.0
471
+ clip: null
472
+ scale: null
473
+ delay_min_lag: 0
474
+ delay_max_lag: 0
475
+ delay_per_env: true
476
+ delay_hold_prob: 0.0
477
+ delay_update_period: 0
478
+ delay_per_env_phase: true
479
+ history_length: 0
480
+ flatten_history_dim: true
481
+ foot_height:
482
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_height ''
483
+ params:
484
+ asset_cfg:
485
+ name: robot
486
+ joint_names: null
487
+ joint_ids: !!python/object/apply:builtins.slice
488
+ - null
489
+ - null
490
+ - null
491
+ body_names: null
492
+ body_ids: !!python/object/apply:builtins.slice
493
+ - null
494
+ - null
495
+ - null
496
+ geom_names: null
497
+ geom_ids: !!python/object/apply:builtins.slice
498
+ - null
499
+ - null
500
+ - null
501
+ site_names: !!python/tuple
502
+ - fl
503
+ - fr
504
+ - bl
505
+ - br
506
+ site_ids: !!python/object/apply:builtins.slice
507
+ - null
508
+ - null
509
+ - null
510
+ actuator_names: null
511
+ actuator_ids: !!python/object/apply:builtins.slice
512
+ - null
513
+ - null
514
+ - null
515
+ tendon_names: null
516
+ tendon_ids: !!python/object/apply:builtins.slice
517
+ - null
518
+ - null
519
+ - null
520
+ camera_names: null
521
+ camera_ids: !!python/object/apply:builtins.slice
522
+ - null
523
+ - null
524
+ - null
525
+ light_names: null
526
+ light_ids: !!python/object/apply:builtins.slice
527
+ - null
528
+ - null
529
+ - null
530
+ material_names: null
531
+ material_ids: !!python/object/apply:builtins.slice
532
+ - null
533
+ - null
534
+ - null
535
+ preserve_order: false
536
+ noise: null
537
+ clip: null
538
+ scale: null
539
+ delay_min_lag: 0
540
+ delay_max_lag: 0
541
+ delay_per_env: true
542
+ delay_hold_prob: 0.0
543
+ delay_update_period: 0
544
+ delay_per_env_phase: true
545
+ history_length: 0
546
+ flatten_history_dim: true
547
+ foot_air_time:
548
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_air_time ''
549
+ params:
550
+ sensor_name: feet_ground_contact
551
+ noise: null
552
+ clip: null
553
+ scale: null
554
+ delay_min_lag: 0
555
+ delay_max_lag: 0
556
+ delay_per_env: true
557
+ delay_hold_prob: 0.0
558
+ delay_update_period: 0
559
+ delay_per_env_phase: true
560
+ history_length: 0
561
+ flatten_history_dim: true
562
+ foot_contact:
563
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_contact ''
564
+ params:
565
+ sensor_name: feet_ground_contact
566
+ noise: null
567
+ clip: null
568
+ scale: null
569
+ delay_min_lag: 0
570
+ delay_max_lag: 0
571
+ delay_per_env: true
572
+ delay_hold_prob: 0.0
573
+ delay_update_period: 0
574
+ delay_per_env_phase: true
575
+ history_length: 0
576
+ flatten_history_dim: true
577
+ foot_contact_forces:
578
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_contact_forces ''
579
+ params:
580
+ sensor_name: feet_ground_contact
581
+ noise: null
582
+ clip: null
583
+ scale: null
584
+ delay_min_lag: 0
585
+ delay_max_lag: 0
586
+ delay_per_env: true
587
+ delay_hold_prob: 0.0
588
+ delay_update_period: 0
589
+ delay_per_env_phase: true
590
+ history_length: 0
591
+ flatten_history_dim: true
592
+ concatenate_terms: true
593
+ concatenate_dim: -1
594
+ enable_corruption: false
595
+ history_length: 1
596
+ flatten_history_dim: true
597
+ nan_policy: disabled
598
+ nan_check_per_term: true
599
+ actions:
600
+ joint_pos:
601
+ entity_name: robot
602
+ clip: null
603
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
604
+ - joint
605
+ actuator_names: !!python/tuple
606
+ - .*
607
+ scale: 0.25
608
+ offset: 0.0
609
+ preserve_order: false
610
+ use_default_offset: true
611
+ events:
612
+ reset_base:
613
+ func: !!python/name:mjlab.envs.mdp.events.reset_root_state_uniform ''
614
+ params:
615
+ pose_range:
616
+ x: !!python/tuple
617
+ - -0.5
618
+ - 0.5
619
+ y: !!python/tuple
620
+ - -0.5
621
+ - 0.5
622
+ z: !!python/tuple
623
+ - 0.0
624
+ - 0.0
625
+ yaw: !!python/tuple
626
+ - -3.14
627
+ - 3.14
628
+ velocity_range: {}
629
+ mode: reset
630
+ interval_range_s: null
631
+ is_global_time: false
632
+ min_step_count_between_reset: 0
633
+ reset_robot_joints:
634
+ func: !!python/name:mjlab.envs.mdp.events.reset_joints_by_offset ''
635
+ params:
636
+ position_range: !!python/tuple
637
+ - -0.0
638
+ - 0.0
639
+ velocity_range: !!python/tuple
640
+ - -0.0
641
+ - 0.0
642
+ asset_cfg:
643
+ name: robot
644
+ joint_names: !!python/tuple
645
+ - .*
646
+ joint_ids: !!python/object/apply:builtins.slice
647
+ - null
648
+ - null
649
+ - null
650
+ body_names: null
651
+ body_ids: !!python/object/apply:builtins.slice
652
+ - null
653
+ - null
654
+ - null
655
+ geom_names: null
656
+ geom_ids: !!python/object/apply:builtins.slice
657
+ - null
658
+ - null
659
+ - null
660
+ site_names: null
661
+ site_ids: !!python/object/apply:builtins.slice
662
+ - null
663
+ - null
664
+ - null
665
+ actuator_names: null
666
+ actuator_ids: !!python/object/apply:builtins.slice
667
+ - null
668
+ - null
669
+ - null
670
+ tendon_names: null
671
+ tendon_ids: !!python/object/apply:builtins.slice
672
+ - null
673
+ - null
674
+ - null
675
+ camera_names: null
676
+ camera_ids: !!python/object/apply:builtins.slice
677
+ - null
678
+ - null
679
+ - null
680
+ light_names: null
681
+ light_ids: !!python/object/apply:builtins.slice
682
+ - null
683
+ - null
684
+ - null
685
+ material_names: null
686
+ material_ids: !!python/object/apply:builtins.slice
687
+ - null
688
+ - null
689
+ - null
690
+ preserve_order: false
691
+ mode: reset
692
+ interval_range_s: null
693
+ is_global_time: false
694
+ min_step_count_between_reset: 0
695
+ push_robot:
696
+ func: !!python/name:mjlab.envs.mdp.events.push_by_setting_velocity ''
697
+ params:
698
+ velocity_range:
699
+ x: !!python/tuple
700
+ - -0.5
701
+ - 0.5
702
+ y: !!python/tuple
703
+ - -0.5
704
+ - 0.5
705
+ z: !!python/tuple
706
+ - -0.4
707
+ - 0.4
708
+ roll: !!python/tuple
709
+ - -0.52
710
+ - 0.52
711
+ pitch: !!python/tuple
712
+ - -0.52
713
+ - 0.52
714
+ yaw: !!python/tuple
715
+ - -0.78
716
+ - 0.78
717
+ mode: interval
718
+ interval_range_s: !!python/tuple
719
+ - 5.0
720
+ - 6.0
721
+ is_global_time: false
722
+ min_step_count_between_reset: 0
723
+ foot_friction:
724
+ func: !!python/name:mjlab.envs.mdp.dr.geom.geom_friction ''
725
+ params:
726
+ asset_cfg:
727
+ name: robot
728
+ joint_names: null
729
+ joint_ids: !!python/object/apply:builtins.slice
730
+ - null
731
+ - null
732
+ - null
733
+ body_names: null
734
+ body_ids: !!python/object/apply:builtins.slice
735
+ - null
736
+ - null
737
+ - null
738
+ geom_names: !!python/tuple
739
+ - fl_calf_collision
740
+ - fr_calf_collision
741
+ - bl_calf_collision
742
+ - br_calf_collision
743
+ geom_ids: !!python/object/apply:builtins.slice
744
+ - null
745
+ - null
746
+ - null
747
+ site_names: null
748
+ site_ids: !!python/object/apply:builtins.slice
749
+ - null
750
+ - null
751
+ - null
752
+ actuator_names: null
753
+ actuator_ids: !!python/object/apply:builtins.slice
754
+ - null
755
+ - null
756
+ - null
757
+ tendon_names: null
758
+ tendon_ids: !!python/object/apply:builtins.slice
759
+ - null
760
+ - null
761
+ - null
762
+ camera_names: null
763
+ camera_ids: !!python/object/apply:builtins.slice
764
+ - null
765
+ - null
766
+ - null
767
+ light_names: null
768
+ light_ids: !!python/object/apply:builtins.slice
769
+ - null
770
+ - null
771
+ - null
772
+ material_names: null
773
+ material_ids: !!python/object/apply:builtins.slice
774
+ - null
775
+ - null
776
+ - null
777
+ preserve_order: false
778
+ operation: abs
779
+ ranges: !!python/tuple
780
+ - 0.2
781
+ - 3.0
782
+ shared_random: true
783
+ mode: startup
784
+ interval_range_s: null
785
+ is_global_time: false
786
+ min_step_count_between_reset: 0
787
+ encoder_bias:
788
+ func: !!python/name:mjlab.envs.mdp.dr.joint.encoder_bias ''
789
+ params:
790
+ asset_cfg:
791
+ name: robot
792
+ joint_names: null
793
+ joint_ids: !!python/object/apply:builtins.slice
794
+ - null
795
+ - null
796
+ - null
797
+ body_names: null
798
+ body_ids: !!python/object/apply:builtins.slice
799
+ - null
800
+ - null
801
+ - null
802
+ geom_names: null
803
+ geom_ids: !!python/object/apply:builtins.slice
804
+ - null
805
+ - null
806
+ - null
807
+ site_names: null
808
+ site_ids: !!python/object/apply:builtins.slice
809
+ - null
810
+ - null
811
+ - null
812
+ actuator_names: null
813
+ actuator_ids: !!python/object/apply:builtins.slice
814
+ - null
815
+ - null
816
+ - null
817
+ tendon_names: null
818
+ tendon_ids: !!python/object/apply:builtins.slice
819
+ - null
820
+ - null
821
+ - null
822
+ camera_names: null
823
+ camera_ids: !!python/object/apply:builtins.slice
824
+ - null
825
+ - null
826
+ - null
827
+ light_names: null
828
+ light_ids: !!python/object/apply:builtins.slice
829
+ - null
830
+ - null
831
+ - null
832
+ material_names: null
833
+ material_ids: !!python/object/apply:builtins.slice
834
+ - null
835
+ - null
836
+ - null
837
+ preserve_order: false
838
+ bias_range: !!python/tuple
839
+ - -0.04
840
+ - 0.04
841
+ mode: startup
842
+ interval_range_s: null
843
+ is_global_time: false
844
+ min_step_count_between_reset: 0
845
+ base_com:
846
+ func: !!python/name:mjlab.envs.mdp.dr.body.body_com_offset ''
847
+ params:
848
+ asset_cfg:
849
+ name: robot
850
+ joint_names: null
851
+ joint_ids: !!python/object/apply:builtins.slice
852
+ - null
853
+ - null
854
+ - null
855
+ body_names: !!python/tuple
856
+ - base
857
+ body_ids: !!python/object/apply:builtins.slice
858
+ - null
859
+ - null
860
+ - null
861
+ geom_names: null
862
+ geom_ids: !!python/object/apply:builtins.slice
863
+ - null
864
+ - null
865
+ - null
866
+ site_names: null
867
+ site_ids: !!python/object/apply:builtins.slice
868
+ - null
869
+ - null
870
+ - null
871
+ actuator_names: null
872
+ actuator_ids: !!python/object/apply:builtins.slice
873
+ - null
874
+ - null
875
+ - null
876
+ tendon_names: null
877
+ tendon_ids: !!python/object/apply:builtins.slice
878
+ - null
879
+ - null
880
+ - null
881
+ camera_names: null
882
+ camera_ids: !!python/object/apply:builtins.slice
883
+ - null
884
+ - null
885
+ - null
886
+ light_names: null
887
+ light_ids: !!python/object/apply:builtins.slice
888
+ - null
889
+ - null
890
+ - null
891
+ material_names: null
892
+ material_ids: !!python/object/apply:builtins.slice
893
+ - null
894
+ - null
895
+ - null
896
+ preserve_order: false
897
+ operation: add
898
+ ranges:
899
+ 0: !!python/tuple
900
+ - -0.035
901
+ - 0.035
902
+ 1: !!python/tuple
903
+ - -0.02
904
+ - 0.02
905
+ 2: !!python/tuple
906
+ - -0.02
907
+ - 0.02
908
+ mode: startup
909
+ interval_range_s: null
910
+ is_global_time: false
911
+ min_step_count_between_reset: 0
912
+ seed: 42
913
+ sim:
914
+ nconmax: null
915
+ njmax: 300
916
+ ls_parallel: true
917
+ contact_sensor_maxmatch: 64
918
+ mujoco:
919
+ timestep: 0.004
920
+ integrator: implicitfast
921
+ impratio: 1.0
922
+ cone: pyramidal
923
+ jacobian: auto
924
+ solver: newton
925
+ iterations: 10
926
+ tolerance: 1.0e-08
927
+ ls_iterations: 20
928
+ ls_tolerance: 0.01
929
+ ccd_iterations: 50
930
+ gravity: !!python/tuple
931
+ - 0.0
932
+ - 0.0
933
+ - -9.81
934
+ multiccd: false
935
+ nan_guard:
936
+ enabled: false
937
+ buffer_size: 100
938
+ output_dir: /tmp/mjlab/nan_dumps
939
+ max_envs_to_dump: 5
940
+ viewer:
941
+ lookat: !!python/tuple
942
+ - 0.0
943
+ - 0.0
944
+ - 0.0
945
+ distance: 1.5
946
+ fovy: null
947
+ elevation: -10.0
948
+ azimuth: 90.0
949
+ origin_type: !!python/object/apply:mjlab.viewer.viewer_config.OriginType
950
+ - 4
951
+ entity_name: robot
952
+ body_name: base
953
+ env_idx: 0
954
+ max_extra_envs: 2
955
+ enable_reflections: true
956
+ enable_shadows: true
957
+ height: 240
958
+ width: 320
959
+ episode_length_s: 20.0
960
+ rewards:
961
+ track_linear_velocity:
962
+ func: !!python/name:src.tasks.velocity.mdp.rewards.track_linear_velocity ''
963
+ params:
964
+ command_name: twist
965
+ std: 0.15
966
+ weight: 4.0
967
+ track_angular_velocity:
968
+ func: !!python/name:src.tasks.velocity.mdp.rewards.track_angular_velocity ''
969
+ params:
970
+ command_name: twist
971
+ std: 0.15
972
+ weight: 4.0
973
+ body_orientation_l2:
974
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_orientation_l2 ''
975
+ params:
976
+ asset_cfg:
977
+ name: robot
978
+ joint_names: null
979
+ joint_ids: !!python/object/apply:builtins.slice
980
+ - null
981
+ - null
982
+ - null
983
+ body_names: !!python/tuple
984
+ - base
985
+ body_ids: !!python/object/apply:builtins.slice
986
+ - null
987
+ - null
988
+ - null
989
+ geom_names: null
990
+ geom_ids: !!python/object/apply:builtins.slice
991
+ - null
992
+ - null
993
+ - null
994
+ site_names: null
995
+ site_ids: !!python/object/apply:builtins.slice
996
+ - null
997
+ - null
998
+ - null
999
+ actuator_names: null
1000
+ actuator_ids: !!python/object/apply:builtins.slice
1001
+ - null
1002
+ - null
1003
+ - null
1004
+ tendon_names: null
1005
+ tendon_ids: !!python/object/apply:builtins.slice
1006
+ - null
1007
+ - null
1008
+ - null
1009
+ camera_names: null
1010
+ camera_ids: !!python/object/apply:builtins.slice
1011
+ - null
1012
+ - null
1013
+ - null
1014
+ light_names: null
1015
+ light_ids: !!python/object/apply:builtins.slice
1016
+ - null
1017
+ - null
1018
+ - null
1019
+ material_names: null
1020
+ material_ids: !!python/object/apply:builtins.slice
1021
+ - null
1022
+ - null
1023
+ - null
1024
+ preserve_order: false
1025
+ weight: -1.0
1026
+ pose:
1027
+ func: !!python/name:src.tasks.velocity.mdp.rewards.variable_posture ''
1028
+ params:
1029
+ asset_cfg:
1030
+ name: robot
1031
+ joint_names: .*
1032
+ joint_ids: !!python/object/apply:builtins.slice
1033
+ - null
1034
+ - null
1035
+ - null
1036
+ body_names: null
1037
+ body_ids: !!python/object/apply:builtins.slice
1038
+ - null
1039
+ - null
1040
+ - null
1041
+ geom_names: null
1042
+ geom_ids: !!python/object/apply:builtins.slice
1043
+ - null
1044
+ - null
1045
+ - null
1046
+ site_names: null
1047
+ site_ids: !!python/object/apply:builtins.slice
1048
+ - null
1049
+ - null
1050
+ - null
1051
+ actuator_names: null
1052
+ actuator_ids: !!python/object/apply:builtins.slice
1053
+ - null
1054
+ - null
1055
+ - null
1056
+ tendon_names: null
1057
+ tendon_ids: !!python/object/apply:builtins.slice
1058
+ - null
1059
+ - null
1060
+ - null
1061
+ camera_names: null
1062
+ camera_ids: !!python/object/apply:builtins.slice
1063
+ - null
1064
+ - null
1065
+ - null
1066
+ light_names: null
1067
+ light_ids: !!python/object/apply:builtins.slice
1068
+ - null
1069
+ - null
1070
+ - null
1071
+ material_names: null
1072
+ material_ids: !!python/object/apply:builtins.slice
1073
+ - null
1074
+ - null
1075
+ - null
1076
+ preserve_order: false
1077
+ command_name: twist
1078
+ std_standing:
1079
+ .*(fl|fr|bl|br)_hip_joint.*: 0.05
1080
+ .*(fl|fr|bl|br)_thigh_joint.*: 0.1
1081
+ .*(fl|fr|bl|br)_calf_joint.*: 0.15
1082
+ ^arm_yaw_joint$: 0.1
1083
+ ^arm_thigh_joint$: 0.1
1084
+ ^arm_calf_joint$: 0.1
1085
+ std_walking:
1086
+ .*(fl|fr|bl|br)_hip_joint.*: 0.15
1087
+ .*(fl|fr|bl|br)_thigh_joint.*: 0.35
1088
+ .*(fl|fr|bl|br)_calf_joint.*: 0.35
1089
+ ^arm_yaw_joint$: 0.1
1090
+ ^arm_thigh_joint$: 0.1
1091
+ ^arm_calf_joint$: 0.1
1092
+ std_running:
1093
+ .*(fl|fr|bl|br)_hip_joint.*: 0.15
1094
+ .*(fl|fr|bl|br)_thigh_joint.*: 0.5
1095
+ .*(fl|fr|bl|br)_calf_joint.*: 0.5
1096
+ ^arm_yaw_joint$: 0.1
1097
+ ^arm_thigh_joint$: 0.1
1098
+ ^arm_calf_joint$: 0.1
1099
+ walking_threshold: 0.05
1100
+ running_threshold: 0.3
1101
+ weight: 1.0
1102
+ body_ang_vel:
1103
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_angular_velocity_penalty ''
1104
+ params:
1105
+ asset_cfg:
1106
+ name: robot
1107
+ joint_names: null
1108
+ joint_ids: !!python/object/apply:builtins.slice
1109
+ - null
1110
+ - null
1111
+ - null
1112
+ body_names: !!python/tuple
1113
+ - base
1114
+ body_ids: !!python/object/apply:builtins.slice
1115
+ - null
1116
+ - null
1117
+ - null
1118
+ geom_names: null
1119
+ geom_ids: !!python/object/apply:builtins.slice
1120
+ - null
1121
+ - null
1122
+ - null
1123
+ site_names: null
1124
+ site_ids: !!python/object/apply:builtins.slice
1125
+ - null
1126
+ - null
1127
+ - null
1128
+ actuator_names: null
1129
+ actuator_ids: !!python/object/apply:builtins.slice
1130
+ - null
1131
+ - null
1132
+ - null
1133
+ tendon_names: null
1134
+ tendon_ids: !!python/object/apply:builtins.slice
1135
+ - null
1136
+ - null
1137
+ - null
1138
+ camera_names: null
1139
+ camera_ids: !!python/object/apply:builtins.slice
1140
+ - null
1141
+ - null
1142
+ - null
1143
+ light_names: null
1144
+ light_ids: !!python/object/apply:builtins.slice
1145
+ - null
1146
+ - null
1147
+ - null
1148
+ material_names: null
1149
+ material_ids: !!python/object/apply:builtins.slice
1150
+ - null
1151
+ - null
1152
+ - null
1153
+ preserve_order: false
1154
+ weight: -0.08
1155
+ angular_momentum:
1156
+ func: !!python/name:src.tasks.velocity.mdp.rewards.angular_momentum_penalty ''
1157
+ params:
1158
+ sensor_name: robot/root_angmom
1159
+ weight: -0.03
1160
+ is_terminated:
1161
+ func: !!python/name:mjlab.envs.mdp.rewards.is_terminated ''
1162
+ params: {}
1163
+ weight: -200.0
1164
+ joint_acc_l2:
1165
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_acc_l2 ''
1166
+ params: {}
1167
+ weight: -2.5e-07
1168
+ joint_pos_limits:
1169
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_pos_limits ''
1170
+ params: {}
1171
+ weight: -10.0
1172
+ action_rate_l2:
1173
+ func: !!python/name:mjlab.envs.mdp.rewards.action_rate_l2 ''
1174
+ params: {}
1175
+ weight: -0.2
1176
+ foot_gait:
1177
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_gait ''
1178
+ params:
1179
+ period: 0.4
1180
+ offset:
1181
+ - 0.0
1182
+ - 0.5
1183
+ - 0.0
1184
+ - 0.5
1185
+ threshold: 0.56
1186
+ command_threshold: 0.1
1187
+ command_name: twist
1188
+ sensor_name: feet_ground_contact
1189
+ weight: 1.0
1190
+ foot_clearance:
1191
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_clearance ''
1192
+ params:
1193
+ target_height: 0.02
1194
+ command_name: twist
1195
+ command_threshold: 0.1
1196
+ asset_cfg:
1197
+ name: robot
1198
+ joint_names: null
1199
+ joint_ids: !!python/object/apply:builtins.slice
1200
+ - null
1201
+ - null
1202
+ - null
1203
+ body_names: null
1204
+ body_ids: !!python/object/apply:builtins.slice
1205
+ - null
1206
+ - null
1207
+ - null
1208
+ geom_names: null
1209
+ geom_ids: !!python/object/apply:builtins.slice
1210
+ - null
1211
+ - null
1212
+ - null
1213
+ site_names: !!python/tuple
1214
+ - fl
1215
+ - fr
1216
+ - bl
1217
+ - br
1218
+ site_ids: !!python/object/apply:builtins.slice
1219
+ - null
1220
+ - null
1221
+ - null
1222
+ actuator_names: null
1223
+ actuator_ids: !!python/object/apply:builtins.slice
1224
+ - null
1225
+ - null
1226
+ - null
1227
+ tendon_names: null
1228
+ tendon_ids: !!python/object/apply:builtins.slice
1229
+ - null
1230
+ - null
1231
+ - null
1232
+ camera_names: null
1233
+ camera_ids: !!python/object/apply:builtins.slice
1234
+ - null
1235
+ - null
1236
+ - null
1237
+ light_names: null
1238
+ light_ids: !!python/object/apply:builtins.slice
1239
+ - null
1240
+ - null
1241
+ - null
1242
+ material_names: null
1243
+ material_ids: !!python/object/apply:builtins.slice
1244
+ - null
1245
+ - null
1246
+ - null
1247
+ preserve_order: false
1248
+ weight: -0.5
1249
+ foot_slip:
1250
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_slip ''
1251
+ params:
1252
+ sensor_name: feet_ground_contact
1253
+ command_name: twist
1254
+ command_threshold: 0.1
1255
+ asset_cfg:
1256
+ name: robot
1257
+ joint_names: null
1258
+ joint_ids: !!python/object/apply:builtins.slice
1259
+ - null
1260
+ - null
1261
+ - null
1262
+ body_names: null
1263
+ body_ids: !!python/object/apply:builtins.slice
1264
+ - null
1265
+ - null
1266
+ - null
1267
+ geom_names: null
1268
+ geom_ids: !!python/object/apply:builtins.slice
1269
+ - null
1270
+ - null
1271
+ - null
1272
+ site_names: !!python/tuple
1273
+ - fl
1274
+ - fr
1275
+ - bl
1276
+ - br
1277
+ site_ids: !!python/object/apply:builtins.slice
1278
+ - null
1279
+ - null
1280
+ - null
1281
+ actuator_names: null
1282
+ actuator_ids: !!python/object/apply:builtins.slice
1283
+ - null
1284
+ - null
1285
+ - null
1286
+ tendon_names: null
1287
+ tendon_ids: !!python/object/apply:builtins.slice
1288
+ - null
1289
+ - null
1290
+ - null
1291
+ camera_names: null
1292
+ camera_ids: !!python/object/apply:builtins.slice
1293
+ - null
1294
+ - null
1295
+ - null
1296
+ light_names: null
1297
+ light_ids: !!python/object/apply:builtins.slice
1298
+ - null
1299
+ - null
1300
+ - null
1301
+ material_names: null
1302
+ material_ids: !!python/object/apply:builtins.slice
1303
+ - null
1304
+ - null
1305
+ - null
1306
+ preserve_order: false
1307
+ weight: -0.05
1308
+ soft_landing:
1309
+ func: !!python/name:src.tasks.velocity.mdp.rewards.soft_landing ''
1310
+ params:
1311
+ sensor_name: feet_ground_contact
1312
+ command_name: twist
1313
+ command_threshold: 0.1
1314
+ weight: -0.001
1315
+ stand_still:
1316
+ func: !!python/name:src.tasks.velocity.mdp.rewards.stand_still ''
1317
+ params:
1318
+ command_name: twist
1319
+ command_threshold: 0.1
1320
+ asset_cfg:
1321
+ name: robot
1322
+ joint_names: .*
1323
+ joint_ids: !!python/object/apply:builtins.slice
1324
+ - null
1325
+ - null
1326
+ - null
1327
+ body_names: null
1328
+ body_ids: !!python/object/apply:builtins.slice
1329
+ - null
1330
+ - null
1331
+ - null
1332
+ geom_names: null
1333
+ geom_ids: !!python/object/apply:builtins.slice
1334
+ - null
1335
+ - null
1336
+ - null
1337
+ site_names: null
1338
+ site_ids: !!python/object/apply:builtins.slice
1339
+ - null
1340
+ - null
1341
+ - null
1342
+ actuator_names: null
1343
+ actuator_ids: !!python/object/apply:builtins.slice
1344
+ - null
1345
+ - null
1346
+ - null
1347
+ tendon_names: null
1348
+ tendon_ids: !!python/object/apply:builtins.slice
1349
+ - null
1350
+ - null
1351
+ - null
1352
+ camera_names: null
1353
+ camera_ids: !!python/object/apply:builtins.slice
1354
+ - null
1355
+ - null
1356
+ - null
1357
+ light_names: null
1358
+ light_ids: !!python/object/apply:builtins.slice
1359
+ - null
1360
+ - null
1361
+ - null
1362
+ material_names: null
1363
+ material_ids: !!python/object/apply:builtins.slice
1364
+ - null
1365
+ - null
1366
+ - null
1367
+ preserve_order: false
1368
+ weight: -1.0
1369
+ nonfoot_contact:
1370
+ func: &id008 !!python/name:mjlab.tasks.velocity.mdp.terminations.illegal_contact ''
1371
+ params:
1372
+ sensor_name: nonfoot_ground_touch
1373
+ force_threshold: 0.5
1374
+ weight: -3
1375
+ terminations:
1376
+ time_out:
1377
+ func: !!python/name:mjlab.envs.mdp.terminations.time_out ''
1378
+ params: {}
1379
+ time_out: true
1380
+ fell_over:
1381
+ func: !!python/name:mjlab.envs.mdp.terminations.bad_orientation ''
1382
+ params:
1383
+ limit_angle: 1.2217304763960306
1384
+ time_out: false
1385
+ illegal_contact:
1386
+ func: *id008
1387
+ params:
1388
+ sensor_name: nonfoot_ground_touch
1389
+ force_threshold: 10.0
1390
+ time_out: false
1391
+ commands:
1392
+ twist:
1393
+ resampling_time_range: !!python/tuple
1394
+ - 3.0
1395
+ - 8.0
1396
+ debug_vis: true
1397
+ entity_name: robot
1398
+ heading_command: false
1399
+ heading_control_stiffness: 0.5
1400
+ rel_standing_envs: 0.0
1401
+ rel_heading_envs: 0.1
1402
+ init_velocity_prob: 0.0
1403
+ ranges:
1404
+ lin_vel_x: !!python/tuple
1405
+ - -0.5
1406
+ - 0.6
1407
+ lin_vel_y: !!python/tuple
1408
+ - -0.3
1409
+ - 0.3
1410
+ ang_vel_z: !!python/tuple
1411
+ - -0.8
1412
+ - 0.8
1413
+ heading: null
1414
+ viz:
1415
+ z_offset: 0.2
1416
+ scale: 0.5
1417
+ curriculum: {}
1418
+ metrics:
1419
+ mean_action_acc:
1420
+ func: !!python/name:mjlab.envs.mdp.metrics.mean_action_acc ''
1421
+ params: {}
1422
+ is_finite_horizon: false
1423
+ scale_rewards_by_dt: true
mini2s_walk/policy.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a752314870f431abcca9ab6629c358d0f0aab1ec70956d0fbeb116bc9a7a47a0
3
+ size 783960
mini2sw_turn/model_1499.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d4bc9120f0fd83ffc3b30d377d43000be0bda05c9dc6a73c25d71d0dd2ae834
3
+ size 4857461
mini2sw_turn/params/agent.yaml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ seed: 42
2
+ num_steps_per_env: 24
3
+ max_iterations: 1500
4
+ obs_groups:
5
+ actor: !!python/tuple
6
+ - actor
7
+ critic: !!python/tuple
8
+ - critic
9
+ save_interval: 100
10
+ experiment_name: mini2sw_velocity_turn
11
+ run_name: ''
12
+ logger: tensorboard
13
+ wandb_project: mjlab
14
+ wandb_tags: !!python/tuple []
15
+ resume: false
16
+ load_run: .*
17
+ load_checkpoint: model_.*.pt
18
+ clip_actions: null
19
+ upload_model: true
20
+ class_name: OnPolicyRunner
21
+ actor:
22
+ hidden_dims: !!python/tuple
23
+ - 512
24
+ - 256
25
+ - 128
26
+ activation: elu
27
+ obs_normalization: true
28
+ distribution_cfg:
29
+ init_std: 2.0
30
+ std_type: scalar
31
+ critic:
32
+ hidden_dims: !!python/tuple
33
+ - 512
34
+ - 256
35
+ - 128
36
+ activation: elu
37
+ obs_normalization: true
38
+ algorithm:
39
+ num_learning_epochs: 5
40
+ num_mini_batches: 4
41
+ learning_rate: 0.001
42
+ schedule: adaptive
43
+ gamma: 0.993
44
+ lam: 0.95
45
+ entropy_coef: 0.01
46
+ desired_kl: 0.01
47
+ max_grad_norm: 1.0
48
+ value_loss_coef: 1.0
49
+ use_clipped_value_loss: true
50
+ clip_param: 0.2
51
+ normalize_advantage_per_mini_batch: false
52
+ optimizer: adam
53
+ rnd_cfg: null
54
+ symmetry_cfg: null
55
+ multi_gpu: null
mini2sw_turn/params/env.yaml ADDED
@@ -0,0 +1,1176 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ decimation: 10
2
+ scene:
3
+ num_envs: 4096
4
+ env_spacing: 2.0
5
+ terrain:
6
+ init_state:
7
+ pos: !!python/tuple
8
+ - 0.0
9
+ - 0.0
10
+ - 0.0
11
+ rot: !!python/tuple
12
+ - 1.0
13
+ - 0.0
14
+ - 0.0
15
+ - 0.0
16
+ lin_vel: !!python/tuple
17
+ - 0.0
18
+ - 0.0
19
+ - 0.0
20
+ ang_vel: !!python/tuple
21
+ - 0.0
22
+ - 0.0
23
+ - 0.0
24
+ joint_pos:
25
+ .*: 0.0
26
+ joint_vel:
27
+ .*: 0.0
28
+ spec_fn: !!python/name:mjlab.entity.entity.%3Clambda%3E ''
29
+ articulation: null
30
+ sort_actuators: false
31
+ lights: !!python/tuple
32
+ - name: sun
33
+ body: world
34
+ mode: fixed
35
+ target: null
36
+ type: directional
37
+ castshadow: true
38
+ pos: !!python/tuple
39
+ - 0.0
40
+ - 0.0
41
+ - 1.5
42
+ dir: !!python/tuple
43
+ - 0.0
44
+ - 0.0
45
+ - -1.0
46
+ cutoff: 45.0
47
+ exponent: 10.0
48
+ cameras: !!python/tuple []
49
+ textures: !!python/tuple
50
+ - name: groundplane
51
+ type: 2d
52
+ builtin: checker
53
+ rgb1: !!python/tuple
54
+ - 0.2
55
+ - 0.3
56
+ - 0.4
57
+ rgb2: !!python/tuple
58
+ - 0.1
59
+ - 0.2
60
+ - 0.3
61
+ width: 300
62
+ height: 300
63
+ mark: edge
64
+ markrgb: !!python/tuple
65
+ - 0.8
66
+ - 0.8
67
+ - 0.8
68
+ materials: !!python/tuple
69
+ - name: groundplane
70
+ rgba: !!python/tuple
71
+ - 1.0
72
+ - 1.0
73
+ - 1.0
74
+ - 1.0
75
+ texuniform: true
76
+ texrepeat: !!python/tuple
77
+ - 4.0
78
+ - 4.0
79
+ reflectance: 0.2
80
+ texture: groundplane
81
+ geom_names_expr: !!python/tuple
82
+ - terrain$
83
+ collisions: !!python/tuple []
84
+ terrain_type: plane
85
+ terrain_generator: null
86
+ env_spacing: 2.0
87
+ max_init_terrain_level: 5
88
+ num_envs: 4096
89
+ entities:
90
+ robot:
91
+ init_state:
92
+ pos: !!python/tuple
93
+ - 0.0
94
+ - 0.0
95
+ - 0.2
96
+ rot: !!python/tuple
97
+ - 1.0
98
+ - 0.0
99
+ - 0.0
100
+ - 0.0
101
+ lin_vel: !!python/tuple
102
+ - 0.0
103
+ - 0.0
104
+ - 0.0
105
+ ang_vel: !!python/tuple
106
+ - 0.0
107
+ - 0.0
108
+ - 0.0
109
+ joint_pos:
110
+ ^(fl|fr|bl|br)_thigh_joint$: 1
111
+ ^(fl|fr|bl|br)_calf_joint$: 0.0
112
+ ^(fl|fr|bl|br)_hip_joint$: 0.0
113
+ arm_yaw_joint: 0.0
114
+ arm_thigh_joint: -1.57
115
+ arm_calf_joint: 1.35
116
+ joint_vel:
117
+ .*: 0.0
118
+ spec_fn: !!python/name:src.assets.robots.mini2sw.mini2sw_constants.get_spec ''
119
+ articulation:
120
+ actuators: !!python/tuple
121
+ - target_names_expr: !!python/tuple
122
+ - .*
123
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
124
+ - joint
125
+ armature: 0.0
126
+ frictionloss: 0.0
127
+ base_cfg:
128
+ target_names_expr: !!python/tuple
129
+ - .*
130
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
131
+ - joint
132
+ armature: 0.0
133
+ frictionloss: 0.0
134
+ delay_target: position
135
+ delay_min_lag: 1
136
+ delay_max_lag: 2
137
+ delay_hold_prob: 0.0
138
+ delay_update_period: 0
139
+ delay_per_env_phase: true
140
+ soft_joint_pos_limit_factor: 0.9
141
+ sort_actuators: false
142
+ lights: !!python/tuple []
143
+ cameras: !!python/tuple []
144
+ textures: !!python/tuple []
145
+ materials: !!python/tuple []
146
+ collisions: !!python/tuple
147
+ - geom_names_expr: !!python/tuple
148
+ - .*_collision
149
+ contype: 1
150
+ conaffinity: 0
151
+ condim:
152
+ ^(fl|fr|bl|br)_wheel_collision$: 3
153
+ .*_collision: 1
154
+ priority:
155
+ ^(fl|fr|bl|br)_wheel_collision$: 1
156
+ friction:
157
+ ^(fl|fr|bl|br)_wheel_collision$: !!python/tuple
158
+ - 0.6
159
+ solref: null
160
+ solimp:
161
+ ^(fl|fr|bl|br)_wheel_collision$: !!python/tuple
162
+ - 0.9
163
+ - 0.95
164
+ - 0.023
165
+ disable_other_geoms: false
166
+ sensors: !!python/tuple
167
+ - name: nonfoot_ground_touch
168
+ primary:
169
+ mode: geom
170
+ pattern: .*
171
+ entity: robot
172
+ exclude: !!python/tuple
173
+ - fl_wheel_collision
174
+ - fr_wheel_collision
175
+ - bl_wheel_collision
176
+ - br_wheel_collision
177
+ secondary:
178
+ mode: body
179
+ pattern: terrain
180
+ entity: null
181
+ exclude: !!python/tuple []
182
+ fields: !!python/tuple
183
+ - found
184
+ - force
185
+ reduce: none
186
+ num_slots: 1
187
+ secondary_policy: first
188
+ track_air_time: false
189
+ global_frame: false
190
+ history_length: 4
191
+ debug: false
192
+ extent: 2.0
193
+ spec_fn: null
194
+ observations:
195
+ actor:
196
+ terms:
197
+ base_ang_vel:
198
+ func: &id001 !!python/name:mjlab.envs.mdp.observations.builtin_sensor ''
199
+ params:
200
+ sensor_name: robot/imu_ang_vel
201
+ noise:
202
+ operation: add
203
+ _tensor_cache: {}
204
+ n_min: -1.0
205
+ n_max: 1.0
206
+ clip: null
207
+ scale: null
208
+ delay_min_lag: 0
209
+ delay_max_lag: 0
210
+ delay_per_env: true
211
+ delay_hold_prob: 0.0
212
+ delay_update_period: 0
213
+ delay_per_env_phase: true
214
+ history_length: 0
215
+ flatten_history_dim: true
216
+ projected_gravity:
217
+ func: &id002 !!python/name:mjlab.envs.mdp.observations.projected_gravity ''
218
+ params: {}
219
+ noise:
220
+ operation: add
221
+ _tensor_cache: {}
222
+ n_min: -0.1
223
+ n_max: 0.1
224
+ clip: null
225
+ scale: null
226
+ delay_min_lag: 0
227
+ delay_max_lag: 0
228
+ delay_per_env: true
229
+ delay_hold_prob: 0.0
230
+ delay_update_period: 0
231
+ delay_per_env_phase: true
232
+ history_length: 0
233
+ flatten_history_dim: true
234
+ command:
235
+ func: &id003 !!python/name:mjlab.envs.mdp.observations.generated_commands ''
236
+ params:
237
+ command_name: twist
238
+ noise: null
239
+ clip: null
240
+ scale: null
241
+ delay_min_lag: 0
242
+ delay_max_lag: 0
243
+ delay_per_env: true
244
+ delay_hold_prob: 0.0
245
+ delay_update_period: 0
246
+ delay_per_env_phase: true
247
+ history_length: 0
248
+ flatten_history_dim: true
249
+ phase:
250
+ func: &id004 !!python/name:src.tasks.velocity.mdp.observations.phase ''
251
+ params:
252
+ period: 0.4
253
+ command_name: twist
254
+ noise: null
255
+ clip: null
256
+ scale: null
257
+ delay_min_lag: 0
258
+ delay_max_lag: 0
259
+ delay_per_env: true
260
+ delay_hold_prob: 0.0
261
+ delay_update_period: 0
262
+ delay_per_env_phase: true
263
+ history_length: 0
264
+ flatten_history_dim: true
265
+ joint_pos:
266
+ func: &id005 !!python/name:mjlab.envs.mdp.observations.joint_pos_rel ''
267
+ params: {}
268
+ noise:
269
+ operation: add
270
+ _tensor_cache: {}
271
+ n_min: -0.1
272
+ n_max: 0.1
273
+ clip: null
274
+ scale: null
275
+ delay_min_lag: 1
276
+ delay_max_lag: 2
277
+ delay_per_env: true
278
+ delay_hold_prob: 0.0
279
+ delay_update_period: 0
280
+ delay_per_env_phase: true
281
+ history_length: 0
282
+ flatten_history_dim: true
283
+ joint_vel:
284
+ func: &id006 !!python/name:mjlab.envs.mdp.observations.joint_vel_rel ''
285
+ params: {}
286
+ noise:
287
+ operation: add
288
+ _tensor_cache: {}
289
+ n_min: -2.0
290
+ n_max: 2.0
291
+ clip: null
292
+ scale: null
293
+ delay_min_lag: 1
294
+ delay_max_lag: 2
295
+ delay_per_env: true
296
+ delay_hold_prob: 0.0
297
+ delay_update_period: 0
298
+ delay_per_env_phase: true
299
+ history_length: 0
300
+ flatten_history_dim: true
301
+ actions:
302
+ func: &id007 !!python/name:mjlab.envs.mdp.observations.last_action ''
303
+ params: {}
304
+ noise: null
305
+ clip: null
306
+ scale: null
307
+ delay_min_lag: 0
308
+ delay_max_lag: 0
309
+ delay_per_env: true
310
+ delay_hold_prob: 0.0
311
+ delay_update_period: 0
312
+ delay_per_env_phase: true
313
+ history_length: 0
314
+ flatten_history_dim: true
315
+ concatenate_terms: true
316
+ concatenate_dim: -1
317
+ enable_corruption: true
318
+ history_length: 1
319
+ flatten_history_dim: true
320
+ nan_policy: disabled
321
+ nan_check_per_term: true
322
+ critic:
323
+ terms:
324
+ base_ang_vel:
325
+ func: *id001
326
+ params:
327
+ sensor_name: robot/imu_ang_vel
328
+ noise:
329
+ operation: add
330
+ _tensor_cache: {}
331
+ n_min: -1.0
332
+ n_max: 1.0
333
+ clip: null
334
+ scale: null
335
+ delay_min_lag: 0
336
+ delay_max_lag: 0
337
+ delay_per_env: true
338
+ delay_hold_prob: 0.0
339
+ delay_update_period: 0
340
+ delay_per_env_phase: true
341
+ history_length: 0
342
+ flatten_history_dim: true
343
+ projected_gravity:
344
+ func: *id002
345
+ params: {}
346
+ noise:
347
+ operation: add
348
+ _tensor_cache: {}
349
+ n_min: -0.1
350
+ n_max: 0.1
351
+ clip: null
352
+ scale: null
353
+ delay_min_lag: 0
354
+ delay_max_lag: 0
355
+ delay_per_env: true
356
+ delay_hold_prob: 0.0
357
+ delay_update_period: 0
358
+ delay_per_env_phase: true
359
+ history_length: 0
360
+ flatten_history_dim: true
361
+ command:
362
+ func: *id003
363
+ params:
364
+ command_name: twist
365
+ noise: null
366
+ clip: null
367
+ scale: null
368
+ delay_min_lag: 0
369
+ delay_max_lag: 0
370
+ delay_per_env: true
371
+ delay_hold_prob: 0.0
372
+ delay_update_period: 0
373
+ delay_per_env_phase: true
374
+ history_length: 0
375
+ flatten_history_dim: true
376
+ phase:
377
+ func: *id004
378
+ params:
379
+ period: 0.4
380
+ command_name: twist
381
+ noise: null
382
+ clip: null
383
+ scale: null
384
+ delay_min_lag: 0
385
+ delay_max_lag: 0
386
+ delay_per_env: true
387
+ delay_hold_prob: 0.0
388
+ delay_update_period: 0
389
+ delay_per_env_phase: true
390
+ history_length: 0
391
+ flatten_history_dim: true
392
+ joint_pos:
393
+ func: *id005
394
+ params: {}
395
+ noise:
396
+ operation: add
397
+ _tensor_cache: {}
398
+ n_min: -0.1
399
+ n_max: 0.1
400
+ clip: null
401
+ scale: null
402
+ delay_min_lag: 1
403
+ delay_max_lag: 2
404
+ delay_per_env: true
405
+ delay_hold_prob: 0.0
406
+ delay_update_period: 0
407
+ delay_per_env_phase: true
408
+ history_length: 0
409
+ flatten_history_dim: true
410
+ joint_vel:
411
+ func: *id006
412
+ params: {}
413
+ noise:
414
+ operation: add
415
+ _tensor_cache: {}
416
+ n_min: -2.0
417
+ n_max: 2.0
418
+ clip: null
419
+ scale: null
420
+ delay_min_lag: 1
421
+ delay_max_lag: 2
422
+ delay_per_env: true
423
+ delay_hold_prob: 0.0
424
+ delay_update_period: 0
425
+ delay_per_env_phase: true
426
+ history_length: 0
427
+ flatten_history_dim: true
428
+ actions:
429
+ func: *id007
430
+ params: {}
431
+ noise: null
432
+ clip: null
433
+ scale: null
434
+ delay_min_lag: 0
435
+ delay_max_lag: 0
436
+ delay_per_env: true
437
+ delay_hold_prob: 0.0
438
+ delay_update_period: 0
439
+ delay_per_env_phase: true
440
+ history_length: 0
441
+ flatten_history_dim: true
442
+ base_lin_vel:
443
+ func: *id001
444
+ params:
445
+ sensor_name: robot/imu_lin_vel
446
+ noise:
447
+ operation: add
448
+ _tensor_cache: {}
449
+ n_min: -1.0
450
+ n_max: 1.0
451
+ clip: null
452
+ scale: null
453
+ delay_min_lag: 0
454
+ delay_max_lag: 0
455
+ delay_per_env: true
456
+ delay_hold_prob: 0.0
457
+ delay_update_period: 0
458
+ delay_per_env_phase: true
459
+ history_length: 0
460
+ flatten_history_dim: true
461
+ foot_height:
462
+ func: &id008 !!python/name:src.tasks.velocity.mdp.observations.constant_zeros ''
463
+ params:
464
+ size: 4
465
+ noise: null
466
+ clip: null
467
+ scale: null
468
+ delay_min_lag: 0
469
+ delay_max_lag: 0
470
+ delay_per_env: true
471
+ delay_hold_prob: 0.0
472
+ delay_update_period: 0
473
+ delay_per_env_phase: true
474
+ history_length: 0
475
+ flatten_history_dim: true
476
+ foot_air_time:
477
+ func: *id008
478
+ params:
479
+ size: 4
480
+ noise: null
481
+ clip: null
482
+ scale: null
483
+ delay_min_lag: 0
484
+ delay_max_lag: 0
485
+ delay_per_env: true
486
+ delay_hold_prob: 0.0
487
+ delay_update_period: 0
488
+ delay_per_env_phase: true
489
+ history_length: 0
490
+ flatten_history_dim: true
491
+ foot_contact:
492
+ func: *id008
493
+ params:
494
+ size: 4
495
+ noise: null
496
+ clip: null
497
+ scale: null
498
+ delay_min_lag: 0
499
+ delay_max_lag: 0
500
+ delay_per_env: true
501
+ delay_hold_prob: 0.0
502
+ delay_update_period: 0
503
+ delay_per_env_phase: true
504
+ history_length: 0
505
+ flatten_history_dim: true
506
+ foot_contact_forces:
507
+ func: *id008
508
+ params:
509
+ size: 12
510
+ noise: null
511
+ clip: null
512
+ scale: null
513
+ delay_min_lag: 0
514
+ delay_max_lag: 0
515
+ delay_per_env: true
516
+ delay_hold_prob: 0.0
517
+ delay_update_period: 0
518
+ delay_per_env_phase: true
519
+ history_length: 0
520
+ flatten_history_dim: true
521
+ concatenate_terms: true
522
+ concatenate_dim: -1
523
+ enable_corruption: false
524
+ history_length: 1
525
+ flatten_history_dim: true
526
+ nan_policy: disabled
527
+ nan_check_per_term: true
528
+ actions:
529
+ joint_pos:
530
+ entity_name: robot
531
+ clip: null
532
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
533
+ - joint
534
+ actuator_names: !!python/tuple
535
+ - .*
536
+ scale: 0.25
537
+ offset: 0.0
538
+ preserve_order: false
539
+ use_default_offset: true
540
+ hold_duration_s: 1.0
541
+ events:
542
+ reset_base:
543
+ func: !!python/name:mjlab.envs.mdp.events.reset_root_state_uniform ''
544
+ params:
545
+ pose_range:
546
+ x: !!python/tuple
547
+ - -0.2
548
+ - 0.2
549
+ y: !!python/tuple
550
+ - -0.2
551
+ - 0.2
552
+ z: !!python/tuple
553
+ - 0.05
554
+ - 0.05
555
+ roll: !!python/tuple
556
+ - -3.141592653589793
557
+ - 3.141592653589793
558
+ pitch: !!python/tuple
559
+ - -3.141592653589793
560
+ - 3.141592653589793
561
+ yaw: !!python/tuple
562
+ - -3.141592653589793
563
+ - 3.141592653589793
564
+ velocity_range: {}
565
+ mode: reset
566
+ interval_range_s: null
567
+ is_global_time: false
568
+ min_step_count_between_reset: 0
569
+ reset_robot_joints:
570
+ func: !!python/name:mjlab.envs.mdp.events.reset_joints_by_offset ''
571
+ params:
572
+ position_range: !!python/tuple
573
+ - -0.3
574
+ - 0.3
575
+ velocity_range: !!python/tuple
576
+ - -0.05
577
+ - 0.05
578
+ asset_cfg:
579
+ name: robot
580
+ joint_names: !!python/tuple
581
+ - .*
582
+ joint_ids: !!python/object/apply:builtins.slice
583
+ - null
584
+ - null
585
+ - null
586
+ body_names: null
587
+ body_ids: !!python/object/apply:builtins.slice
588
+ - null
589
+ - null
590
+ - null
591
+ geom_names: null
592
+ geom_ids: !!python/object/apply:builtins.slice
593
+ - null
594
+ - null
595
+ - null
596
+ site_names: null
597
+ site_ids: !!python/object/apply:builtins.slice
598
+ - null
599
+ - null
600
+ - null
601
+ actuator_names: null
602
+ actuator_ids: !!python/object/apply:builtins.slice
603
+ - null
604
+ - null
605
+ - null
606
+ tendon_names: null
607
+ tendon_ids: !!python/object/apply:builtins.slice
608
+ - null
609
+ - null
610
+ - null
611
+ camera_names: null
612
+ camera_ids: !!python/object/apply:builtins.slice
613
+ - null
614
+ - null
615
+ - null
616
+ light_names: null
617
+ light_ids: !!python/object/apply:builtins.slice
618
+ - null
619
+ - null
620
+ - null
621
+ material_names: null
622
+ material_ids: !!python/object/apply:builtins.slice
623
+ - null
624
+ - null
625
+ - null
626
+ preserve_order: false
627
+ mode: reset
628
+ interval_range_s: null
629
+ is_global_time: false
630
+ min_step_count_between_reset: 0
631
+ foot_friction:
632
+ func: !!python/name:mjlab.envs.mdp.dr.geom.geom_friction ''
633
+ params:
634
+ asset_cfg:
635
+ name: robot
636
+ joint_names: null
637
+ joint_ids: !!python/object/apply:builtins.slice
638
+ - null
639
+ - null
640
+ - null
641
+ body_names: null
642
+ body_ids: !!python/object/apply:builtins.slice
643
+ - null
644
+ - null
645
+ - null
646
+ geom_names: !!python/tuple
647
+ - fl_wheel_collision
648
+ - fr_wheel_collision
649
+ - bl_wheel_collision
650
+ - br_wheel_collision
651
+ geom_ids: !!python/object/apply:builtins.slice
652
+ - null
653
+ - null
654
+ - null
655
+ site_names: null
656
+ site_ids: !!python/object/apply:builtins.slice
657
+ - null
658
+ - null
659
+ - null
660
+ actuator_names: null
661
+ actuator_ids: !!python/object/apply:builtins.slice
662
+ - null
663
+ - null
664
+ - null
665
+ tendon_names: null
666
+ tendon_ids: !!python/object/apply:builtins.slice
667
+ - null
668
+ - null
669
+ - null
670
+ camera_names: null
671
+ camera_ids: !!python/object/apply:builtins.slice
672
+ - null
673
+ - null
674
+ - null
675
+ light_names: null
676
+ light_ids: !!python/object/apply:builtins.slice
677
+ - null
678
+ - null
679
+ - null
680
+ material_names: null
681
+ material_ids: !!python/object/apply:builtins.slice
682
+ - null
683
+ - null
684
+ - null
685
+ preserve_order: false
686
+ operation: abs
687
+ ranges: !!python/tuple
688
+ - 0.2
689
+ - 3.0
690
+ shared_random: true
691
+ mode: startup
692
+ interval_range_s: null
693
+ is_global_time: false
694
+ min_step_count_between_reset: 0
695
+ encoder_bias:
696
+ func: !!python/name:mjlab.envs.mdp.dr.joint.encoder_bias ''
697
+ params:
698
+ asset_cfg:
699
+ name: robot
700
+ joint_names: null
701
+ joint_ids: !!python/object/apply:builtins.slice
702
+ - null
703
+ - null
704
+ - null
705
+ body_names: null
706
+ body_ids: !!python/object/apply:builtins.slice
707
+ - null
708
+ - null
709
+ - null
710
+ geom_names: null
711
+ geom_ids: !!python/object/apply:builtins.slice
712
+ - null
713
+ - null
714
+ - null
715
+ site_names: null
716
+ site_ids: !!python/object/apply:builtins.slice
717
+ - null
718
+ - null
719
+ - null
720
+ actuator_names: null
721
+ actuator_ids: !!python/object/apply:builtins.slice
722
+ - null
723
+ - null
724
+ - null
725
+ tendon_names: null
726
+ tendon_ids: !!python/object/apply:builtins.slice
727
+ - null
728
+ - null
729
+ - null
730
+ camera_names: null
731
+ camera_ids: !!python/object/apply:builtins.slice
732
+ - null
733
+ - null
734
+ - null
735
+ light_names: null
736
+ light_ids: !!python/object/apply:builtins.slice
737
+ - null
738
+ - null
739
+ - null
740
+ material_names: null
741
+ material_ids: !!python/object/apply:builtins.slice
742
+ - null
743
+ - null
744
+ - null
745
+ preserve_order: false
746
+ bias_range: !!python/tuple
747
+ - -0.04
748
+ - 0.04
749
+ mode: startup
750
+ interval_range_s: null
751
+ is_global_time: false
752
+ min_step_count_between_reset: 0
753
+ base_com:
754
+ func: !!python/name:mjlab.envs.mdp.dr.body.body_com_offset ''
755
+ params:
756
+ asset_cfg:
757
+ name: robot
758
+ joint_names: null
759
+ joint_ids: !!python/object/apply:builtins.slice
760
+ - null
761
+ - null
762
+ - null
763
+ body_names: !!python/tuple
764
+ - base
765
+ body_ids: !!python/object/apply:builtins.slice
766
+ - null
767
+ - null
768
+ - null
769
+ geom_names: null
770
+ geom_ids: !!python/object/apply:builtins.slice
771
+ - null
772
+ - null
773
+ - null
774
+ site_names: null
775
+ site_ids: !!python/object/apply:builtins.slice
776
+ - null
777
+ - null
778
+ - null
779
+ actuator_names: null
780
+ actuator_ids: !!python/object/apply:builtins.slice
781
+ - null
782
+ - null
783
+ - null
784
+ tendon_names: null
785
+ tendon_ids: !!python/object/apply:builtins.slice
786
+ - null
787
+ - null
788
+ - null
789
+ camera_names: null
790
+ camera_ids: !!python/object/apply:builtins.slice
791
+ - null
792
+ - null
793
+ - null
794
+ light_names: null
795
+ light_ids: !!python/object/apply:builtins.slice
796
+ - null
797
+ - null
798
+ - null
799
+ material_names: null
800
+ material_ids: !!python/object/apply:builtins.slice
801
+ - null
802
+ - null
803
+ - null
804
+ preserve_order: false
805
+ operation: add
806
+ ranges:
807
+ 0: !!python/tuple
808
+ - -0.035
809
+ - 0.035
810
+ 1: !!python/tuple
811
+ - -0.02
812
+ - 0.02
813
+ 2: !!python/tuple
814
+ - -0.02
815
+ - 0.02
816
+ mode: startup
817
+ interval_range_s: null
818
+ is_global_time: false
819
+ min_step_count_between_reset: 0
820
+ seed: 42
821
+ sim:
822
+ nconmax: 64
823
+ njmax: 2000
824
+ ls_parallel: true
825
+ contact_sensor_maxmatch: 128
826
+ mujoco:
827
+ timestep: 0.002
828
+ integrator: implicitfast
829
+ impratio: 1.0
830
+ cone: pyramidal
831
+ jacobian: auto
832
+ solver: newton
833
+ iterations: 10
834
+ tolerance: 1.0e-08
835
+ ls_iterations: 20
836
+ ls_tolerance: 0.01
837
+ ccd_iterations: 50
838
+ gravity: !!python/tuple
839
+ - 0.0
840
+ - 0.0
841
+ - -9.81
842
+ multiccd: false
843
+ nan_guard:
844
+ enabled: false
845
+ buffer_size: 100
846
+ output_dir: /tmp/mjlab/nan_dumps
847
+ max_envs_to_dump: 5
848
+ viewer:
849
+ lookat: !!python/tuple
850
+ - 0.0
851
+ - 0.0
852
+ - 0.0
853
+ distance: 1.5
854
+ fovy: null
855
+ elevation: -10.0
856
+ azimuth: 90.0
857
+ origin_type: !!python/object/apply:mjlab.viewer.viewer_config.OriginType
858
+ - 4
859
+ entity_name: robot
860
+ body_name: base
861
+ env_idx: 0
862
+ max_extra_envs: 2
863
+ enable_reflections: true
864
+ enable_shadows: true
865
+ height: 240
866
+ width: 320
867
+ episode_length_s: 8.0
868
+ rewards:
869
+ body_orientation_l2:
870
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_orientation_l2 ''
871
+ params:
872
+ asset_cfg:
873
+ name: robot
874
+ joint_names: null
875
+ joint_ids: !!python/object/apply:builtins.slice
876
+ - null
877
+ - null
878
+ - null
879
+ body_names: !!python/tuple
880
+ - base
881
+ body_ids: !!python/object/apply:builtins.slice
882
+ - null
883
+ - null
884
+ - null
885
+ geom_names: null
886
+ geom_ids: !!python/object/apply:builtins.slice
887
+ - null
888
+ - null
889
+ - null
890
+ site_names: null
891
+ site_ids: !!python/object/apply:builtins.slice
892
+ - null
893
+ - null
894
+ - null
895
+ actuator_names: null
896
+ actuator_ids: !!python/object/apply:builtins.slice
897
+ - null
898
+ - null
899
+ - null
900
+ tendon_names: null
901
+ tendon_ids: !!python/object/apply:builtins.slice
902
+ - null
903
+ - null
904
+ - null
905
+ camera_names: null
906
+ camera_ids: !!python/object/apply:builtins.slice
907
+ - null
908
+ - null
909
+ - null
910
+ light_names: null
911
+ light_ids: !!python/object/apply:builtins.slice
912
+ - null
913
+ - null
914
+ - null
915
+ material_names: null
916
+ material_ids: !!python/object/apply:builtins.slice
917
+ - null
918
+ - null
919
+ - null
920
+ preserve_order: false
921
+ weight: -0.1
922
+ pose:
923
+ func: !!python/name:src.tasks.velocity.mdp.rewards.gravity_gated_variable_posture ''
924
+ params:
925
+ asset_cfg:
926
+ name: robot
927
+ joint_names: !!python/tuple
928
+ - ^(fl|fr|bl|br)_(hip|thigh|calf)_joint$
929
+ - ^arm_(yaw|thigh|calf)_joint$
930
+ joint_ids: !!python/object/apply:builtins.slice
931
+ - null
932
+ - null
933
+ - null
934
+ body_names: null
935
+ body_ids: !!python/object/apply:builtins.slice
936
+ - null
937
+ - null
938
+ - null
939
+ geom_names: null
940
+ geom_ids: !!python/object/apply:builtins.slice
941
+ - null
942
+ - null
943
+ - null
944
+ site_names: null
945
+ site_ids: !!python/object/apply:builtins.slice
946
+ - null
947
+ - null
948
+ - null
949
+ actuator_names: null
950
+ actuator_ids: !!python/object/apply:builtins.slice
951
+ - null
952
+ - null
953
+ - null
954
+ tendon_names: null
955
+ tendon_ids: !!python/object/apply:builtins.slice
956
+ - null
957
+ - null
958
+ - null
959
+ camera_names: null
960
+ camera_ids: !!python/object/apply:builtins.slice
961
+ - null
962
+ - null
963
+ - null
964
+ light_names: null
965
+ light_ids: !!python/object/apply:builtins.slice
966
+ - null
967
+ - null
968
+ - null
969
+ material_names: null
970
+ material_ids: !!python/object/apply:builtins.slice
971
+ - null
972
+ - null
973
+ - null
974
+ preserve_order: false
975
+ command_name: twist
976
+ std_standing:
977
+ ^(fl|fr|bl|br)_hip_joint$: 0.08
978
+ ^(fl|fr|bl|br)_thigh_joint$: 0.15
979
+ ^(fl|fr|bl|br)_calf_joint$: 0.2
980
+ ^arm_yaw_joint$: 0.2
981
+ ^arm_thigh_joint$: 0.25
982
+ ^arm_calf_joint$: 1.0
983
+ std_walking:
984
+ ^(fl|fr|bl|br)_hip_joint$: 0.12
985
+ ^(fl|fr|bl|br)_thigh_joint$: 0.25
986
+ ^(fl|fr|bl|br)_calf_joint$: 0.3
987
+ ^arm_yaw_joint$: 0.28
988
+ ^arm_thigh_joint$: 0.32
989
+ ^arm_calf_joint$: 1.0
990
+ std_running:
991
+ ^(fl|fr|bl|br)_hip_joint$: 0.12
992
+ ^(fl|fr|bl|br)_thigh_joint$: 0.3
993
+ ^(fl|fr|bl|br)_calf_joint$: 0.35
994
+ ^arm_yaw_joint$: 0.32
995
+ ^arm_thigh_joint$: 0.36
996
+ ^arm_calf_joint$: 1.0
997
+ walking_threshold: 0.1
998
+ running_threshold: 1.5
999
+ gravity_z_threshold: -0.75
1000
+ weight: 10.0
1001
+ body_ang_vel:
1002
+ func: !!python/name:src.tasks.velocity.mdp.rewards.gravity_gated_body_ang_vel_penalty ''
1003
+ params:
1004
+ asset_cfg:
1005
+ name: robot
1006
+ joint_names: null
1007
+ joint_ids: !!python/object/apply:builtins.slice
1008
+ - null
1009
+ - null
1010
+ - null
1011
+ body_names: !!python/tuple
1012
+ - base
1013
+ body_ids: !!python/object/apply:builtins.slice
1014
+ - null
1015
+ - null
1016
+ - null
1017
+ geom_names: null
1018
+ geom_ids: !!python/object/apply:builtins.slice
1019
+ - null
1020
+ - null
1021
+ - null
1022
+ site_names: null
1023
+ site_ids: !!python/object/apply:builtins.slice
1024
+ - null
1025
+ - null
1026
+ - null
1027
+ actuator_names: null
1028
+ actuator_ids: !!python/object/apply:builtins.slice
1029
+ - null
1030
+ - null
1031
+ - null
1032
+ tendon_names: null
1033
+ tendon_ids: !!python/object/apply:builtins.slice
1034
+ - null
1035
+ - null
1036
+ - null
1037
+ camera_names: null
1038
+ camera_ids: !!python/object/apply:builtins.slice
1039
+ - null
1040
+ - null
1041
+ - null
1042
+ light_names: null
1043
+ light_ids: !!python/object/apply:builtins.slice
1044
+ - null
1045
+ - null
1046
+ - null
1047
+ material_names: null
1048
+ material_ids: !!python/object/apply:builtins.slice
1049
+ - null
1050
+ - null
1051
+ - null
1052
+ preserve_order: false
1053
+ gravity_z_threshold: 1.0
1054
+ weight: -0.2
1055
+ angular_momentum:
1056
+ func: !!python/name:src.tasks.velocity.mdp.rewards.gravity_gated_angular_momentum_penalty ''
1057
+ params:
1058
+ sensor_name: robot/root_angmom
1059
+ gravity_z_threshold: -0.4
1060
+ weight: -0.2
1061
+ is_terminated:
1062
+ func: !!python/name:mjlab.envs.mdp.rewards.is_terminated ''
1063
+ params: {}
1064
+ weight: -200.0
1065
+ joint_acc_l2:
1066
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_acc_l2 ''
1067
+ params: {}
1068
+ weight: -2.5e-07
1069
+ joint_pos_limits:
1070
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_pos_limits ''
1071
+ params: {}
1072
+ weight: -10.0
1073
+ action_rate_l2:
1074
+ func: !!python/name:mjlab.envs.mdp.rewards.action_rate_l2 ''
1075
+ params: {}
1076
+ weight: -0.25
1077
+ joint_vel_l2:
1078
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_vel_l2 ''
1079
+ params: {}
1080
+ weight: -0.005
1081
+ recovery_progress:
1082
+ func: !!python/name:src.tasks.velocity.mdp.rewards.recovery_progress ''
1083
+ params:
1084
+ asset_cfg:
1085
+ name: robot
1086
+ joint_names: null
1087
+ joint_ids: !!python/object/apply:builtins.slice
1088
+ - null
1089
+ - null
1090
+ - null
1091
+ body_names: null
1092
+ body_ids: !!python/object/apply:builtins.slice
1093
+ - null
1094
+ - null
1095
+ - null
1096
+ geom_names: null
1097
+ geom_ids: !!python/object/apply:builtins.slice
1098
+ - null
1099
+ - null
1100
+ - null
1101
+ site_names: null
1102
+ site_ids: !!python/object/apply:builtins.slice
1103
+ - null
1104
+ - null
1105
+ - null
1106
+ actuator_names: null
1107
+ actuator_ids: !!python/object/apply:builtins.slice
1108
+ - null
1109
+ - null
1110
+ - null
1111
+ tendon_names: null
1112
+ tendon_ids: !!python/object/apply:builtins.slice
1113
+ - null
1114
+ - null
1115
+ - null
1116
+ camera_names: null
1117
+ camera_ids: !!python/object/apply:builtins.slice
1118
+ - null
1119
+ - null
1120
+ - null
1121
+ light_names: null
1122
+ light_ids: !!python/object/apply:builtins.slice
1123
+ - null
1124
+ - null
1125
+ - null
1126
+ material_names: null
1127
+ material_ids: !!python/object/apply:builtins.slice
1128
+ - null
1129
+ - null
1130
+ - null
1131
+ preserve_order: false
1132
+ weight: 10.0
1133
+ nonfoot_contact:
1134
+ func: !!python/name:mjlab.tasks.velocity.mdp.terminations.illegal_contact ''
1135
+ params:
1136
+ sensor_name: nonfoot_ground_touch
1137
+ force_threshold: 0.5
1138
+ weight: -0.5
1139
+ terminations:
1140
+ time_out:
1141
+ func: !!python/name:mjlab.envs.mdp.terminations.time_out ''
1142
+ params: {}
1143
+ time_out: true
1144
+ commands:
1145
+ twist:
1146
+ resampling_time_range: !!python/tuple
1147
+ - 10.0
1148
+ - 10.0
1149
+ debug_vis: true
1150
+ entity_name: robot
1151
+ heading_command: false
1152
+ heading_control_stiffness: 0.5
1153
+ rel_standing_envs: 1.0
1154
+ rel_heading_envs: 0.0
1155
+ init_velocity_prob: 0.0
1156
+ ranges:
1157
+ lin_vel_x: !!python/tuple
1158
+ - 0.0
1159
+ - 0.0
1160
+ lin_vel_y: !!python/tuple
1161
+ - 0.0
1162
+ - 0.0
1163
+ ang_vel_z: !!python/tuple
1164
+ - 0.0
1165
+ - 0.0
1166
+ heading: null
1167
+ viz:
1168
+ z_offset: 0.2
1169
+ scale: 0.5
1170
+ curriculum: {}
1171
+ metrics:
1172
+ mean_action_acc:
1173
+ func: !!python/name:mjlab.envs.mdp.metrics.mean_action_acc ''
1174
+ params: {}
1175
+ is_finite_horizon: false
1176
+ scale_rewards_by_dt: true
mini2sw_turn/policy.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1e3e190473d8be83fb21ca58f16c6be445627d9969759c3d597b7338cfb6b917
3
+ size 783960
mini2sw_walk/model_1499.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d1bec321efc68b35560b980c9454af626486cb5c9d01ab6321b89d3411be15a
3
+ size 4857461
mini2sw_walk/params/agent.yaml ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ seed: 42
2
+ num_steps_per_env: 24
3
+ max_iterations: 1500
4
+ obs_groups:
5
+ actor: !!python/tuple
6
+ - actor
7
+ critic: !!python/tuple
8
+ - critic
9
+ save_interval: 100
10
+ experiment_name: mini2sw_velocity_walk
11
+ run_name: ''
12
+ logger: tensorboard
13
+ wandb_project: mjlab
14
+ wandb_tags: !!python/tuple []
15
+ resume: false
16
+ load_run: .*
17
+ load_checkpoint: model_.*.pt
18
+ clip_actions: null
19
+ upload_model: true
20
+ class_name: OnPolicyRunner
21
+ actor:
22
+ hidden_dims: !!python/tuple
23
+ - 512
24
+ - 256
25
+ - 128
26
+ activation: elu
27
+ obs_normalization: true
28
+ distribution_cfg:
29
+ init_std: 1.0
30
+ std_type: scalar
31
+ critic:
32
+ hidden_dims: !!python/tuple
33
+ - 512
34
+ - 256
35
+ - 128
36
+ activation: elu
37
+ obs_normalization: true
38
+ algorithm:
39
+ num_learning_epochs: 5
40
+ num_mini_batches: 4
41
+ learning_rate: 0.001
42
+ schedule: adaptive
43
+ gamma: 0.99
44
+ lam: 0.95
45
+ entropy_coef: 0.01
46
+ desired_kl: 0.01
47
+ max_grad_norm: 1.0
48
+ value_loss_coef: 1.0
49
+ use_clipped_value_loss: true
50
+ clip_param: 0.2
51
+ normalize_advantage_per_mini_batch: false
52
+ optimizer: adam
53
+ rnd_cfg: null
54
+ symmetry_cfg: null
55
+ multi_gpu: null
mini2sw_walk/params/env.yaml ADDED
@@ -0,0 +1,1423 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ decimation: 5
2
+ scene:
3
+ num_envs: 4096
4
+ env_spacing: 2.0
5
+ terrain:
6
+ init_state:
7
+ pos: !!python/tuple
8
+ - 0.0
9
+ - 0.0
10
+ - 0.0
11
+ rot: !!python/tuple
12
+ - 1.0
13
+ - 0.0
14
+ - 0.0
15
+ - 0.0
16
+ lin_vel: !!python/tuple
17
+ - 0.0
18
+ - 0.0
19
+ - 0.0
20
+ ang_vel: !!python/tuple
21
+ - 0.0
22
+ - 0.0
23
+ - 0.0
24
+ joint_pos:
25
+ .*: 0.0
26
+ joint_vel:
27
+ .*: 0.0
28
+ spec_fn: !!python/name:mjlab.entity.entity.%3Clambda%3E ''
29
+ articulation: null
30
+ sort_actuators: false
31
+ lights: !!python/tuple
32
+ - name: sun
33
+ body: world
34
+ mode: fixed
35
+ target: null
36
+ type: directional
37
+ castshadow: true
38
+ pos: !!python/tuple
39
+ - 0.0
40
+ - 0.0
41
+ - 1.5
42
+ dir: !!python/tuple
43
+ - 0.0
44
+ - 0.0
45
+ - -1.0
46
+ cutoff: 45.0
47
+ exponent: 10.0
48
+ cameras: !!python/tuple []
49
+ textures: !!python/tuple
50
+ - name: groundplane
51
+ type: 2d
52
+ builtin: checker
53
+ rgb1: !!python/tuple
54
+ - 0.2
55
+ - 0.3
56
+ - 0.4
57
+ rgb2: !!python/tuple
58
+ - 0.1
59
+ - 0.2
60
+ - 0.3
61
+ width: 300
62
+ height: 300
63
+ mark: edge
64
+ markrgb: !!python/tuple
65
+ - 0.8
66
+ - 0.8
67
+ - 0.8
68
+ materials: !!python/tuple
69
+ - name: groundplane
70
+ rgba: !!python/tuple
71
+ - 1.0
72
+ - 1.0
73
+ - 1.0
74
+ - 1.0
75
+ texuniform: true
76
+ texrepeat: !!python/tuple
77
+ - 4.0
78
+ - 4.0
79
+ reflectance: 0.2
80
+ texture: groundplane
81
+ geom_names_expr: !!python/tuple
82
+ - terrain$
83
+ collisions: !!python/tuple []
84
+ terrain_type: plane
85
+ terrain_generator: null
86
+ env_spacing: 2.0
87
+ max_init_terrain_level: 5
88
+ num_envs: 4096
89
+ entities:
90
+ robot:
91
+ init_state:
92
+ pos: !!python/tuple
93
+ - 0.0
94
+ - 0.0
95
+ - 0.2
96
+ rot: !!python/tuple
97
+ - 1.0
98
+ - 0.0
99
+ - 0.0
100
+ - 0.0
101
+ lin_vel: !!python/tuple
102
+ - 0.0
103
+ - 0.0
104
+ - 0.0
105
+ ang_vel: !!python/tuple
106
+ - 0.0
107
+ - 0.0
108
+ - 0.0
109
+ joint_pos:
110
+ ^(fl|fr|bl|br)_thigh_joint$: 1
111
+ ^(fl|fr|bl|br)_calf_joint$: 0.0
112
+ ^(fl|fr|bl|br)_hip_joint$: 0.0
113
+ arm_yaw_joint: 0.0
114
+ arm_thigh_joint: -1.57
115
+ arm_calf_joint: 1.35
116
+ joint_vel:
117
+ .*: 0.0
118
+ spec_fn: !!python/name:src.assets.robots.mini2sw.mini2sw_constants.get_spec ''
119
+ articulation:
120
+ actuators: !!python/tuple
121
+ - target_names_expr: !!python/tuple
122
+ - .*
123
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
124
+ - joint
125
+ armature: 0.0
126
+ frictionloss: 0.0
127
+ base_cfg:
128
+ target_names_expr: !!python/tuple
129
+ - .*
130
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
131
+ - joint
132
+ armature: 0.0
133
+ frictionloss: 0.0
134
+ delay_target: position
135
+ delay_min_lag: 1
136
+ delay_max_lag: 2
137
+ delay_hold_prob: 0.0
138
+ delay_update_period: 0
139
+ delay_per_env_phase: true
140
+ soft_joint_pos_limit_factor: 0.9
141
+ sort_actuators: false
142
+ lights: !!python/tuple []
143
+ cameras: !!python/tuple []
144
+ textures: !!python/tuple []
145
+ materials: !!python/tuple []
146
+ collisions: !!python/tuple
147
+ - geom_names_expr: !!python/tuple
148
+ - ^(fl|fr|bl|br)_wheel_collision$
149
+ contype: 0
150
+ conaffinity: 1
151
+ condim: 3
152
+ priority: 1
153
+ friction: !!python/tuple
154
+ - 0.6
155
+ solref: null
156
+ solimp: !!python/tuple
157
+ - 0.9
158
+ - 0.95
159
+ - 0.023
160
+ disable_other_geoms: true
161
+ sensors: !!python/tuple
162
+ - name: feet_ground_contact
163
+ primary:
164
+ mode: geom
165
+ pattern: !!python/tuple
166
+ - fl_wheel_collision
167
+ - fr_wheel_collision
168
+ - bl_wheel_collision
169
+ - br_wheel_collision
170
+ entity: robot
171
+ exclude: !!python/tuple []
172
+ secondary:
173
+ mode: body
174
+ pattern: terrain
175
+ entity: null
176
+ exclude: !!python/tuple []
177
+ fields: !!python/tuple
178
+ - found
179
+ - force
180
+ reduce: netforce
181
+ num_slots: 1
182
+ secondary_policy: first
183
+ track_air_time: true
184
+ global_frame: false
185
+ history_length: 0
186
+ debug: false
187
+ - name: nonfoot_ground_touch
188
+ primary:
189
+ mode: geom
190
+ pattern: .*
191
+ entity: robot
192
+ exclude: !!python/tuple
193
+ - fl_wheel_collision
194
+ - fr_wheel_collision
195
+ - bl_wheel_collision
196
+ - br_wheel_collision
197
+ secondary:
198
+ mode: body
199
+ pattern: terrain
200
+ entity: null
201
+ exclude: !!python/tuple []
202
+ fields: !!python/tuple
203
+ - found
204
+ - force
205
+ reduce: none
206
+ num_slots: 1
207
+ secondary_policy: first
208
+ track_air_time: false
209
+ global_frame: false
210
+ history_length: 4
211
+ debug: false
212
+ extent: 2.0
213
+ spec_fn: null
214
+ observations:
215
+ actor:
216
+ terms:
217
+ base_ang_vel:
218
+ func: &id001 !!python/name:mjlab.envs.mdp.observations.builtin_sensor ''
219
+ params:
220
+ sensor_name: robot/imu_ang_vel
221
+ noise:
222
+ operation: add
223
+ _tensor_cache: {}
224
+ n_min: -1.0
225
+ n_max: 1.0
226
+ clip: null
227
+ scale: null
228
+ delay_min_lag: 0
229
+ delay_max_lag: 0
230
+ delay_per_env: true
231
+ delay_hold_prob: 0.0
232
+ delay_update_period: 0
233
+ delay_per_env_phase: true
234
+ history_length: 0
235
+ flatten_history_dim: true
236
+ projected_gravity:
237
+ func: &id002 !!python/name:mjlab.envs.mdp.observations.projected_gravity ''
238
+ params: {}
239
+ noise:
240
+ operation: add
241
+ _tensor_cache: {}
242
+ n_min: -0.1
243
+ n_max: 0.1
244
+ clip: null
245
+ scale: null
246
+ delay_min_lag: 0
247
+ delay_max_lag: 0
248
+ delay_per_env: true
249
+ delay_hold_prob: 0.0
250
+ delay_update_period: 0
251
+ delay_per_env_phase: true
252
+ history_length: 0
253
+ flatten_history_dim: true
254
+ command:
255
+ func: &id003 !!python/name:mjlab.envs.mdp.observations.generated_commands ''
256
+ params:
257
+ command_name: twist
258
+ noise: null
259
+ clip: null
260
+ scale: null
261
+ delay_min_lag: 0
262
+ delay_max_lag: 0
263
+ delay_per_env: true
264
+ delay_hold_prob: 0.0
265
+ delay_update_period: 0
266
+ delay_per_env_phase: true
267
+ history_length: 0
268
+ flatten_history_dim: true
269
+ phase:
270
+ func: &id004 !!python/name:src.tasks.velocity.mdp.observations.phase ''
271
+ params:
272
+ period: 0.4
273
+ command_name: twist
274
+ noise: null
275
+ clip: null
276
+ scale: null
277
+ delay_min_lag: 0
278
+ delay_max_lag: 0
279
+ delay_per_env: true
280
+ delay_hold_prob: 0.0
281
+ delay_update_period: 0
282
+ delay_per_env_phase: true
283
+ history_length: 0
284
+ flatten_history_dim: true
285
+ joint_pos:
286
+ func: &id005 !!python/name:mjlab.envs.mdp.observations.joint_pos_rel ''
287
+ params: {}
288
+ noise:
289
+ operation: add
290
+ _tensor_cache: {}
291
+ n_min: -0.1
292
+ n_max: 0.1
293
+ clip: null
294
+ scale: null
295
+ delay_min_lag: 1
296
+ delay_max_lag: 2
297
+ delay_per_env: true
298
+ delay_hold_prob: 0.0
299
+ delay_update_period: 0
300
+ delay_per_env_phase: true
301
+ history_length: 0
302
+ flatten_history_dim: true
303
+ joint_vel:
304
+ func: &id006 !!python/name:mjlab.envs.mdp.observations.joint_vel_rel ''
305
+ params: {}
306
+ noise:
307
+ operation: add
308
+ _tensor_cache: {}
309
+ n_min: -2.0
310
+ n_max: 2.0
311
+ clip: null
312
+ scale: null
313
+ delay_min_lag: 1
314
+ delay_max_lag: 2
315
+ delay_per_env: true
316
+ delay_hold_prob: 0.0
317
+ delay_update_period: 0
318
+ delay_per_env_phase: true
319
+ history_length: 0
320
+ flatten_history_dim: true
321
+ actions:
322
+ func: &id007 !!python/name:mjlab.envs.mdp.observations.last_action ''
323
+ params: {}
324
+ noise: null
325
+ clip: null
326
+ scale: null
327
+ delay_min_lag: 0
328
+ delay_max_lag: 0
329
+ delay_per_env: true
330
+ delay_hold_prob: 0.0
331
+ delay_update_period: 0
332
+ delay_per_env_phase: true
333
+ history_length: 0
334
+ flatten_history_dim: true
335
+ concatenate_terms: true
336
+ concatenate_dim: -1
337
+ enable_corruption: true
338
+ history_length: 1
339
+ flatten_history_dim: true
340
+ nan_policy: disabled
341
+ nan_check_per_term: true
342
+ critic:
343
+ terms:
344
+ base_ang_vel:
345
+ func: *id001
346
+ params:
347
+ sensor_name: robot/imu_ang_vel
348
+ noise:
349
+ operation: add
350
+ _tensor_cache: {}
351
+ n_min: -1.0
352
+ n_max: 1.0
353
+ clip: null
354
+ scale: null
355
+ delay_min_lag: 0
356
+ delay_max_lag: 0
357
+ delay_per_env: true
358
+ delay_hold_prob: 0.0
359
+ delay_update_period: 0
360
+ delay_per_env_phase: true
361
+ history_length: 0
362
+ flatten_history_dim: true
363
+ projected_gravity:
364
+ func: *id002
365
+ params: {}
366
+ noise:
367
+ operation: add
368
+ _tensor_cache: {}
369
+ n_min: -0.1
370
+ n_max: 0.1
371
+ clip: null
372
+ scale: null
373
+ delay_min_lag: 0
374
+ delay_max_lag: 0
375
+ delay_per_env: true
376
+ delay_hold_prob: 0.0
377
+ delay_update_period: 0
378
+ delay_per_env_phase: true
379
+ history_length: 0
380
+ flatten_history_dim: true
381
+ command:
382
+ func: *id003
383
+ params:
384
+ command_name: twist
385
+ noise: null
386
+ clip: null
387
+ scale: null
388
+ delay_min_lag: 0
389
+ delay_max_lag: 0
390
+ delay_per_env: true
391
+ delay_hold_prob: 0.0
392
+ delay_update_period: 0
393
+ delay_per_env_phase: true
394
+ history_length: 0
395
+ flatten_history_dim: true
396
+ phase:
397
+ func: *id004
398
+ params:
399
+ period: 0.4
400
+ command_name: twist
401
+ noise: null
402
+ clip: null
403
+ scale: null
404
+ delay_min_lag: 0
405
+ delay_max_lag: 0
406
+ delay_per_env: true
407
+ delay_hold_prob: 0.0
408
+ delay_update_period: 0
409
+ delay_per_env_phase: true
410
+ history_length: 0
411
+ flatten_history_dim: true
412
+ joint_pos:
413
+ func: *id005
414
+ params: {}
415
+ noise:
416
+ operation: add
417
+ _tensor_cache: {}
418
+ n_min: -0.1
419
+ n_max: 0.1
420
+ clip: null
421
+ scale: null
422
+ delay_min_lag: 1
423
+ delay_max_lag: 2
424
+ delay_per_env: true
425
+ delay_hold_prob: 0.0
426
+ delay_update_period: 0
427
+ delay_per_env_phase: true
428
+ history_length: 0
429
+ flatten_history_dim: true
430
+ joint_vel:
431
+ func: *id006
432
+ params: {}
433
+ noise:
434
+ operation: add
435
+ _tensor_cache: {}
436
+ n_min: -2.0
437
+ n_max: 2.0
438
+ clip: null
439
+ scale: null
440
+ delay_min_lag: 1
441
+ delay_max_lag: 2
442
+ delay_per_env: true
443
+ delay_hold_prob: 0.0
444
+ delay_update_period: 0
445
+ delay_per_env_phase: true
446
+ history_length: 0
447
+ flatten_history_dim: true
448
+ actions:
449
+ func: *id007
450
+ params: {}
451
+ noise: null
452
+ clip: null
453
+ scale: null
454
+ delay_min_lag: 0
455
+ delay_max_lag: 0
456
+ delay_per_env: true
457
+ delay_hold_prob: 0.0
458
+ delay_update_period: 0
459
+ delay_per_env_phase: true
460
+ history_length: 0
461
+ flatten_history_dim: true
462
+ base_lin_vel:
463
+ func: *id001
464
+ params:
465
+ sensor_name: robot/imu_lin_vel
466
+ noise:
467
+ operation: add
468
+ _tensor_cache: {}
469
+ n_min: -1.0
470
+ n_max: 1.0
471
+ clip: null
472
+ scale: null
473
+ delay_min_lag: 0
474
+ delay_max_lag: 0
475
+ delay_per_env: true
476
+ delay_hold_prob: 0.0
477
+ delay_update_period: 0
478
+ delay_per_env_phase: true
479
+ history_length: 0
480
+ flatten_history_dim: true
481
+ foot_height:
482
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_height ''
483
+ params:
484
+ asset_cfg:
485
+ name: robot
486
+ joint_names: null
487
+ joint_ids: !!python/object/apply:builtins.slice
488
+ - null
489
+ - null
490
+ - null
491
+ body_names: null
492
+ body_ids: !!python/object/apply:builtins.slice
493
+ - null
494
+ - null
495
+ - null
496
+ geom_names: null
497
+ geom_ids: !!python/object/apply:builtins.slice
498
+ - null
499
+ - null
500
+ - null
501
+ site_names: !!python/tuple
502
+ - fl
503
+ - fr
504
+ - bl
505
+ - br
506
+ site_ids: !!python/object/apply:builtins.slice
507
+ - null
508
+ - null
509
+ - null
510
+ actuator_names: null
511
+ actuator_ids: !!python/object/apply:builtins.slice
512
+ - null
513
+ - null
514
+ - null
515
+ tendon_names: null
516
+ tendon_ids: !!python/object/apply:builtins.slice
517
+ - null
518
+ - null
519
+ - null
520
+ camera_names: null
521
+ camera_ids: !!python/object/apply:builtins.slice
522
+ - null
523
+ - null
524
+ - null
525
+ light_names: null
526
+ light_ids: !!python/object/apply:builtins.slice
527
+ - null
528
+ - null
529
+ - null
530
+ material_names: null
531
+ material_ids: !!python/object/apply:builtins.slice
532
+ - null
533
+ - null
534
+ - null
535
+ preserve_order: false
536
+ noise: null
537
+ clip: null
538
+ scale: null
539
+ delay_min_lag: 0
540
+ delay_max_lag: 0
541
+ delay_per_env: true
542
+ delay_hold_prob: 0.0
543
+ delay_update_period: 0
544
+ delay_per_env_phase: true
545
+ history_length: 0
546
+ flatten_history_dim: true
547
+ foot_air_time:
548
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_air_time ''
549
+ params:
550
+ sensor_name: feet_ground_contact
551
+ noise: null
552
+ clip: null
553
+ scale: null
554
+ delay_min_lag: 0
555
+ delay_max_lag: 0
556
+ delay_per_env: true
557
+ delay_hold_prob: 0.0
558
+ delay_update_period: 0
559
+ delay_per_env_phase: true
560
+ history_length: 0
561
+ flatten_history_dim: true
562
+ foot_contact:
563
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_contact ''
564
+ params:
565
+ sensor_name: feet_ground_contact
566
+ noise: null
567
+ clip: null
568
+ scale: null
569
+ delay_min_lag: 0
570
+ delay_max_lag: 0
571
+ delay_per_env: true
572
+ delay_hold_prob: 0.0
573
+ delay_update_period: 0
574
+ delay_per_env_phase: true
575
+ history_length: 0
576
+ flatten_history_dim: true
577
+ foot_contact_forces:
578
+ func: !!python/name:src.tasks.velocity.mdp.observations.foot_contact_forces ''
579
+ params:
580
+ sensor_name: feet_ground_contact
581
+ noise: null
582
+ clip: null
583
+ scale: null
584
+ delay_min_lag: 0
585
+ delay_max_lag: 0
586
+ delay_per_env: true
587
+ delay_hold_prob: 0.0
588
+ delay_update_period: 0
589
+ delay_per_env_phase: true
590
+ history_length: 0
591
+ flatten_history_dim: true
592
+ concatenate_terms: true
593
+ concatenate_dim: -1
594
+ enable_corruption: false
595
+ history_length: 1
596
+ flatten_history_dim: true
597
+ nan_policy: disabled
598
+ nan_check_per_term: true
599
+ actions:
600
+ joint_pos:
601
+ entity_name: robot
602
+ clip: null
603
+ transmission_type: !!python/object/apply:mjlab.actuator.actuator.TransmissionType
604
+ - joint
605
+ actuator_names: !!python/tuple
606
+ - .*
607
+ scale: 0.25
608
+ offset: 0.0
609
+ preserve_order: false
610
+ use_default_offset: true
611
+ events:
612
+ reset_base:
613
+ func: !!python/name:mjlab.envs.mdp.events.reset_root_state_uniform ''
614
+ params:
615
+ pose_range:
616
+ x: !!python/tuple
617
+ - -0.5
618
+ - 0.5
619
+ y: !!python/tuple
620
+ - -0.5
621
+ - 0.5
622
+ z: !!python/tuple
623
+ - 0.0
624
+ - 0.0
625
+ yaw: !!python/tuple
626
+ - -3.14
627
+ - 3.14
628
+ velocity_range: {}
629
+ mode: reset
630
+ interval_range_s: null
631
+ is_global_time: false
632
+ min_step_count_between_reset: 0
633
+ reset_robot_joints:
634
+ func: !!python/name:mjlab.envs.mdp.events.reset_joints_by_offset ''
635
+ params:
636
+ position_range: !!python/tuple
637
+ - -0.0
638
+ - 0.0
639
+ velocity_range: !!python/tuple
640
+ - -0.0
641
+ - 0.0
642
+ asset_cfg:
643
+ name: robot
644
+ joint_names: !!python/tuple
645
+ - .*
646
+ joint_ids: !!python/object/apply:builtins.slice
647
+ - null
648
+ - null
649
+ - null
650
+ body_names: null
651
+ body_ids: !!python/object/apply:builtins.slice
652
+ - null
653
+ - null
654
+ - null
655
+ geom_names: null
656
+ geom_ids: !!python/object/apply:builtins.slice
657
+ - null
658
+ - null
659
+ - null
660
+ site_names: null
661
+ site_ids: !!python/object/apply:builtins.slice
662
+ - null
663
+ - null
664
+ - null
665
+ actuator_names: null
666
+ actuator_ids: !!python/object/apply:builtins.slice
667
+ - null
668
+ - null
669
+ - null
670
+ tendon_names: null
671
+ tendon_ids: !!python/object/apply:builtins.slice
672
+ - null
673
+ - null
674
+ - null
675
+ camera_names: null
676
+ camera_ids: !!python/object/apply:builtins.slice
677
+ - null
678
+ - null
679
+ - null
680
+ light_names: null
681
+ light_ids: !!python/object/apply:builtins.slice
682
+ - null
683
+ - null
684
+ - null
685
+ material_names: null
686
+ material_ids: !!python/object/apply:builtins.slice
687
+ - null
688
+ - null
689
+ - null
690
+ preserve_order: false
691
+ mode: reset
692
+ interval_range_s: null
693
+ is_global_time: false
694
+ min_step_count_between_reset: 0
695
+ push_robot:
696
+ func: !!python/name:mjlab.envs.mdp.events.push_by_setting_velocity ''
697
+ params:
698
+ velocity_range:
699
+ x: !!python/tuple
700
+ - -0.5
701
+ - 0.5
702
+ y: !!python/tuple
703
+ - -0.5
704
+ - 0.5
705
+ z: !!python/tuple
706
+ - -0.4
707
+ - 0.4
708
+ roll: !!python/tuple
709
+ - -0.52
710
+ - 0.52
711
+ pitch: !!python/tuple
712
+ - -0.52
713
+ - 0.52
714
+ yaw: !!python/tuple
715
+ - -0.78
716
+ - 0.78
717
+ mode: interval
718
+ interval_range_s: !!python/tuple
719
+ - 5.0
720
+ - 6.0
721
+ is_global_time: false
722
+ min_step_count_between_reset: 0
723
+ foot_friction:
724
+ func: !!python/name:mjlab.envs.mdp.dr.geom.geom_friction ''
725
+ params:
726
+ asset_cfg:
727
+ name: robot
728
+ joint_names: null
729
+ joint_ids: !!python/object/apply:builtins.slice
730
+ - null
731
+ - null
732
+ - null
733
+ body_names: null
734
+ body_ids: !!python/object/apply:builtins.slice
735
+ - null
736
+ - null
737
+ - null
738
+ geom_names: !!python/tuple
739
+ - fl_wheel_collision
740
+ - fr_wheel_collision
741
+ - bl_wheel_collision
742
+ - br_wheel_collision
743
+ geom_ids: !!python/object/apply:builtins.slice
744
+ - null
745
+ - null
746
+ - null
747
+ site_names: null
748
+ site_ids: !!python/object/apply:builtins.slice
749
+ - null
750
+ - null
751
+ - null
752
+ actuator_names: null
753
+ actuator_ids: !!python/object/apply:builtins.slice
754
+ - null
755
+ - null
756
+ - null
757
+ tendon_names: null
758
+ tendon_ids: !!python/object/apply:builtins.slice
759
+ - null
760
+ - null
761
+ - null
762
+ camera_names: null
763
+ camera_ids: !!python/object/apply:builtins.slice
764
+ - null
765
+ - null
766
+ - null
767
+ light_names: null
768
+ light_ids: !!python/object/apply:builtins.slice
769
+ - null
770
+ - null
771
+ - null
772
+ material_names: null
773
+ material_ids: !!python/object/apply:builtins.slice
774
+ - null
775
+ - null
776
+ - null
777
+ preserve_order: false
778
+ operation: abs
779
+ ranges: !!python/tuple
780
+ - 0.2
781
+ - 3.0
782
+ shared_random: true
783
+ mode: startup
784
+ interval_range_s: null
785
+ is_global_time: false
786
+ min_step_count_between_reset: 0
787
+ encoder_bias:
788
+ func: !!python/name:mjlab.envs.mdp.dr.joint.encoder_bias ''
789
+ params:
790
+ asset_cfg:
791
+ name: robot
792
+ joint_names: null
793
+ joint_ids: !!python/object/apply:builtins.slice
794
+ - null
795
+ - null
796
+ - null
797
+ body_names: null
798
+ body_ids: !!python/object/apply:builtins.slice
799
+ - null
800
+ - null
801
+ - null
802
+ geom_names: null
803
+ geom_ids: !!python/object/apply:builtins.slice
804
+ - null
805
+ - null
806
+ - null
807
+ site_names: null
808
+ site_ids: !!python/object/apply:builtins.slice
809
+ - null
810
+ - null
811
+ - null
812
+ actuator_names: null
813
+ actuator_ids: !!python/object/apply:builtins.slice
814
+ - null
815
+ - null
816
+ - null
817
+ tendon_names: null
818
+ tendon_ids: !!python/object/apply:builtins.slice
819
+ - null
820
+ - null
821
+ - null
822
+ camera_names: null
823
+ camera_ids: !!python/object/apply:builtins.slice
824
+ - null
825
+ - null
826
+ - null
827
+ light_names: null
828
+ light_ids: !!python/object/apply:builtins.slice
829
+ - null
830
+ - null
831
+ - null
832
+ material_names: null
833
+ material_ids: !!python/object/apply:builtins.slice
834
+ - null
835
+ - null
836
+ - null
837
+ preserve_order: false
838
+ bias_range: !!python/tuple
839
+ - -0.04
840
+ - 0.04
841
+ mode: startup
842
+ interval_range_s: null
843
+ is_global_time: false
844
+ min_step_count_between_reset: 0
845
+ base_com:
846
+ func: !!python/name:mjlab.envs.mdp.dr.body.body_com_offset ''
847
+ params:
848
+ asset_cfg:
849
+ name: robot
850
+ joint_names: null
851
+ joint_ids: !!python/object/apply:builtins.slice
852
+ - null
853
+ - null
854
+ - null
855
+ body_names: !!python/tuple
856
+ - base
857
+ body_ids: !!python/object/apply:builtins.slice
858
+ - null
859
+ - null
860
+ - null
861
+ geom_names: null
862
+ geom_ids: !!python/object/apply:builtins.slice
863
+ - null
864
+ - null
865
+ - null
866
+ site_names: null
867
+ site_ids: !!python/object/apply:builtins.slice
868
+ - null
869
+ - null
870
+ - null
871
+ actuator_names: null
872
+ actuator_ids: !!python/object/apply:builtins.slice
873
+ - null
874
+ - null
875
+ - null
876
+ tendon_names: null
877
+ tendon_ids: !!python/object/apply:builtins.slice
878
+ - null
879
+ - null
880
+ - null
881
+ camera_names: null
882
+ camera_ids: !!python/object/apply:builtins.slice
883
+ - null
884
+ - null
885
+ - null
886
+ light_names: null
887
+ light_ids: !!python/object/apply:builtins.slice
888
+ - null
889
+ - null
890
+ - null
891
+ material_names: null
892
+ material_ids: !!python/object/apply:builtins.slice
893
+ - null
894
+ - null
895
+ - null
896
+ preserve_order: false
897
+ operation: add
898
+ ranges:
899
+ 0: !!python/tuple
900
+ - -0.035
901
+ - 0.035
902
+ 1: !!python/tuple
903
+ - -0.02
904
+ - 0.02
905
+ 2: !!python/tuple
906
+ - -0.02
907
+ - 0.02
908
+ mode: startup
909
+ interval_range_s: null
910
+ is_global_time: false
911
+ min_step_count_between_reset: 0
912
+ seed: 42
913
+ sim:
914
+ nconmax: null
915
+ njmax: 300
916
+ ls_parallel: true
917
+ contact_sensor_maxmatch: 64
918
+ mujoco:
919
+ timestep: 0.004
920
+ integrator: implicitfast
921
+ impratio: 1.0
922
+ cone: pyramidal
923
+ jacobian: auto
924
+ solver: newton
925
+ iterations: 10
926
+ tolerance: 1.0e-08
927
+ ls_iterations: 20
928
+ ls_tolerance: 0.01
929
+ ccd_iterations: 50
930
+ gravity: !!python/tuple
931
+ - 0.0
932
+ - 0.0
933
+ - -9.81
934
+ multiccd: false
935
+ nan_guard:
936
+ enabled: false
937
+ buffer_size: 100
938
+ output_dir: /tmp/mjlab/nan_dumps
939
+ max_envs_to_dump: 5
940
+ viewer:
941
+ lookat: !!python/tuple
942
+ - 0.0
943
+ - 0.0
944
+ - 0.0
945
+ distance: 1.5
946
+ fovy: null
947
+ elevation: -10.0
948
+ azimuth: 90.0
949
+ origin_type: !!python/object/apply:mjlab.viewer.viewer_config.OriginType
950
+ - 4
951
+ entity_name: robot
952
+ body_name: base
953
+ env_idx: 0
954
+ max_extra_envs: 2
955
+ enable_reflections: true
956
+ enable_shadows: true
957
+ height: 240
958
+ width: 320
959
+ episode_length_s: 20.0
960
+ rewards:
961
+ track_linear_velocity:
962
+ func: !!python/name:src.tasks.velocity.mdp.rewards.track_linear_velocity ''
963
+ params:
964
+ command_name: twist
965
+ std: 0.15
966
+ weight: 4.0
967
+ track_angular_velocity:
968
+ func: !!python/name:src.tasks.velocity.mdp.rewards.track_angular_velocity ''
969
+ params:
970
+ command_name: twist
971
+ std: 0.15
972
+ weight: 4.0
973
+ body_orientation_l2:
974
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_orientation_l2 ''
975
+ params:
976
+ asset_cfg:
977
+ name: robot
978
+ joint_names: null
979
+ joint_ids: !!python/object/apply:builtins.slice
980
+ - null
981
+ - null
982
+ - null
983
+ body_names: !!python/tuple
984
+ - base
985
+ body_ids: !!python/object/apply:builtins.slice
986
+ - null
987
+ - null
988
+ - null
989
+ geom_names: null
990
+ geom_ids: !!python/object/apply:builtins.slice
991
+ - null
992
+ - null
993
+ - null
994
+ site_names: null
995
+ site_ids: !!python/object/apply:builtins.slice
996
+ - null
997
+ - null
998
+ - null
999
+ actuator_names: null
1000
+ actuator_ids: !!python/object/apply:builtins.slice
1001
+ - null
1002
+ - null
1003
+ - null
1004
+ tendon_names: null
1005
+ tendon_ids: !!python/object/apply:builtins.slice
1006
+ - null
1007
+ - null
1008
+ - null
1009
+ camera_names: null
1010
+ camera_ids: !!python/object/apply:builtins.slice
1011
+ - null
1012
+ - null
1013
+ - null
1014
+ light_names: null
1015
+ light_ids: !!python/object/apply:builtins.slice
1016
+ - null
1017
+ - null
1018
+ - null
1019
+ material_names: null
1020
+ material_ids: !!python/object/apply:builtins.slice
1021
+ - null
1022
+ - null
1023
+ - null
1024
+ preserve_order: false
1025
+ weight: -1.0
1026
+ pose:
1027
+ func: !!python/name:src.tasks.velocity.mdp.rewards.variable_posture ''
1028
+ params:
1029
+ asset_cfg:
1030
+ name: robot
1031
+ joint_names: .*
1032
+ joint_ids: !!python/object/apply:builtins.slice
1033
+ - null
1034
+ - null
1035
+ - null
1036
+ body_names: null
1037
+ body_ids: !!python/object/apply:builtins.slice
1038
+ - null
1039
+ - null
1040
+ - null
1041
+ geom_names: null
1042
+ geom_ids: !!python/object/apply:builtins.slice
1043
+ - null
1044
+ - null
1045
+ - null
1046
+ site_names: null
1047
+ site_ids: !!python/object/apply:builtins.slice
1048
+ - null
1049
+ - null
1050
+ - null
1051
+ actuator_names: null
1052
+ actuator_ids: !!python/object/apply:builtins.slice
1053
+ - null
1054
+ - null
1055
+ - null
1056
+ tendon_names: null
1057
+ tendon_ids: !!python/object/apply:builtins.slice
1058
+ - null
1059
+ - null
1060
+ - null
1061
+ camera_names: null
1062
+ camera_ids: !!python/object/apply:builtins.slice
1063
+ - null
1064
+ - null
1065
+ - null
1066
+ light_names: null
1067
+ light_ids: !!python/object/apply:builtins.slice
1068
+ - null
1069
+ - null
1070
+ - null
1071
+ material_names: null
1072
+ material_ids: !!python/object/apply:builtins.slice
1073
+ - null
1074
+ - null
1075
+ - null
1076
+ preserve_order: false
1077
+ command_name: twist
1078
+ std_standing:
1079
+ .*(fl|fr|bl|br)_hip_joint.*: 0.05
1080
+ .*(fl|fr|bl|br)_thigh_joint.*: 0.1
1081
+ .*(fl|fr|bl|br)_calf_joint.*: 0.15
1082
+ ^arm_yaw_joint$: 0.1
1083
+ ^arm_thigh_joint$: 0.1
1084
+ ^arm_calf_joint$: 0.1
1085
+ std_walking:
1086
+ .*(fl|fr|bl|br)_hip_joint.*: 0.15
1087
+ .*(fl|fr|bl|br)_thigh_joint.*: 0.35
1088
+ .*(fl|fr|bl|br)_calf_joint.*: 0.35
1089
+ ^arm_yaw_joint$: 0.1
1090
+ ^arm_thigh_joint$: 0.1
1091
+ ^arm_calf_joint$: 0.1
1092
+ std_running:
1093
+ .*(fl|fr|bl|br)_hip_joint.*: 0.15
1094
+ .*(fl|fr|bl|br)_thigh_joint.*: 0.5
1095
+ .*(fl|fr|bl|br)_calf_joint.*: 0.5
1096
+ ^arm_yaw_joint$: 0.1
1097
+ ^arm_thigh_joint$: 0.1
1098
+ ^arm_calf_joint$: 0.1
1099
+ walking_threshold: 0.05
1100
+ running_threshold: 0.3
1101
+ weight: 1.0
1102
+ body_ang_vel:
1103
+ func: !!python/name:src.tasks.velocity.mdp.rewards.body_angular_velocity_penalty ''
1104
+ params:
1105
+ asset_cfg:
1106
+ name: robot
1107
+ joint_names: null
1108
+ joint_ids: !!python/object/apply:builtins.slice
1109
+ - null
1110
+ - null
1111
+ - null
1112
+ body_names: !!python/tuple
1113
+ - base
1114
+ body_ids: !!python/object/apply:builtins.slice
1115
+ - null
1116
+ - null
1117
+ - null
1118
+ geom_names: null
1119
+ geom_ids: !!python/object/apply:builtins.slice
1120
+ - null
1121
+ - null
1122
+ - null
1123
+ site_names: null
1124
+ site_ids: !!python/object/apply:builtins.slice
1125
+ - null
1126
+ - null
1127
+ - null
1128
+ actuator_names: null
1129
+ actuator_ids: !!python/object/apply:builtins.slice
1130
+ - null
1131
+ - null
1132
+ - null
1133
+ tendon_names: null
1134
+ tendon_ids: !!python/object/apply:builtins.slice
1135
+ - null
1136
+ - null
1137
+ - null
1138
+ camera_names: null
1139
+ camera_ids: !!python/object/apply:builtins.slice
1140
+ - null
1141
+ - null
1142
+ - null
1143
+ light_names: null
1144
+ light_ids: !!python/object/apply:builtins.slice
1145
+ - null
1146
+ - null
1147
+ - null
1148
+ material_names: null
1149
+ material_ids: !!python/object/apply:builtins.slice
1150
+ - null
1151
+ - null
1152
+ - null
1153
+ preserve_order: false
1154
+ weight: -0.08
1155
+ angular_momentum:
1156
+ func: !!python/name:src.tasks.velocity.mdp.rewards.angular_momentum_penalty ''
1157
+ params:
1158
+ sensor_name: robot/root_angmom
1159
+ weight: -0.03
1160
+ is_terminated:
1161
+ func: !!python/name:mjlab.envs.mdp.rewards.is_terminated ''
1162
+ params: {}
1163
+ weight: -200.0
1164
+ joint_acc_l2:
1165
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_acc_l2 ''
1166
+ params: {}
1167
+ weight: -2.5e-07
1168
+ joint_pos_limits:
1169
+ func: !!python/name:mjlab.envs.mdp.rewards.joint_pos_limits ''
1170
+ params: {}
1171
+ weight: -10.0
1172
+ action_rate_l2:
1173
+ func: !!python/name:mjlab.envs.mdp.rewards.action_rate_l2 ''
1174
+ params: {}
1175
+ weight: -0.2
1176
+ foot_gait:
1177
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_gait ''
1178
+ params:
1179
+ period: 0.4
1180
+ offset:
1181
+ - 0.0
1182
+ - 0.5
1183
+ - 0.0
1184
+ - 0.5
1185
+ threshold: 0.56
1186
+ command_threshold: 0.1
1187
+ command_name: twist
1188
+ sensor_name: feet_ground_contact
1189
+ weight: 1.0
1190
+ foot_clearance:
1191
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_clearance ''
1192
+ params:
1193
+ target_height: 0.02
1194
+ command_name: twist
1195
+ command_threshold: 0.1
1196
+ asset_cfg:
1197
+ name: robot
1198
+ joint_names: null
1199
+ joint_ids: !!python/object/apply:builtins.slice
1200
+ - null
1201
+ - null
1202
+ - null
1203
+ body_names: null
1204
+ body_ids: !!python/object/apply:builtins.slice
1205
+ - null
1206
+ - null
1207
+ - null
1208
+ geom_names: null
1209
+ geom_ids: !!python/object/apply:builtins.slice
1210
+ - null
1211
+ - null
1212
+ - null
1213
+ site_names: !!python/tuple
1214
+ - fl
1215
+ - fr
1216
+ - bl
1217
+ - br
1218
+ site_ids: !!python/object/apply:builtins.slice
1219
+ - null
1220
+ - null
1221
+ - null
1222
+ actuator_names: null
1223
+ actuator_ids: !!python/object/apply:builtins.slice
1224
+ - null
1225
+ - null
1226
+ - null
1227
+ tendon_names: null
1228
+ tendon_ids: !!python/object/apply:builtins.slice
1229
+ - null
1230
+ - null
1231
+ - null
1232
+ camera_names: null
1233
+ camera_ids: !!python/object/apply:builtins.slice
1234
+ - null
1235
+ - null
1236
+ - null
1237
+ light_names: null
1238
+ light_ids: !!python/object/apply:builtins.slice
1239
+ - null
1240
+ - null
1241
+ - null
1242
+ material_names: null
1243
+ material_ids: !!python/object/apply:builtins.slice
1244
+ - null
1245
+ - null
1246
+ - null
1247
+ preserve_order: false
1248
+ weight: -0.5
1249
+ foot_slip:
1250
+ func: !!python/name:src.tasks.velocity.mdp.rewards.feet_slip ''
1251
+ params:
1252
+ sensor_name: feet_ground_contact
1253
+ command_name: twist
1254
+ command_threshold: 0.1
1255
+ asset_cfg:
1256
+ name: robot
1257
+ joint_names: null
1258
+ joint_ids: !!python/object/apply:builtins.slice
1259
+ - null
1260
+ - null
1261
+ - null
1262
+ body_names: null
1263
+ body_ids: !!python/object/apply:builtins.slice
1264
+ - null
1265
+ - null
1266
+ - null
1267
+ geom_names: null
1268
+ geom_ids: !!python/object/apply:builtins.slice
1269
+ - null
1270
+ - null
1271
+ - null
1272
+ site_names: !!python/tuple
1273
+ - fl
1274
+ - fr
1275
+ - bl
1276
+ - br
1277
+ site_ids: !!python/object/apply:builtins.slice
1278
+ - null
1279
+ - null
1280
+ - null
1281
+ actuator_names: null
1282
+ actuator_ids: !!python/object/apply:builtins.slice
1283
+ - null
1284
+ - null
1285
+ - null
1286
+ tendon_names: null
1287
+ tendon_ids: !!python/object/apply:builtins.slice
1288
+ - null
1289
+ - null
1290
+ - null
1291
+ camera_names: null
1292
+ camera_ids: !!python/object/apply:builtins.slice
1293
+ - null
1294
+ - null
1295
+ - null
1296
+ light_names: null
1297
+ light_ids: !!python/object/apply:builtins.slice
1298
+ - null
1299
+ - null
1300
+ - null
1301
+ material_names: null
1302
+ material_ids: !!python/object/apply:builtins.slice
1303
+ - null
1304
+ - null
1305
+ - null
1306
+ preserve_order: false
1307
+ weight: -0.05
1308
+ soft_landing:
1309
+ func: !!python/name:src.tasks.velocity.mdp.rewards.soft_landing ''
1310
+ params:
1311
+ sensor_name: feet_ground_contact
1312
+ command_name: twist
1313
+ command_threshold: 0.1
1314
+ weight: -0.001
1315
+ stand_still:
1316
+ func: !!python/name:src.tasks.velocity.mdp.rewards.stand_still ''
1317
+ params:
1318
+ command_name: twist
1319
+ command_threshold: 0.1
1320
+ asset_cfg:
1321
+ name: robot
1322
+ joint_names: .*
1323
+ joint_ids: !!python/object/apply:builtins.slice
1324
+ - null
1325
+ - null
1326
+ - null
1327
+ body_names: null
1328
+ body_ids: !!python/object/apply:builtins.slice
1329
+ - null
1330
+ - null
1331
+ - null
1332
+ geom_names: null
1333
+ geom_ids: !!python/object/apply:builtins.slice
1334
+ - null
1335
+ - null
1336
+ - null
1337
+ site_names: null
1338
+ site_ids: !!python/object/apply:builtins.slice
1339
+ - null
1340
+ - null
1341
+ - null
1342
+ actuator_names: null
1343
+ actuator_ids: !!python/object/apply:builtins.slice
1344
+ - null
1345
+ - null
1346
+ - null
1347
+ tendon_names: null
1348
+ tendon_ids: !!python/object/apply:builtins.slice
1349
+ - null
1350
+ - null
1351
+ - null
1352
+ camera_names: null
1353
+ camera_ids: !!python/object/apply:builtins.slice
1354
+ - null
1355
+ - null
1356
+ - null
1357
+ light_names: null
1358
+ light_ids: !!python/object/apply:builtins.slice
1359
+ - null
1360
+ - null
1361
+ - null
1362
+ material_names: null
1363
+ material_ids: !!python/object/apply:builtins.slice
1364
+ - null
1365
+ - null
1366
+ - null
1367
+ preserve_order: false
1368
+ weight: -1.0
1369
+ nonfoot_contact:
1370
+ func: &id008 !!python/name:mjlab.tasks.velocity.mdp.terminations.illegal_contact ''
1371
+ params:
1372
+ sensor_name: nonfoot_ground_touch
1373
+ force_threshold: 0.5
1374
+ weight: -3
1375
+ terminations:
1376
+ time_out:
1377
+ func: !!python/name:mjlab.envs.mdp.terminations.time_out ''
1378
+ params: {}
1379
+ time_out: true
1380
+ fell_over:
1381
+ func: !!python/name:mjlab.envs.mdp.terminations.bad_orientation ''
1382
+ params:
1383
+ limit_angle: 1.2217304763960306
1384
+ time_out: false
1385
+ illegal_contact:
1386
+ func: *id008
1387
+ params:
1388
+ sensor_name: nonfoot_ground_touch
1389
+ force_threshold: 10.0
1390
+ time_out: false
1391
+ commands:
1392
+ twist:
1393
+ resampling_time_range: !!python/tuple
1394
+ - 3.0
1395
+ - 8.0
1396
+ debug_vis: true
1397
+ entity_name: robot
1398
+ heading_command: false
1399
+ heading_control_stiffness: 0.5
1400
+ rel_standing_envs: 0.0
1401
+ rel_heading_envs: 0.1
1402
+ init_velocity_prob: 0.0
1403
+ ranges:
1404
+ lin_vel_x: !!python/tuple
1405
+ - -0.5
1406
+ - 0.6
1407
+ lin_vel_y: !!python/tuple
1408
+ - -0.3
1409
+ - 0.3
1410
+ ang_vel_z: !!python/tuple
1411
+ - -0.8
1412
+ - 0.8
1413
+ heading: null
1414
+ viz:
1415
+ z_offset: 0.2
1416
+ scale: 0.5
1417
+ curriculum: {}
1418
+ metrics:
1419
+ mean_action_acc:
1420
+ func: !!python/name:mjlab.envs.mdp.metrics.mean_action_acc ''
1421
+ params: {}
1422
+ is_finite_horizon: false
1423
+ scale_rewards_by_dt: true
mini2sw_walk/policy.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a56a3254e991854794ff837edc7ae933804e97a437ee1db44bf1d1d138397f5
3
+ size 783960