Add RFCP policy (ONNX)
Browse files- MODEL_CARD.md +64 -0
- README.md +22 -0
- SHA256SUMS +7 -0
- config.yaml +903 -0
- model_config.yaml +317 -0
- onnx_verify.json +46 -0
- sonic_catwalk_decoder.onnx +3 -0
- sonic_catwalk_encoder.onnx +3 -0
- sonic_catwalk_g1.onnx +3 -0
MODEL_CARD.md
ADDED
|
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Model card: SONIC Catwalk, a fine-tuned SONIC policy (Unitree G1)
|
| 2 |
+
|
| 3 |
+
**Team:** Ghost Couture (Kent State Advanced Telerobotics Research Lab) · Ghost Trial 04, Performance Arts track
|
| 4 |
+
|
| 5 |
+
**What it does:** it tracks the m7 runway performance (walk, turn + pose, walk back) much closer to its path and turn point than stock SONIC.
|
| 6 |
+
- m7 path error (mpjpe_g): 365.8 → 218.4 mm (−40%).
|
| 7 |
+
- End drift: 0.61 → 0.27 m.
|
| 8 |
+
- Turn + pose segment: 502 → 458 mm.
|
| 9 |
+
- All 30 control clips succeed (standard eval).
|
| 10 |
+
- With domain randomization and pushes on, it completes all 5 m7 runs (stock 4 of 5).
|
| 11 |
+
- It runs in MuJoCo sim2sim without falling.
|
| 12 |
+
|
| 13 |
+
## Files (this folder)
|
| 14 |
+
- `sonic_catwalk_g1.onnx`: the main policy (G1-joint encoder + decoder). Input `obs_dict` [1, 1570] = [tokenizer obs | proprioception], output [1, 29] joint actions.
|
| 15 |
+
- `sonic_catwalk_encoder.onnx`: all encoders, input [1, 1751], output token [1, 64].
|
| 16 |
+
- `sonic_catwalk_decoder.onnx`: decoder only, input [1, 994], output [1, 29].
|
| 17 |
+
- `config.yaml`: the resolved training config. `model_config.yaml`: the env/algo config written by the ONNX export.
|
| 18 |
+
- `onnx_verify.json`: the ONNX Runtime vs torch check. On 100 recorded observations the g1 model's max abs diff is 8.6e-6 (tolerance 1e-4, pass).
|
| 19 |
+
- `SHA256SUMS`: checksums of every file.
|
| 20 |
+
|
| 21 |
+
The ONNX files follow the SONIC deployment layout (`gear_sonic_deploy`).
|
| 22 |
+
|
| 23 |
+
## How it was trained
|
| 24 |
+
- **Start:** fine-tuned from the released SONIC checkpoint `sonic_release/last.pt` (Hugging Face `nvidia/GEAR-SONIC`, sha256 e6bdab3f…). There is no other warm start.
|
| 25 |
+
- **Algorithm:** SONIC's own PPO fine-tuning (`gear_sonic/train_agent_trl.py +exp=manager/universal_token/all_modes/sonic_release`) in Isaac Lab on 1 GPU. The release config is unchanged except for:
|
| 26 |
+
- the motion file (30 control clips + 14 copies of m7);
|
| 27 |
+
- `smpl_motion_file=dummy` (G1 only);
|
| 28 |
+
- `num_envs`;
|
| 29 |
+
- the checkpoint frequency;
|
| 30 |
+
- the wandb project.
|
| 31 |
+
- **Checkpoint selection:** the lowest m7 path error that passes all hard constraints versus stock:
|
| 32 |
+
- m7 success = 1.0;
|
| 33 |
+
- controls success ≥ stock − 0.02;
|
| 34 |
+
- walk/turn control mpjpe_l ≤ stock + 2 mm;
|
| 35 |
+
- jitter ≤ 1.1 × stock;
|
| 36 |
+
- self-collision frames ≤ stock.
|
| 37 |
+
- **Exact configuration and commands:** `03_training_config/`.
|
| 38 |
+
|
| 39 |
+
## Data
|
| 40 |
+
The m7 runway performance (683 frames at 30 fps) plus 30 BONES-SEED control clips; see `02_dataset/DATASET_CARD.md`.
|
| 41 |
+
|
| 42 |
+
## Before / after (stock SONIC and ours on the same machine, same procedure)
|
| 43 |
+
| Metric | Stock SONIC | Ours |
|
| 44 |
+
|---|---|---|
|
| 45 |
+
| m7 success rate | 1.00 | 1.00 |
|
| 46 |
+
| m7 path error mpjpe_g (mm) | 365.8 | 218.4 |
|
| 47 |
+
| m7 pose error mpjpe_l (mm) | 26.0 | 26.9 |
|
| 48 |
+
| m7 walk / turn + pose / walk back / idle mpjpe_g (mm) | 260.7 / 501.5 / 369.9 / 652.4 | 132.6 / 457.5 / 183.1 / 220.7 |
|
| 49 |
+
| root drift at end (m) | 0.61 | 0.27 |
|
| 50 |
+
| max root xy error (m) | 1.03 | 0.79 |
|
| 51 |
+
| step width, walking (m; target 0.033) | 0.112 | 0.127 |
|
| 52 |
+
| jitter (rad) | 0.00458 | 0.00462 |
|
| 53 |
+
| self-collision frames (approx.) / joint-limit violations | 0 / 0 | 0 / 0 |
|
| 54 |
+
| controls success (30 clips) | 1.00 | 1.00 |
|
| 55 |
+
| controls walk / turn / idle mpjpe_l (mm) | 25.0 / 23.8 / 28.1 | 23.7 / 22.6 / 30.3 |
|
| 56 |
+
| unseen clips (5): success / mpjpe_l / mpjpe_g | 1.00 / 22.2 / 284.8 | 1.00 / 25.8 / 259.7 |
|
| 57 |
+
| randomization + pushes, m7 (5 runs): success / mpjpe_g | 4/5 / 482.9 ± 105.9 | 5/5 / 473.0 ± 248.9 |
|
| 58 |
+
| randomization + pushes, controls (150 runs): success | 150/150 | 146/150 |
|
| 59 |
+
| MuJoCo sim2sim (m7, walk, turn): falls | 0 | 0 |
|
| 60 |
+
|
| 61 |
+
The first rows (m7 and controls) come from the training machine (H100). The unseen-clip, randomization and sim2sim rows come from a second machine (Quadro RTX 6000). On that machine, m7 path error is 389.3 mm for stock vs 281.7 mm for ours.
|
| 62 |
+
|
| 63 |
+
## License
|
| 64 |
+
This policy is a derivative of the NVIDIA SONIC (GEAR-SONIC) weights and is subject to the **NVIDIA Open Model License**. The control clips come from BONES-SEED (Motion Data by Bones Studio) and are not redistributed.
|
README.md
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: nvidia-open-model-license
|
| 4 |
+
tags: [robotics, humanoid, unitree-g1, onnx, sonic, catwalk]
|
| 5 |
+
---
|
| 6 |
+
|
| 7 |
+
# RFCP: Robot Fashion Catwalk Policy
|
| 8 |
+
|
| 9 |
+
A SONIC fine-tune that makes the Unitree G1 walk a fashion runway: down the catwalk, turn, pose, walk back.
|
| 10 |
+
|
| 11 |
+
- `*_g1.onnx`: the policy
|
| 12 |
+
- `*_encoder.onnx`, `*_decoder.onnx`: SONIC's split export
|
| 13 |
+
- `config.yaml`, `model_config.yaml`: the config it was trained and exported with
|
| 14 |
+
|
| 15 |
+
| vs stock SONIC | Stock | RFCP |
|
| 16 |
+
|---|---|---|
|
| 17 |
+
| Path error | 366 mm | 218 mm |
|
| 18 |
+
| End drift | 0.61 m | 0.27 m |
|
| 19 |
+
|
| 20 |
+
Fine-tuned from NVIDIA SONIC (GR00T-WholeBodyControl) weights under the NVIDIA Open Model License.
|
| 21 |
+
|
| 22 |
+
Team ATR · Motion Data by Bones Studio · Dataset: https://huggingface.co/datasets/Kyry10/rfcp-dataset
|
SHA256SUMS
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
aebf0c26e2c5cebb81583848eb8d0412779eed0bd86faedb89d3a0b67edb5277 sonic_catwalk_decoder.onnx
|
| 2 |
+
f7015d9e6ee972bbe1a2e46054008c21087db97e2be283267400e28dcdf83f04 sonic_catwalk_encoder.onnx
|
| 3 |
+
f9937b9ab675e644cdc9f89175db3f8af2f31eddfc3ea9fafaf1e6513bb84962 sonic_catwalk_g1.onnx
|
| 4 |
+
136d30f8cb18a1c4823a09c22425a9f17460bb20d91ecaf8edb372ee1e6f7d1f config.yaml
|
| 5 |
+
adff7e175b591da425ca0b8cc206a3e8bbad21098e3e710663af9407c53c555f model_config.yaml
|
| 6 |
+
76974d391533b662d132f8093290b4f45050f186ba1bafa713b556fa688cfaa5 onnx_verify.json
|
| 7 |
+
afe967a76f9d45620379c2b856097dbd2fddafff67f2ed5c569530a21dd9719a MODEL_CARD.md
|
config.yaml
ADDED
|
@@ -0,0 +1,903 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
num_gpus: 1
|
| 2 |
+
max_retries: 1
|
| 3 |
+
seed: 0
|
| 4 |
+
codebase_version: 1.0
|
| 5 |
+
headless: true
|
| 6 |
+
num_envs: 4096
|
| 7 |
+
auto_load_latest: false
|
| 8 |
+
checkpoint: sonic_release/last.pt
|
| 9 |
+
project_name: ghost04
|
| 10 |
+
experiment_name: ${exp_base}_${exp_var}
|
| 11 |
+
base_dir: logs_rl
|
| 12 |
+
timestamp: ${now:%Y%m%d_%H%M%S}
|
| 13 |
+
experiment_dir: ${base_dir}/${project_name}/${experiment_name}-${timestamp}
|
| 14 |
+
save_dir: ${experiment_dir}/.hydra
|
| 15 |
+
force_flat_terrain: false
|
| 16 |
+
use_wandb: true
|
| 17 |
+
log_task_name: TEST
|
| 18 |
+
multi_gpu: false
|
| 19 |
+
global_rank: 0
|
| 20 |
+
sim_type: isaacsim
|
| 21 |
+
env_spacing: 20
|
| 22 |
+
output_dir: ${experiment_dir}/output
|
| 23 |
+
eval_overrides:
|
| 24 |
+
headless: false
|
| 25 |
+
num_envs: 1
|
| 26 |
+
auto_load_latest: false
|
| 27 |
+
use_wandb: false
|
| 28 |
+
algo:
|
| 29 |
+
trl:
|
| 30 |
+
dataset_name: dummy
|
| 31 |
+
output_dir: logs_rl/ghost04/manager/universal_token/all_modes/sonic_release_ft_m7_B-20260927_014418
|
| 32 |
+
learning_rate: ${algo.config.actor_learning_rate}
|
| 33 |
+
num_total_batches: ${algo.config.num_learning_iterations}
|
| 34 |
+
total_episodes: null
|
| 35 |
+
num_ppo_epochs: ${algo.config.num_learning_epochs}
|
| 36 |
+
num_mini_batches: ${algo.config.num_mini_batches}
|
| 37 |
+
per_device_train_batch_size: null
|
| 38 |
+
gradient_accumulation_steps: 1
|
| 39 |
+
report_to: none
|
| 40 |
+
gamma: ${algo.config.gamma}
|
| 41 |
+
lam: ${algo.config.lam}
|
| 42 |
+
vf_coef: ${algo.config.value_loss_coef}
|
| 43 |
+
max_grad_norm: ${algo.config.max_grad_norm}
|
| 44 |
+
lr_scheduler_type: constant
|
| 45 |
+
save_strategy: 'no'
|
| 46 |
+
disable_tqdm: true
|
| 47 |
+
config:
|
| 48 |
+
critic:
|
| 49 |
+
_target_: gear_sonic.trl.modules.actor_critic_modules.Critic
|
| 50 |
+
running_mean_std: true
|
| 51 |
+
backbone:
|
| 52 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 53 |
+
process_output_dim: true
|
| 54 |
+
module_config_dict:
|
| 55 |
+
type: MLP
|
| 56 |
+
input_dim:
|
| 57 |
+
- critic_obs
|
| 58 |
+
output_dim:
|
| 59 |
+
- 1
|
| 60 |
+
layer_config:
|
| 61 |
+
type: MLP
|
| 62 |
+
hidden_dims:
|
| 63 |
+
- 2048
|
| 64 |
+
- 2048
|
| 65 |
+
- 1024
|
| 66 |
+
- 1024
|
| 67 |
+
- 512
|
| 68 |
+
- 512
|
| 69 |
+
activation: SiLU
|
| 70 |
+
actor:
|
| 71 |
+
backbone:
|
| 72 |
+
quantizer:
|
| 73 |
+
_target_: vector_quantize_pytorch.FSQ
|
| 74 |
+
encoders:
|
| 75 |
+
g1:
|
| 76 |
+
inputs:
|
| 77 |
+
- command_multi_future_nonflat
|
| 78 |
+
- motion_anchor_ori_b_mf_nonflat
|
| 79 |
+
params:
|
| 80 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 81 |
+
input_dim: null
|
| 82 |
+
output_dim: null
|
| 83 |
+
num_input_temporal_dims: ${manager_env.commands.motion.num_future_frames}
|
| 84 |
+
num_output_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
|
| 85 |
+
module_config_dict:
|
| 86 |
+
layer_config:
|
| 87 |
+
type: MLP
|
| 88 |
+
hidden_dims:
|
| 89 |
+
- 2048
|
| 90 |
+
- 1024
|
| 91 |
+
- 512
|
| 92 |
+
- 512
|
| 93 |
+
activation: SiLU
|
| 94 |
+
teleop:
|
| 95 |
+
inputs:
|
| 96 |
+
- command_multi_future_lower_body
|
| 97 |
+
- vr_3point_local_target
|
| 98 |
+
- vr_3point_local_orn_target
|
| 99 |
+
- motion_anchor_ori_b
|
| 100 |
+
params:
|
| 101 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 102 |
+
input_dim: null
|
| 103 |
+
output_dim: null
|
| 104 |
+
num_input_temporal_dims: null
|
| 105 |
+
num_output_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
|
| 106 |
+
module_config_dict:
|
| 107 |
+
layer_config:
|
| 108 |
+
type: MLP
|
| 109 |
+
hidden_dims:
|
| 110 |
+
- 2048
|
| 111 |
+
- 1024
|
| 112 |
+
- 512
|
| 113 |
+
- 512
|
| 114 |
+
activation: SiLU
|
| 115 |
+
smpl:
|
| 116 |
+
inputs:
|
| 117 |
+
- smpl_joints_multi_future_local_nonflat
|
| 118 |
+
- smpl_root_ori_b_multi_future
|
| 119 |
+
- joint_pos_multi_future_wrist_for_smpl
|
| 120 |
+
params:
|
| 121 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 122 |
+
input_dim: null
|
| 123 |
+
output_dim: null
|
| 124 |
+
num_input_temporal_dims: ${manager_env.commands.motion.smpl_num_future_frames}
|
| 125 |
+
num_output_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
|
| 126 |
+
module_config_dict:
|
| 127 |
+
layer_config:
|
| 128 |
+
type: MLP
|
| 129 |
+
hidden_dims:
|
| 130 |
+
- 2048
|
| 131 |
+
- 1024
|
| 132 |
+
- 512
|
| 133 |
+
- 512
|
| 134 |
+
activation: SiLU
|
| 135 |
+
decoders:
|
| 136 |
+
g1_dyn:
|
| 137 |
+
inputs:
|
| 138 |
+
- token_flattened
|
| 139 |
+
- proprioception
|
| 140 |
+
outputs:
|
| 141 |
+
- action
|
| 142 |
+
has_temporal_dim: false
|
| 143 |
+
params:
|
| 144 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 145 |
+
input_dim: null
|
| 146 |
+
output_dim: null
|
| 147 |
+
num_input_temporal_dims: null
|
| 148 |
+
num_output_temporal_dims: null
|
| 149 |
+
module_config_dict:
|
| 150 |
+
layer_config:
|
| 151 |
+
type: MLP
|
| 152 |
+
hidden_dims:
|
| 153 |
+
- 2048
|
| 154 |
+
- 2048
|
| 155 |
+
- 1024
|
| 156 |
+
- 1024
|
| 157 |
+
- 512
|
| 158 |
+
- 512
|
| 159 |
+
activation: SiLU
|
| 160 |
+
g1_kin:
|
| 161 |
+
inputs:
|
| 162 |
+
- token
|
| 163 |
+
outputs:
|
| 164 |
+
- command_multi_future_nonflat
|
| 165 |
+
- motion_anchor_ori_b_mf_nonflat
|
| 166 |
+
has_temporal_dim: true
|
| 167 |
+
params:
|
| 168 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 169 |
+
input_dim: null
|
| 170 |
+
output_dim: null
|
| 171 |
+
num_input_temporal_dims: ${algo.config.actor.backbone.max_num_tokens}
|
| 172 |
+
num_output_temporal_dims: ${manager_env.commands.motion.num_future_frames}
|
| 173 |
+
module_config_dict:
|
| 174 |
+
layer_config:
|
| 175 |
+
type: MLP
|
| 176 |
+
hidden_dims:
|
| 177 |
+
- 2048
|
| 178 |
+
- 1024
|
| 179 |
+
- 512
|
| 180 |
+
- 512
|
| 181 |
+
activation: SiLU
|
| 182 |
+
_target_: gear_sonic.trl.modules.universal_token_modules.UniversalTokenModule
|
| 183 |
+
num_future_frames: ${manager_env.commands.motion.num_future_frames}
|
| 184 |
+
proprioception_features:
|
| 185 |
+
- actor_obs
|
| 186 |
+
encoder_sample_probs: ${manager_env.commands.motion.encoder_sample_probs}
|
| 187 |
+
num_fsq_levels: 32
|
| 188 |
+
fsq_level_list: 32
|
| 189 |
+
max_num_tokens: 2
|
| 190 |
+
aux_loss_func:
|
| 191 |
+
g1_recon:
|
| 192 |
+
_target_: gear_sonic.trl.losses.token_losses.G1ReconLoss
|
| 193 |
+
loss_type: mse
|
| 194 |
+
g1_smpl_latent:
|
| 195 |
+
_target_: gear_sonic.trl.losses.token_losses.G1SmplLatentLoss
|
| 196 |
+
loss_type: mse
|
| 197 |
+
g1_teleop_latent:
|
| 198 |
+
_target_: gear_sonic.trl.losses.token_losses.G1TeleopLatentLoss
|
| 199 |
+
loss_type: mse
|
| 200 |
+
teleop_smpl_latent:
|
| 201 |
+
_target_: gear_sonic.trl.losses.token_losses.TeleopSmplLatentLoss
|
| 202 |
+
loss_type: mse
|
| 203 |
+
detach_teleop_target: true
|
| 204 |
+
reencoded_smpl_g1_latent:
|
| 205 |
+
_target_: gear_sonic.trl.losses.token_losses.ReencodedSmplG1LatentLoss
|
| 206 |
+
loss_type: mse
|
| 207 |
+
aux_loss_coef:
|
| 208 |
+
g1_recon: 0.01
|
| 209 |
+
g1_smpl_latent: 1.0
|
| 210 |
+
g1_teleop_latent: 1.0
|
| 211 |
+
teleop_smpl_latent: 1.0
|
| 212 |
+
reencoded_smpl_g1_latent: 1.0
|
| 213 |
+
reencode_smpl_g1_recon: true
|
| 214 |
+
_target_: gear_sonic.trl.modules.actor_critic_modules.Actor
|
| 215 |
+
running_mean_std: false
|
| 216 |
+
input_obs_dict: true
|
| 217 |
+
has_aux_loss: true
|
| 218 |
+
num_learning_epochs: 5
|
| 219 |
+
num_mini_batches: 4
|
| 220 |
+
clip_param: 0.2
|
| 221 |
+
gamma: 0.99
|
| 222 |
+
lam: 0.95
|
| 223 |
+
value_loss_coef: 1.0
|
| 224 |
+
entropy_coef: 0.01
|
| 225 |
+
actor_learning_rate: 2.0e-05
|
| 226 |
+
critic_learning_rate: 0.001
|
| 227 |
+
max_grad_norm: 0.1
|
| 228 |
+
use_clipped_value_loss: true
|
| 229 |
+
schedule: adaptive
|
| 230 |
+
desired_kl: 0.01
|
| 231 |
+
adaptive_lr_min: 1.0e-05
|
| 232 |
+
adaptive_lr_max: 0.0002
|
| 233 |
+
use_new_actor_critic: true
|
| 234 |
+
use_padding_mask: false
|
| 235 |
+
ppo_shuffle_every_epoch: true
|
| 236 |
+
sync_advantage_normalization: true
|
| 237 |
+
empty_cache_every_n_ppo_epoch: -1
|
| 238 |
+
num_steps_per_env: 24
|
| 239 |
+
save_interval: 500
|
| 240 |
+
eval_frequency: 500
|
| 241 |
+
load_optimizer: true
|
| 242 |
+
init_noise_std: 0.05
|
| 243 |
+
num_learning_iterations: 100000
|
| 244 |
+
init_at_random_ep_len: true
|
| 245 |
+
global_rank: 0
|
| 246 |
+
world_size: 1
|
| 247 |
+
use_clampped_std: true
|
| 248 |
+
std_clamp_min: 0.001
|
| 249 |
+
std_clamp_max: 0.5
|
| 250 |
+
_recursive_: false
|
| 251 |
+
env: ???
|
| 252 |
+
terrain: ???
|
| 253 |
+
callbacks:
|
| 254 |
+
model_save:
|
| 255 |
+
_target_: gear_sonic.trl.callbacks.model_save_callback.ModelSaveCallback
|
| 256 |
+
save_dir: ${experiment_dir}
|
| 257 |
+
save_frequency: 25
|
| 258 |
+
max_disk_usage: 14.8
|
| 259 |
+
wandb:
|
| 260 |
+
_target_: gear_sonic.trl.callbacks.wandb_callback.WandbCallback
|
| 261 |
+
read_eval:
|
| 262 |
+
_target_: gear_sonic.trl.callbacks.read_eval_callback.ReadEvalCallback
|
| 263 |
+
eval_dir: ${experiment_dir}/eval
|
| 264 |
+
check_interval: 1
|
| 265 |
+
im_resample:
|
| 266 |
+
_target_: gear_sonic.trl.callbacks.im_resample_callback.ImResampleCallback
|
| 267 |
+
motion_resample_frequency: 250
|
| 268 |
+
trainer:
|
| 269 |
+
_target_: gear_sonic.trl.trainer.ppo_trainer_aux_loss.TRLAuxLossPPOTrainer
|
| 270 |
+
wandb:
|
| 271 |
+
wandb_project: ghost04
|
| 272 |
+
wandb_tags: online
|
| 273 |
+
wandb_group: null
|
| 274 |
+
wandb_id: null
|
| 275 |
+
wandb_entity: null
|
| 276 |
+
wandb_dir: /data/kkolesni/GR00T-WholeBodyControl/data/ghost04/wandb
|
| 277 |
+
manager_env:
|
| 278 |
+
commands:
|
| 279 |
+
motion:
|
| 280 |
+
encoder_sample_probs:
|
| 281 |
+
g1: 1.0
|
| 282 |
+
teleop: 1.0
|
| 283 |
+
smpl: 1.0
|
| 284 |
+
_target_: gear_sonic.envs.manager_env.mdp.commands.TrackingCommandCfg
|
| 285 |
+
asset_name: robot
|
| 286 |
+
motion_lib_cfg:
|
| 287 |
+
motion_file: /data/kkolesni/GR00T-WholeBodyControl/data/ghost04/m7data/train_B
|
| 288 |
+
smpl_motion_file: dummy
|
| 289 |
+
asset:
|
| 290 |
+
assetRoot: gear_sonic/data/assets/robot_description/mjcf/
|
| 291 |
+
assetFileName: g1_29dof_rev_1_0.xml
|
| 292 |
+
urdfFileName: ''
|
| 293 |
+
extend_config: []
|
| 294 |
+
target_fps: 50
|
| 295 |
+
multi_thread: true
|
| 296 |
+
filter_motion_keys: null
|
| 297 |
+
adaptive_sampling:
|
| 298 |
+
enable: true
|
| 299 |
+
bin_size: 50
|
| 300 |
+
sequence_length_agnostic: true
|
| 301 |
+
init_num_failures: 1
|
| 302 |
+
uniform_sampling_rate: 0.1
|
| 303 |
+
pre_failure_sample_window: 200
|
| 304 |
+
use_failure_rate_decay: false
|
| 305 |
+
decay_gamma: 0.8
|
| 306 |
+
adp_samp_failure_rate_max_over_mean: 200
|
| 307 |
+
upper_body_augment_prefixes:
|
| 308 |
+
- '2025'
|
| 309 |
+
- sonic_mixed_walking_running
|
| 310 |
+
- sonic_squating_different_height_switching
|
| 311 |
+
- sonic_running
|
| 312 |
+
- sonic_walking
|
| 313 |
+
- sonic_squating_different_height_hold
|
| 314 |
+
- sonic_walking_other_style
|
| 315 |
+
- balance
|
| 316 |
+
smpl_y_up: true
|
| 317 |
+
resampling_time_range:
|
| 318 |
+
- 1000000000.0
|
| 319 |
+
- 1000000000.0
|
| 320 |
+
debug_vis: true
|
| 321 |
+
dt_future_ref_frames: 0.1
|
| 322 |
+
num_future_frames: 10
|
| 323 |
+
pose_range:
|
| 324 |
+
x:
|
| 325 |
+
- -0.05
|
| 326 |
+
- 0.05
|
| 327 |
+
'y':
|
| 328 |
+
- -0.05
|
| 329 |
+
- 0.05
|
| 330 |
+
z:
|
| 331 |
+
- -0.01
|
| 332 |
+
- 0.01
|
| 333 |
+
roll:
|
| 334 |
+
- -0.1
|
| 335 |
+
- 0.1
|
| 336 |
+
pitch:
|
| 337 |
+
- -0.1
|
| 338 |
+
- 0.1
|
| 339 |
+
yaw:
|
| 340 |
+
- -0.2
|
| 341 |
+
- 0.2
|
| 342 |
+
velocity_range:
|
| 343 |
+
x:
|
| 344 |
+
- -0.5
|
| 345 |
+
- 0.5
|
| 346 |
+
'y':
|
| 347 |
+
- -0.5
|
| 348 |
+
- 0.5
|
| 349 |
+
z:
|
| 350 |
+
- -0.2
|
| 351 |
+
- 0.2
|
| 352 |
+
roll:
|
| 353 |
+
- -0.52
|
| 354 |
+
- 0.52
|
| 355 |
+
pitch:
|
| 356 |
+
- -0.52
|
| 357 |
+
- 0.52
|
| 358 |
+
yaw:
|
| 359 |
+
- -0.78
|
| 360 |
+
- 0.78
|
| 361 |
+
joint_position_range:
|
| 362 |
+
- -0.1
|
| 363 |
+
- 0.1
|
| 364 |
+
joint_velocity_range:
|
| 365 |
+
- 0
|
| 366 |
+
- 0
|
| 367 |
+
anchor_body: pelvis
|
| 368 |
+
vr_3point_body:
|
| 369 |
+
- left_wrist_yaw_link
|
| 370 |
+
- right_wrist_yaw_link
|
| 371 |
+
- torso_link
|
| 372 |
+
vr_3point_body_offset:
|
| 373 |
+
- - 0.18
|
| 374 |
+
- -0.025
|
| 375 |
+
- 0.0
|
| 376 |
+
- - 0.18
|
| 377 |
+
- 0.025
|
| 378 |
+
- 0.0
|
| 379 |
+
- - 0.0
|
| 380 |
+
- 0.0
|
| 381 |
+
- 0.35
|
| 382 |
+
reward_point_body:
|
| 383 |
+
- torso_link
|
| 384 |
+
- left_wrist_yaw_link
|
| 385 |
+
- right_wrist_yaw_link
|
| 386 |
+
reward_point_body_offset:
|
| 387 |
+
- - 0.0
|
| 388 |
+
- 0.0
|
| 389 |
+
- 0.5
|
| 390 |
+
- - 0.0
|
| 391 |
+
- -0.0
|
| 392 |
+
- 0.0
|
| 393 |
+
- - 0.0
|
| 394 |
+
- -0.0
|
| 395 |
+
- 0.0
|
| 396 |
+
body_names:
|
| 397 |
+
- pelvis
|
| 398 |
+
- left_hip_roll_link
|
| 399 |
+
- left_knee_link
|
| 400 |
+
- left_ankle_roll_link
|
| 401 |
+
- right_hip_roll_link
|
| 402 |
+
- right_knee_link
|
| 403 |
+
- right_ankle_roll_link
|
| 404 |
+
- torso_link
|
| 405 |
+
- left_shoulder_roll_link
|
| 406 |
+
- left_elbow_link
|
| 407 |
+
- left_wrist_yaw_link
|
| 408 |
+
- right_shoulder_roll_link
|
| 409 |
+
- right_elbow_link
|
| 410 |
+
- right_wrist_yaw_link
|
| 411 |
+
smpl_num_future_frames: 10
|
| 412 |
+
smpl_dt_future_ref_frames: 0.02
|
| 413 |
+
cat_upper_body_poses: true
|
| 414 |
+
cat_upper_body_poses_prob: 0.5
|
| 415 |
+
freeze_frame_aug: true
|
| 416 |
+
teleop_sample_prob_when_smpl: 0.5
|
| 417 |
+
_target_: gear_sonic.envs.manager_env.mdp.commands.CommandsCfg
|
| 418 |
+
actions:
|
| 419 |
+
joint_pos:
|
| 420 |
+
_target_: isaaclab.envs.mdp.actions.JointPositionActionCfg
|
| 421 |
+
asset_name: robot
|
| 422 |
+
joint_names:
|
| 423 |
+
- .*
|
| 424 |
+
use_default_offset: true
|
| 425 |
+
_target_: gear_sonic.envs.manager_env.mdp.actions.ActionsCfg
|
| 426 |
+
observations:
|
| 427 |
+
policy:
|
| 428 |
+
gravity_dir:
|
| 429 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 430 |
+
func: gear_sonic.envs.manager_env.mdp:gravity_dir
|
| 431 |
+
params:
|
| 432 |
+
command_name: motion
|
| 433 |
+
history_length: ${actor_prop_history_length}
|
| 434 |
+
noise:
|
| 435 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 436 |
+
n_min: -0.05
|
| 437 |
+
n_max: 0.05
|
| 438 |
+
base_ang_vel:
|
| 439 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 440 |
+
func: gear_sonic.envs.manager_env.mdp:base_ang_vel
|
| 441 |
+
history_length: ${actor_prop_history_length}
|
| 442 |
+
noise:
|
| 443 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 444 |
+
n_min: -0.2
|
| 445 |
+
n_max: 0.2
|
| 446 |
+
joint_pos:
|
| 447 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 448 |
+
func: gear_sonic.envs.manager_env.mdp:joint_pos_rel
|
| 449 |
+
history_length: ${actor_prop_history_length}
|
| 450 |
+
noise:
|
| 451 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 452 |
+
n_min: -0.01
|
| 453 |
+
n_max: 0.01
|
| 454 |
+
joint_vel:
|
| 455 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 456 |
+
func: gear_sonic.envs.manager_env.mdp:joint_vel_rel
|
| 457 |
+
history_length: ${actor_prop_history_length}
|
| 458 |
+
noise:
|
| 459 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 460 |
+
n_min: -0.5
|
| 461 |
+
n_max: 0.5
|
| 462 |
+
actions:
|
| 463 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 464 |
+
func: gear_sonic.envs.manager_env.mdp:last_action
|
| 465 |
+
history_length: ${actor_actions_history_length}
|
| 466 |
+
_target_: gear_sonic.envs.manager_env.mdp.observations.PolicyCfg
|
| 467 |
+
enable_corruption: true
|
| 468 |
+
concatenate_terms: true
|
| 469 |
+
critic:
|
| 470 |
+
command_multi_future:
|
| 471 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 472 |
+
func: gear_sonic.envs.manager_env.mdp:command_multi_future
|
| 473 |
+
params:
|
| 474 |
+
command_name: motion
|
| 475 |
+
motion_anchor_pos_b:
|
| 476 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 477 |
+
func: gear_sonic.envs.manager_env.mdp:motion_anchor_pos_b
|
| 478 |
+
params:
|
| 479 |
+
command_name: motion
|
| 480 |
+
motion_anchor_ori_b:
|
| 481 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 482 |
+
func: gear_sonic.envs.manager_env.mdp:motion_anchor_ori_b
|
| 483 |
+
params:
|
| 484 |
+
command_name: motion
|
| 485 |
+
body_pos:
|
| 486 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 487 |
+
func: gear_sonic.envs.manager_env.mdp:robot_body_pos_b
|
| 488 |
+
params:
|
| 489 |
+
command_name: motion
|
| 490 |
+
body_ori:
|
| 491 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 492 |
+
func: gear_sonic.envs.manager_env.mdp:robot_body_ori_b
|
| 493 |
+
params:
|
| 494 |
+
command_name: motion
|
| 495 |
+
base_lin_vel:
|
| 496 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 497 |
+
func: gear_sonic.envs.manager_env.mdp:base_lin_vel
|
| 498 |
+
history_length: ${critic_prop_history_length}
|
| 499 |
+
base_ang_vel:
|
| 500 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 501 |
+
func: gear_sonic.envs.manager_env.mdp:base_ang_vel
|
| 502 |
+
history_length: ${critic_prop_history_length}
|
| 503 |
+
joint_pos:
|
| 504 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 505 |
+
func: gear_sonic.envs.manager_env.mdp:joint_pos_rel
|
| 506 |
+
history_length: ${critic_prop_history_length}
|
| 507 |
+
joint_vel:
|
| 508 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 509 |
+
func: gear_sonic.envs.manager_env.mdp:joint_vel_rel
|
| 510 |
+
history_length: ${critic_prop_history_length}
|
| 511 |
+
actions:
|
| 512 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 513 |
+
func: gear_sonic.envs.manager_env.mdp:last_action
|
| 514 |
+
history_length: ${critic_actions_history_length}
|
| 515 |
+
_target_: gear_sonic.envs.manager_env.mdp.observations.PrivilegedCfg
|
| 516 |
+
tokenizer:
|
| 517 |
+
encoder_index:
|
| 518 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 519 |
+
func: gear_sonic.envs.manager_env.mdp:get_command_obs
|
| 520 |
+
params:
|
| 521 |
+
command_name: motion
|
| 522 |
+
obs_name: episode_encoder_index
|
| 523 |
+
command_multi_future_nonflat:
|
| 524 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 525 |
+
func: gear_sonic.envs.manager_env.mdp:command_multi_future
|
| 526 |
+
params:
|
| 527 |
+
command_name: motion
|
| 528 |
+
non_flatten: true
|
| 529 |
+
command_z_multi_future_nonflat:
|
| 530 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 531 |
+
func: gear_sonic.envs.manager_env.mdp:command_z_multi_future
|
| 532 |
+
params:
|
| 533 |
+
command_name: motion
|
| 534 |
+
non_flatten: true
|
| 535 |
+
motion_anchor_ori_b_mf_nonflat:
|
| 536 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 537 |
+
func: gear_sonic.envs.manager_env.mdp:motion_anchor_ori_b_mf
|
| 538 |
+
params:
|
| 539 |
+
command_name: motion
|
| 540 |
+
non_flatten: true
|
| 541 |
+
noise:
|
| 542 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 543 |
+
n_min: -0.05
|
| 544 |
+
n_max: 0.05
|
| 545 |
+
command_multi_future_lower_body:
|
| 546 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 547 |
+
func: gear_sonic.envs.manager_env.mdp:command_multi_future_lower_body
|
| 548 |
+
params:
|
| 549 |
+
command_name: motion
|
| 550 |
+
vr_3point_local_target:
|
| 551 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 552 |
+
func: gear_sonic.envs.manager_env.mdp:vr_3point_local_target
|
| 553 |
+
params:
|
| 554 |
+
command_name: motion
|
| 555 |
+
vr_3point_local_orn_target:
|
| 556 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 557 |
+
func: gear_sonic.envs.manager_env.mdp:vr_3point_local_orn_target
|
| 558 |
+
params:
|
| 559 |
+
command_name: motion
|
| 560 |
+
motion_anchor_ori_b:
|
| 561 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 562 |
+
func: gear_sonic.envs.manager_env.mdp:motion_anchor_ori_b
|
| 563 |
+
params:
|
| 564 |
+
command_name: motion
|
| 565 |
+
noise:
|
| 566 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 567 |
+
n_min: -0.05
|
| 568 |
+
n_max: 0.05
|
| 569 |
+
command_z:
|
| 570 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 571 |
+
func: gear_sonic.envs.manager_env.mdp:command_z
|
| 572 |
+
params:
|
| 573 |
+
command_name: motion
|
| 574 |
+
smpl_joints_multi_future_local_nonflat:
|
| 575 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 576 |
+
func: gear_sonic.envs.manager_env.mdp:smpl_joints_multi_future_local
|
| 577 |
+
params:
|
| 578 |
+
command_name: motion
|
| 579 |
+
non_flatten: true
|
| 580 |
+
noise:
|
| 581 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 582 |
+
n_min: -0.05
|
| 583 |
+
n_max: 0.05
|
| 584 |
+
smpl_root_ori_b_multi_future:
|
| 585 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 586 |
+
func: gear_sonic.envs.manager_env.mdp:smpl_root_ori_b_mf
|
| 587 |
+
params:
|
| 588 |
+
command_name: motion
|
| 589 |
+
non_flatten: true
|
| 590 |
+
noise:
|
| 591 |
+
_target_: isaaclab.utils.noise.AdditiveUniformNoiseCfg
|
| 592 |
+
n_min: -0.05
|
| 593 |
+
n_max: 0.05
|
| 594 |
+
joint_pos_multi_future_wrist_for_smpl:
|
| 595 |
+
_target_: isaaclab.managers.ObservationTermCfg
|
| 596 |
+
func: gear_sonic.envs.manager_env.mdp:joint_pos_multi_future_select_joints_for_smpl
|
| 597 |
+
params:
|
| 598 |
+
command_name: motion
|
| 599 |
+
joints_idx:
|
| 600 |
+
- 23
|
| 601 |
+
- 24
|
| 602 |
+
- 25
|
| 603 |
+
- 26
|
| 604 |
+
- 27
|
| 605 |
+
- 28
|
| 606 |
+
_target_: gear_sonic.envs.manager_env.mdp.observations.TokenizerCfg
|
| 607 |
+
enable_corruption: true
|
| 608 |
+
concatenate_terms: false
|
| 609 |
+
_target_: gear_sonic.envs.manager_env.mdp.observations.ObservationsCfg
|
| 610 |
+
rewards:
|
| 611 |
+
tracking_anchor_pos:
|
| 612 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 613 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_anchor_pos_error
|
| 614 |
+
weight: 0.5
|
| 615 |
+
params:
|
| 616 |
+
command_name: motion
|
| 617 |
+
std: 0.3
|
| 618 |
+
tracking_anchor_ori:
|
| 619 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 620 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_anchor_ori_error
|
| 621 |
+
weight: 0.5
|
| 622 |
+
params:
|
| 623 |
+
command_name: motion
|
| 624 |
+
std: 0.4
|
| 625 |
+
tracking_relative_body_pos:
|
| 626 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 627 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_relative_body_pos_error
|
| 628 |
+
weight: 1.0
|
| 629 |
+
params:
|
| 630 |
+
command_name: motion
|
| 631 |
+
std: 0.3
|
| 632 |
+
tracking_relative_body_ori:
|
| 633 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 634 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_relative_body_ori_error
|
| 635 |
+
weight: 1.0
|
| 636 |
+
params:
|
| 637 |
+
command_name: motion
|
| 638 |
+
std: 0.4
|
| 639 |
+
tracking_body_linvel:
|
| 640 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 641 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_body_linvel_error
|
| 642 |
+
weight: 1.0
|
| 643 |
+
params:
|
| 644 |
+
command_name: motion
|
| 645 |
+
std: 1.0
|
| 646 |
+
tracking_body_angvel:
|
| 647 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 648 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_body_angvel_error
|
| 649 |
+
weight: 1.0
|
| 650 |
+
params:
|
| 651 |
+
command_name: motion
|
| 652 |
+
std: 3.14
|
| 653 |
+
action_rate_l2:
|
| 654 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 655 |
+
func: gear_sonic.envs.manager_env.mdp:action_rate_l2
|
| 656 |
+
weight: -0.1
|
| 657 |
+
joint_limit:
|
| 658 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 659 |
+
func: gear_sonic.envs.manager_env.mdp:joint_pos_limits
|
| 660 |
+
weight: -10.0
|
| 661 |
+
params:
|
| 662 |
+
asset_cfg:
|
| 663 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 664 |
+
name: robot
|
| 665 |
+
joint_names:
|
| 666 |
+
- .*
|
| 667 |
+
undesired_contacts:
|
| 668 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 669 |
+
func: gear_sonic.envs.manager_env.mdp:undesired_contacts
|
| 670 |
+
weight: -0.1
|
| 671 |
+
params:
|
| 672 |
+
sensor_cfg:
|
| 673 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 674 |
+
name: contact_forces
|
| 675 |
+
body_names:
|
| 676 |
+
- ^(?!left_ankle_roll_link$)(?!right_ankle_roll_link$)(?!left_wrist_yaw_link$)(?!right_wrist_yaw_link$)(?!left_elbow_link$)(?!right_elbow_link$).+$
|
| 677 |
+
threshold: 1.0
|
| 678 |
+
anti_shake_ang_vel:
|
| 679 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 680 |
+
func: gear_sonic.envs.manager_env.mdp:anti_shake_ang_vel_l2
|
| 681 |
+
weight: -0.005
|
| 682 |
+
params:
|
| 683 |
+
command_name: motion
|
| 684 |
+
threshold: 1.5
|
| 685 |
+
body_names:
|
| 686 |
+
- left_wrist_yaw_link
|
| 687 |
+
- right_wrist_yaw_link
|
| 688 |
+
- head_link
|
| 689 |
+
tracking_vr_5point_local:
|
| 690 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 691 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_local_vr_5point_error
|
| 692 |
+
weight: 2.0
|
| 693 |
+
params:
|
| 694 |
+
command_name: motion
|
| 695 |
+
std: 0.1
|
| 696 |
+
feet_acc:
|
| 697 |
+
_target_: isaaclab.managers.RewardTermCfg
|
| 698 |
+
func: gear_sonic.envs.manager_env.mdp:joint_acc_l2
|
| 699 |
+
weight: -2.5e-06
|
| 700 |
+
params:
|
| 701 |
+
asset_cfg:
|
| 702 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 703 |
+
name: robot
|
| 704 |
+
joint_names:
|
| 705 |
+
- .*ankle.*
|
| 706 |
+
_target_: gear_sonic.envs.manager_env.mdp.rewards.RewardsCfg
|
| 707 |
+
terminations:
|
| 708 |
+
anchor_pos:
|
| 709 |
+
_target_: isaaclab.managers.TerminationTermCfg
|
| 710 |
+
func: gear_sonic.envs.manager_env.mdp:exceeded_anchor_height
|
| 711 |
+
params:
|
| 712 |
+
command_name: motion
|
| 713 |
+
threshold: 0.15
|
| 714 |
+
threshold_adaptive: true
|
| 715 |
+
down_threshold: 0.75
|
| 716 |
+
root_height_threshold: 0.5
|
| 717 |
+
anchor_ori_full:
|
| 718 |
+
_target_: isaaclab.managers.TerminationTermCfg
|
| 719 |
+
func: gear_sonic.envs.manager_env.mdp:exceeded_anchor_ori
|
| 720 |
+
params:
|
| 721 |
+
asset_cfg:
|
| 722 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 723 |
+
name: robot
|
| 724 |
+
command_name: motion
|
| 725 |
+
threshold: 0.2
|
| 726 |
+
ee_body_pos:
|
| 727 |
+
_target_: isaaclab.managers.TerminationTermCfg
|
| 728 |
+
func: gear_sonic.envs.manager_env.mdp:exceeded_body_height
|
| 729 |
+
params:
|
| 730 |
+
command_name: motion
|
| 731 |
+
threshold: 0.15
|
| 732 |
+
threshold_adaptive: true
|
| 733 |
+
down_threshold: 0.75
|
| 734 |
+
root_height_threshold: 0.5
|
| 735 |
+
body_names:
|
| 736 |
+
- left_ankle_roll_link
|
| 737 |
+
- right_ankle_roll_link
|
| 738 |
+
- left_wrist_yaw_link
|
| 739 |
+
- right_wrist_yaw_link
|
| 740 |
+
time_out:
|
| 741 |
+
_target_: isaaclab.managers.TerminationTermCfg
|
| 742 |
+
func: gear_sonic.envs.manager_env.mdp:tracking_time_out
|
| 743 |
+
time_out: true
|
| 744 |
+
params:
|
| 745 |
+
command_name: motion
|
| 746 |
+
foot_pos_xyz:
|
| 747 |
+
_target_: isaaclab.managers.TerminationTermCfg
|
| 748 |
+
func: gear_sonic.envs.manager_env.mdp:exceeded_body_pos
|
| 749 |
+
params:
|
| 750 |
+
command_name: motion
|
| 751 |
+
threshold: 0.2
|
| 752 |
+
body_names:
|
| 753 |
+
- left_ankle_roll_link
|
| 754 |
+
- right_ankle_roll_link
|
| 755 |
+
_target_: gear_sonic.envs.manager_env.mdp.terminations.TerminationsCfg
|
| 756 |
+
events:
|
| 757 |
+
physics_material:
|
| 758 |
+
_target_: isaaclab.managers.EventTermCfg
|
| 759 |
+
func: gear_sonic.envs.manager_env.mdp:randomize_rigid_body_material
|
| 760 |
+
mode: startup
|
| 761 |
+
params:
|
| 762 |
+
asset_cfg:
|
| 763 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 764 |
+
name: robot
|
| 765 |
+
body_names: .*
|
| 766 |
+
static_friction_range:
|
| 767 |
+
- 0.3
|
| 768 |
+
- 1.6
|
| 769 |
+
dynamic_friction_range:
|
| 770 |
+
- 0.3
|
| 771 |
+
- 1.2
|
| 772 |
+
restitution_range:
|
| 773 |
+
- 0.0
|
| 774 |
+
- 0.5
|
| 775 |
+
num_buckets: 64
|
| 776 |
+
add_joint_default_pos:
|
| 777 |
+
_target_: isaaclab.managers.EventTermCfg
|
| 778 |
+
func: gear_sonic.envs.manager_env.mdp:randomize_joint_default_pos
|
| 779 |
+
mode: startup
|
| 780 |
+
params:
|
| 781 |
+
asset_cfg:
|
| 782 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 783 |
+
name: robot
|
| 784 |
+
joint_names:
|
| 785 |
+
- .*
|
| 786 |
+
pos_distribution_params:
|
| 787 |
+
- -0.01
|
| 788 |
+
- 0.01
|
| 789 |
+
operation: add
|
| 790 |
+
base_com:
|
| 791 |
+
_target_: isaaclab.managers.EventTermCfg
|
| 792 |
+
func: gear_sonic.envs.manager_env.mdp:randomize_rigid_body_com
|
| 793 |
+
mode: startup
|
| 794 |
+
params:
|
| 795 |
+
asset_cfg:
|
| 796 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 797 |
+
name: robot
|
| 798 |
+
body_names: torso_link
|
| 799 |
+
com_range:
|
| 800 |
+
x:
|
| 801 |
+
- -0.025
|
| 802 |
+
- 0.025
|
| 803 |
+
'y':
|
| 804 |
+
- -0.05
|
| 805 |
+
- 0.05
|
| 806 |
+
z:
|
| 807 |
+
- -0.05
|
| 808 |
+
- 0.05
|
| 809 |
+
push_robot:
|
| 810 |
+
_target_: isaaclab.managers.EventTermCfg
|
| 811 |
+
func: gear_sonic.envs.manager_env.mdp:push_by_setting_velocity
|
| 812 |
+
mode: interval
|
| 813 |
+
interval_range_s:
|
| 814 |
+
- 4.0
|
| 815 |
+
- 6.0
|
| 816 |
+
params:
|
| 817 |
+
velocity_range:
|
| 818 |
+
x:
|
| 819 |
+
- -0.5
|
| 820 |
+
- 0.5
|
| 821 |
+
'y':
|
| 822 |
+
- -0.5
|
| 823 |
+
- 0.5
|
| 824 |
+
z:
|
| 825 |
+
- -0.2
|
| 826 |
+
- 0.2
|
| 827 |
+
roll:
|
| 828 |
+
- -0.52
|
| 829 |
+
- 0.52
|
| 830 |
+
pitch:
|
| 831 |
+
- -0.52
|
| 832 |
+
- 0.52
|
| 833 |
+
yaw:
|
| 834 |
+
- -0.78
|
| 835 |
+
- 0.78
|
| 836 |
+
randomize_rigid_body_mass:
|
| 837 |
+
_target_: isaaclab.managers.EventTermCfg
|
| 838 |
+
func: gear_sonic.envs.manager_env.mdp:randomize_rigid_body_mass
|
| 839 |
+
mode: startup
|
| 840 |
+
params:
|
| 841 |
+
asset_cfg:
|
| 842 |
+
_target_: isaaclab.managers.SceneEntityCfg
|
| 843 |
+
name: robot
|
| 844 |
+
body_names: .*wrist_yaw.*|torso_link
|
| 845 |
+
mass_distribution_params:
|
| 846 |
+
- 0.8
|
| 847 |
+
- 2.5
|
| 848 |
+
operation: scale
|
| 849 |
+
_target_: gear_sonic.envs.manager_env.mdp.events.EventCfg
|
| 850 |
+
curriculum:
|
| 851 |
+
_target_: gear_sonic.envs.manager_env.mdp.curriculum.CurriculumCfg
|
| 852 |
+
recorders:
|
| 853 |
+
_target_: gear_sonic.envs.manager_env.mdp.recorders.RecordersCfg
|
| 854 |
+
_target_: gear_sonic.envs.manager_env.modular_tracking_env_cfg.ModularTrackingEnvCfg
|
| 855 |
+
config:
|
| 856 |
+
num_envs: ${num_envs}
|
| 857 |
+
env_spacing: 2.0
|
| 858 |
+
decimation: 4
|
| 859 |
+
episode_length_s: 10.0
|
| 860 |
+
sim_dt: 0.005
|
| 861 |
+
viewer_eye:
|
| 862 |
+
- 4.5
|
| 863 |
+
- 0.0
|
| 864 |
+
- 6.0
|
| 865 |
+
viewer_lookat:
|
| 866 |
+
- 0.0
|
| 867 |
+
- 0.0
|
| 868 |
+
- 2.0
|
| 869 |
+
render_results: false
|
| 870 |
+
save_rendering_dir: ${experiment_dir}/renderings_training
|
| 871 |
+
experiment_dir: ${experiment_dir}
|
| 872 |
+
terrain_type: trimesh
|
| 873 |
+
object_mass: null
|
| 874 |
+
table_offset: null
|
| 875 |
+
eval_camera_offset:
|
| 876 |
+
- 2
|
| 877 |
+
- 2
|
| 878 |
+
- 1
|
| 879 |
+
action_transform_module_cfg: null
|
| 880 |
+
action_transform_module_checkpoint: null
|
| 881 |
+
meta_action_dim: null
|
| 882 |
+
needs_policy_atm: true
|
| 883 |
+
obs:
|
| 884 |
+
obs_dict: {}
|
| 885 |
+
obs_dims: {}
|
| 886 |
+
group_obs_dims: {}
|
| 887 |
+
group_obs_names: {}
|
| 888 |
+
action_clip_value: 20.0
|
| 889 |
+
robot:
|
| 890 |
+
type: g1_model_12_dex
|
| 891 |
+
algo_obs_dim_dict: {}
|
| 892 |
+
rewards:
|
| 893 |
+
num_critics: 1
|
| 894 |
+
train_only_events:
|
| 895 |
+
- push_robot
|
| 896 |
+
- compliance_force_push
|
| 897 |
+
use_manager_env: true
|
| 898 |
+
exp_base: ${hydra:runtime.choices.exp}
|
| 899 |
+
exp_var: ft_m7_B
|
| 900 |
+
actor_prop_history_length: 10
|
| 901 |
+
actor_actions_history_length: 10
|
| 902 |
+
critic_prop_history_length: 10
|
| 903 |
+
critic_actions_history_length: 10
|
model_config.yaml
ADDED
|
@@ -0,0 +1,317 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
algo_config:
|
| 2 |
+
actor:
|
| 3 |
+
_target_: gear_sonic.trl.modules.actor_critic_modules.Actor
|
| 4 |
+
backbone:
|
| 5 |
+
_target_: gear_sonic.trl.modules.universal_token_modules.UniversalTokenModule
|
| 6 |
+
aux_loss_coef:
|
| 7 |
+
g1_recon: 0.01
|
| 8 |
+
g1_smpl_latent: 1.0
|
| 9 |
+
g1_teleop_latent: 1.0
|
| 10 |
+
reencoded_smpl_g1_latent: 1.0
|
| 11 |
+
teleop_smpl_latent: 1.0
|
| 12 |
+
aux_loss_func:
|
| 13 |
+
g1_recon:
|
| 14 |
+
_target_: gear_sonic.trl.losses.token_losses.G1ReconLoss
|
| 15 |
+
loss_type: mse
|
| 16 |
+
g1_smpl_latent:
|
| 17 |
+
_target_: gear_sonic.trl.losses.token_losses.G1SmplLatentLoss
|
| 18 |
+
loss_type: mse
|
| 19 |
+
g1_teleop_latent:
|
| 20 |
+
_target_: gear_sonic.trl.losses.token_losses.G1TeleopLatentLoss
|
| 21 |
+
loss_type: mse
|
| 22 |
+
reencoded_smpl_g1_latent:
|
| 23 |
+
_target_: gear_sonic.trl.losses.token_losses.ReencodedSmplG1LatentLoss
|
| 24 |
+
loss_type: mse
|
| 25 |
+
teleop_smpl_latent:
|
| 26 |
+
_target_: gear_sonic.trl.losses.token_losses.TeleopSmplLatentLoss
|
| 27 |
+
detach_teleop_target: true
|
| 28 |
+
loss_type: mse
|
| 29 |
+
decoders:
|
| 30 |
+
g1_dyn:
|
| 31 |
+
has_temporal_dim: false
|
| 32 |
+
inputs:
|
| 33 |
+
- token_flattened
|
| 34 |
+
- proprioception
|
| 35 |
+
outputs:
|
| 36 |
+
- action
|
| 37 |
+
params:
|
| 38 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 39 |
+
input_dim: null
|
| 40 |
+
module_config_dict:
|
| 41 |
+
layer_config:
|
| 42 |
+
activation: SiLU
|
| 43 |
+
hidden_dims:
|
| 44 |
+
- 2048
|
| 45 |
+
- 2048
|
| 46 |
+
- 1024
|
| 47 |
+
- 1024
|
| 48 |
+
- 512
|
| 49 |
+
- 512
|
| 50 |
+
type: MLP
|
| 51 |
+
num_input_temporal_dims: null
|
| 52 |
+
num_output_temporal_dims: null
|
| 53 |
+
output_dim: null
|
| 54 |
+
g1_kin:
|
| 55 |
+
has_temporal_dim: true
|
| 56 |
+
inputs:
|
| 57 |
+
- token
|
| 58 |
+
outputs:
|
| 59 |
+
- command_multi_future_nonflat
|
| 60 |
+
- motion_anchor_ori_b_mf_nonflat
|
| 61 |
+
params:
|
| 62 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 63 |
+
input_dim: null
|
| 64 |
+
module_config_dict:
|
| 65 |
+
layer_config:
|
| 66 |
+
activation: SiLU
|
| 67 |
+
hidden_dims:
|
| 68 |
+
- 2048
|
| 69 |
+
- 1024
|
| 70 |
+
- 512
|
| 71 |
+
- 512
|
| 72 |
+
type: MLP
|
| 73 |
+
num_input_temporal_dims: 2
|
| 74 |
+
num_output_temporal_dims: 10
|
| 75 |
+
output_dim: null
|
| 76 |
+
encoder_sample_probs:
|
| 77 |
+
g1: 1.0
|
| 78 |
+
smpl: 1.0
|
| 79 |
+
teleop: 1.0
|
| 80 |
+
encoders:
|
| 81 |
+
g1:
|
| 82 |
+
inputs:
|
| 83 |
+
- command_multi_future_nonflat
|
| 84 |
+
- motion_anchor_ori_b_mf_nonflat
|
| 85 |
+
params:
|
| 86 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 87 |
+
input_dim: null
|
| 88 |
+
module_config_dict:
|
| 89 |
+
layer_config:
|
| 90 |
+
activation: SiLU
|
| 91 |
+
hidden_dims:
|
| 92 |
+
- 2048
|
| 93 |
+
- 1024
|
| 94 |
+
- 512
|
| 95 |
+
- 512
|
| 96 |
+
type: MLP
|
| 97 |
+
num_input_temporal_dims: 10
|
| 98 |
+
num_output_temporal_dims: 2
|
| 99 |
+
output_dim: null
|
| 100 |
+
smpl:
|
| 101 |
+
inputs:
|
| 102 |
+
- smpl_joints_multi_future_local_nonflat
|
| 103 |
+
- smpl_root_ori_b_multi_future
|
| 104 |
+
- joint_pos_multi_future_wrist_for_smpl
|
| 105 |
+
params:
|
| 106 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 107 |
+
input_dim: null
|
| 108 |
+
module_config_dict:
|
| 109 |
+
layer_config:
|
| 110 |
+
activation: SiLU
|
| 111 |
+
hidden_dims:
|
| 112 |
+
- 2048
|
| 113 |
+
- 1024
|
| 114 |
+
- 512
|
| 115 |
+
- 512
|
| 116 |
+
type: MLP
|
| 117 |
+
num_input_temporal_dims: 10
|
| 118 |
+
num_output_temporal_dims: 2
|
| 119 |
+
output_dim: null
|
| 120 |
+
teleop:
|
| 121 |
+
inputs:
|
| 122 |
+
- command_multi_future_lower_body
|
| 123 |
+
- vr_3point_local_target
|
| 124 |
+
- vr_3point_local_orn_target
|
| 125 |
+
- motion_anchor_ori_b
|
| 126 |
+
params:
|
| 127 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 128 |
+
input_dim: null
|
| 129 |
+
module_config_dict:
|
| 130 |
+
layer_config:
|
| 131 |
+
activation: SiLU
|
| 132 |
+
hidden_dims:
|
| 133 |
+
- 2048
|
| 134 |
+
- 1024
|
| 135 |
+
- 512
|
| 136 |
+
- 512
|
| 137 |
+
type: MLP
|
| 138 |
+
num_input_temporal_dims: null
|
| 139 |
+
num_output_temporal_dims: 2
|
| 140 |
+
output_dim: null
|
| 141 |
+
fsq_level_list: 32
|
| 142 |
+
max_num_tokens: 2
|
| 143 |
+
num_fsq_levels: 32
|
| 144 |
+
num_future_frames: 10
|
| 145 |
+
proprioception_features:
|
| 146 |
+
- actor_obs
|
| 147 |
+
quantizer:
|
| 148 |
+
_target_: vector_quantize_pytorch.FSQ
|
| 149 |
+
reencode_smpl_g1_recon: true
|
| 150 |
+
has_aux_loss: true
|
| 151 |
+
input_obs_dict: true
|
| 152 |
+
running_mean_std: false
|
| 153 |
+
actor_learning_rate: 2.0e-05
|
| 154 |
+
adaptive_lr_max: 0.0002
|
| 155 |
+
adaptive_lr_min: 1.0e-05
|
| 156 |
+
clip_param: 0.2
|
| 157 |
+
critic:
|
| 158 |
+
_target_: gear_sonic.trl.modules.actor_critic_modules.Critic
|
| 159 |
+
backbone:
|
| 160 |
+
_target_: gear_sonic.trl.modules.base_module.BaseModule
|
| 161 |
+
module_config_dict:
|
| 162 |
+
input_dim:
|
| 163 |
+
- critic_obs
|
| 164 |
+
layer_config:
|
| 165 |
+
activation: SiLU
|
| 166 |
+
hidden_dims:
|
| 167 |
+
- 2048
|
| 168 |
+
- 2048
|
| 169 |
+
- 1024
|
| 170 |
+
- 1024
|
| 171 |
+
- 512
|
| 172 |
+
- 512
|
| 173 |
+
type: MLP
|
| 174 |
+
output_dim:
|
| 175 |
+
- 1
|
| 176 |
+
type: MLP
|
| 177 |
+
process_output_dim: true
|
| 178 |
+
running_mean_std: true
|
| 179 |
+
critic_learning_rate: 0.001
|
| 180 |
+
desired_kl: 0.01
|
| 181 |
+
empty_cache_every_n_ppo_epoch: -1
|
| 182 |
+
entropy_coef: 0.01
|
| 183 |
+
eval:
|
| 184 |
+
num_eval_episodes: 150
|
| 185 |
+
num_save_episodes: 200
|
| 186 |
+
save_goal_reached_only: true
|
| 187 |
+
save_trajectories: false
|
| 188 |
+
save_videos: false
|
| 189 |
+
video_save_prob: 1.0
|
| 190 |
+
eval_frequency: 500
|
| 191 |
+
gamma: 0.99
|
| 192 |
+
global_rank: 0
|
| 193 |
+
init_at_random_ep_len: true
|
| 194 |
+
init_noise_std: 0.05
|
| 195 |
+
lam: 0.95
|
| 196 |
+
load_optimizer: true
|
| 197 |
+
max_grad_norm: 0.1
|
| 198 |
+
num_learning_epochs: 5
|
| 199 |
+
num_learning_iterations: 100000
|
| 200 |
+
num_mini_batches: 4
|
| 201 |
+
num_steps_per_env: 24
|
| 202 |
+
ppo_shuffle_every_epoch: true
|
| 203 |
+
save_interval: 500
|
| 204 |
+
schedule: adaptive
|
| 205 |
+
std_clamp_max: 0.5
|
| 206 |
+
std_clamp_min: 0.001
|
| 207 |
+
sync_advantage_normalization: true
|
| 208 |
+
use_clampped_std: true
|
| 209 |
+
use_clipped_value_loss: true
|
| 210 |
+
use_new_actor_critic: true
|
| 211 |
+
use_padding_mask: false
|
| 212 |
+
value_loss_coef: 1.0
|
| 213 |
+
world_size: 1
|
| 214 |
+
env_config:
|
| 215 |
+
action_clip_value: 20.0
|
| 216 |
+
action_transform_module_cfg: null
|
| 217 |
+
action_transform_module_checkpoint: null
|
| 218 |
+
decimation: 4
|
| 219 |
+
env_spacing: 2.0
|
| 220 |
+
episode_length_s: 10.0
|
| 221 |
+
eval_camera_offset:
|
| 222 |
+
- 2
|
| 223 |
+
- 2
|
| 224 |
+
- 1
|
| 225 |
+
experiment_dir: !!python/object/apply:pathlib.PosixPath
|
| 226 |
+
- /
|
| 227 |
+
- data
|
| 228 |
+
- kkolesni
|
| 229 |
+
- GR00T-WholeBodyControl
|
| 230 |
+
- logs_rl
|
| 231 |
+
- ghost04
|
| 232 |
+
- manager
|
| 233 |
+
- universal_token
|
| 234 |
+
- all_modes
|
| 235 |
+
- sonic_release_ft_m7_B-20260927_014418
|
| 236 |
+
headless: true
|
| 237 |
+
meta_action_dim: null
|
| 238 |
+
needs_policy_atm: true
|
| 239 |
+
num_envs: 1
|
| 240 |
+
object_mass: null
|
| 241 |
+
obs:
|
| 242 |
+
group_obs_dims:
|
| 243 |
+
tokenizer:
|
| 244 |
+
command_multi_future_lower_body:
|
| 245 |
+
- 240
|
| 246 |
+
command_multi_future_nonflat:
|
| 247 |
+
- 10
|
| 248 |
+
- 58
|
| 249 |
+
command_z:
|
| 250 |
+
- 1
|
| 251 |
+
command_z_multi_future_nonflat:
|
| 252 |
+
- 10
|
| 253 |
+
- 1
|
| 254 |
+
encoder_index:
|
| 255 |
+
- 3
|
| 256 |
+
joint_pos_multi_future_wrist_for_smpl:
|
| 257 |
+
- 10
|
| 258 |
+
- 6
|
| 259 |
+
motion_anchor_ori_b:
|
| 260 |
+
- 6
|
| 261 |
+
motion_anchor_ori_b_mf_nonflat:
|
| 262 |
+
- 10
|
| 263 |
+
- 6
|
| 264 |
+
smpl_joints_multi_future_local_nonflat:
|
| 265 |
+
- 10
|
| 266 |
+
- 72
|
| 267 |
+
smpl_root_ori_b_multi_future:
|
| 268 |
+
- 10
|
| 269 |
+
- 6
|
| 270 |
+
vr_3point_local_orn_target:
|
| 271 |
+
- 12
|
| 272 |
+
vr_3point_local_target:
|
| 273 |
+
- 9
|
| 274 |
+
group_obs_names:
|
| 275 |
+
tokenizer:
|
| 276 |
+
- encoder_index
|
| 277 |
+
- command_multi_future_nonflat
|
| 278 |
+
- command_z_multi_future_nonflat
|
| 279 |
+
- command_z
|
| 280 |
+
- motion_anchor_ori_b
|
| 281 |
+
- motion_anchor_ori_b_mf_nonflat
|
| 282 |
+
- command_multi_future_lower_body
|
| 283 |
+
- vr_3point_local_target
|
| 284 |
+
- vr_3point_local_orn_target
|
| 285 |
+
- smpl_joints_multi_future_local_nonflat
|
| 286 |
+
- smpl_root_ori_b_multi_future
|
| 287 |
+
- joint_pos_multi_future_wrist_for_smpl
|
| 288 |
+
obs_dict: {}
|
| 289 |
+
obs_dims:
|
| 290 |
+
actor_obs: 930
|
| 291 |
+
critic_obs: 1645
|
| 292 |
+
tokenizer: 1761
|
| 293 |
+
render_results: false
|
| 294 |
+
rewards:
|
| 295 |
+
num_critics: 1
|
| 296 |
+
robot:
|
| 297 |
+
actions_dim: 29
|
| 298 |
+
algo_obs_dim_dict:
|
| 299 |
+
actor_obs: 930
|
| 300 |
+
critic_obs: 1645
|
| 301 |
+
tokenizer: 1761
|
| 302 |
+
type: g1_model_12_dex
|
| 303 |
+
save_rendering_dir: /data/kkolesni/GR00T-WholeBodyControl/logs_rl/ghost04/manager/universal_token/all_modes/sonic_release_ft_m7_B-20260927_014418/renderings_training
|
| 304 |
+
sim_dt: 0.005
|
| 305 |
+
table_offset: null
|
| 306 |
+
terrain_type: trimesh
|
| 307 |
+
train_only_events:
|
| 308 |
+
- push_robot
|
| 309 |
+
- compliance_force_push
|
| 310 |
+
viewer_eye:
|
| 311 |
+
- 4.5
|
| 312 |
+
- 0.0
|
| 313 |
+
- 6.0
|
| 314 |
+
viewer_lookat:
|
| 315 |
+
- 0.0
|
| 316 |
+
- 0.0
|
| 317 |
+
- 2.0
|
onnx_verify.json
ADDED
|
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"n_recorded_obs": 100,
|
| 3 |
+
"tolerance": 0.0001,
|
| 4 |
+
"recorded_obs_max_abs_diff": {
|
| 5 |
+
"sonic_catwalk_g1.onnx": 8.58306884765625e-06
|
| 6 |
+
},
|
| 7 |
+
"recorded_obs_pass": true,
|
| 8 |
+
"files": {
|
| 9 |
+
"sonic_catwalk_g1.onnx": {
|
| 10 |
+
"loads": true,
|
| 11 |
+
"example_max_abs_diff": 2.384185791015625e-06,
|
| 12 |
+
"input_shape": [
|
| 13 |
+
1,
|
| 14 |
+
1570
|
| 15 |
+
],
|
| 16 |
+
"output_shape": [
|
| 17 |
+
1,
|
| 18 |
+
29
|
| 19 |
+
]
|
| 20 |
+
},
|
| 21 |
+
"sonic_catwalk_encoder.onnx": {
|
| 22 |
+
"loads": true,
|
| 23 |
+
"example_max_abs_diff": 0.0,
|
| 24 |
+
"input_shape": [
|
| 25 |
+
1,
|
| 26 |
+
1751
|
| 27 |
+
],
|
| 28 |
+
"output_shape": [
|
| 29 |
+
1,
|
| 30 |
+
64
|
| 31 |
+
]
|
| 32 |
+
},
|
| 33 |
+
"sonic_catwalk_decoder.onnx": {
|
| 34 |
+
"loads": true,
|
| 35 |
+
"example_max_abs_diff": 1.0728836059570312e-06,
|
| 36 |
+
"input_shape": [
|
| 37 |
+
1,
|
| 38 |
+
994
|
| 39 |
+
],
|
| 40 |
+
"output_shape": [
|
| 41 |
+
1,
|
| 42 |
+
29
|
| 43 |
+
]
|
| 44 |
+
}
|
| 45 |
+
}
|
| 46 |
+
}
|
sonic_catwalk_decoder.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:aebf0c26e2c5cebb81583848eb8d0412779eed0bd86faedb89d3a0b67edb5277
|
| 3 |
+
size 40931482
|
sonic_catwalk_encoder.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f7015d9e6ee972bbe1a2e46054008c21087db97e2be283267400e28dcdf83f04
|
| 3 |
+
size 50220408
|
sonic_catwalk_g1.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f9937b9ab675e644cdc9f89175db3f8af2f31eddfc3ea9fafaf1e6513bb84962
|
| 3 |
+
size 58075937
|