Update representative checkpoint model card
Browse files
README.md
CHANGED
|
@@ -7,17 +7,21 @@ tags:
|
|
| 7 |
|
| 8 |
# DexPolicy representative checkpoints
|
| 9 |
|
| 10 |
-
This repository contains a representative subset of the object-specific policies reported in the DexPolicy paper. The released
|
| 11 |
|
| 12 |
## Checkpoints
|
| 13 |
|
| 14 |
-
| File | Method | Object | Seed |
|
| 15 |
|---|---|---|---:|---|
|
|
|
|
|
|
|
| 16 |
| `models/grpo_mustard_baseline_seed0.zip` | GRPO baseline | YCB 006 mustard bottle | 0 | Inherited, learned policy standard deviation |
|
| 17 |
| `models/grpo_mustard_dexpolicy_seed0.zip` | GRPO + DexPolicy | YCB 006 mustard bottle | 0 | Scheduled standard deviation, `0.10 -> 0.03` |
|
|
|
|
|
|
|
| 18 |
|
| 19 |
-
|
| 20 |
|
| 21 |
-
The archives follow the Stable-Baselines3 checkpoint layout and include the policy, PyTorch variables, optimizer state, and library-version metadata. These policies are object-specific and are not presented as a single cross-object policy.
|
| 22 |
|
| 23 |
This is a compact representative release rather than the complete multi-object checkpoint suite.
|
|
|
|
| 7 |
|
| 8 |
# DexPolicy representative checkpoints
|
| 9 |
|
| 10 |
+
This repository contains a representative subset of the object-specific policies reported in the DexPolicy paper. The released pairs use the YCB mustard-bottle relocation task and isolate the paper's exploration-scheduling intervention under PPO, GRPO, and FPO.
|
| 11 |
|
| 12 |
## Checkpoints
|
| 13 |
|
| 14 |
+
| File | Method | Object | Seed | Exploration during training |
|
| 15 |
|---|---|---|---:|---|
|
| 16 |
+
| `models/ppo_mustard_baseline_seed0.zip` | PPO baseline | YCB 006 mustard bottle | 0 | Learned policy standard deviation |
|
| 17 |
+
| `models/ppo_mustard_dexpolicy_seed0.zip` | PPO + DexPolicy | YCB 006 mustard bottle | 0 | Piecewise schedule from `0.20` to a final `0.04` plateau |
|
| 18 |
| `models/grpo_mustard_baseline_seed0.zip` | GRPO baseline | YCB 006 mustard bottle | 0 | Inherited, learned policy standard deviation |
|
| 19 |
| `models/grpo_mustard_dexpolicy_seed0.zip` | GRPO + DexPolicy | YCB 006 mustard bottle | 0 | Scheduled standard deviation, `0.10 -> 0.03` |
|
| 20 |
+
| `models/fpo_mustard_baseline_seed0.pt` | FPO baseline | YCB 006 mustard bottle | 0 | Fixed standard deviation, `0.10` |
|
| 21 |
+
| `models/fpo_mustard_dexpolicy_seed0.pt` | FPO + DexPolicy | YCB 006 mustard bottle | 0 | Linear schedule, `0.20 -> 0.05` |
|
| 22 |
|
| 23 |
+
The PPO and FPO pairs train for approximately 5M environment steps with matched settings within each pair. PPO uses an MLP actor mean; FPO uses a conditional-flow actor mean. The GRPO pair continues from matched object-and-seed checkpoints at 507,904 environment steps for another 250,000 steps. It uses the same reward, terminal success definition, curriculum stage, and return-to-go credit module; the exploration schedule is the controlled difference.
|
| 24 |
|
| 25 |
+
The PPO and GRPO `.zip` archives follow the Stable-Baselines3 checkpoint layout and include the policy, PyTorch variables, optimizer state, and library-version metadata. The FPO `.pt` files are PyTorch training checkpoints for the conditional-flow actor and critic. These policies are object-specific and are not presented as a single cross-object policy.
|
| 26 |
|
| 27 |
This is a compact representative release rather than the complete multi-object checkpoint suite.
|