Add DexPolicy model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,23 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- reinforcement-learning
|
| 4 |
+
- robotics
|
| 5 |
+
- dexterous-manipulation
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# DexPolicy representative checkpoints
|
| 9 |
+
|
| 10 |
+
This repository contains a representative subset of the object-specific policies reported in the DexPolicy paper. The released pair uses the YCB mustard-bottle relocation task and isolates the paper's exploration-scheduling intervention under GRPO.
|
| 11 |
+
|
| 12 |
+
## Checkpoints
|
| 13 |
+
|
| 14 |
+
| File | Method | Object | Seed | Continuation |
|
| 15 |
+
|---|---|---|---:|---|
|
| 16 |
+
| `models/grpo_mustard_baseline_seed0.zip` | GRPO baseline | YCB 006 mustard bottle | 0 | Inherited, learned policy standard deviation |
|
| 17 |
+
| `models/grpo_mustard_dexpolicy_seed0.zip` | GRPO + DexPolicy | YCB 006 mustard bottle | 0 | Scheduled standard deviation, `0.10 -> 0.03` |
|
| 18 |
+
|
| 19 |
+
Both policies continue from matched object-and-seed checkpoints at 507,904 environment steps for another 250,000 steps. They use the same reward, terminal success definition, curriculum stage, and GRPO return-to-go credit module; the exploration schedule is the controlled difference.
|
| 20 |
+
|
| 21 |
+
The archives follow the Stable-Baselines3 checkpoint layout and include the policy, PyTorch variables, optimizer state, and library-version metadata. These policies are object-specific and are not presented as a single cross-object policy.
|
| 22 |
+
|
| 23 |
+
This is a compact representative release rather than the complete multi-object checkpoint suite.
|