Add model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: gemma
|
| 4 |
+
license_link: https://ai.google.dev/gemma/terms
|
| 5 |
+
pipeline_tag: robotics
|
| 6 |
+
tags:
|
| 7 |
+
- robotics
|
| 8 |
+
- vision-language-action
|
| 9 |
+
- robot-memory
|
| 10 |
+
- pi0.5
|
| 11 |
+
- robomme
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# Is Your Robot's Memory Just a Clock? — Checkpoints
|
| 15 |
+
|
| 16 |
+
<!-- TODO after arXiv: add the arXiv link here (https://arxiv.org/abs/XXXX.XXXXX) so these models appear on the Hugging Face paper page -->
|
| 17 |
+
|
| 18 |
+
Policies trained for the paper *Is Your Robot's Memory Just a Clock? Temporal Shortcuts in Memory-Augmented VLA Policies*.
|
| 19 |
+
Code: [github.com/bennidict23/memory-clock](https://github.com/bennidict23/memory-clock)
|
| 20 |
+
|
| 21 |
+
All models are trained from the pi0.5 base checkpoint with the released [RoboMME](https://github.com/RoboMME/robomme_policy_learning)
|
| 22 |
+
MME-VLA recipe (FrameSamp-Modul memory, 30k steps, global batch 64) and evaluated on RoboMME.
|
| 23 |
+
|
| 24 |
+
| Folder | Model | Used in |
|
| 25 |
+
|---|---|---|
|
| 26 |
+
| `clock/` | FrameSamp-Modul memory with time stamps | Figs. 6, 8b |
|
| 27 |
+
| `noclock/` | the same without time encoding (`use_pos_emb: false`) | Fig. 6 |
|
| 28 |
+
|
| 29 |
+
Each folder holds `29999/{params,assets}` (openpi / orbax format) and `history_config.txt`.
|
| 30 |
+
|
| 31 |
+
## Usage
|
| 32 |
+
|
| 33 |
+
```bash
|
| 34 |
+
git clone https://github.com/bennidict23/memory-clock.git && cd memory-clock
|
| 35 |
+
bash install.sh && bash download.sh # fetches these checkpoints into checkpoints/<name>/29999
|
| 36 |
+
bash run_eval.sh --model clock --task PickXtimes --event pause --len 100
|
| 37 |
+
```
|
| 38 |
+
|
| 39 |
+
## License
|
| 40 |
+
|
| 41 |
+
The weights are derived from pi0.5 / PaliGemma and are subject to the [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
|