Add model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,34 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- molmoact2
|
| 4 |
+
- robotics
|
| 5 |
+
- lerobot
|
| 6 |
+
- vla
|
| 7 |
+
datasets:
|
| 8 |
+
- armnet/busybox_multitask
|
| 9 |
+
---
|
| 10 |
+
|
| 11 |
+
# molmoact2_busybox_multitask
|
| 12 |
+
|
| 13 |
+
Full-component fine-tune of [MolmoAct2](https://huggingface.co/allenai/MolmoAct2) on SO-101 BusyBox multitask. Token embeddings stay frozen.
|
| 14 |
+
|
| 15 |
+
| | |
|
| 16 |
+
|---|---|
|
| 17 |
+
| **Init** | `allenai/MolmoAct2` (not the SO100_101 checkpoint) |
|
| 18 |
+
| **Dataset** | [armnet/busybox_multitask](https://huggingface.co/datasets/armnet/busybox_multitask) (132 episodes, 27 tasks) |
|
| 19 |
+
| **Cameras** | `top`, `wrist`, `front` |
|
| 20 |
+
| **Training** | 1× H200 NVL, batch 4, 20k steps, horizon 30, gradient checkpointing on |
|
| 21 |
+
| **Result** | loss 0.231 → 0.017. 5 h 21 m. Finished 2026-10-25 17:54 UTC. 5.046B learnable / 5.442B total |
|
| 22 |
+
| **W&B** | [olalqzcn](https://wandb.ai/pravsels/molmoact2_busybox_multitask/runs/olalqzcn) (offline run, partial sync) |
|
| 23 |
+
|
| 24 |
+
## Checkpoints
|
| 25 |
+
|
| 26 |
+
`checkpoint-20000/` is the final step.
|
| 27 |
+
|
| 28 |
+
`checkpoint-5000/` · `checkpoint-10000/` · `checkpoint-15000/` · `checkpoint-20000/`
|
| 29 |
+
|
| 30 |
+
```python
|
| 31 |
+
from huggingface_hub import snapshot_download
|
| 32 |
+
|
| 33 |
+
ckpt = snapshot_download("armnet/molmoact2_busybox_multitask", allow_patterns="checkpoint-20000/**")
|
| 34 |
+
```
|