Move the model into robotwin/, as in THUSI-Lab/PrismWAM
Browse files
README.md
CHANGED
|
@@ -14,15 +14,16 @@ World Action Models**. It is released for evaluation only.
|
|
| 14 |
|
| 15 |
[Code](https://github.com/THUSI-Lab/PrismWAM) · [Project page](https://prism-wam.github.io/) · [arXiv](https://arxiv.org/abs/2610.26564) · [PrismWAM checkpoints](https://huggingface.co/THUSI-Lab/PrismWAM)
|
| 16 |
|
| 17 |
-
| Benchmark | Actions | Result |
|
| 18 |
-
| --- | --- | ---: |
|
| 19 |
-
| RoboTwin 2.0, Clean → Randomized | 14-D absolute joints | 83.67 |
|
| 20 |
|
| 21 |
Average success rate in % over the 50 tasks in clean and randomized scenes, 100 episodes per task;
|
| 22 |
trained on clean scenes only.
|
| 23 |
|
| 24 |
-
|
| 25 |
-
|
|
|
|
| 26 |
[Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) and the CLIP image encoder of
|
| 27 |
[Wan2.1-I2V-14B-480P](https://huggingface.co/Wan-AI/Wan2.1-I2V-14B-480P).
|
| 28 |
|
|
@@ -31,13 +32,13 @@ action statistics. On first use the code also fetches the T5 text encoder of
|
|
| 31 |
Install the [code](https://github.com/THUSI-Lab/PrismWAM), then from the repository root:
|
| 32 |
|
| 33 |
```bash
|
| 34 |
-
hf download THUSI-Lab/PrismWAM-Star --local-dir weights/prismwam_star
|
| 35 |
```
|
| 36 |
|
| 37 |
```python
|
| 38 |
from prismwam import load_pretrained
|
| 39 |
|
| 40 |
-
policy = load_pretrained("prismwam_star")
|
| 41 |
observation["prompt"] = policy.format_prompt("lift the bottle with the right arm")
|
| 42 |
out = policy.predict(observation, seed=0) # out["action"]: 32 x 14
|
| 43 |
```
|
|
|
|
| 14 |
|
| 15 |
[Code](https://github.com/THUSI-Lab/PrismWAM) · [Project page](https://prism-wam.github.io/) · [arXiv](https://arxiv.org/abs/2610.26564) · [PrismWAM checkpoints](https://huggingface.co/THUSI-Lab/PrismWAM)
|
| 16 |
|
| 17 |
+
| Folder | Benchmark | Actions | Result |
|
| 18 |
+
| --- | --- | --- | ---: |
|
| 19 |
+
| `robotwin/` | RoboTwin 2.0, Clean → Randomized | 14-D absolute joints | 83.67 |
|
| 20 |
|
| 21 |
Average success rate in % over the 50 tasks in clean and randomized scenes, 100 episodes per task;
|
| 22 |
trained on clean scenes only.
|
| 23 |
|
| 24 |
+
The model folder is laid out like those of [THUSI-Lab/PrismWAM](https://huggingface.co/THUSI-Lab/PrismWAM):
|
| 25 |
+
`config.yaml`, `policy.pt`, the RGB and depth VAEs, and the action statistics. On first use the
|
| 26 |
+
code also fetches the T5 text encoder of
|
| 27 |
[Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) and the CLIP image encoder of
|
| 28 |
[Wan2.1-I2V-14B-480P](https://huggingface.co/Wan-AI/Wan2.1-I2V-14B-480P).
|
| 29 |
|
|
|
|
| 32 |
Install the [code](https://github.com/THUSI-Lab/PrismWAM), then from the repository root:
|
| 33 |
|
| 34 |
```bash
|
| 35 |
+
hf download THUSI-Lab/PrismWAM-Star --include "robotwin/*" --local-dir weights/prismwam_star
|
| 36 |
```
|
| 37 |
|
| 38 |
```python
|
| 39 |
from prismwam import load_pretrained
|
| 40 |
|
| 41 |
+
policy = load_pretrained("prismwam_star/robotwin") # uses weights/prismwam_star/robotwin
|
| 42 |
observation["prompt"] = policy.format_prompt("lift the bottle with the right arm")
|
| 43 |
out = policy.predict(observation, seed=0) # out["action"]: 32 x 14
|
| 44 |
```
|
action_stats.pt → robotwin/action_stats.pt
RENAMED
|
File without changes
|
config.yaml → robotwin/config.yaml
RENAMED
|
File without changes
|
depth_vae.pt → robotwin/depth_vae.pt
RENAMED
|
File without changes
|
policy.pt → robotwin/policy.pt
RENAMED
|
File without changes
|
rgb_vae.pth → robotwin/rgb_vae.pth
RENAMED
|
File without changes
|