MiniWan commited on
Commit
135db57
·
verified ·
1 Parent(s): 9de6226

Move the model into robotwin/, as in THUSI-Lab/PrismWAM

Browse files
README.md CHANGED
@@ -14,15 +14,16 @@ World Action Models**. It is released for evaluation only.
14
 
15
  [Code](https://github.com/THUSI-Lab/PrismWAM) · [Project page](https://prism-wam.github.io/) · [arXiv](https://arxiv.org/abs/2610.26564) · [PrismWAM checkpoints](https://huggingface.co/THUSI-Lab/PrismWAM)
16
 
17
- | Benchmark | Actions | Result |
18
- | --- | --- | ---: |
19
- | RoboTwin 2.0, Clean → Randomized | 14-D absolute joints | 83.67 |
20
 
21
  Average success rate in % over the 50 tasks in clean and randomized scenes, 100 episodes per task;
22
  trained on clean scenes only.
23
 
24
- This repository is one model folder: `config.yaml`, `policy.pt`, the RGB and depth VAEs, and the
25
- action statistics. On first use the code also fetches the T5 text encoder of
 
26
  [Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) and the CLIP image encoder of
27
  [Wan2.1-I2V-14B-480P](https://huggingface.co/Wan-AI/Wan2.1-I2V-14B-480P).
28
 
@@ -31,13 +32,13 @@ action statistics. On first use the code also fetches the T5 text encoder of
31
  Install the [code](https://github.com/THUSI-Lab/PrismWAM), then from the repository root:
32
 
33
  ```bash
34
- hf download THUSI-Lab/PrismWAM-Star --local-dir weights/prismwam_star
35
  ```
36
 
37
  ```python
38
  from prismwam import load_pretrained
39
 
40
- policy = load_pretrained("prismwam_star")
41
  observation["prompt"] = policy.format_prompt("lift the bottle with the right arm")
42
  out = policy.predict(observation, seed=0) # out["action"]: 32 x 14
43
  ```
 
14
 
15
  [Code](https://github.com/THUSI-Lab/PrismWAM) · [Project page](https://prism-wam.github.io/) · [arXiv](https://arxiv.org/abs/2610.26564) · [PrismWAM checkpoints](https://huggingface.co/THUSI-Lab/PrismWAM)
16
 
17
+ | Folder | Benchmark | Actions | Result |
18
+ | --- | --- | --- | ---: |
19
+ | `robotwin/` | RoboTwin 2.0, Clean → Randomized | 14-D absolute joints | 83.67 |
20
 
21
  Average success rate in % over the 50 tasks in clean and randomized scenes, 100 episodes per task;
22
  trained on clean scenes only.
23
 
24
+ The model folder is laid out like those of [THUSI-Lab/PrismWAM](https://huggingface.co/THUSI-Lab/PrismWAM):
25
+ `config.yaml`, `policy.pt`, the RGB and depth VAEs, and the action statistics. On first use the
26
+ code also fetches the T5 text encoder of
27
  [Wan2.2-TI2V-5B](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B) and the CLIP image encoder of
28
  [Wan2.1-I2V-14B-480P](https://huggingface.co/Wan-AI/Wan2.1-I2V-14B-480P).
29
 
 
32
  Install the [code](https://github.com/THUSI-Lab/PrismWAM), then from the repository root:
33
 
34
  ```bash
35
+ hf download THUSI-Lab/PrismWAM-Star --include "robotwin/*" --local-dir weights/prismwam_star
36
  ```
37
 
38
  ```python
39
  from prismwam import load_pretrained
40
 
41
+ policy = load_pretrained("prismwam_star/robotwin") # uses weights/prismwam_star/robotwin
42
  observation["prompt"] = policy.format_prompt("lift the bottle with the right arm")
43
  out = policy.predict(observation, seed=0) # out["action"]: 32 x 14
44
  ```
action_stats.pt → robotwin/action_stats.pt RENAMED
File without changes
config.yaml → robotwin/config.yaml RENAMED
File without changes
depth_vae.pt → robotwin/depth_vae.pt RENAMED
File without changes
policy.pt → robotwin/policy.pt RENAMED
File without changes
rgb_vae.pth → robotwin/rgb_vae.pth RENAMED
File without changes