Potestates commited on
Commit
ec6cef0
·
verified ·
1 Parent(s): dce0041

Phase-2 pretrained base (OpenVLA-7B, 20k full-parameter steps, latp2_inv latent) as a post-training INIT

Browse files
p2fft_20k/action_decoder.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55a0c41e6ab2291d387db0df2a9231e9dba1624b7aee2c05f89be0439d2e2404
3
+ size 105268830
p2fft_20k/ctrl_meta.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "latent": "tc_cont",
3
+ "n_tokens": 4,
4
+ "codebook_size": 0,
5
+ "dz": 256,
6
+ "window_size": 12,
7
+ "step": 20000,
8
+ "vla_path": "/lustre/fs1/home/ti874297/lf/latent_free/cache/vla/openvla-7b",
9
+ "lam_path": "/lustre/fs1/home/ti874297/lf/latent_free/claude_survey/ckpt/s2mix_1ep.pt",
10
+ "acdc_tag": "s1_acdc_1ep",
11
+ "acdc_codebook": "vq_s1_acdc_1ep_K64.npz",
12
+ "tc_tag": "latp2_inv",
13
+ "dataset_name": "acdc_oxe29",
14
+ "train_frac": null,
15
+ "override": {},
16
+ "head": "flow",
17
+ "query_tokens": 4,
18
+ "flow": {
19
+ "width": 512,
20
+ "layers": 4,
21
+ "z_tok": 32,
22
+ "steps": 10
23
+ }
24
+ }
p2fft_20k/dataset_statistics.json ADDED
@@ -0,0 +1,3627 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "fractal20220817_data": {
3
+ "action": {
4
+ "mean": [
5
+ 0.006987463217228651,
6
+ 0.0062659792602062225,
7
+ -0.012625119648873806,
8
+ 0.043332017958164215,
9
+ -0.005756177939474583,
10
+ 0.0009130935650318861,
11
+ 0.5354204773902893
12
+ ],
13
+ "std": [
14
+ 0.06921203434467316,
15
+ 0.05965432524681091,
16
+ 0.07353132963180542,
17
+ 0.15610051155090332,
18
+ 0.1316419094800949,
19
+ 0.14593257009983063,
20
+ 0.49710309505462646
21
+ ],
22
+ "max": [
23
+ 2.9984593391418457,
24
+ 22.09052848815918,
25
+ 2.7507524490356445,
26
+ 1.570636510848999,
27
+ 1.5321086645126343,
28
+ 1.5691522359848022,
29
+ 1.0
30
+ ],
31
+ "min": [
32
+ -2.0204520225524902,
33
+ -5.497899532318115,
34
+ -2.031663417816162,
35
+ -1.569917917251587,
36
+ -1.569892168045044,
37
+ -1.570419430732727,
38
+ 0.0
39
+ ],
40
+ "q01": [
41
+ -0.22453527510166169,
42
+ -0.14820013284683228,
43
+ -0.231589707583189,
44
+ -0.3517994859814644,
45
+ -0.4193011274933815,
46
+ -0.43643461108207704,
47
+ 0.0
48
+ ],
49
+ "q99": [
50
+ 0.17824687153100965,
51
+ 0.14938379630446405,
52
+ 0.21842354819178575,
53
+ 0.5892666035890578,
54
+ 0.35272657424211445,
55
+ 0.44796681255102094,
56
+ 1.0
57
+ ],
58
+ "mask": [
59
+ true,
60
+ true,
61
+ true,
62
+ true,
63
+ true,
64
+ true,
65
+ false
66
+ ]
67
+ },
68
+ "proprio": {
69
+ "mean": [
70
+ 0.0,
71
+ 0.0,
72
+ 0.0,
73
+ 0.0,
74
+ 0.0,
75
+ 0.0,
76
+ 0.0
77
+ ],
78
+ "std": [
79
+ 0.0,
80
+ 0.0,
81
+ 0.0,
82
+ 0.0,
83
+ 0.0,
84
+ 0.0,
85
+ 0.0
86
+ ],
87
+ "max": [
88
+ 0.0,
89
+ 0.0,
90
+ 0.0,
91
+ 0.0,
92
+ 0.0,
93
+ 0.0,
94
+ 0.0
95
+ ],
96
+ "min": [
97
+ 0.0,
98
+ 0.0,
99
+ 0.0,
100
+ 0.0,
101
+ 0.0,
102
+ 0.0,
103
+ 0.0
104
+ ],
105
+ "q01": [
106
+ 0.0,
107
+ 0.0,
108
+ 0.0,
109
+ 0.0,
110
+ 0.0,
111
+ 0.0,
112
+ 0.0
113
+ ],
114
+ "q99": [
115
+ 0.0,
116
+ 0.0,
117
+ 0.0,
118
+ 0.0,
119
+ 0.0,
120
+ 0.0,
121
+ 0.0
122
+ ]
123
+ },
124
+ "num_transitions": 3786400,
125
+ "num_trajectories": 87212
126
+ },
127
+ "kuka": {
128
+ "action": {
129
+ "mean": [
130
+ -0.000666001986246556,
131
+ 0.0005195796256884933,
132
+ -0.0025409692898392677,
133
+ 0.0,
134
+ 0.0,
135
+ -0.04171476140618324,
136
+ 0.5571627616882324
137
+ ],
138
+ "std": [
139
+ 0.02349698171019554,
140
+ 0.03598447144031525,
141
+ 0.05768078938126564,
142
+ 0.0,
143
+ 0.0,
144
+ 0.15819761157035828,
145
+ 0.49720585346221924
146
+ ],
147
+ "max": [
148
+ 0.1844477355480194,
149
+ 0.41020017862319946,
150
+ 0.47794756293296814,
151
+ 0.0,
152
+ 0.0,
153
+ 1.9684287309646606,
154
+ 1.0
155
+ ],
156
+ "min": [
157
+ -0.18329957127571106,
158
+ -0.4093305170536041,
159
+ -0.31821030378341675,
160
+ 0.0,
161
+ 0.0,
162
+ -2.2200400829315186,
163
+ 0.0
164
+ ],
165
+ "q01": [
166
+ -0.0715009643882513,
167
+ -0.1005610878765583,
168
+ -0.14212991625070573,
169
+ 0.0,
170
+ 0.0,
171
+ -0.5773134130239487,
172
+ 0.0
173
+ ],
174
+ "q99": [
175
+ 0.07124358467757705,
176
+ 0.10033808737993255,
177
+ 0.17008798226714167,
178
+ 0.0,
179
+ 0.0,
180
+ 0.3423049446940424,
181
+ 1.0
182
+ ],
183
+ "mask": [
184
+ true,
185
+ true,
186
+ true,
187
+ true,
188
+ true,
189
+ true,
190
+ false
191
+ ]
192
+ },
193
+ "proprio": {
194
+ "mean": [
195
+ 0.0,
196
+ 0.0,
197
+ 0.0,
198
+ 0.0,
199
+ 0.0,
200
+ 0.0,
201
+ 0.0
202
+ ],
203
+ "std": [
204
+ 0.0,
205
+ 0.0,
206
+ 0.0,
207
+ 0.0,
208
+ 0.0,
209
+ 0.0,
210
+ 0.0
211
+ ],
212
+ "max": [
213
+ 0.0,
214
+ 0.0,
215
+ 0.0,
216
+ 0.0,
217
+ 0.0,
218
+ 0.0,
219
+ 0.0
220
+ ],
221
+ "min": [
222
+ 0.0,
223
+ 0.0,
224
+ 0.0,
225
+ 0.0,
226
+ 0.0,
227
+ 0.0,
228
+ 0.0
229
+ ],
230
+ "q01": [
231
+ 0.0,
232
+ 0.0,
233
+ 0.0,
234
+ 0.0,
235
+ 0.0,
236
+ 0.0,
237
+ 0.0
238
+ ],
239
+ "q99": [
240
+ 0.0,
241
+ 0.0,
242
+ 0.0,
243
+ 0.0,
244
+ 0.0,
245
+ 0.0,
246
+ 0.0
247
+ ]
248
+ },
249
+ "num_transitions": 8583978,
250
+ "num_trajectories": 580392
251
+ },
252
+ "bridge_oxe": {
253
+ "action": {
254
+ "mean": [
255
+ 0.0002893369528464973,
256
+ 0.00014495191862806678,
257
+ -0.00021900612046010792,
258
+ -0.0003023830649908632,
259
+ -0.00065906549571082,
260
+ 0.0002646197972353548,
261
+ 0.6497402787208557
262
+ ],
263
+ "std": [
264
+ 0.01000096183270216,
265
+ 0.014115499332547188,
266
+ 0.013139443472027779,
267
+ 0.029833167791366577,
268
+ 0.03306308761239052,
269
+ 0.06081424281001091,
270
+ 0.47789087891578674
271
+ ],
272
+ "max": [
273
+ 0.06491869688034058,
274
+ 0.10465731471776962,
275
+ 0.07840253412723541,
276
+ 0.48420292139053345,
277
+ 0.638953685760498,
278
+ 6.272472858428955,
279
+ 1.0
280
+ ],
281
+ "min": [
282
+ -0.0840979814529419,
283
+ -0.13874775171279907,
284
+ -0.06363017857074738,
285
+ -0.7343192100524902,
286
+ -0.35826510190963745,
287
+ -6.274418830871582,
288
+ 0.0
289
+ ],
290
+ "q01": [
291
+ -0.028917968273162842,
292
+ -0.04320061206817627,
293
+ -0.02554995596408844,
294
+ -0.08335682392120361,
295
+ -0.10034397959709168,
296
+ -0.15845893859863283,
297
+ 0.0
298
+ ],
299
+ "q99": [
300
+ 0.0288640558719635,
301
+ 0.04256527900695803,
302
+ 0.042192451655864716,
303
+ 0.08410081028938296,
304
+ 0.08085504114627841,
305
+ 0.1651961439847947,
306
+ 1.0
307
+ ],
308
+ "mask": [
309
+ true,
310
+ true,
311
+ true,
312
+ true,
313
+ true,
314
+ true,
315
+ false
316
+ ]
317
+ },
318
+ "proprio": {
319
+ "mean": [
320
+ 0.0,
321
+ 0.0,
322
+ 0.0,
323
+ 0.0,
324
+ 0.0,
325
+ 0.0,
326
+ 0.0
327
+ ],
328
+ "std": [
329
+ 0.0,
330
+ 0.0,
331
+ 0.0,
332
+ 0.0,
333
+ 0.0,
334
+ 0.0,
335
+ 0.0
336
+ ],
337
+ "max": [
338
+ 0.0,
339
+ 0.0,
340
+ 0.0,
341
+ 0.0,
342
+ 0.0,
343
+ 0.0,
344
+ 0.0
345
+ ],
346
+ "min": [
347
+ 0.0,
348
+ 0.0,
349
+ 0.0,
350
+ 0.0,
351
+ 0.0,
352
+ 0.0,
353
+ 0.0
354
+ ],
355
+ "q01": [
356
+ 0.0,
357
+ 0.0,
358
+ 0.0,
359
+ 0.0,
360
+ 0.0,
361
+ 0.0,
362
+ 0.0
363
+ ],
364
+ "q99": [
365
+ 0.0,
366
+ 0.0,
367
+ 0.0,
368
+ 0.0,
369
+ 0.0,
370
+ 0.0,
371
+ 0.0
372
+ ]
373
+ },
374
+ "num_transitions": 925025,
375
+ "num_trajectories": 28935
376
+ },
377
+ "taco_play": {
378
+ "action": {
379
+ "mean": [
380
+ -0.0038459412753582,
381
+ 0.009671558625996113,
382
+ 0.012780647724866867,
383
+ -0.005403801333159208,
384
+ -0.009606570936739445,
385
+ -0.002480780705809593,
386
+ 0.4263913035392761
387
+ ],
388
+ "std": [
389
+ 0.23254019021987915,
390
+ 0.36298397183418274,
391
+ 0.28692975640296936,
392
+ 0.26177117228507996,
393
+ 0.2438896894454956,
394
+ 0.5216496586799622,
395
+ 0.49469098448753357
396
+ ],
397
+ "max": [
398
+ 1.4915844202041626,
399
+ 2.1842432022094727,
400
+ 2.6836395263671875,
401
+ 5.035226821899414,
402
+ 2.665864944458008,
403
+ 4.250768661499023,
404
+ 1.0
405
+ ],
406
+ "min": [
407
+ -4.242457866668701,
408
+ -3.192805051803589,
409
+ -1.3371467590332031,
410
+ -4.202683448791504,
411
+ -2.6722638607025146,
412
+ -3.3467135429382324,
413
+ 0.0
414
+ ],
415
+ "q01": [
416
+ -0.7106140398979186,
417
+ -1.056944659948349,
418
+ -0.5878450274467468,
419
+ -0.7682853937149048,
420
+ -0.7180147767066956,
421
+ -1.5527938604354858,
422
+ 0.0
423
+ ],
424
+ "q99": [
425
+ 0.6482916426658629,
426
+ 1.0051310062408447,
427
+ 0.9480248689651489,
428
+ 0.6926478147506714,
429
+ 0.6351067513227462,
430
+ 1.628010264635086,
431
+ 1.0
432
+ ],
433
+ "mask": [
434
+ true,
435
+ true,
436
+ true,
437
+ true,
438
+ true,
439
+ true,
440
+ false
441
+ ]
442
+ },
443
+ "proprio": {
444
+ "mean": [
445
+ 0.0,
446
+ 0.0,
447
+ 0.0,
448
+ 0.0,
449
+ 0.0,
450
+ 0.0,
451
+ 0.0
452
+ ],
453
+ "std": [
454
+ 0.0,
455
+ 0.0,
456
+ 0.0,
457
+ 0.0,
458
+ 0.0,
459
+ 0.0,
460
+ 0.0
461
+ ],
462
+ "max": [
463
+ 0.0,
464
+ 0.0,
465
+ 0.0,
466
+ 0.0,
467
+ 0.0,
468
+ 0.0,
469
+ 0.0
470
+ ],
471
+ "min": [
472
+ 0.0,
473
+ 0.0,
474
+ 0.0,
475
+ 0.0,
476
+ 0.0,
477
+ 0.0,
478
+ 0.0
479
+ ],
480
+ "q01": [
481
+ 0.0,
482
+ 0.0,
483
+ 0.0,
484
+ 0.0,
485
+ 0.0,
486
+ 0.0,
487
+ 0.0
488
+ ],
489
+ "q99": [
490
+ 0.0,
491
+ 0.0,
492
+ 0.0,
493
+ 0.0,
494
+ 0.0,
495
+ 0.0,
496
+ 0.0
497
+ ]
498
+ },
499
+ "num_transitions": 237798,
500
+ "num_trajectories": 3603
501
+ },
502
+ "jaco_play": {
503
+ "action": {
504
+ "mean": [
505
+ 0.0009658571798354387,
506
+ -0.0058007449842989445,
507
+ -0.0039506033062934875,
508
+ 0.0,
509
+ 0.0,
510
+ 0.0,
511
+ 0.34934908151626587
512
+ ],
513
+ "std": [
514
+ 0.12235091626644135,
515
+ 0.09678775072097778,
516
+ 0.11155400425195694,
517
+ 0.0,
518
+ 0.0,
519
+ 0.0,
520
+ 0.47682490944862366
521
+ ],
522
+ "max": [
523
+ 0.20000000298023224,
524
+ 0.20000000298023224,
525
+ 0.20000000298023224,
526
+ 0.0,
527
+ 0.0,
528
+ 0.0,
529
+ 1.0
530
+ ],
531
+ "min": [
532
+ -0.20000000298023224,
533
+ -0.20000000298023224,
534
+ -0.20000000298023224,
535
+ 0.0,
536
+ 0.0,
537
+ 0.0,
538
+ 0.0
539
+ ],
540
+ "q01": [
541
+ -0.20000000298023224,
542
+ -0.20000000298023224,
543
+ -0.20000000298023224,
544
+ 0.0,
545
+ 0.0,
546
+ 0.0,
547
+ 0.0
548
+ ],
549
+ "q99": [
550
+ 0.20000000298023224,
551
+ 0.20000000298023224,
552
+ 0.20000000298023224,
553
+ 0.0,
554
+ 0.0,
555
+ 0.0,
556
+ 1.0
557
+ ],
558
+ "mask": [
559
+ true,
560
+ true,
561
+ true,
562
+ true,
563
+ true,
564
+ true,
565
+ false
566
+ ]
567
+ },
568
+ "proprio": {
569
+ "mean": [
570
+ 0.0,
571
+ 0.0,
572
+ 0.0,
573
+ 0.0,
574
+ 0.0,
575
+ 0.0,
576
+ 0.0
577
+ ],
578
+ "std": [
579
+ 0.0,
580
+ 0.0,
581
+ 0.0,
582
+ 0.0,
583
+ 0.0,
584
+ 0.0,
585
+ 0.0
586
+ ],
587
+ "max": [
588
+ 0.0,
589
+ 0.0,
590
+ 0.0,
591
+ 0.0,
592
+ 0.0,
593
+ 0.0,
594
+ 0.0
595
+ ],
596
+ "min": [
597
+ 0.0,
598
+ 0.0,
599
+ 0.0,
600
+ 0.0,
601
+ 0.0,
602
+ 0.0,
603
+ 0.0
604
+ ],
605
+ "q01": [
606
+ 0.0,
607
+ 0.0,
608
+ 0.0,
609
+ 0.0,
610
+ 0.0,
611
+ 0.0,
612
+ 0.0
613
+ ],
614
+ "q99": [
615
+ 0.0,
616
+ 0.0,
617
+ 0.0,
618
+ 0.0,
619
+ 0.0,
620
+ 0.0,
621
+ 0.0
622
+ ]
623
+ },
624
+ "num_transitions": 77965,
625
+ "num_trajectories": 1085
626
+ },
627
+ "berkeley_cable_routing": {
628
+ "action": {
629
+ "mean": [
630
+ -0.07139848172664642,
631
+ 0.02360900677740574,
632
+ 0.10241951793432236,
633
+ 0.0,
634
+ 0.0,
635
+ 0.04967072233557701,
636
+ 0.0
637
+ ],
638
+ "std": [
639
+ 0.18154974281787872,
640
+ 0.18109895288944244,
641
+ 0.21220748126506805,
642
+ 0.0,
643
+ 0.0,
644
+ 0.34755122661590576,
645
+ 0.0
646
+ ],
647
+ "max": [
648
+ 0.9633283019065857,
649
+ 1.0,
650
+ 1.0,
651
+ 0.0,
652
+ 0.0,
653
+ 1.0,
654
+ 0.0
655
+ ],
656
+ "min": [
657
+ -0.9809081554412842,
658
+ -0.9554349184036255,
659
+ -0.9994775056838989,
660
+ 0.0,
661
+ 0.0,
662
+ -1.0,
663
+ 0.0
664
+ ],
665
+ "q01": [
666
+ -0.5534318816661835,
667
+ -0.4797285574674606,
668
+ -0.5314934802055359,
669
+ 0.0,
670
+ 0.0,
671
+ -0.8855219376087189,
672
+ 0.0
673
+ ],
674
+ "q99": [
675
+ 0.42652835428714786,
676
+ 0.5000944086909298,
677
+ 0.639823433756829,
678
+ 0.0,
679
+ 0.0,
680
+ 0.984243879914284,
681
+ 0.0
682
+ ],
683
+ "mask": [
684
+ true,
685
+ true,
686
+ true,
687
+ true,
688
+ true,
689
+ true,
690
+ false
691
+ ]
692
+ },
693
+ "proprio": {
694
+ "mean": [
695
+ 0.0,
696
+ 0.0,
697
+ 0.0,
698
+ 0.0,
699
+ 0.0,
700
+ 0.0,
701
+ 0.0
702
+ ],
703
+ "std": [
704
+ 0.0,
705
+ 0.0,
706
+ 0.0,
707
+ 0.0,
708
+ 0.0,
709
+ 0.0,
710
+ 0.0
711
+ ],
712
+ "max": [
713
+ 0.0,
714
+ 0.0,
715
+ 0.0,
716
+ 0.0,
717
+ 0.0,
718
+ 0.0,
719
+ 0.0
720
+ ],
721
+ "min": [
722
+ 0.0,
723
+ 0.0,
724
+ 0.0,
725
+ 0.0,
726
+ 0.0,
727
+ 0.0,
728
+ 0.0
729
+ ],
730
+ "q01": [
731
+ 0.0,
732
+ 0.0,
733
+ 0.0,
734
+ 0.0,
735
+ 0.0,
736
+ 0.0,
737
+ 0.0
738
+ ],
739
+ "q99": [
740
+ 0.0,
741
+ 0.0,
742
+ 0.0,
743
+ 0.0,
744
+ 0.0,
745
+ 0.0,
746
+ 0.0
747
+ ]
748
+ },
749
+ "num_transitions": 42328,
750
+ "num_trajectories": 1647
751
+ },
752
+ "roboturk": {
753
+ "action": {
754
+ "mean": [
755
+ 0.0014448887668550014,
756
+ -0.0015945356572046876,
757
+ -0.0011753805447369814,
758
+ 0.0023012396413832903,
759
+ -0.0009382437565363944,
760
+ -0.00011485873983474448,
761
+ 0.5746025443077087
762
+ ],
763
+ "std": [
764
+ 0.0493537001311779,
765
+ 0.06354563683271408,
766
+ 0.06116491183638573,
767
+ 0.0955340564250946,
768
+ 0.08420014381408691,
769
+ 0.06517912447452545,
770
+ 0.49451765418052673
771
+ ],
772
+ "max": [
773
+ 0.39124172925949097,
774
+ 0.4601028263568878,
775
+ 0.4870833456516266,
776
+ 1.816888689994812,
777
+ 1.8240282535552979,
778
+ 1.4824820756912231,
779
+ 1.0
780
+ ],
781
+ "min": [
782
+ -0.6546999216079712,
783
+ -0.6365841031074524,
784
+ -0.4217723608016968,
785
+ -1.6695482730865479,
786
+ -1.8023357391357422,
787
+ -1.4630827903747559,
788
+ 0.0
789
+ ],
790
+ "q01": [
791
+ -0.1342635464668274,
792
+ -0.19996687173843383,
793
+ -0.1482972100377083,
794
+ -0.20720748245716095,
795
+ -0.09676413893699647,
796
+ -0.18075634717941286,
797
+ 0.0
798
+ ],
799
+ "q99": [
800
+ 0.14956976801157001,
801
+ 0.1805950567126275,
802
+ 0.18841815620660796,
803
+ 0.21615413755178453,
804
+ 0.09457383215427405,
805
+ 0.18543301910162005,
806
+ 1.0
807
+ ],
808
+ "mask": [
809
+ true,
810
+ true,
811
+ true,
812
+ true,
813
+ true,
814
+ true,
815
+ false
816
+ ]
817
+ },
818
+ "proprio": {
819
+ "mean": [
820
+ 0.0,
821
+ 0.0,
822
+ 0.0,
823
+ 0.0,
824
+ 0.0,
825
+ 0.0,
826
+ 0.0
827
+ ],
828
+ "std": [
829
+ 0.0,
830
+ 0.0,
831
+ 0.0,
832
+ 0.0,
833
+ 0.0,
834
+ 0.0,
835
+ 0.0
836
+ ],
837
+ "max": [
838
+ 0.0,
839
+ 0.0,
840
+ 0.0,
841
+ 0.0,
842
+ 0.0,
843
+ 0.0,
844
+ 0.0
845
+ ],
846
+ "min": [
847
+ 0.0,
848
+ 0.0,
849
+ 0.0,
850
+ 0.0,
851
+ 0.0,
852
+ 0.0,
853
+ 0.0
854
+ ],
855
+ "q01": [
856
+ 0.0,
857
+ 0.0,
858
+ 0.0,
859
+ 0.0,
860
+ 0.0,
861
+ 0.0,
862
+ 0.0
863
+ ],
864
+ "q99": [
865
+ 0.0,
866
+ 0.0,
867
+ 0.0,
868
+ 0.0,
869
+ 0.0,
870
+ 0.0,
871
+ 0.0
872
+ ]
873
+ },
874
+ "num_transitions": 187507,
875
+ "num_trajectories": 1995
876
+ },
877
+ "viola": {
878
+ "action": {
879
+ "mean": [
880
+ 0.04761877655982971,
881
+ -0.029204610735177994,
882
+ 0.05586715787649155,
883
+ -0.0026184841990470886,
884
+ 0.0068673426285386086,
885
+ -0.016821278259158134,
886
+ 0.7323777675628662
887
+ ],
888
+ "std": [
889
+ 0.39158034324645996,
890
+ 0.4076541066169739,
891
+ 0.4007757008075714,
892
+ 0.1002395898103714,
893
+ 0.08443206548690796,
894
+ 0.10375133156776428,
895
+ 0.44260966777801514
896
+ ],
897
+ "max": [
898
+ 1.0,
899
+ 1.0,
900
+ 1.0,
901
+ 0.375,
902
+ 0.36321428418159485,
903
+ 0.375,
904
+ 1.0
905
+ ],
906
+ "min": [
907
+ -1.0,
908
+ -1.0,
909
+ -1.0,
910
+ -0.375,
911
+ -0.375,
912
+ -0.375,
913
+ 0.0
914
+ ],
915
+ "q01": [
916
+ -0.9628571271896362,
917
+ -1.0,
918
+ -1.0,
919
+ -0.26249998807907104,
920
+ -0.21321429312229156,
921
+ -0.3385714292526245,
922
+ 0.0
923
+ ],
924
+ "q99": [
925
+ 0.9114285707473755,
926
+ 0.868571400642395,
927
+ 1.0,
928
+ 0.2817857265472412,
929
+ 0.2239285707473755,
930
+ 0.3557142913341522,
931
+ 1.0
932
+ ],
933
+ "mask": [
934
+ true,
935
+ true,
936
+ true,
937
+ true,
938
+ true,
939
+ true,
940
+ false
941
+ ]
942
+ },
943
+ "proprio": {
944
+ "mean": [
945
+ 0.0,
946
+ 0.0,
947
+ 0.0,
948
+ 0.0,
949
+ 0.0,
950
+ 0.0,
951
+ 0.0
952
+ ],
953
+ "std": [
954
+ 0.0,
955
+ 0.0,
956
+ 0.0,
957
+ 0.0,
958
+ 0.0,
959
+ 0.0,
960
+ 0.0
961
+ ],
962
+ "max": [
963
+ 0.0,
964
+ 0.0,
965
+ 0.0,
966
+ 0.0,
967
+ 0.0,
968
+ 0.0,
969
+ 0.0
970
+ ],
971
+ "min": [
972
+ 0.0,
973
+ 0.0,
974
+ 0.0,
975
+ 0.0,
976
+ 0.0,
977
+ 0.0,
978
+ 0.0
979
+ ],
980
+ "q01": [
981
+ 0.0,
982
+ 0.0,
983
+ 0.0,
984
+ 0.0,
985
+ 0.0,
986
+ 0.0,
987
+ 0.0
988
+ ],
989
+ "q99": [
990
+ 0.0,
991
+ 0.0,
992
+ 0.0,
993
+ 0.0,
994
+ 0.0,
995
+ 0.0,
996
+ 0.0
997
+ ]
998
+ },
999
+ "num_transitions": 76324,
1000
+ "num_trajectories": 150
1001
+ },
1002
+ "berkeley_autolab_ur5": {
1003
+ "action": {
1004
+ "mean": [
1005
+ 0.0005683610797859728,
1006
+ 0.0012176943710073829,
1007
+ -0.0005296352901495993,
1008
+ 0.00021029709023423493,
1009
+ 6.0694979765685275e-05,
1010
+ 0.0012049833312630653,
1011
+ 0.6298308372497559
1012
+ ],
1013
+ "std": [
1014
+ 0.011533242650330067,
1015
+ 0.007990539073944092,
1016
+ 0.009577766992151737,
1017
+ 0.009433037601411343,
1018
+ 0.016427550464868546,
1019
+ 0.011054284870624542,
1020
+ 0.48267725110054016
1021
+ ],
1022
+ "max": [
1023
+ 0.019999999552965164,
1024
+ 0.019999999552965164,
1025
+ 0.019999999552965164,
1026
+ 0.06666667014360428,
1027
+ 0.06666667014360428,
1028
+ 0.06666667014360428,
1029
+ 1.0
1030
+ ],
1031
+ "min": [
1032
+ -0.019999999552965164,
1033
+ -0.019999999552965164,
1034
+ -0.019999999552965164,
1035
+ -0.06666667014360428,
1036
+ -0.06666667014360428,
1037
+ -0.06666667014360428,
1038
+ 0.0
1039
+ ],
1040
+ "q01": [
1041
+ -0.019999999552965164,
1042
+ -0.019999999552965164,
1043
+ -0.019999999552965164,
1044
+ -0.02628571353852749,
1045
+ -0.06666667014360428,
1046
+ -0.03847619146108627,
1047
+ 0.0
1048
+ ],
1049
+ "q99": [
1050
+ 0.019999999552965164,
1051
+ 0.019999999552965164,
1052
+ 0.019999999552965164,
1053
+ 0.031809523701667786,
1054
+ 0.06666667014360428,
1055
+ 0.036571428179740906,
1056
+ 1.0
1057
+ ],
1058
+ "mask": [
1059
+ true,
1060
+ true,
1061
+ true,
1062
+ true,
1063
+ true,
1064
+ true,
1065
+ false
1066
+ ]
1067
+ },
1068
+ "proprio": {
1069
+ "mean": [
1070
+ 0.0,
1071
+ 0.0,
1072
+ 0.0,
1073
+ 0.0,
1074
+ 0.0,
1075
+ 0.0,
1076
+ 0.0
1077
+ ],
1078
+ "std": [
1079
+ 0.0,
1080
+ 0.0,
1081
+ 0.0,
1082
+ 0.0,
1083
+ 0.0,
1084
+ 0.0,
1085
+ 0.0
1086
+ ],
1087
+ "max": [
1088
+ 0.0,
1089
+ 0.0,
1090
+ 0.0,
1091
+ 0.0,
1092
+ 0.0,
1093
+ 0.0,
1094
+ 0.0
1095
+ ],
1096
+ "min": [
1097
+ 0.0,
1098
+ 0.0,
1099
+ 0.0,
1100
+ 0.0,
1101
+ 0.0,
1102
+ 0.0,
1103
+ 0.0
1104
+ ],
1105
+ "q01": [
1106
+ 0.0,
1107
+ 0.0,
1108
+ 0.0,
1109
+ 0.0,
1110
+ 0.0,
1111
+ 0.0,
1112
+ 0.0
1113
+ ],
1114
+ "q99": [
1115
+ 0.0,
1116
+ 0.0,
1117
+ 0.0,
1118
+ 0.0,
1119
+ 0.0,
1120
+ 0.0,
1121
+ 0.0
1122
+ ]
1123
+ },
1124
+ "num_transitions": 97939,
1125
+ "num_trajectories": 1000
1126
+ },
1127
+ "toto": {
1128
+ "action": {
1129
+ "mean": [
1130
+ 0.38542017340660095,
1131
+ 0.00776953948661685,
1132
+ 0.36326831579208374,
1133
+ -0.6652101874351501,
1134
+ 0.1890408992767334,
1135
+ 0.032986655831336975,
1136
+ 0.0
1137
+ ],
1138
+ "std": [
1139
+ 0.122115857899189,
1140
+ 0.19378714263439178,
1141
+ 0.10178214311599731,
1142
+ 0.5725197196006775,
1143
+ 0.2988477051258087,
1144
+ 0.3259887993335724,
1145
+ 0.0
1146
+ ],
1147
+ "max": [
1148
+ 0.6839867234230042,
1149
+ 0.4454185664653778,
1150
+ 0.7984078526496887,
1151
+ 2.120781660079956,
1152
+ 1.371164321899414,
1153
+ 1.4118704795837402,
1154
+ 0.0
1155
+ ],
1156
+ "min": [
1157
+ 0.09922284632921219,
1158
+ -0.5180193781852722,
1159
+ 0.13791072368621826,
1160
+ -2.635117530822754,
1161
+ -1.0734480619430542,
1162
+ -1.9282547235488892,
1163
+ 0.0
1164
+ ],
1165
+ "q01": [
1166
+ 0.1756722891330719,
1167
+ -0.3077590811252594,
1168
+ 0.235383919775486,
1169
+ -2.0908505964279174,
1170
+ -0.6191593289375306,
1171
+ -0.7488683319091797,
1172
+ 0.0
1173
+ ],
1174
+ "q99": [
1175
+ 0.6136963081359863,
1176
+ 0.33704194784164443,
1177
+ 0.6681221985816956,
1178
+ 0.7422861719131538,
1179
+ 0.7955395007133507,
1180
+ 0.740464625358582,
1181
+ 0.0
1182
+ ],
1183
+ "mask": [
1184
+ true,
1185
+ true,
1186
+ true,
1187
+ true,
1188
+ true,
1189
+ true,
1190
+ false
1191
+ ]
1192
+ },
1193
+ "proprio": {
1194
+ "mean": [
1195
+ 0.0,
1196
+ 0.0,
1197
+ 0.0,
1198
+ 0.0,
1199
+ 0.0,
1200
+ 0.0,
1201
+ 0.0
1202
+ ],
1203
+ "std": [
1204
+ 0.0,
1205
+ 0.0,
1206
+ 0.0,
1207
+ 0.0,
1208
+ 0.0,
1209
+ 0.0,
1210
+ 0.0
1211
+ ],
1212
+ "max": [
1213
+ 0.0,
1214
+ 0.0,
1215
+ 0.0,
1216
+ 0.0,
1217
+ 0.0,
1218
+ 0.0,
1219
+ 0.0
1220
+ ],
1221
+ "min": [
1222
+ 0.0,
1223
+ 0.0,
1224
+ 0.0,
1225
+ 0.0,
1226
+ 0.0,
1227
+ 0.0,
1228
+ 0.0
1229
+ ],
1230
+ "q01": [
1231
+ 0.0,
1232
+ 0.0,
1233
+ 0.0,
1234
+ 0.0,
1235
+ 0.0,
1236
+ 0.0,
1237
+ 0.0
1238
+ ],
1239
+ "q99": [
1240
+ 0.0,
1241
+ 0.0,
1242
+ 0.0,
1243
+ 0.0,
1244
+ 0.0,
1245
+ 0.0,
1246
+ 0.0
1247
+ ]
1248
+ },
1249
+ "num_transitions": 325699,
1250
+ "num_trajectories": 1003
1251
+ },
1252
+ "language_table": {
1253
+ "action": {
1254
+ "mean": [
1255
+ 0.00014892566832713783,
1256
+ -0.0005636522546410561,
1257
+ 0.0,
1258
+ 0.0,
1259
+ 0.0,
1260
+ 0.0,
1261
+ 1.0
1262
+ ],
1263
+ "std": [
1264
+ 0.030163420364260674,
1265
+ 0.04230625927448273,
1266
+ 0.0,
1267
+ 0.0,
1268
+ 0.0,
1269
+ 0.0,
1270
+ 0.0
1271
+ ],
1272
+ "max": [
1273
+ 0.23357294499874115,
1274
+ 0.24496802687644958,
1275
+ 0.0,
1276
+ 0.0,
1277
+ 0.0,
1278
+ 0.0,
1279
+ 1.0
1280
+ ],
1281
+ "min": [
1282
+ -0.21989956498146057,
1283
+ -0.23736150562763214,
1284
+ 0.0,
1285
+ 0.0,
1286
+ 0.0,
1287
+ 0.0,
1288
+ 1.0
1289
+ ],
1290
+ "q01": [
1291
+ -0.08179590478539467,
1292
+ -0.11795833334326744,
1293
+ 0.0,
1294
+ 0.0,
1295
+ 0.0,
1296
+ 0.0,
1297
+ 1.0
1298
+ ],
1299
+ "q99": [
1300
+ 0.08822273463010788,
1301
+ 0.1191693339496851,
1302
+ 0.0,
1303
+ 0.0,
1304
+ 0.0,
1305
+ 0.0,
1306
+ 1.0
1307
+ ],
1308
+ "mask": [
1309
+ true,
1310
+ true,
1311
+ true,
1312
+ true,
1313
+ true,
1314
+ true,
1315
+ false
1316
+ ]
1317
+ },
1318
+ "proprio": {
1319
+ "mean": [
1320
+ 0.0,
1321
+ 0.0,
1322
+ 0.0,
1323
+ 0.0,
1324
+ 0.0,
1325
+ 0.0,
1326
+ 0.0
1327
+ ],
1328
+ "std": [
1329
+ 0.0,
1330
+ 0.0,
1331
+ 0.0,
1332
+ 0.0,
1333
+ 0.0,
1334
+ 0.0,
1335
+ 0.0
1336
+ ],
1337
+ "max": [
1338
+ 0.0,
1339
+ 0.0,
1340
+ 0.0,
1341
+ 0.0,
1342
+ 0.0,
1343
+ 0.0,
1344
+ 0.0
1345
+ ],
1346
+ "min": [
1347
+ 0.0,
1348
+ 0.0,
1349
+ 0.0,
1350
+ 0.0,
1351
+ 0.0,
1352
+ 0.0,
1353
+ 0.0
1354
+ ],
1355
+ "q01": [
1356
+ 0.0,
1357
+ 0.0,
1358
+ 0.0,
1359
+ 0.0,
1360
+ 0.0,
1361
+ 0.0,
1362
+ 0.0
1363
+ ],
1364
+ "q99": [
1365
+ 0.0,
1366
+ 0.0,
1367
+ 0.0,
1368
+ 0.0,
1369
+ 0.0,
1370
+ 0.0,
1371
+ 0.0
1372
+ ]
1373
+ },
1374
+ "num_transitions": 7045476,
1375
+ "num_trajectories": 442226
1376
+ },
1377
+ "stanford_hydra_dataset_converted_externally_to_rlds": {
1378
+ "action": {
1379
+ "mean": [
1380
+ 0.0007790164090692997,
1381
+ 0.00013707924517802894,
1382
+ -0.000254861603025347,
1383
+ 0.0012903378810733557,
1384
+ -0.0047517865896224976,
1385
+ 0.002692901762202382,
1386
+ 0.48855218291282654
1387
+ ],
1388
+ "std": [
1389
+ 0.008022228255867958,
1390
+ 0.009131468832492828,
1391
+ 0.00957429688423872,
1392
+ 0.04122218117117882,
1393
+ 0.03843004256486893,
1394
+ 0.04606714844703674,
1395
+ 0.49976059794425964
1396
+ ],
1397
+ "max": [
1398
+ 0.02499854564666748,
1399
+ 0.02499903365969658,
1400
+ 0.024999922141432762,
1401
+ 0.24974457919597626,
1402
+ 0.24997030198574066,
1403
+ 0.24999946355819702,
1404
+ 1.0
1405
+ ],
1406
+ "min": [
1407
+ -0.024999044835567474,
1408
+ -0.024999700486660004,
1409
+ -0.02499929815530777,
1410
+ -0.24993225932121277,
1411
+ -0.2499666064977646,
1412
+ -0.2499932497739792,
1413
+ 0.0
1414
+ ],
1415
+ "q01": [
1416
+ -0.019992006458342076,
1417
+ -0.02415412735193968,
1418
+ -0.022941758055239916,
1419
+ -0.11085530579090118,
1420
+ -0.12024572037160397,
1421
+ -0.13314770206809043,
1422
+ 0.0
1423
+ ],
1424
+ "q99": [
1425
+ 0.022886231057345868,
1426
+ 0.022358838934451335,
1427
+ 0.02410089675337076,
1428
+ 0.12370114490389822,
1429
+ 0.11323311634361738,
1430
+ 0.18474749639630164,
1431
+ 1.0
1432
+ ],
1433
+ "mask": [
1434
+ true,
1435
+ true,
1436
+ true,
1437
+ true,
1438
+ true,
1439
+ true,
1440
+ false
1441
+ ]
1442
+ },
1443
+ "proprio": {
1444
+ "mean": [
1445
+ 0.0,
1446
+ 0.0,
1447
+ 0.0,
1448
+ 0.0,
1449
+ 0.0,
1450
+ 0.0,
1451
+ 0.0
1452
+ ],
1453
+ "std": [
1454
+ 0.0,
1455
+ 0.0,
1456
+ 0.0,
1457
+ 0.0,
1458
+ 0.0,
1459
+ 0.0,
1460
+ 0.0
1461
+ ],
1462
+ "max": [
1463
+ 0.0,
1464
+ 0.0,
1465
+ 0.0,
1466
+ 0.0,
1467
+ 0.0,
1468
+ 0.0,
1469
+ 0.0
1470
+ ],
1471
+ "min": [
1472
+ 0.0,
1473
+ 0.0,
1474
+ 0.0,
1475
+ 0.0,
1476
+ 0.0,
1477
+ 0.0,
1478
+ 0.0
1479
+ ],
1480
+ "q01": [
1481
+ 0.0,
1482
+ 0.0,
1483
+ 0.0,
1484
+ 0.0,
1485
+ 0.0,
1486
+ 0.0,
1487
+ 0.0
1488
+ ],
1489
+ "q99": [
1490
+ 0.0,
1491
+ 0.0,
1492
+ 0.0,
1493
+ 0.0,
1494
+ 0.0,
1495
+ 0.0,
1496
+ 0.0
1497
+ ]
1498
+ },
1499
+ "num_transitions": 358234,
1500
+ "num_trajectories": 570
1501
+ },
1502
+ "austin_buds_dataset_converted_externally_to_rlds": {
1503
+ "action": {
1504
+ "mean": [
1505
+ -0.07678356021642685,
1506
+ 0.003684917464852333,
1507
+ 0.05644920840859413,
1508
+ 0.0,
1509
+ 0.0,
1510
+ 0.0,
1511
+ 0.3510494828224182
1512
+ ],
1513
+ "std": [
1514
+ 0.6367749571800232,
1515
+ 0.3788917064666748,
1516
+ 0.4779629111289978,
1517
+ 0.0,
1518
+ 0.0,
1519
+ 0.0,
1520
+ 0.4772108793258667
1521
+ ],
1522
+ "max": [
1523
+ 1.0,
1524
+ 1.0,
1525
+ 1.0,
1526
+ 0.0,
1527
+ 0.0,
1528
+ 0.0,
1529
+ 1.0
1530
+ ],
1531
+ "min": [
1532
+ -1.0,
1533
+ -1.0,
1534
+ -1.0,
1535
+ 0.0,
1536
+ 0.0,
1537
+ 0.0,
1538
+ 0.0
1539
+ ],
1540
+ "q01": [
1541
+ -1.0,
1542
+ -0.9599999785423279,
1543
+ -0.8714285492897034,
1544
+ 0.0,
1545
+ 0.0,
1546
+ 0.0,
1547
+ 0.0
1548
+ ],
1549
+ "q99": [
1550
+ 1.0,
1551
+ 0.8600000143051147,
1552
+ 1.0,
1553
+ 0.0,
1554
+ 0.0,
1555
+ 0.0,
1556
+ 1.0
1557
+ ],
1558
+ "mask": [
1559
+ true,
1560
+ true,
1561
+ true,
1562
+ true,
1563
+ true,
1564
+ true,
1565
+ false
1566
+ ]
1567
+ },
1568
+ "proprio": {
1569
+ "mean": [
1570
+ 0.0,
1571
+ 0.0,
1572
+ 0.0,
1573
+ 0.0,
1574
+ 0.0,
1575
+ 0.0,
1576
+ 0.0
1577
+ ],
1578
+ "std": [
1579
+ 0.0,
1580
+ 0.0,
1581
+ 0.0,
1582
+ 0.0,
1583
+ 0.0,
1584
+ 0.0,
1585
+ 0.0
1586
+ ],
1587
+ "max": [
1588
+ 0.0,
1589
+ 0.0,
1590
+ 0.0,
1591
+ 0.0,
1592
+ 0.0,
1593
+ 0.0,
1594
+ 0.0
1595
+ ],
1596
+ "min": [
1597
+ 0.0,
1598
+ 0.0,
1599
+ 0.0,
1600
+ 0.0,
1601
+ 0.0,
1602
+ 0.0,
1603
+ 0.0
1604
+ ],
1605
+ "q01": [
1606
+ 0.0,
1607
+ 0.0,
1608
+ 0.0,
1609
+ 0.0,
1610
+ 0.0,
1611
+ 0.0,
1612
+ 0.0
1613
+ ],
1614
+ "q99": [
1615
+ 0.0,
1616
+ 0.0,
1617
+ 0.0,
1618
+ 0.0,
1619
+ 0.0,
1620
+ 0.0,
1621
+ 0.0
1622
+ ]
1623
+ },
1624
+ "num_transitions": 34112,
1625
+ "num_trajectories": 50
1626
+ },
1627
+ "nyu_franka_play_dataset_converted_externally_to_rlds": {
1628
+ "action": {
1629
+ "mean": [
1630
+ 0.0010219900868833065,
1631
+ -0.00012002677249256521,
1632
+ 0.00032894228934310377,
1633
+ 0.0015034276293590665,
1634
+ -0.002198527567088604,
1635
+ -0.0016632305923849344,
1636
+ 0.7230083346366882
1637
+ ],
1638
+ "std": [
1639
+ 0.013274147175252438,
1640
+ 0.013215902261435986,
1641
+ 0.012822103686630726,
1642
+ 0.27324479818344116,
1643
+ 0.057022575289011,
1644
+ 0.0391729362308979,
1645
+ 0.44753125309944153
1646
+ ],
1647
+ "max": [
1648
+ 0.06424188613891602,
1649
+ 0.07027634978294373,
1650
+ 0.06129661202430725,
1651
+ 6.281067848205566,
1652
+ 0.1967729926109314,
1653
+ 0.26377415657043457,
1654
+ 1.0
1655
+ ],
1656
+ "min": [
1657
+ -0.05952230095863342,
1658
+ -0.07232445478439331,
1659
+ -0.06730806827545166,
1660
+ -6.278434753417969,
1661
+ -0.21479034423828125,
1662
+ -0.3627619743347168,
1663
+ 0.0
1664
+ ],
1665
+ "q01": [
1666
+ -0.03199600875377655,
1667
+ -0.032861671447753905,
1668
+ -0.03368805110454559,
1669
+ -0.12080862045288086,
1670
+ -0.12175218224525451,
1671
+ -0.11370223641395569,
1672
+ 0.0
1673
+ ],
1674
+ "q99": [
1675
+ 0.03101520001888276,
1676
+ 0.0373908892273903,
1677
+ 0.03646374464035038,
1678
+ 0.11764093399047852,
1679
+ 0.1258920183777809,
1680
+ 0.09366151213645942,
1681
+ 1.0
1682
+ ],
1683
+ "mask": [
1684
+ true,
1685
+ true,
1686
+ true,
1687
+ true,
1688
+ true,
1689
+ true,
1690
+ false
1691
+ ]
1692
+ },
1693
+ "proprio": {
1694
+ "mean": [
1695
+ 0.0,
1696
+ 0.0,
1697
+ 0.0,
1698
+ 0.0,
1699
+ 0.0,
1700
+ 0.0,
1701
+ 0.0
1702
+ ],
1703
+ "std": [
1704
+ 0.0,
1705
+ 0.0,
1706
+ 0.0,
1707
+ 0.0,
1708
+ 0.0,
1709
+ 0.0,
1710
+ 0.0
1711
+ ],
1712
+ "max": [
1713
+ 0.0,
1714
+ 0.0,
1715
+ 0.0,
1716
+ 0.0,
1717
+ 0.0,
1718
+ 0.0,
1719
+ 0.0
1720
+ ],
1721
+ "min": [
1722
+ 0.0,
1723
+ 0.0,
1724
+ 0.0,
1725
+ 0.0,
1726
+ 0.0,
1727
+ 0.0,
1728
+ 0.0
1729
+ ],
1730
+ "q01": [
1731
+ 0.0,
1732
+ 0.0,
1733
+ 0.0,
1734
+ 0.0,
1735
+ 0.0,
1736
+ 0.0,
1737
+ 0.0
1738
+ ],
1739
+ "q99": [
1740
+ 0.0,
1741
+ 0.0,
1742
+ 0.0,
1743
+ 0.0,
1744
+ 0.0,
1745
+ 0.0,
1746
+ 0.0
1747
+ ]
1748
+ },
1749
+ "num_transitions": 44875,
1750
+ "num_trajectories": 456
1751
+ },
1752
+ "furniture_bench_dataset_converted_externally_to_rlds": {
1753
+ "action": {
1754
+ "mean": [
1755
+ 0.00014610168000217527,
1756
+ 0.0010830931132659316,
1757
+ 0.0006224784883670509,
1758
+ -0.003303125035017729,
1759
+ -0.0026881853118538857,
1760
+ 0.018242118880152702,
1761
+ 0.48854944109916687
1762
+ ],
1763
+ "std": [
1764
+ 0.016107194125652313,
1765
+ 0.014891430735588074,
1766
+ 0.01401403546333313,
1767
+ 0.05827407166361809,
1768
+ 0.1141672357916832,
1769
+ 0.3348046541213989,
1770
+ 0.4999234676361084
1771
+ ],
1772
+ "max": [
1773
+ 0.10000000149011612,
1774
+ 0.10000000149011612,
1775
+ 0.10000000149011612,
1776
+ 0.8651833534240723,
1777
+ 1.0909736156463623,
1778
+ 2.863185405731201,
1779
+ 1.0
1780
+ ],
1781
+ "min": [
1782
+ -0.10495579987764359,
1783
+ -0.10939455777406693,
1784
+ -0.10000000149011612,
1785
+ -0.971906840801239,
1786
+ -1.0475432872772217,
1787
+ -3.06000018119812,
1788
+ 0.0
1789
+ ],
1790
+ "q01": [
1791
+ -0.053988199681043625,
1792
+ -0.05049169331789017,
1793
+ -0.032499241530895236,
1794
+ -0.1953887003660202,
1795
+ -0.41674559473991396,
1796
+ -0.8886768388748169,
1797
+ 0.0
1798
+ ],
1799
+ "q99": [
1800
+ 0.05414841488003723,
1801
+ 0.04965164884924884,
1802
+ 0.060055799782276154,
1803
+ 0.18231668293476103,
1804
+ 0.39867786407470646,
1805
+ 0.8772023963928218,
1806
+ 1.0
1807
+ ],
1808
+ "mask": [
1809
+ true,
1810
+ true,
1811
+ true,
1812
+ true,
1813
+ true,
1814
+ true,
1815
+ false
1816
+ ]
1817
+ },
1818
+ "proprio": {
1819
+ "mean": [
1820
+ 0.0,
1821
+ 0.0,
1822
+ 0.0,
1823
+ 0.0,
1824
+ 0.0,
1825
+ 0.0,
1826
+ 0.0
1827
+ ],
1828
+ "std": [
1829
+ 0.0,
1830
+ 0.0,
1831
+ 0.0,
1832
+ 0.0,
1833
+ 0.0,
1834
+ 0.0,
1835
+ 0.0
1836
+ ],
1837
+ "max": [
1838
+ 0.0,
1839
+ 0.0,
1840
+ 0.0,
1841
+ 0.0,
1842
+ 0.0,
1843
+ 0.0,
1844
+ 0.0
1845
+ ],
1846
+ "min": [
1847
+ 0.0,
1848
+ 0.0,
1849
+ 0.0,
1850
+ 0.0,
1851
+ 0.0,
1852
+ 0.0,
1853
+ 0.0
1854
+ ],
1855
+ "q01": [
1856
+ 0.0,
1857
+ 0.0,
1858
+ 0.0,
1859
+ 0.0,
1860
+ 0.0,
1861
+ 0.0,
1862
+ 0.0
1863
+ ],
1864
+ "q99": [
1865
+ 0.0,
1866
+ 0.0,
1867
+ 0.0,
1868
+ 0.0,
1869
+ 0.0,
1870
+ 0.0,
1871
+ 0.0
1872
+ ]
1873
+ },
1874
+ "num_transitions": 3948057,
1875
+ "num_trajectories": 5100
1876
+ },
1877
+ "ucsd_kitchen_dataset_converted_externally_to_rlds": {
1878
+ "action": {
1879
+ "mean": [
1880
+ 410.3756103515625,
1881
+ 116.95188903808594,
1882
+ 192.35035705566406,
1883
+ -121.22441101074219,
1884
+ -33.84892654418945,
1885
+ 50.016136169433594,
1886
+ 0.741813600063324
1887
+ ],
1888
+ "std": [
1889
+ 122.81497192382812,
1890
+ 108.80082702636719,
1891
+ 130.3034210205078,
1892
+ 116.28184509277344,
1893
+ 27.621871948242188,
1894
+ 41.020965576171875,
1895
+ 0.43763336539268494
1896
+ ],
1897
+ "max": [
1898
+ 678.0,
1899
+ 400.0,
1900
+ 507.0,
1901
+ 180.00001525878906,
1902
+ 6.000013828277588,
1903
+ 116.99998474121094,
1904
+ 1.0
1905
+ ],
1906
+ "min": [
1907
+ 172.0,
1908
+ -166.0,
1909
+ -99.99999237060547,
1910
+ -180.00001525878906,
1911
+ -89.0,
1912
+ -96.00010681152344,
1913
+ 0.0
1914
+ ],
1915
+ "q01": [
1916
+ 200.00001052856445,
1917
+ -102.31004211425781,
1918
+ -94.99993370056153,
1919
+ -180.00001525878906,
1920
+ -88.00001525878906,
1921
+ -38.999977111816406,
1922
+ 0.0
1923
+ ],
1924
+ "q99": [
1925
+ 637.0,
1926
+ 368.30999999999995,
1927
+ 493.0,
1928
+ 180.00001525878906,
1929
+ 0.999983012676239,
1930
+ 105.00001525878906,
1931
+ 1.0
1932
+ ],
1933
+ "mask": [
1934
+ true,
1935
+ true,
1936
+ true,
1937
+ true,
1938
+ true,
1939
+ true,
1940
+ false
1941
+ ]
1942
+ },
1943
+ "proprio": {
1944
+ "mean": [
1945
+ 0.0,
1946
+ 0.0,
1947
+ 0.0,
1948
+ 0.0,
1949
+ 0.0,
1950
+ 0.0,
1951
+ 0.0
1952
+ ],
1953
+ "std": [
1954
+ 0.0,
1955
+ 0.0,
1956
+ 0.0,
1957
+ 0.0,
1958
+ 0.0,
1959
+ 0.0,
1960
+ 0.0
1961
+ ],
1962
+ "max": [
1963
+ 0.0,
1964
+ 0.0,
1965
+ 0.0,
1966
+ 0.0,
1967
+ 0.0,
1968
+ 0.0,
1969
+ 0.0
1970
+ ],
1971
+ "min": [
1972
+ 0.0,
1973
+ 0.0,
1974
+ 0.0,
1975
+ 0.0,
1976
+ 0.0,
1977
+ 0.0,
1978
+ 0.0
1979
+ ],
1980
+ "q01": [
1981
+ 0.0,
1982
+ 0.0,
1983
+ 0.0,
1984
+ 0.0,
1985
+ 0.0,
1986
+ 0.0,
1987
+ 0.0
1988
+ ],
1989
+ "q99": [
1990
+ 0.0,
1991
+ 0.0,
1992
+ 0.0,
1993
+ 0.0,
1994
+ 0.0,
1995
+ 0.0,
1996
+ 0.0
1997
+ ]
1998
+ },
1999
+ "num_transitions": 3970,
2000
+ "num_trajectories": 150
2001
+ },
2002
+ "austin_sailor_dataset_converted_externally_to_rlds": {
2003
+ "action": {
2004
+ "mean": [
2005
+ 0.011825300753116608,
2006
+ 0.006460939068347216,
2007
+ 0.0602368600666523,
2008
+ 0.0,
2009
+ 0.0,
2010
+ 0.0016466040397062898,
2011
+ 0.5260950326919556
2012
+ ],
2013
+ "std": [
2014
+ 0.46349024772644043,
2015
+ 0.4124005138874054,
2016
+ 0.411862313747406,
2017
+ 0.0,
2018
+ 0.0,
2019
+ 0.057860683649778366,
2020
+ 0.49893513321876526
2021
+ ],
2022
+ "max": [
2023
+ 1.0,
2024
+ 1.0,
2025
+ 1.0,
2026
+ 0.0,
2027
+ 0.0,
2028
+ 0.375,
2029
+ 1.0
2030
+ ],
2031
+ "min": [
2032
+ -1.0,
2033
+ -1.0,
2034
+ -1.0,
2035
+ 0.0,
2036
+ 0.0,
2037
+ -0.375,
2038
+ 0.0
2039
+ ],
2040
+ "q01": [
2041
+ -1.0,
2042
+ -0.9828571677207947,
2043
+ -0.6000000238418579,
2044
+ 0.0,
2045
+ 0.0,
2046
+ -0.17249999940395355,
2047
+ 0.0
2048
+ ],
2049
+ "q99": [
2050
+ 1.0,
2051
+ 0.9457142949104309,
2052
+ 1.0,
2053
+ 0.0,
2054
+ 0.0,
2055
+ 0.17892856895923615,
2056
+ 1.0
2057
+ ],
2058
+ "mask": [
2059
+ true,
2060
+ true,
2061
+ true,
2062
+ true,
2063
+ true,
2064
+ true,
2065
+ false
2066
+ ]
2067
+ },
2068
+ "proprio": {
2069
+ "mean": [
2070
+ 0.0,
2071
+ 0.0,
2072
+ 0.0,
2073
+ 0.0,
2074
+ 0.0,
2075
+ 0.0,
2076
+ 0.0
2077
+ ],
2078
+ "std": [
2079
+ 0.0,
2080
+ 0.0,
2081
+ 0.0,
2082
+ 0.0,
2083
+ 0.0,
2084
+ 0.0,
2085
+ 0.0
2086
+ ],
2087
+ "max": [
2088
+ 0.0,
2089
+ 0.0,
2090
+ 0.0,
2091
+ 0.0,
2092
+ 0.0,
2093
+ 0.0,
2094
+ 0.0
2095
+ ],
2096
+ "min": [
2097
+ 0.0,
2098
+ 0.0,
2099
+ 0.0,
2100
+ 0.0,
2101
+ 0.0,
2102
+ 0.0,
2103
+ 0.0
2104
+ ],
2105
+ "q01": [
2106
+ 0.0,
2107
+ 0.0,
2108
+ 0.0,
2109
+ 0.0,
2110
+ 0.0,
2111
+ 0.0,
2112
+ 0.0
2113
+ ],
2114
+ "q99": [
2115
+ 0.0,
2116
+ 0.0,
2117
+ 0.0,
2118
+ 0.0,
2119
+ 0.0,
2120
+ 0.0,
2121
+ 0.0
2122
+ ]
2123
+ },
2124
+ "num_transitions": 353094,
2125
+ "num_trajectories": 240
2126
+ },
2127
+ "austin_sirius_dataset_converted_externally_to_rlds": {
2128
+ "action": {
2129
+ "mean": [
2130
+ 0.07747644931077957,
2131
+ 0.03195479139685631,
2132
+ 0.04244719445705414,
2133
+ 0.0,
2134
+ 0.0,
2135
+ -0.016034608706831932,
2136
+ 0.4326019883155823
2137
+ ],
2138
+ "std": [
2139
+ 0.39063578844070435,
2140
+ 0.2998167872428894,
2141
+ 0.2782306373119354,
2142
+ 0.0,
2143
+ 0.0,
2144
+ 0.08120734244585037,
2145
+ 0.49527204036712646
2146
+ ],
2147
+ "max": [
2148
+ 1.0002285242080688,
2149
+ 0.960608720779419,
2150
+ 1.105179786682129,
2151
+ 0.0,
2152
+ 0.0,
2153
+ 0.341785728931427,
2154
+ 1.0
2155
+ ],
2156
+ "min": [
2157
+ -1.0183025598526,
2158
+ -0.9800000190734863,
2159
+ -0.9774575233459473,
2160
+ 0.0,
2161
+ 0.0,
2162
+ -0.34607142210006714,
2163
+ 0.0
2164
+ ],
2165
+ "q01": [
2166
+ -0.780905865430832,
2167
+ -0.5667179036140442,
2168
+ -0.5254343223571777,
2169
+ 0.0,
2170
+ 0.0,
2171
+ -0.28495091378688814,
2172
+ 0.0
2173
+ ],
2174
+ "q99": [
2175
+ 0.9569637751579284,
2176
+ 0.6971374487876891,
2177
+ 0.8124888157844541,
2178
+ 0.0,
2179
+ 0.0,
2180
+ 0.1971428543329239,
2181
+ 1.0
2182
+ ],
2183
+ "mask": [
2184
+ true,
2185
+ true,
2186
+ true,
2187
+ true,
2188
+ true,
2189
+ true,
2190
+ false
2191
+ ]
2192
+ },
2193
+ "proprio": {
2194
+ "mean": [
2195
+ 0.0,
2196
+ 0.0,
2197
+ 0.0,
2198
+ 0.0,
2199
+ 0.0,
2200
+ 0.0,
2201
+ 0.0
2202
+ ],
2203
+ "std": [
2204
+ 0.0,
2205
+ 0.0,
2206
+ 0.0,
2207
+ 0.0,
2208
+ 0.0,
2209
+ 0.0,
2210
+ 0.0
2211
+ ],
2212
+ "max": [
2213
+ 0.0,
2214
+ 0.0,
2215
+ 0.0,
2216
+ 0.0,
2217
+ 0.0,
2218
+ 0.0,
2219
+ 0.0
2220
+ ],
2221
+ "min": [
2222
+ 0.0,
2223
+ 0.0,
2224
+ 0.0,
2225
+ 0.0,
2226
+ 0.0,
2227
+ 0.0,
2228
+ 0.0
2229
+ ],
2230
+ "q01": [
2231
+ 0.0,
2232
+ 0.0,
2233
+ 0.0,
2234
+ 0.0,
2235
+ 0.0,
2236
+ 0.0,
2237
+ 0.0
2238
+ ],
2239
+ "q99": [
2240
+ 0.0,
2241
+ 0.0,
2242
+ 0.0,
2243
+ 0.0,
2244
+ 0.0,
2245
+ 0.0,
2246
+ 0.0
2247
+ ]
2248
+ },
2249
+ "num_transitions": 279939,
2250
+ "num_trajectories": 559
2251
+ },
2252
+ "dlr_edan_shared_control_converted_externally_to_rlds": {
2253
+ "action": {
2254
+ "mean": [
2255
+ 0.006647802423685789,
2256
+ -0.0007657355163246393,
2257
+ 0.0065228380262851715,
2258
+ 0.0011679776944220066,
2259
+ -0.006395635195076466,
2260
+ -0.01190304197371006,
2261
+ 0.6985887289047241
2262
+ ],
2263
+ "std": [
2264
+ 0.021393626928329468,
2265
+ 0.0181423332542181,
2266
+ 0.033743780106306076,
2267
+ 0.017435410991311073,
2268
+ 0.0339437834918499,
2269
+ 0.04641877859830856,
2270
+ 0.45885926485061646
2271
+ ],
2272
+ "max": [
2273
+ 0.18991442024707794,
2274
+ 0.0739002525806427,
2275
+ 0.18064819276332855,
2276
+ 0.0866486132144928,
2277
+ 0.13464981317520142,
2278
+ 0.16910280287265778,
2279
+ 1.0
2280
+ ],
2281
+ "min": [
2282
+ -0.10054297000169754,
2283
+ -0.08427435159683228,
2284
+ -0.13533438742160797,
2285
+ -0.17556548118591309,
2286
+ -0.18485672771930695,
2287
+ -0.2680685818195343,
2288
+ 0.0
2289
+ ],
2290
+ "q01": [
2291
+ -0.02987122368067503,
2292
+ -0.06013262912631035,
2293
+ -0.08286409199237824,
2294
+ -0.05924444157630205,
2295
+ -0.15986866518855095,
2296
+ -0.15636983573436739,
2297
+ 0.0
2298
+ ],
2299
+ "q99": [
2300
+ 0.08832092039287087,
2301
+ 0.042126184627413736,
2302
+ 0.11311905644834042,
2303
+ 0.0643695573508739,
2304
+ 0.03941855944693088,
2305
+ 0.156646853685379,
2306
+ 1.0
2307
+ ],
2308
+ "mask": [
2309
+ true,
2310
+ true,
2311
+ true,
2312
+ true,
2313
+ true,
2314
+ true,
2315
+ false
2316
+ ]
2317
+ },
2318
+ "proprio": {
2319
+ "mean": [
2320
+ 0.0,
2321
+ 0.0,
2322
+ 0.0,
2323
+ 0.0,
2324
+ 0.0,
2325
+ 0.0,
2326
+ 0.0
2327
+ ],
2328
+ "std": [
2329
+ 0.0,
2330
+ 0.0,
2331
+ 0.0,
2332
+ 0.0,
2333
+ 0.0,
2334
+ 0.0,
2335
+ 0.0
2336
+ ],
2337
+ "max": [
2338
+ 0.0,
2339
+ 0.0,
2340
+ 0.0,
2341
+ 0.0,
2342
+ 0.0,
2343
+ 0.0,
2344
+ 0.0
2345
+ ],
2346
+ "min": [
2347
+ 0.0,
2348
+ 0.0,
2349
+ 0.0,
2350
+ 0.0,
2351
+ 0.0,
2352
+ 0.0,
2353
+ 0.0
2354
+ ],
2355
+ "q01": [
2356
+ 0.0,
2357
+ 0.0,
2358
+ 0.0,
2359
+ 0.0,
2360
+ 0.0,
2361
+ 0.0,
2362
+ 0.0
2363
+ ],
2364
+ "q99": [
2365
+ 0.0,
2366
+ 0.0,
2367
+ 0.0,
2368
+ 0.0,
2369
+ 0.0,
2370
+ 0.0,
2371
+ 0.0
2372
+ ]
2373
+ },
2374
+ "num_transitions": 8928,
2375
+ "num_trajectories": 104
2376
+ },
2377
+ "iamlab_cmu_pickup_insert_converted_externally_to_rlds": {
2378
+ "action": {
2379
+ "mean": [
2380
+ 0.5274292230606079,
2381
+ 0.028582023456692696,
2382
+ 0.18712405860424042,
2383
+ 1.2339727878570557,
2384
+ 0.032266099005937576,
2385
+ -1.419977068901062,
2386
+ 0.5550631880760193
2387
+ ],
2388
+ "std": [
2389
+ 0.08108391612768173,
2390
+ 0.11167500168085098,
2391
+ 0.07747591286897659,
2392
+ 2.873704433441162,
2393
+ 0.02774694189429283,
2394
+ 2.7678940296173096,
2395
+ 0.4969407320022583
2396
+ ],
2397
+ "max": [
2398
+ 0.6634981632232666,
2399
+ 0.23428471386432648,
2400
+ 0.4308285415172577,
2401
+ 3.1415927410125732,
2402
+ 0.13647015392780304,
2403
+ 3.141592502593994,
2404
+ 1.0
2405
+ ],
2406
+ "min": [
2407
+ 0.3071657121181488,
2408
+ -0.29754969477653503,
2409
+ 0.06578229367733002,
2410
+ -3.1415927410125732,
2411
+ -0.04584203287959099,
2412
+ -3.141592502593994,
2413
+ 0.0
2414
+ ],
2415
+ "q01": [
2416
+ 0.3148897051811218,
2417
+ -0.20317550599575043,
2418
+ 0.06785467118024827,
2419
+ -3.140952730178833,
2420
+ -0.029743434861302376,
2421
+ -3.141091251373291,
2422
+ 0.0
2423
+ ],
2424
+ "q99": [
2425
+ 0.6472805738449097,
2426
+ 0.20846802592277527,
2427
+ 0.36855655312538155,
2428
+ 3.1409926891326903,
2429
+ 0.11424950212240226,
2430
+ 3.1410969257354737,
2431
+ 1.0
2432
+ ],
2433
+ "mask": [
2434
+ true,
2435
+ true,
2436
+ true,
2437
+ true,
2438
+ true,
2439
+ true,
2440
+ false
2441
+ ]
2442
+ },
2443
+ "proprio": {
2444
+ "mean": [
2445
+ 0.0,
2446
+ 0.0,
2447
+ 0.0,
2448
+ 0.0,
2449
+ 0.0,
2450
+ 0.0,
2451
+ 0.0
2452
+ ],
2453
+ "std": [
2454
+ 0.0,
2455
+ 0.0,
2456
+ 0.0,
2457
+ 0.0,
2458
+ 0.0,
2459
+ 0.0,
2460
+ 0.0
2461
+ ],
2462
+ "max": [
2463
+ 0.0,
2464
+ 0.0,
2465
+ 0.0,
2466
+ 0.0,
2467
+ 0.0,
2468
+ 0.0,
2469
+ 0.0
2470
+ ],
2471
+ "min": [
2472
+ 0.0,
2473
+ 0.0,
2474
+ 0.0,
2475
+ 0.0,
2476
+ 0.0,
2477
+ 0.0,
2478
+ 0.0
2479
+ ],
2480
+ "q01": [
2481
+ 0.0,
2482
+ 0.0,
2483
+ 0.0,
2484
+ 0.0,
2485
+ 0.0,
2486
+ 0.0,
2487
+ 0.0
2488
+ ],
2489
+ "q99": [
2490
+ 0.0,
2491
+ 0.0,
2492
+ 0.0,
2493
+ 0.0,
2494
+ 0.0,
2495
+ 0.0,
2496
+ 0.0
2497
+ ]
2498
+ },
2499
+ "num_transitions": 146241,
2500
+ "num_trajectories": 631
2501
+ },
2502
+ "utaustin_mutex": {
2503
+ "action": {
2504
+ "mean": [
2505
+ 0.06176342815160751,
2506
+ -0.005005466286092997,
2507
+ 0.10216818749904633,
2508
+ -0.03314115107059479,
2509
+ 0.013894995674490929,
2510
+ -0.011317668482661247,
2511
+ 0.5038976669311523
2512
+ ],
2513
+ "std": [
2514
+ 0.1874988079071045,
2515
+ 0.4468454122543335,
2516
+ 0.3792799413204193,
2517
+ 0.1409822553396225,
2518
+ 0.0645362138748169,
2519
+ 0.11765013635158539,
2520
+ 0.5010449886322021
2521
+ ],
2522
+ "max": [
2523
+ 1.0,
2524
+ 1.0,
2525
+ 1.0,
2526
+ 0.375,
2527
+ 0.375,
2528
+ 0.375,
2529
+ 1.0
2530
+ ],
2531
+ "min": [
2532
+ -1.0,
2533
+ -1.0,
2534
+ -1.0,
2535
+ -0.375,
2536
+ -0.375,
2537
+ -0.375,
2538
+ 0.0
2539
+ ],
2540
+ "q01": [
2541
+ -0.4285714328289032,
2542
+ -0.9800000190734863,
2543
+ -0.5571428537368774,
2544
+ -0.375,
2545
+ -0.15642857551574707,
2546
+ -0.335357129573822,
2547
+ 0.0
2548
+ ],
2549
+ "q99": [
2550
+ 0.5914285778999329,
2551
+ 0.9714285731315613,
2552
+ 1.0,
2553
+ 0.3278571367263794,
2554
+ 0.207857146859169,
2555
+ 0.25607141852378845,
2556
+ 1.0
2557
+ ],
2558
+ "mask": [
2559
+ true,
2560
+ true,
2561
+ true,
2562
+ true,
2563
+ true,
2564
+ true,
2565
+ false
2566
+ ]
2567
+ },
2568
+ "proprio": {
2569
+ "mean": [
2570
+ 0.0,
2571
+ 0.0,
2572
+ 0.0,
2573
+ 0.0,
2574
+ 0.0,
2575
+ 0.0,
2576
+ 0.0
2577
+ ],
2578
+ "std": [
2579
+ 0.0,
2580
+ 0.0,
2581
+ 0.0,
2582
+ 0.0,
2583
+ 0.0,
2584
+ 0.0,
2585
+ 0.0
2586
+ ],
2587
+ "max": [
2588
+ 0.0,
2589
+ 0.0,
2590
+ 0.0,
2591
+ 0.0,
2592
+ 0.0,
2593
+ 0.0,
2594
+ 0.0
2595
+ ],
2596
+ "min": [
2597
+ 0.0,
2598
+ 0.0,
2599
+ 0.0,
2600
+ 0.0,
2601
+ 0.0,
2602
+ 0.0,
2603
+ 0.0
2604
+ ],
2605
+ "q01": [
2606
+ 0.0,
2607
+ 0.0,
2608
+ 0.0,
2609
+ 0.0,
2610
+ 0.0,
2611
+ 0.0,
2612
+ 0.0
2613
+ ],
2614
+ "q99": [
2615
+ 0.0,
2616
+ 0.0,
2617
+ 0.0,
2618
+ 0.0,
2619
+ 0.0,
2620
+ 0.0,
2621
+ 0.0
2622
+ ]
2623
+ },
2624
+ "num_transitions": 361883,
2625
+ "num_trajectories": 1500
2626
+ },
2627
+ "berkeley_fanuc_manipulation": {
2628
+ "action": {
2629
+ "mean": [
2630
+ 0.0007744057802483439,
2631
+ -0.00031240080716088414,
2632
+ -0.0015001941937953234,
2633
+ -0.0007515158504247665,
2634
+ -0.00015832878125365824,
2635
+ 0.00014327642566058785,
2636
+ 0.699295699596405
2637
+ ],
2638
+ "std": [
2639
+ 0.0034070033580064774,
2640
+ 0.004992207046598196,
2641
+ 0.005344338249415159,
2642
+ 0.007599035743623972,
2643
+ 0.004081510007381439,
2644
+ 0.008568975143134594,
2645
+ 0.45871078968048096
2646
+ ],
2647
+ "max": [
2648
+ 0.009999999776482582,
2649
+ 0.009999999776482582,
2650
+ 0.009999999776482582,
2651
+ 0.03490658476948738,
2652
+ 0.03490658476948738,
2653
+ 0.03490658476948738,
2654
+ 1.0
2655
+ ],
2656
+ "min": [
2657
+ -0.009999999776482582,
2658
+ -0.009999999776482582,
2659
+ -0.009999999776482582,
2660
+ -0.03490658476948738,
2661
+ -0.03490658476948738,
2662
+ -0.03490658476948738,
2663
+ 0.0
2664
+ ],
2665
+ "q01": [
2666
+ -0.009999999776482582,
2667
+ -0.009999999776482582,
2668
+ -0.009999999776482582,
2669
+ -0.03490658476948738,
2670
+ 0.0,
2671
+ -0.03490658476948738,
2672
+ 0.0
2673
+ ],
2674
+ "q99": [
2675
+ 0.009999999776482582,
2676
+ 0.009999999776482582,
2677
+ 0.009999999776482582,
2678
+ 0.03490658476948738,
2679
+ 0.0,
2680
+ 0.03490658476948738,
2681
+ 1.0
2682
+ ],
2683
+ "mask": [
2684
+ true,
2685
+ true,
2686
+ true,
2687
+ true,
2688
+ true,
2689
+ true,
2690
+ false
2691
+ ]
2692
+ },
2693
+ "proprio": {
2694
+ "mean": [
2695
+ 0.0,
2696
+ 0.0,
2697
+ 0.0,
2698
+ 0.0,
2699
+ 0.0,
2700
+ 0.0,
2701
+ 0.0
2702
+ ],
2703
+ "std": [
2704
+ 0.0,
2705
+ 0.0,
2706
+ 0.0,
2707
+ 0.0,
2708
+ 0.0,
2709
+ 0.0,
2710
+ 0.0
2711
+ ],
2712
+ "max": [
2713
+ 0.0,
2714
+ 0.0,
2715
+ 0.0,
2716
+ 0.0,
2717
+ 0.0,
2718
+ 0.0,
2719
+ 0.0
2720
+ ],
2721
+ "min": [
2722
+ 0.0,
2723
+ 0.0,
2724
+ 0.0,
2725
+ 0.0,
2726
+ 0.0,
2727
+ 0.0,
2728
+ 0.0
2729
+ ],
2730
+ "q01": [
2731
+ 0.0,
2732
+ 0.0,
2733
+ 0.0,
2734
+ 0.0,
2735
+ 0.0,
2736
+ 0.0,
2737
+ 0.0
2738
+ ],
2739
+ "q99": [
2740
+ 0.0,
2741
+ 0.0,
2742
+ 0.0,
2743
+ 0.0,
2744
+ 0.0,
2745
+ 0.0,
2746
+ 0.0
2747
+ ]
2748
+ },
2749
+ "num_transitions": 62613,
2750
+ "num_trajectories": 415
2751
+ },
2752
+ "cmu_stretch": {
2753
+ "action": {
2754
+ "mean": [
2755
+ 0.0003630461869761348,
2756
+ 0.0,
2757
+ 0.0016466971719637513,
2758
+ 0.0,
2759
+ 0.0,
2760
+ 0.0,
2761
+ 0.3987048268318176
2762
+ ],
2763
+ "std": [
2764
+ 0.004081820137798786,
2765
+ 0.0,
2766
+ 0.0037743367720395327,
2767
+ 0.0,
2768
+ 0.0,
2769
+ 0.0,
2770
+ 0.48963725566864014
2771
+ ],
2772
+ "max": [
2773
+ 0.02338407188653946,
2774
+ 0.0,
2775
+ 0.023404927924275398,
2776
+ 0.0,
2777
+ 0.0,
2778
+ 0.0,
2779
+ 1.0
2780
+ ],
2781
+ "min": [
2782
+ -0.019353797659277916,
2783
+ 0.0,
2784
+ -0.02019215188920498,
2785
+ 0.0,
2786
+ 0.0,
2787
+ 0.0,
2788
+ 0.0
2789
+ ],
2790
+ "q01": [
2791
+ -0.011175686959177256,
2792
+ 0.0,
2793
+ -0.0032206363626755773,
2794
+ 0.0,
2795
+ 0.0,
2796
+ 0.0,
2797
+ 0.0
2798
+ ],
2799
+ "q99": [
2800
+ 0.014501785952597848,
2801
+ 0.0,
2802
+ 0.015056106168776728,
2803
+ 0.0,
2804
+ 0.0,
2805
+ 0.0,
2806
+ 1.0
2807
+ ],
2808
+ "mask": [
2809
+ true,
2810
+ true,
2811
+ true,
2812
+ true,
2813
+ true,
2814
+ true,
2815
+ false
2816
+ ]
2817
+ },
2818
+ "proprio": {
2819
+ "mean": [
2820
+ 0.0,
2821
+ 0.0,
2822
+ 0.0,
2823
+ 0.0,
2824
+ 0.0,
2825
+ 0.0,
2826
+ 0.0
2827
+ ],
2828
+ "std": [
2829
+ 0.0,
2830
+ 0.0,
2831
+ 0.0,
2832
+ 0.0,
2833
+ 0.0,
2834
+ 0.0,
2835
+ 0.0
2836
+ ],
2837
+ "max": [
2838
+ 0.0,
2839
+ 0.0,
2840
+ 0.0,
2841
+ 0.0,
2842
+ 0.0,
2843
+ 0.0,
2844
+ 0.0
2845
+ ],
2846
+ "min": [
2847
+ 0.0,
2848
+ 0.0,
2849
+ 0.0,
2850
+ 0.0,
2851
+ 0.0,
2852
+ 0.0,
2853
+ 0.0
2854
+ ],
2855
+ "q01": [
2856
+ 0.0,
2857
+ 0.0,
2858
+ 0.0,
2859
+ 0.0,
2860
+ 0.0,
2861
+ 0.0,
2862
+ 0.0
2863
+ ],
2864
+ "q99": [
2865
+ 0.0,
2866
+ 0.0,
2867
+ 0.0,
2868
+ 0.0,
2869
+ 0.0,
2870
+ 0.0,
2871
+ 0.0
2872
+ ]
2873
+ },
2874
+ "num_transitions": 25016,
2875
+ "num_trajectories": 135
2876
+ },
2877
+ "bc_z": {
2878
+ "action": {
2879
+ "mean": [
2880
+ -0.00995843019336462,
2881
+ 0.0008958271937444806,
2882
+ 0.004995627794414759,
2883
+ 0.00029754845309071243,
2884
+ -0.008735301904380322,
2885
+ -0.03069321997463703,
2886
+ 0.8344562649726868
2887
+ ],
2888
+ "std": [
2889
+ 0.03053455241024494,
2890
+ 0.023142483085393906,
2891
+ 0.020641736686229706,
2892
+ 0.04155934974551201,
2893
+ 0.04642800614237785,
2894
+ 0.07698209583759308,
2895
+ 0.36102741956710815
2896
+ ],
2897
+ "max": [
2898
+ 0.2165454924106598,
2899
+ 0.1251407265663147,
2900
+ 0.10772687941789627,
2901
+ 0.33544227480888367,
2902
+ 0.28117990493774414,
2903
+ 0.40614867210388184,
2904
+ 1.0
2905
+ ],
2906
+ "min": [
2907
+ -0.1677047461271286,
2908
+ -0.14630407094955444,
2909
+ -0.10066790133714676,
2910
+ -0.29421567916870117,
2911
+ -0.32101404666900635,
2912
+ -0.4635624885559082,
2913
+ 0.0
2914
+ ],
2915
+ "q01": [
2916
+ -0.09220654994249344,
2917
+ -0.06456145539879798,
2918
+ -0.049121275544166565,
2919
+ -0.11594625547528267,
2920
+ -0.14152548640966414,
2921
+ -0.2251061636209488,
2922
+ 0.0
2923
+ ],
2924
+ "q99": [
2925
+ 0.07628866866230968,
2926
+ 0.058019736707210584,
2927
+ 0.052540797740221024,
2928
+ 0.11740604028105736,
2929
+ 0.11703975558280955,
2930
+ 0.16729306846857078,
2931
+ 1.0
2932
+ ],
2933
+ "mask": [
2934
+ true,
2935
+ true,
2936
+ true,
2937
+ true,
2938
+ true,
2939
+ true,
2940
+ false
2941
+ ]
2942
+ },
2943
+ "proprio": {
2944
+ "mean": [
2945
+ 0.0,
2946
+ 0.0,
2947
+ 0.0,
2948
+ 0.0,
2949
+ 0.0,
2950
+ 0.0,
2951
+ 0.0
2952
+ ],
2953
+ "std": [
2954
+ 0.0,
2955
+ 0.0,
2956
+ 0.0,
2957
+ 0.0,
2958
+ 0.0,
2959
+ 0.0,
2960
+ 0.0
2961
+ ],
2962
+ "max": [
2963
+ 0.0,
2964
+ 0.0,
2965
+ 0.0,
2966
+ 0.0,
2967
+ 0.0,
2968
+ 0.0,
2969
+ 0.0
2970
+ ],
2971
+ "min": [
2972
+ 0.0,
2973
+ 0.0,
2974
+ 0.0,
2975
+ 0.0,
2976
+ 0.0,
2977
+ 0.0,
2978
+ 0.0
2979
+ ],
2980
+ "q01": [
2981
+ 0.0,
2982
+ 0.0,
2983
+ 0.0,
2984
+ 0.0,
2985
+ 0.0,
2986
+ 0.0,
2987
+ 0.0
2988
+ ],
2989
+ "q99": [
2990
+ 0.0,
2991
+ 0.0,
2992
+ 0.0,
2993
+ 0.0,
2994
+ 0.0,
2995
+ 0.0,
2996
+ 0.0
2997
+ ]
2998
+ },
2999
+ "num_transitions": 6015535,
3000
+ "num_trajectories": 43264
3001
+ },
3002
+ "fmb": {
3003
+ "action": {
3004
+ "mean": [
3005
+ 0.059029046446084976,
3006
+ -0.0647602304816246,
3007
+ -0.09787999838590622,
3008
+ 0.004325123969465494,
3009
+ 0.0002905694709625095,
3010
+ -0.0445764884352684,
3011
+ 0.7336407899856567
3012
+ ],
3013
+ "std": [
3014
+ 0.2881162762641907,
3015
+ 0.2820442020893097,
3016
+ 0.4626532196998596,
3017
+ 0.32666969299316406,
3018
+ 0.10843083262443542,
3019
+ 0.3440420627593994,
3020
+ 0.4434746503829956
3021
+ ],
3022
+ "max": [
3023
+ 1.399999976158142,
3024
+ 1.0,
3025
+ 1.399999976158142,
3026
+ 1.0,
3027
+ 1.0,
3028
+ 1.0,
3029
+ 1.0
3030
+ ],
3031
+ "min": [
3032
+ -1.399999976158142,
3033
+ -1.399999976158142,
3034
+ -1.0,
3035
+ -1.0,
3036
+ -1.0,
3037
+ -1.0,
3038
+ 0.0
3039
+ ],
3040
+ "q01": [
3041
+ -0.8257142901420593,
3042
+ -1.399999976158142,
3043
+ -1.0,
3044
+ -1.0,
3045
+ -0.3028571307659149,
3046
+ -1.0,
3047
+ 0.0
3048
+ ],
3049
+ "q99": [
3050
+ 1.0,
3051
+ 0.5257142782211304,
3052
+ 1.0,
3053
+ 1.0,
3054
+ 0.3400000035762787,
3055
+ 1.0,
3056
+ 1.0
3057
+ ],
3058
+ "mask": [
3059
+ true,
3060
+ true,
3061
+ true,
3062
+ true,
3063
+ true,
3064
+ true,
3065
+ false
3066
+ ]
3067
+ },
3068
+ "proprio": {
3069
+ "mean": [
3070
+ 0.0,
3071
+ 0.0,
3072
+ 0.0,
3073
+ 0.0,
3074
+ 0.0,
3075
+ 0.0,
3076
+ 0.0
3077
+ ],
3078
+ "std": [
3079
+ 0.0,
3080
+ 0.0,
3081
+ 0.0,
3082
+ 0.0,
3083
+ 0.0,
3084
+ 0.0,
3085
+ 0.0
3086
+ ],
3087
+ "max": [
3088
+ 0.0,
3089
+ 0.0,
3090
+ 0.0,
3091
+ 0.0,
3092
+ 0.0,
3093
+ 0.0,
3094
+ 0.0
3095
+ ],
3096
+ "min": [
3097
+ 0.0,
3098
+ 0.0,
3099
+ 0.0,
3100
+ 0.0,
3101
+ 0.0,
3102
+ 0.0,
3103
+ 0.0
3104
+ ],
3105
+ "q01": [
3106
+ 0.0,
3107
+ 0.0,
3108
+ 0.0,
3109
+ 0.0,
3110
+ 0.0,
3111
+ 0.0,
3112
+ 0.0
3113
+ ],
3114
+ "q99": [
3115
+ 0.0,
3116
+ 0.0,
3117
+ 0.0,
3118
+ 0.0,
3119
+ 0.0,
3120
+ 0.0,
3121
+ 0.0
3122
+ ]
3123
+ },
3124
+ "num_transitions": 1137340,
3125
+ "num_trajectories": 8611
3126
+ },
3127
+ "dobbe": {
3128
+ "action": {
3129
+ "mean": [
3130
+ -0.00011206549970665947,
3131
+ 0.001122951740399003,
3132
+ -0.00010194253263762221,
3133
+ -7.371370156761259e-05,
3134
+ -0.000675320450682193,
3135
+ -5.664382842951454e-05,
3136
+ 0.6318313479423523
3137
+ ],
3138
+ "std": [
3139
+ 0.042647797614336014,
3140
+ 0.044285230338573456,
3141
+ 0.12223999202251434,
3142
+ 0.005388559307903051,
3143
+ 0.011246565729379654,
3144
+ 0.006287876050919294,
3145
+ 0.39733052253723145
3146
+ ],
3147
+ "max": [
3148
+ 38.590423583984375,
3149
+ 17.932697296142578,
3150
+ 4.843764305114746,
3151
+ 1.4372116327285767,
3152
+ 0.4340403974056244,
3153
+ 1.2057193517684937,
3154
+ 0.9998947381973267
3155
+ ],
3156
+ "min": [
3157
+ -5.700923442840576,
3158
+ -21.605947494506836,
3159
+ -123.72489929199219,
3160
+ -1.7229845523834229,
3161
+ -0.4998578727245331,
3162
+ -0.8867913484573364,
3163
+ 1.4196479014572105e-06
3164
+ ],
3165
+ "q01": [
3166
+ -0.01119564864784479,
3167
+ -0.014266146533191203,
3168
+ -0.0071747214533388615,
3169
+ -0.009444301575422287,
3170
+ -0.03990109823644161,
3171
+ -0.017422311007976532,
3172
+ 4.003279136668425e-05
3173
+ ],
3174
+ "q99": [
3175
+ 0.01015154086053368,
3176
+ 0.017181577533483497,
3177
+ 0.007216989761218411,
3178
+ 0.010380979906767595,
3179
+ 0.03556173853576176,
3180
+ 0.018032474815845446,
3181
+ 0.9982578039169312
3182
+ ],
3183
+ "mask": [
3184
+ true,
3185
+ true,
3186
+ true,
3187
+ true,
3188
+ true,
3189
+ true,
3190
+ false
3191
+ ]
3192
+ },
3193
+ "proprio": {
3194
+ "mean": [
3195
+ 0.0,
3196
+ 0.0,
3197
+ 0.0,
3198
+ 0.0,
3199
+ 0.0,
3200
+ 0.0,
3201
+ 0.0
3202
+ ],
3203
+ "std": [
3204
+ 0.0,
3205
+ 0.0,
3206
+ 0.0,
3207
+ 0.0,
3208
+ 0.0,
3209
+ 0.0,
3210
+ 0.0
3211
+ ],
3212
+ "max": [
3213
+ 0.0,
3214
+ 0.0,
3215
+ 0.0,
3216
+ 0.0,
3217
+ 0.0,
3218
+ 0.0,
3219
+ 0.0
3220
+ ],
3221
+ "min": [
3222
+ 0.0,
3223
+ 0.0,
3224
+ 0.0,
3225
+ 0.0,
3226
+ 0.0,
3227
+ 0.0,
3228
+ 0.0
3229
+ ],
3230
+ "q01": [
3231
+ 0.0,
3232
+ 0.0,
3233
+ 0.0,
3234
+ 0.0,
3235
+ 0.0,
3236
+ 0.0,
3237
+ 0.0
3238
+ ],
3239
+ "q99": [
3240
+ 0.0,
3241
+ 0.0,
3242
+ 0.0,
3243
+ 0.0,
3244
+ 0.0,
3245
+ 0.0,
3246
+ 0.0
3247
+ ]
3248
+ },
3249
+ "num_transitions": 1139911,
3250
+ "num_trajectories": 5208
3251
+ },
3252
+ "berkeley_gnm_recon": {
3253
+ "action": {
3254
+ "mean": [
3255
+ 0.24872927367687225,
3256
+ -5.411964957602322e-05,
3257
+ 0.0,
3258
+ 0.0,
3259
+ 0.0,
3260
+ 0.0,
3261
+ 0.0
3262
+ ],
3263
+ "std": [
3264
+ 0.05812746286392212,
3265
+ 0.024206699803471565,
3266
+ 0.0,
3267
+ 0.0,
3268
+ 0.0,
3269
+ 0.0,
3270
+ 0.0
3271
+ ],
3272
+ "max": [
3273
+ 2.510159969329834,
3274
+ 2.404067039489746,
3275
+ 0.0,
3276
+ 0.0,
3277
+ 0.0,
3278
+ 0.0,
3279
+ 0.0
3280
+ ],
3281
+ "min": [
3282
+ -0.0016135479090735316,
3283
+ -2.025881767272949,
3284
+ 0.0,
3285
+ 0.0,
3286
+ 0.0,
3287
+ 0.0,
3288
+ 0.0
3289
+ ],
3290
+ "q01": [
3291
+ 0.0,
3292
+ -0.0535198350995779,
3293
+ 0.0,
3294
+ 0.0,
3295
+ 0.0,
3296
+ 0.0,
3297
+ 0.0
3298
+ ],
3299
+ "q99": [
3300
+ 0.39367246329784245,
3301
+ 0.0531731820106503,
3302
+ 0.0,
3303
+ 0.0,
3304
+ 0.0,
3305
+ 0.0,
3306
+ 0.0
3307
+ ],
3308
+ "mask": [
3309
+ true,
3310
+ true,
3311
+ true,
3312
+ true,
3313
+ true,
3314
+ true,
3315
+ false
3316
+ ]
3317
+ },
3318
+ "proprio": {
3319
+ "mean": [
3320
+ 0.0,
3321
+ 0.0,
3322
+ 0.0,
3323
+ 0.0,
3324
+ 0.0,
3325
+ 0.0,
3326
+ 0.0
3327
+ ],
3328
+ "std": [
3329
+ 0.0,
3330
+ 0.0,
3331
+ 0.0,
3332
+ 0.0,
3333
+ 0.0,
3334
+ 0.0,
3335
+ 0.0
3336
+ ],
3337
+ "max": [
3338
+ 0.0,
3339
+ 0.0,
3340
+ 0.0,
3341
+ 0.0,
3342
+ 0.0,
3343
+ 0.0,
3344
+ 0.0
3345
+ ],
3346
+ "min": [
3347
+ 0.0,
3348
+ 0.0,
3349
+ 0.0,
3350
+ 0.0,
3351
+ 0.0,
3352
+ 0.0,
3353
+ 0.0
3354
+ ],
3355
+ "q01": [
3356
+ 0.0,
3357
+ 0.0,
3358
+ 0.0,
3359
+ 0.0,
3360
+ 0.0,
3361
+ 0.0,
3362
+ 0.0
3363
+ ],
3364
+ "q99": [
3365
+ 0.0,
3366
+ 0.0,
3367
+ 0.0,
3368
+ 0.0,
3369
+ 0.0,
3370
+ 0.0,
3371
+ 0.0
3372
+ ]
3373
+ },
3374
+ "num_transitions": 610907,
3375
+ "num_trajectories": 11834
3376
+ },
3377
+ "berkeley_gnm_cory_hall": {
3378
+ "action": {
3379
+ "mean": [
3380
+ 0.06114849075675011,
3381
+ 0.0038686818443238735,
3382
+ 0.0,
3383
+ 0.0,
3384
+ 0.0,
3385
+ 0.0,
3386
+ 0.0
3387
+ ],
3388
+ "std": [
3389
+ 0.025893665850162506,
3390
+ 0.003098808927461505,
3391
+ 0.0,
3392
+ 0.0,
3393
+ 0.0,
3394
+ 0.0,
3395
+ 0.0
3396
+ ],
3397
+ "max": [
3398
+ 0.24892958998680115,
3399
+ 0.0282847099006176,
3400
+ 0.0,
3401
+ 0.0,
3402
+ 0.0,
3403
+ 0.0,
3404
+ 0.0
3405
+ ],
3406
+ "min": [
3407
+ -0.04163464531302452,
3408
+ -0.004486563615500927,
3409
+ 0.0,
3410
+ 0.0,
3411
+ 0.0,
3412
+ 0.0,
3413
+ 0.0
3414
+ ],
3415
+ "q01": [
3416
+ 0.0,
3417
+ 0.0,
3418
+ 0.0,
3419
+ 0.0,
3420
+ 0.0,
3421
+ 0.0,
3422
+ 0.0
3423
+ ],
3424
+ "q99": [
3425
+ 0.08704738721251487,
3426
+ 0.009815949257463217,
3427
+ 0.0,
3428
+ 0.0,
3429
+ 0.0,
3430
+ 0.0,
3431
+ 0.0
3432
+ ],
3433
+ "mask": [
3434
+ true,
3435
+ true,
3436
+ true,
3437
+ true,
3438
+ true,
3439
+ true,
3440
+ false
3441
+ ]
3442
+ },
3443
+ "proprio": {
3444
+ "mean": [
3445
+ 0.0,
3446
+ 0.0,
3447
+ 0.0,
3448
+ 0.0,
3449
+ 0.0,
3450
+ 0.0,
3451
+ 0.0
3452
+ ],
3453
+ "std": [
3454
+ 0.0,
3455
+ 0.0,
3456
+ 0.0,
3457
+ 0.0,
3458
+ 0.0,
3459
+ 0.0,
3460
+ 0.0
3461
+ ],
3462
+ "max": [
3463
+ 0.0,
3464
+ 0.0,
3465
+ 0.0,
3466
+ 0.0,
3467
+ 0.0,
3468
+ 0.0,
3469
+ 0.0
3470
+ ],
3471
+ "min": [
3472
+ 0.0,
3473
+ 0.0,
3474
+ 0.0,
3475
+ 0.0,
3476
+ 0.0,
3477
+ 0.0,
3478
+ 0.0
3479
+ ],
3480
+ "q01": [
3481
+ 0.0,
3482
+ 0.0,
3483
+ 0.0,
3484
+ 0.0,
3485
+ 0.0,
3486
+ 0.0,
3487
+ 0.0
3488
+ ],
3489
+ "q99": [
3490
+ 0.0,
3491
+ 0.0,
3492
+ 0.0,
3493
+ 0.0,
3494
+ 0.0,
3495
+ 0.0,
3496
+ 0.0
3497
+ ]
3498
+ },
3499
+ "num_transitions": 156012,
3500
+ "num_trajectories": 7331
3501
+ },
3502
+ "berkeley_gnm_sac_son": {
3503
+ "action": {
3504
+ "mean": [
3505
+ 0.2501138150691986,
3506
+ 0.0018258533673360944,
3507
+ 0.0,
3508
+ 0.0,
3509
+ 0.0,
3510
+ 0.0,
3511
+ 0.0
3512
+ ],
3513
+ "std": [
3514
+ 0.11722511798143387,
3515
+ 0.034274861216545105,
3516
+ 0.0,
3517
+ 0.0,
3518
+ 0.0,
3519
+ 0.0,
3520
+ 0.0
3521
+ ],
3522
+ "max": [
3523
+ 1.4488461017608643,
3524
+ 0.9228910207748413,
3525
+ 0.0,
3526
+ 0.0,
3527
+ 0.0,
3528
+ 0.0,
3529
+ 0.0
3530
+ ],
3531
+ "min": [
3532
+ 0.0,
3533
+ -0.32534390687942505,
3534
+ 0.0,
3535
+ 0.0,
3536
+ 0.0,
3537
+ 0.0,
3538
+ 0.0
3539
+ ],
3540
+ "q01": [
3541
+ 0.0,
3542
+ -0.10800920695066452,
3543
+ 0.0,
3544
+ 0.0,
3545
+ 0.0,
3546
+ 0.0,
3547
+ 0.0
3548
+ ],
3549
+ "q99": [
3550
+ 0.5312446105480191,
3551
+ 0.1076271431148052,
3552
+ 0.0,
3553
+ 0.0,
3554
+ 0.0,
3555
+ 0.0,
3556
+ 0.0
3557
+ ],
3558
+ "mask": [
3559
+ true,
3560
+ true,
3561
+ true,
3562
+ true,
3563
+ true,
3564
+ true,
3565
+ false
3566
+ ]
3567
+ },
3568
+ "proprio": {
3569
+ "mean": [
3570
+ 0.0,
3571
+ 0.0,
3572
+ 0.0,
3573
+ 0.0,
3574
+ 0.0,
3575
+ 0.0,
3576
+ 0.0
3577
+ ],
3578
+ "std": [
3579
+ 0.0,
3580
+ 0.0,
3581
+ 0.0,
3582
+ 0.0,
3583
+ 0.0,
3584
+ 0.0,
3585
+ 0.0
3586
+ ],
3587
+ "max": [
3588
+ 0.0,
3589
+ 0.0,
3590
+ 0.0,
3591
+ 0.0,
3592
+ 0.0,
3593
+ 0.0,
3594
+ 0.0
3595
+ ],
3596
+ "min": [
3597
+ 0.0,
3598
+ 0.0,
3599
+ 0.0,
3600
+ 0.0,
3601
+ 0.0,
3602
+ 0.0,
3603
+ 0.0
3604
+ ],
3605
+ "q01": [
3606
+ 0.0,
3607
+ 0.0,
3608
+ 0.0,
3609
+ 0.0,
3610
+ 0.0,
3611
+ 0.0,
3612
+ 0.0
3613
+ ],
3614
+ "q99": [
3615
+ 0.0,
3616
+ 0.0,
3617
+ 0.0,
3618
+ 0.0,
3619
+ 0.0,
3620
+ 0.0,
3621
+ 0.0
3622
+ ]
3623
+ },
3624
+ "num_transitions": 241059,
3625
+ "num_trajectories": 2955
3626
+ }
3627
+ }
p2fft_20k/preprocessor_config.json ADDED
@@ -0,0 +1,114 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "auto_map": {
3
+ "AutoImageProcessor": "processing_prismatic.PrismaticImageProcessor",
4
+ "AutoProcessor": "processing_prismatic.PrismaticProcessor"
5
+ },
6
+ "image_processor_type": "PrismaticImageProcessor",
7
+ "image_resize_strategy": "resize-naive",
8
+ "input_sizes": [
9
+ [
10
+ 3,
11
+ 224,
12
+ 224
13
+ ],
14
+ [
15
+ 3,
16
+ 224,
17
+ 224
18
+ ]
19
+ ],
20
+ "interpolations": [
21
+ "bicubic",
22
+ "bicubic"
23
+ ],
24
+ "means": [
25
+ [
26
+ 0.485,
27
+ 0.456,
28
+ 0.406
29
+ ],
30
+ [
31
+ 0.5,
32
+ 0.5,
33
+ 0.5
34
+ ]
35
+ ],
36
+ "processor_class": "PrismaticProcessor",
37
+ "stds": [
38
+ [
39
+ 0.229,
40
+ 0.224,
41
+ 0.225
42
+ ],
43
+ [
44
+ 0.5,
45
+ 0.5,
46
+ 0.5
47
+ ]
48
+ ],
49
+ "tvf_crop_params": [
50
+ {
51
+ "output_size": [
52
+ 224,
53
+ 224
54
+ ]
55
+ },
56
+ {
57
+ "output_size": [
58
+ 224,
59
+ 224
60
+ ]
61
+ }
62
+ ],
63
+ "tvf_do_letterbox": false,
64
+ "tvf_letterbox_fill": null,
65
+ "tvf_normalize_params": [
66
+ {
67
+ "inplace": false,
68
+ "mean": [
69
+ 0.484375,
70
+ 0.455078125,
71
+ 0.40625
72
+ ],
73
+ "std": [
74
+ 0.228515625,
75
+ 0.2236328125,
76
+ 0.224609375
77
+ ]
78
+ },
79
+ {
80
+ "inplace": false,
81
+ "mean": [
82
+ 0.5,
83
+ 0.5,
84
+ 0.5
85
+ ],
86
+ "std": [
87
+ 0.5,
88
+ 0.5,
89
+ 0.5
90
+ ]
91
+ }
92
+ ],
93
+ "tvf_resize_params": [
94
+ {
95
+ "antialias": true,
96
+ "interpolation": 3,
97
+ "max_size": null,
98
+ "size": [
99
+ 224,
100
+ 224
101
+ ]
102
+ },
103
+ {
104
+ "antialias": true,
105
+ "interpolation": 3,
106
+ "max_size": null,
107
+ "size": [
108
+ 224,
109
+ 224
110
+ ]
111
+ }
112
+ ],
113
+ "use_fused_vision_backbone": true
114
+ }
p2fft_20k/processing_prismatic.py ADDED
@@ -0,0 +1,257 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """
2
+ processing_prismatic.py
3
+
4
+ HuggingFace-style preprocessor definitions for Prismatic VLMs, inheriting from `ProcessorMixin`. Default configuration
5
+ specifies `siglip-224px+7b`.
6
+ """
7
+
8
+ from typing import Any, ClassVar, List, Optional, Tuple, Union
9
+
10
+ import timm.data
11
+ import torch
12
+ import torchvision.transforms.functional as TVF
13
+ from PIL import Image
14
+ from torchvision.transforms import CenterCrop, Compose, Normalize, Resize, ToTensor
15
+ from transformers import PreTrainedTokenizerBase
16
+ from transformers.image_processing_utils import BatchFeature, ImageProcessingMixin
17
+ from transformers.processing_utils import ProcessorMixin
18
+ from transformers.tokenization_utils import PaddingStrategy, PreTokenizedInput, TextInput, TruncationStrategy
19
+ from transformers.utils import TensorType
20
+
21
+
22
+ # === Image Processing ===
23
+ def letterbox_pad_transform(image: Image.Image, padding_fill_value: Tuple[int, int, int]) -> Image.Image:
24
+ """Given a PIL.Image, pad to square by adding a symmetric border around the height/width."""
25
+ (w, h), max_wh = image.size, max(image.size)
26
+ horizontal_pad, vertical_pad = int((max_wh - w) / 2), int((max_wh - h) / 2)
27
+ padding = (horizontal_pad, vertical_pad, horizontal_pad, vertical_pad)
28
+
29
+ return TVF.pad(image, padding, fill=padding_fill_value, padding_mode="constant")
30
+
31
+
32
+ class PrismaticImageProcessor(ImageProcessingMixin):
33
+ model_input_names: ClassVar[List[str]] = ["pixel_values"]
34
+
35
+ def __init__(
36
+ self,
37
+ use_fused_vision_backbone: bool = False,
38
+ image_resize_strategy: str = "letterbox",
39
+ input_sizes: Optional[List[Tuple[int, int, int]]] = None,
40
+ interpolations: Optional[List[str]] = None,
41
+ means: Optional[List[Tuple[float, float, float]]] = None,
42
+ stds: Optional[List[Tuple[float, float, float]]] = None,
43
+ **kwargs: str,
44
+ ) -> None:
45
+ """
46
+ Initialize a PrismaticImageProcessor as a wrapper around a torchvision transform; this transform will be
47
+ created by TIMM, and edited to follow our custom `image_resize_strategy` logic.
48
+
49
+ @param use_fused_vision_backbone: Boolean indicating single or fused (dual) vision backbone
50
+ @param image_resize_strategy: Prismatic image resize strategy in < resize-naive | resize-crop | letterbox >
51
+ @param input_size: [TIMM :: `data_cfg`] Input image size as tuple (channels, width, height)
52
+ @param interpolation: [TIMM :: `data_cfg`] Interpolation as string (default: "bicubic")
53
+ @param mean: [TIMM :: `data_cfg`] Normalization mean as float tuple (or two-tuple if `fused_backbone`)
54
+ @param std: [TIMM :: `data_cfg`] Normalization std as float tuple (or two-tuple if `fused_backbone`)
55
+ """
56
+ self.use_fused_vision_backbone = use_fused_vision_backbone
57
+ self.image_resize_strategy = image_resize_strategy
58
+
59
+ # Handle `None` default values
60
+ input_sizes = [(3, 224, 224)] if input_sizes is None else input_sizes
61
+ means = [(0.5, 0.5, 0.5)] if means is None else means
62
+ stds = [(0.5, 0.5, 0.5)] if stds is None else stds
63
+
64
+ # TIMM `data_cfg` Parameters
65
+ self.input_sizes, self.interpolations, self.means, self.stds = input_sizes, interpolations, means, stds
66
+
67
+ # Grab torchvision transforms via TIMM =>> need to parse for specific "functional" transform values!
68
+ self.tvf_resize_params, self.tvf_crop_params, self.tvf_normalize_params = [], [], []
69
+ self.tvf_do_letterbox, self.tvf_letterbox_fill = False, None
70
+
71
+ for idx in range(len(input_sizes)):
72
+ transform = timm.data.create_transform(
73
+ input_size=self.input_sizes[idx],
74
+ interpolation=self.interpolations[idx],
75
+ mean=self.means[idx],
76
+ std=self.stds[idx],
77
+ crop_pct=1.0, # Set to 1.0 to ignore cropping (initial Resize sets `input_size`)
78
+ crop_mode="center", # Default crop mode -- no-op when `crop_pct == 1.0`
79
+ is_training=False, # No image augmentations when loading the transform!
80
+ )
81
+
82
+ # [Validation] Ensure appropriate transform structure, expected sizes
83
+ if not (
84
+ isinstance(transform, Compose)
85
+ and (len(transform.transforms) == 4)
86
+ and isinstance(transform.transforms[0], Resize)
87
+ and isinstance(transform.transforms[1], CenterCrop)
88
+ and isinstance(transform.transforms[2], ToTensor)
89
+ and isinstance(transform.transforms[3], Normalize)
90
+ and (transform.transforms[0].size == self.input_sizes[idx][-1])
91
+ and (transform.transforms[1].size == self.input_sizes[idx][-2:])
92
+ ):
93
+ raise ValueError(f"Unexpected TIMM image transformation structure/sizes: `{transform}`")
94
+
95
+ # HF Image Processors *must* be JSON-serializable; as such, cannot have torchvision. as an attribute.
96
+ # => Instead, we're going to parse the transform and call "torchvision.transforms.functional" (`tvf`)
97
+ resize_t, crop_t, norm_t = transform.transforms[0], transform.transforms[1], transform.transforms[3]
98
+ self.tvf_resize_params.append(
99
+ {
100
+ "size": resize_t.size,
101
+ "interpolation": TVF.pil_modes_mapping[resize_t.interpolation],
102
+ "max_size": None,
103
+ "antialias": True,
104
+ }
105
+ )
106
+ self.tvf_crop_params.append({"output_size": crop_t.size})
107
+ self.tvf_normalize_params.append(
108
+ {
109
+ "mean": norm_t.mean.float().numpy().tolist(),
110
+ "std": norm_t.std.float().numpy().tolist(),
111
+ "inplace": False,
112
+ }
113
+ )
114
+ self.tvf_do_letterbox, self.tvf_letterbox_fill = False, None
115
+
116
+ # Handle Prismatic `image_resize_strategy`
117
+ if self.image_resize_strategy == "resize-naive":
118
+ self.tvf_resize_params[idx]["size"] = (resize_t.size, resize_t.size)
119
+ elif self.image_resize_strategy == "letterbox":
120
+ self.tvf_do_letterbox, self.tvf_letterbox_fill = True, tuple([int(x * 255) for x in self.means[idx]])
121
+ elif self.image_resize_strategy == "resize-crop":
122
+ pass
123
+ else:
124
+ raise ValueError(f"Image resize strategy `{self.image_resize_strategy}` is not supported!")
125
+
126
+ # Dispatch **kwargs to super()
127
+ super().__init__(**kwargs)
128
+
129
+ def apply_transform(self, img: Image.Image) -> torch.Tensor:
130
+ """Apply `functional` variant of TIMM's Transform = Compose([Resize -> CenterCrop -> ToTensor -> Normalize])"""
131
+ if self.tvf_do_letterbox:
132
+ img = letterbox_pad_transform(img, self.tvf_letterbox_fill)
133
+
134
+ # [Contract] Fused Backbones expect "channel-stacked" inputs; we'll unpack on the model side!
135
+ imgs_t = []
136
+ for idx in range(len(self.input_sizes)):
137
+ img_idx = TVF.resize(img, **self.tvf_resize_params[idx])
138
+ img_idx = TVF.center_crop(img_idx, **self.tvf_crop_params[idx])
139
+ img_idx_t = TVF.to_tensor(img_idx)
140
+ img_idx_t = TVF.normalize(img_idx_t, **self.tvf_normalize_params[idx])
141
+ imgs_t.append(img_idx_t)
142
+
143
+ # [Contract] `imgs_t` is a list of Tensors of shape [3, input_size, input_size]; stack along dim = 0
144
+ img_t = torch.vstack(imgs_t)
145
+
146
+ return img_t
147
+
148
+ def preprocess(
149
+ self,
150
+ images: Union[Image.Image, List[Image.Image]],
151
+ return_tensors: Optional[Union[str, TensorType]] = None,
152
+ **_: str,
153
+ ) -> BatchFeature:
154
+ """
155
+ Preprocess an image (or batch of images); note that unlike the `transformers :: BaseImageProcessor` we
156
+ explicitly only handle PIL.Image.Image instances for simplicity.
157
+
158
+ @param images: A (batch of) PIL.Image.Image instance(s) to preprocess.
159
+ @param return_tensors: BatchFeature default Tensor format (e.g., "pt" for torch); if None, returns np.ndarray
160
+
161
+ @return: Instance of `transformers :: BatchFeature` with a single key "pixel_values"
162
+ """
163
+ if not isinstance(images, list):
164
+ images = [images]
165
+
166
+ # Apply `self.img_transform` to each image (will return list of torch.Tensors); stack into "batched" Tensor
167
+ pixel_values = torch.stack([self.apply_transform(img.convert("RGB")) for img in images])
168
+
169
+ # Return BatchFeature =>> note that for compatibility, constructor expects Dict[str, np.ndarray], so we convert
170
+ return BatchFeature(data={"pixel_values": pixel_values.float().numpy()}, tensor_type=return_tensors)
171
+
172
+ def __call__(self, images: Union[Image.Image, List[Image.Image]], **kwargs) -> BatchFeature:
173
+ return self.preprocess(images, **kwargs)
174
+
175
+
176
+ # === PrismaticProcessor =>> Wraps both ImageProcessor and Tokenizer ===
177
+ # =>> https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava/processing_llava.py
178
+ class PrismaticProcessor(ProcessorMixin):
179
+ attributes: ClassVar[List[str]] = ["image_processor", "tokenizer"]
180
+ image_processor_class: str = "AutoImageProcessor"
181
+ tokenizer_class: str = "AutoTokenizer"
182
+
183
+ def __init__(
184
+ self,
185
+ image_processor: Optional[ImageProcessingMixin] = None,
186
+ tokenizer: Optional[PreTrainedTokenizerBase] = None,
187
+ ) -> None:
188
+ super().__init__(image_processor, tokenizer)
189
+
190
+ def __call__(
191
+ self,
192
+ text: Union[TextInput, PreTokenizedInput, List[TextInput], List[PreTokenizedInput]],
193
+ images: Union[Image.Image, List[Image.Image]],
194
+ padding: Union[bool, str, PaddingStrategy] = False,
195
+ truncation: Optional[Union[bool, str, TruncationStrategy]] = None,
196
+ max_length: Optional[int] = None,
197
+ return_tensors: Optional[Union[str, TensorType]] = TensorType.PYTORCH,
198
+ ) -> BatchFeature:
199
+ """
200
+ Preprocess a given (batch) of text/images for a Prismatic VLM; forwards text to the underlying LLM's tokenizer,
201
+ forwards images to PrismaticImageProcessor.
202
+
203
+ @param text: The (batch) of text to encode; must be a string or list of strings.
204
+ @param images: A (batch of) PIL.Image.Image instance(s) to preprocess.
205
+ @param padding: Sequence padding strategy (if multiple specified) in < True = "longest" | "max_length" | False >
206
+ @param truncation: Truncation strategy for the output sequences; requires `max_length` to be specified
207
+ @param max_length: Maximum length (in tokens) to truncate
208
+ @param return_tensors: Type of return tensors (usually "pt" or TensorType.PYTORCH)
209
+
210
+ @return: BatchFeature with keys for `input_ids`, `attention_mask` and `pixel_values`.
211
+ """
212
+ pixel_values = self.image_processor(images, return_tensors=return_tensors)["pixel_values"]
213
+ text_inputs = self.tokenizer(
214
+ text, return_tensors=return_tensors, padding=padding, truncation=truncation, max_length=max_length
215
+ )
216
+
217
+ # [Validate] Need same number of images and text inputs!
218
+ if pixel_values.shape[0] != text_inputs.input_ids.shape[0]:
219
+ raise ValueError("Batch is malformed; expected same number of images and text inputs!")
220
+
221
+ return BatchFeature(data={**text_inputs, "pixel_values": pixel_values})
222
+
223
+ # === Tokenizer Dispatch Utilities =>> check `PreTrainedTokenizerBase` for documentation ===
224
+ def batch_decode(
225
+ self,
226
+ sequences: Union[List[int], List[List[int]], torch.Tensor, Any], # `Any` = np.ndarray | tf.Tensor
227
+ skip_special_tokens: bool = False,
228
+ clean_up_tokenization_spaces: Optional[bool] = None,
229
+ **kwargs: str,
230
+ ) -> List[str]:
231
+ return self.tokenizer.batch_decode(
232
+ sequences=sequences,
233
+ skip_special_tokens=skip_special_tokens,
234
+ clean_up_tokenization_spaces=clean_up_tokenization_spaces,
235
+ **kwargs,
236
+ )
237
+
238
+ def decode(
239
+ self,
240
+ token_ids: Union[int, List[int], torch.Tensor, Any], # `Any` = np.ndarray | tf.Tensor
241
+ skip_special_tokens: bool = False,
242
+ clean_up_tokenization_spaces: Optional[bool] = None,
243
+ **kwargs: str,
244
+ ) -> str:
245
+ return self.tokenizer.decode(
246
+ token_ids=token_ids,
247
+ skip_special_tokens=skip_special_tokens,
248
+ clean_up_tokenization_spaces=clean_up_tokenization_spaces,
249
+ **kwargs,
250
+ )
251
+
252
+ @property
253
+ def model_input_names(self) -> List[str]:
254
+ tokenizer_input_names = self.tokenizer.model_input_names
255
+ image_processor_input_names = self.image_processor.model_input_names
256
+
257
+ return list(dict.fromkeys(tokenizer_input_names + image_processor_input_names))
p2fft_20k/processor_config.json ADDED
@@ -0,0 +1,6 @@
 
 
 
 
 
 
 
1
+ {
2
+ "auto_map": {
3
+ "AutoProcessor": "processing_prismatic.PrismaticProcessor"
4
+ },
5
+ "processor_class": "PrismaticProcessor"
6
+ }
p2fft_20k/special_tokens_map.json ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ {
4
+ "content": "<ACT_0>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false
9
+ },
10
+ {
11
+ "content": "<ACT_1>",
12
+ "lstrip": false,
13
+ "normalized": false,
14
+ "rstrip": false,
15
+ "single_word": false
16
+ },
17
+ {
18
+ "content": "<ACT_2>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ {
25
+ "content": "<ACT_3>",
26
+ "lstrip": false,
27
+ "normalized": false,
28
+ "rstrip": false,
29
+ "single_word": false
30
+ }
31
+ ],
32
+ "bos_token": {
33
+ "content": "<s>",
34
+ "lstrip": false,
35
+ "normalized": false,
36
+ "rstrip": false,
37
+ "single_word": false
38
+ },
39
+ "eos_token": {
40
+ "content": "</s>",
41
+ "lstrip": false,
42
+ "normalized": false,
43
+ "rstrip": false,
44
+ "single_word": false
45
+ },
46
+ "pad_token": {
47
+ "content": "<PAD>",
48
+ "lstrip": false,
49
+ "normalized": false,
50
+ "rstrip": false,
51
+ "single_word": false
52
+ },
53
+ "unk_token": {
54
+ "content": "<unk>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false
59
+ }
60
+ }
p2fft_20k/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1219be150dec6ecbf36f507377e7df878602b89df9388db708d2dc3356aa43be
3
+ size 1843708
p2fft_20k/tokenizer_config.json ADDED
@@ -0,0 +1,91 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": true,
3
+ "add_eos_token": false,
4
+ "added_tokens_decoder": {
5
+ "0": {
6
+ "content": "<unk>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "1": {
14
+ "content": "<s>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "2": {
22
+ "content": "</s>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "32000": {
30
+ "content": "<PAD>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "32001": {
38
+ "content": "<ACT_0>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "32002": {
46
+ "content": "<ACT_1>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "32003": {
54
+ "content": "<ACT_2>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "32004": {
62
+ "content": "<ACT_3>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ }
69
+ },
70
+ "additional_special_tokens": [
71
+ "<ACT_0>",
72
+ "<ACT_1>",
73
+ "<ACT_2>",
74
+ "<ACT_3>"
75
+ ],
76
+ "auto_map": {
77
+ "AutoProcessor": "processing_prismatic.PrismaticProcessor"
78
+ },
79
+ "bos_token": "<s>",
80
+ "clean_up_tokenization_spaces": false,
81
+ "eos_token": "</s>",
82
+ "legacy": false,
83
+ "model_max_length": 2048,
84
+ "pad_token": "<PAD>",
85
+ "padding_side": "right",
86
+ "processor_class": "PrismaticProcessor",
87
+ "sp_model_kwargs": {},
88
+ "tokenizer_class": "LlamaTokenizer",
89
+ "unk_token": "<unk>",
90
+ "use_default_system_prompt": false
91
+ }
p2fft_20k/train_log.jsonl ADDED
The diff for this file is too large to render. See raw diff
 
p2fft_20k/vla_full.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0cd0d4780b8809c43920035ccff2e79fce5ff6e2324a75b342c9b8a8d612bfb
3
+ size 15081838026