greycat111 commited on
Commit
69fdc53
·
verified ·
1 Parent(s): 497843e

Archive DINO-WM PushT, intermediate PLDM Cube and completed seed results

Browse files
README.md ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - world-model
4
+ - planning
5
+ - dinowm
6
+ - pldm
7
+ - fast-lewm
8
+ ---
9
+ # Planning baseline checkpoint archive
10
+
11
+ This repository archives checkpoints and measured planning results for TwoRoom, Cube and PushT. Reacher is excluded and LeJEPA is canceled. Original checkpoints retain their upstream licenses; see `licenses/`.
12
+
13
+ | Directory | Contents | Status |
14
+ |---|---|---|
15
+ | fast-lewm/tworoom, cube, pusht | Exact original `naiverer/fast-leworldmodel` checkpoints | All five-seed planning evaluations completed |
16
+ | dinowm/pusht | Original DINO-WM OSF PushT checkpoint and frozen DINOv2-S/14 backbone | Published model trained on `pusht_noise`; evaluation incomplete |
17
+ | pldm/cube | Resume checkpoint, configuration and provenance | Intermediate checkpoint; read `provenance.json` for completed epoch count, not yet the final 10-epoch model |
18
+ | pldm/tworoom | Configuration and results only | The trained weights were deleted after evaluation under the earlier disk-saving instruction and are unavailable |
19
+
20
+ Newly completed local checkpoints are archived under `trained/<method>/<task>/model.pt`, with provenance alongside each file. Each local checkpoint uses training seed 42. Five evaluation seeds do not mean five independently trained models.
21
+
22
+ ## Results and comparison protocol
23
+
24
+ `results/planning_success.xlsx` contains the detailed per-seed results and the seed summary. `results/planning_summary.csv` contains columns for seeds 42, 43, 44, 45, 46 and mean/sample standard deviation (ddof=1). Success percentages are reported only for 200 completed episodes per seed and goal offset. Goal offsets are 25, 50, 75 and 100. Mean and std require all five completed seeds; missing values are null.
25
+
26
+ The planning budget is 50 environment steps, with a 25-step planning window and CEM using 300 candidates, 30 iterations and 30 elites. Models share the persisted task/offset/seed evaluation pairs. Newly trained PLDM and DINO-WM checkpoints use a fixed 10-epoch training budget, while published Fast-LeWM and DINO-WM checkpoints have their original training histories. This is not an equal-training-budget comparison or an exact paper reproduction. Evaluation pairs come from the supplied dataset and are not a separate held-out test split.
27
+
28
+ ## Loading
29
+
30
+ Original Fast-LeWM object checkpoints depend on the upstream Fast-LeWorldModel Python source. Original DINO-WM objects depend on the original DINO-WM source. Locally trained objects additionally depend on `code/train_models.py` and stable-worldmodel 0.1.1. The Cube resume checkpoint holds state dictionaries, optimizer/RNG state and completed-epoch metadata; it is not a directly callable model object. See `code/train_baseline.py` for restoration. Loading pickled Python model objects requires their matching source and a trusted checkpoint source.
31
+
32
+ Source repositories:
33
+ - https://github.com/lucas-maes/le-wm
34
+ - https://huggingface.co/naiverer/fast-leworldmodel
35
+ - https://github.com/gaoyuezhou/dino_wm
36
+
37
+ No source datasets are uploaded. No paper-reported number is substituted for a measured score. For complete protocol details and known implementation differences, see `results/PROTOCOL.md`.
dinowm/pusht/dinov2_vits14_pretrain.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b938bf1bc15cd2ec0feacfe3a1bb553fe8ea9ca46a7e1d8d00217f29aef60cd9
3
+ size 88283115
dinowm/pusht/model_latest.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e909f0cec958fc0b49a79f2e85730ae6b5f83dee61a224705f91883eb3bb74c5
3
+ size 377929744
pldm/cube/provenance.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "epochs_completed": 8,
3
+ "epochs_required": 10,
4
+ "status": "Intermediate resume checkpoint; not final ten-epoch model"
5
+ }
pldm/cube/resume_checkpoint.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7bd32c324c8f4089517edda3e0e5ef572a5312b2d9979b647b095a91b4164883
3
+ size 216826167
results/completed_seed_results.csv ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ model,dataset,offset,seed_42,seed_43,seed_44,seed_45,seed_46,seeds_completed,mean_percent,std_percent,mean_plus_std
2
+ pldm,tworoom,25,96.0,94.5,95.5,94.0,97.0,5,95.4,1.1937336386313322,95.40 ± 1.19
3
+ pldm,tworoom,50,80.0,76.0,81.0,78.5,79.5,5,79.0,1.9039432764659772,79.00 ± 1.90
4
+ pldm,tworoom,75,57.5,54.5,52.5,54.5,56.0,5,55.0,1.8708286933869707,55.00 ± 1.87
5
+ pldm,tworoom,100,33.5,33.5,33.5,34.5,32.0,5,33.4,0.8944271909999159,33.40 ± 0.89
6
+ fast-lewm,tworoom,25,88.0,90.0,86.5,88.5,91.0,5,88.8,1.753567791675018,88.80 ± 1.75
7
+ fast-lewm,tworoom,50,64.0,58.0,59.0,63.5,66.0,5,62.1,3.4351128074635335,62.10 ± 3.44
8
+ fast-lewm,tworoom,75,44.5,33.5,35.5,34.0,38.0,5,37.1,4.491658936295141,37.10 ± 4.49
9
+ fast-lewm,tworoom,100,16.5,19.0,18.0,16.5,17.0,5,17.4,1.08397416943394,17.40 ± 1.08
10
+ fast-lewm,cube,25,66.5,70.0,66.5,70.5,78.0,5,70.3,4.698403984333403,70.30 ± 4.70
11
+ fast-lewm,cube,50,53.5,46.5,53.0,52.0,58.0,5,52.6,4.1140004861448425,52.60 ± 4.11
12
+ fast-lewm,cube,75,64.5,68.5,62.5,69.0,66.5,5,66.2,2.7294688127912363,66.20 ± 2.73
13
+ fast-lewm,cube,100,63.5,63.0,60.0,63.5,61.0,5,62.2,1.6046806535881213,62.20 ± 1.60
14
+ fast-lewm,pusht,25,88.0,93.5,87.0,86.0,90.0,5,88.9,2.9664793948382653,88.90 ± 2.97
15
+ fast-lewm,pusht,50,39.5,35.5,40.0,36.0,36.5,5,37.5,2.091650066335189,37.50 ± 2.09
16
+ fast-lewm,pusht,75,16.5,13.5,18.0,15.5,18.5,5,16.4,2.0124611797498106,16.40 ± 2.01
17
+ fast-lewm,pusht,100,8.0,8.0,9.5,9.0,9.5,5,8.8,0.758287544405155,8.80 ± 0.76
results/completed_seed_results.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Completed five-seed planning results
2
+
3
+ Success percentages; 200 episodes per seed and offset. Sample standard deviation (ddof=1). These are evaluation seeds of one checkpoint per model/task, not independently trained model seeds.
4
+
5
+ | Model | Dataset | Offset | Seed 42 | Seed 43 | Seed 44 | Seed 45 | Seed 46 | Mean ± std |
6
+ |---|---|---:|---:|---:|---:|---:|---:|---:|
7
+ | pldm | tworoom | 25 | 96.0 | 94.5 | 95.5 | 94.0 | 97.0 | 95.40 ± 1.19 |
8
+ | pldm | tworoom | 50 | 80.0 | 76.0 | 81.0 | 78.5 | 79.5 | 79.00 ± 1.90 |
9
+ | pldm | tworoom | 75 | 57.5 | 54.5 | 52.5 | 54.5 | 56.0 | 55.00 ± 1.87 |
10
+ | pldm | tworoom | 100 | 33.5 | 33.5 | 33.5 | 34.5 | 32.0 | 33.40 ± 0.89 |
11
+ | fast-lewm | tworoom | 25 | 88.0 | 90.0 | 86.5 | 88.5 | 91.0 | 88.80 ± 1.75 |
12
+ | fast-lewm | tworoom | 50 | 64.0 | 58.0 | 59.0 | 63.5 | 66.0 | 62.10 ± 3.44 |
13
+ | fast-lewm | tworoom | 75 | 44.5 | 33.5 | 35.5 | 34.0 | 38.0 | 37.10 ± 4.49 |
14
+ | fast-lewm | tworoom | 100 | 16.5 | 19.0 | 18.0 | 16.5 | 17.0 | 17.40 ± 1.08 |
15
+ | fast-lewm | cube | 25 | 66.5 | 70.0 | 66.5 | 70.5 | 78.0 | 70.30 ± 4.70 |
16
+ | fast-lewm | cube | 50 | 53.5 | 46.5 | 53.0 | 52.0 | 58.0 | 52.60 ± 4.11 |
17
+ | fast-lewm | cube | 75 | 64.5 | 68.5 | 62.5 | 69.0 | 66.5 | 66.20 ± 2.73 |
18
+ | fast-lewm | cube | 100 | 63.5 | 63.0 | 60.0 | 63.5 | 61.0 | 62.20 ± 1.60 |
19
+ | fast-lewm | pusht | 25 | 88.0 | 93.5 | 87.0 | 86.0 | 90.0 | 88.90 ± 2.97 |
20
+ | fast-lewm | pusht | 50 | 39.5 | 35.5 | 40.0 | 36.0 | 36.5 | 37.50 ± 2.09 |
21
+ | fast-lewm | pusht | 75 | 16.5 | 13.5 | 18.0 | 15.5 | 18.5 | 16.40 ± 2.01 |
22
+ | fast-lewm | pusht | 100 | 8.0 | 8.0 | 9.5 | 9.0 | 9.5 | 8.80 ± 0.76 |
results/planning_success.xlsx ADDED
Binary file (27.7 kB). View file
 
results/planning_summary.json ADDED
@@ -0,0 +1,1010 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "model": "dinowm",
4
+ "dataset": "tworoom",
5
+ "offset": 25,
6
+ "seed_42": null,
7
+ "seed_43": null,
8
+ "seed_44": null,
9
+ "seed_45": null,
10
+ "seed_46": null,
11
+ "seeds_completed": 0,
12
+ "mean_percent": null,
13
+ "std_percent": null,
14
+ "mean_plus_std": null
15
+ },
16
+ {
17
+ "model": "dinowm",
18
+ "dataset": "tworoom",
19
+ "offset": 50,
20
+ "seed_42": null,
21
+ "seed_43": null,
22
+ "seed_44": null,
23
+ "seed_45": null,
24
+ "seed_46": null,
25
+ "seeds_completed": 0,
26
+ "mean_percent": null,
27
+ "std_percent": null,
28
+ "mean_plus_std": null
29
+ },
30
+ {
31
+ "model": "dinowm",
32
+ "dataset": "tworoom",
33
+ "offset": 75,
34
+ "seed_42": null,
35
+ "seed_43": null,
36
+ "seed_44": null,
37
+ "seed_45": null,
38
+ "seed_46": null,
39
+ "seeds_completed": 0,
40
+ "mean_percent": null,
41
+ "std_percent": null,
42
+ "mean_plus_std": null
43
+ },
44
+ {
45
+ "model": "dinowm",
46
+ "dataset": "tworoom",
47
+ "offset": 100,
48
+ "seed_42": null,
49
+ "seed_43": null,
50
+ "seed_44": null,
51
+ "seed_45": null,
52
+ "seed_46": null,
53
+ "seeds_completed": 0,
54
+ "mean_percent": null,
55
+ "std_percent": null,
56
+ "mean_plus_std": null
57
+ },
58
+ {
59
+ "model": "dinowm",
60
+ "dataset": "cube",
61
+ "offset": 25,
62
+ "seed_42": null,
63
+ "seed_43": null,
64
+ "seed_44": null,
65
+ "seed_45": null,
66
+ "seed_46": null,
67
+ "seeds_completed": 0,
68
+ "mean_percent": null,
69
+ "std_percent": null,
70
+ "mean_plus_std": null
71
+ },
72
+ {
73
+ "model": "dinowm",
74
+ "dataset": "cube",
75
+ "offset": 50,
76
+ "seed_42": null,
77
+ "seed_43": null,
78
+ "seed_44": null,
79
+ "seed_45": null,
80
+ "seed_46": null,
81
+ "seeds_completed": 0,
82
+ "mean_percent": null,
83
+ "std_percent": null,
84
+ "mean_plus_std": null
85
+ },
86
+ {
87
+ "model": "dinowm",
88
+ "dataset": "cube",
89
+ "offset": 75,
90
+ "seed_42": null,
91
+ "seed_43": null,
92
+ "seed_44": null,
93
+ "seed_45": null,
94
+ "seed_46": null,
95
+ "seeds_completed": 0,
96
+ "mean_percent": null,
97
+ "std_percent": null,
98
+ "mean_plus_std": null
99
+ },
100
+ {
101
+ "model": "dinowm",
102
+ "dataset": "cube",
103
+ "offset": 100,
104
+ "seed_42": null,
105
+ "seed_43": null,
106
+ "seed_44": null,
107
+ "seed_45": null,
108
+ "seed_46": null,
109
+ "seeds_completed": 0,
110
+ "mean_percent": null,
111
+ "std_percent": null,
112
+ "mean_plus_std": null
113
+ },
114
+ {
115
+ "model": "dinowm",
116
+ "dataset": "pusht",
117
+ "offset": 25,
118
+ "seed_42": null,
119
+ "seed_43": null,
120
+ "seed_44": null,
121
+ "seed_45": null,
122
+ "seed_46": null,
123
+ "seeds_completed": 0,
124
+ "mean_percent": null,
125
+ "std_percent": null,
126
+ "mean_plus_std": null
127
+ },
128
+ {
129
+ "model": "dinowm",
130
+ "dataset": "pusht",
131
+ "offset": 50,
132
+ "seed_42": null,
133
+ "seed_43": null,
134
+ "seed_44": null,
135
+ "seed_45": null,
136
+ "seed_46": null,
137
+ "seeds_completed": 0,
138
+ "mean_percent": null,
139
+ "std_percent": null,
140
+ "mean_plus_std": null
141
+ },
142
+ {
143
+ "model": "dinowm",
144
+ "dataset": "pusht",
145
+ "offset": 75,
146
+ "seed_42": null,
147
+ "seed_43": null,
148
+ "seed_44": null,
149
+ "seed_45": null,
150
+ "seed_46": null,
151
+ "seeds_completed": 0,
152
+ "mean_percent": null,
153
+ "std_percent": null,
154
+ "mean_plus_std": null
155
+ },
156
+ {
157
+ "model": "dinowm",
158
+ "dataset": "pusht",
159
+ "offset": 100,
160
+ "seed_42": null,
161
+ "seed_43": null,
162
+ "seed_44": null,
163
+ "seed_45": null,
164
+ "seed_46": null,
165
+ "seeds_completed": 0,
166
+ "mean_percent": null,
167
+ "std_percent": null,
168
+ "mean_plus_std": null
169
+ },
170
+ {
171
+ "model": "pldm",
172
+ "dataset": "tworoom",
173
+ "offset": 25,
174
+ "seed_42": 96.0,
175
+ "seed_43": 94.5,
176
+ "seed_44": 95.5,
177
+ "seed_45": 94.0,
178
+ "seed_46": 97.0,
179
+ "seeds_completed": 5,
180
+ "mean_percent": 95.4,
181
+ "std_percent": 1.1937336386313322,
182
+ "mean_plus_std": "95.40 \u00b1 1.19"
183
+ },
184
+ {
185
+ "model": "pldm",
186
+ "dataset": "tworoom",
187
+ "offset": 50,
188
+ "seed_42": 80.0,
189
+ "seed_43": 76.0,
190
+ "seed_44": 81.0,
191
+ "seed_45": 78.5,
192
+ "seed_46": 79.5,
193
+ "seeds_completed": 5,
194
+ "mean_percent": 79.0,
195
+ "std_percent": 1.9039432764659772,
196
+ "mean_plus_std": "79.00 \u00b1 1.90"
197
+ },
198
+ {
199
+ "model": "pldm",
200
+ "dataset": "tworoom",
201
+ "offset": 75,
202
+ "seed_42": 57.5,
203
+ "seed_43": 54.5,
204
+ "seed_44": 52.5,
205
+ "seed_45": 54.5,
206
+ "seed_46": 56.0,
207
+ "seeds_completed": 5,
208
+ "mean_percent": 55.0,
209
+ "std_percent": 1.8708286933869707,
210
+ "mean_plus_std": "55.00 \u00b1 1.87"
211
+ },
212
+ {
213
+ "model": "pldm",
214
+ "dataset": "tworoom",
215
+ "offset": 100,
216
+ "seed_42": 33.5,
217
+ "seed_43": 33.5,
218
+ "seed_44": 33.5,
219
+ "seed_45": 34.5,
220
+ "seed_46": 32.0,
221
+ "seeds_completed": 5,
222
+ "mean_percent": 33.4,
223
+ "std_percent": 0.8944271909999159,
224
+ "mean_plus_std": "33.40 \u00b1 0.89"
225
+ },
226
+ {
227
+ "model": "pldm",
228
+ "dataset": "cube",
229
+ "offset": 25,
230
+ "seed_42": null,
231
+ "seed_43": null,
232
+ "seed_44": null,
233
+ "seed_45": null,
234
+ "seed_46": null,
235
+ "seeds_completed": 0,
236
+ "mean_percent": null,
237
+ "std_percent": null,
238
+ "mean_plus_std": null
239
+ },
240
+ {
241
+ "model": "pldm",
242
+ "dataset": "cube",
243
+ "offset": 50,
244
+ "seed_42": null,
245
+ "seed_43": null,
246
+ "seed_44": null,
247
+ "seed_45": null,
248
+ "seed_46": null,
249
+ "seeds_completed": 0,
250
+ "mean_percent": null,
251
+ "std_percent": null,
252
+ "mean_plus_std": null
253
+ },
254
+ {
255
+ "model": "pldm",
256
+ "dataset": "cube",
257
+ "offset": 75,
258
+ "seed_42": null,
259
+ "seed_43": null,
260
+ "seed_44": null,
261
+ "seed_45": null,
262
+ "seed_46": null,
263
+ "seeds_completed": 0,
264
+ "mean_percent": null,
265
+ "std_percent": null,
266
+ "mean_plus_std": null
267
+ },
268
+ {
269
+ "model": "pldm",
270
+ "dataset": "cube",
271
+ "offset": 100,
272
+ "seed_42": null,
273
+ "seed_43": null,
274
+ "seed_44": null,
275
+ "seed_45": null,
276
+ "seed_46": null,
277
+ "seeds_completed": 0,
278
+ "mean_percent": null,
279
+ "std_percent": null,
280
+ "mean_plus_std": null
281
+ },
282
+ {
283
+ "model": "pldm",
284
+ "dataset": "pusht",
285
+ "offset": 25,
286
+ "seed_42": null,
287
+ "seed_43": null,
288
+ "seed_44": null,
289
+ "seed_45": null,
290
+ "seed_46": null,
291
+ "seeds_completed": 0,
292
+ "mean_percent": null,
293
+ "std_percent": null,
294
+ "mean_plus_std": null
295
+ },
296
+ {
297
+ "model": "pldm",
298
+ "dataset": "pusht",
299
+ "offset": 50,
300
+ "seed_42": null,
301
+ "seed_43": null,
302
+ "seed_44": null,
303
+ "seed_45": null,
304
+ "seed_46": null,
305
+ "seeds_completed": 0,
306
+ "mean_percent": null,
307
+ "std_percent": null,
308
+ "mean_plus_std": null
309
+ },
310
+ {
311
+ "model": "pldm",
312
+ "dataset": "pusht",
313
+ "offset": 75,
314
+ "seed_42": null,
315
+ "seed_43": null,
316
+ "seed_44": null,
317
+ "seed_45": null,
318
+ "seed_46": null,
319
+ "seeds_completed": 0,
320
+ "mean_percent": null,
321
+ "std_percent": null,
322
+ "mean_plus_std": null
323
+ },
324
+ {
325
+ "model": "pldm",
326
+ "dataset": "pusht",
327
+ "offset": 100,
328
+ "seed_42": null,
329
+ "seed_43": null,
330
+ "seed_44": null,
331
+ "seed_45": null,
332
+ "seed_46": null,
333
+ "seeds_completed": 0,
334
+ "mean_percent": null,
335
+ "std_percent": null,
336
+ "mean_plus_std": null
337
+ },
338
+ {
339
+ "model": "fast-lewm",
340
+ "dataset": "tworoom",
341
+ "offset": 25,
342
+ "seed_42": 88.0,
343
+ "seed_43": 90.0,
344
+ "seed_44": 86.5,
345
+ "seed_45": 88.5,
346
+ "seed_46": 91.0,
347
+ "seeds_completed": 5,
348
+ "mean_percent": 88.8,
349
+ "std_percent": 1.753567791675018,
350
+ "mean_plus_std": "88.80 \u00b1 1.75"
351
+ },
352
+ {
353
+ "model": "fast-lewm",
354
+ "dataset": "tworoom",
355
+ "offset": 50,
356
+ "seed_42": 64.0,
357
+ "seed_43": 58.0,
358
+ "seed_44": 59.0,
359
+ "seed_45": 63.5,
360
+ "seed_46": 66.0,
361
+ "seeds_completed": 5,
362
+ "mean_percent": 62.1,
363
+ "std_percent": 3.4351128074635335,
364
+ "mean_plus_std": "62.10 \u00b1 3.44"
365
+ },
366
+ {
367
+ "model": "fast-lewm",
368
+ "dataset": "tworoom",
369
+ "offset": 75,
370
+ "seed_42": 44.5,
371
+ "seed_43": 33.5,
372
+ "seed_44": 35.5,
373
+ "seed_45": 34.0,
374
+ "seed_46": 38.0,
375
+ "seeds_completed": 5,
376
+ "mean_percent": 37.1,
377
+ "std_percent": 4.491658936295141,
378
+ "mean_plus_std": "37.10 \u00b1 4.49"
379
+ },
380
+ {
381
+ "model": "fast-lewm",
382
+ "dataset": "tworoom",
383
+ "offset": 100,
384
+ "seed_42": 16.5,
385
+ "seed_43": 19.0,
386
+ "seed_44": 18.0,
387
+ "seed_45": 16.5,
388
+ "seed_46": 17.0,
389
+ "seeds_completed": 5,
390
+ "mean_percent": 17.4,
391
+ "std_percent": 1.08397416943394,
392
+ "mean_plus_std": "17.40 \u00b1 1.08"
393
+ },
394
+ {
395
+ "model": "fast-lewm",
396
+ "dataset": "cube",
397
+ "offset": 25,
398
+ "seed_42": 66.5,
399
+ "seed_43": 70.0,
400
+ "seed_44": 66.5,
401
+ "seed_45": 70.5,
402
+ "seed_46": 78.0,
403
+ "seeds_completed": 5,
404
+ "mean_percent": 70.3,
405
+ "std_percent": 4.698403984333403,
406
+ "mean_plus_std": "70.30 \u00b1 4.70"
407
+ },
408
+ {
409
+ "model": "fast-lewm",
410
+ "dataset": "cube",
411
+ "offset": 50,
412
+ "seed_42": 53.5,
413
+ "seed_43": 46.5,
414
+ "seed_44": 53.0,
415
+ "seed_45": 52.0,
416
+ "seed_46": 58.0,
417
+ "seeds_completed": 5,
418
+ "mean_percent": 52.6,
419
+ "std_percent": 4.1140004861448425,
420
+ "mean_plus_std": "52.60 \u00b1 4.11"
421
+ },
422
+ {
423
+ "model": "fast-lewm",
424
+ "dataset": "cube",
425
+ "offset": 75,
426
+ "seed_42": 64.5,
427
+ "seed_43": 68.5,
428
+ "seed_44": 62.5,
429
+ "seed_45": 69.0,
430
+ "seed_46": 66.5,
431
+ "seeds_completed": 5,
432
+ "mean_percent": 66.2,
433
+ "std_percent": 2.7294688127912363,
434
+ "mean_plus_std": "66.20 \u00b1 2.73"
435
+ },
436
+ {
437
+ "model": "fast-lewm",
438
+ "dataset": "cube",
439
+ "offset": 100,
440
+ "seed_42": 63.5,
441
+ "seed_43": 63.0,
442
+ "seed_44": 60.0,
443
+ "seed_45": 63.5,
444
+ "seed_46": 61.0,
445
+ "seeds_completed": 5,
446
+ "mean_percent": 62.2,
447
+ "std_percent": 1.6046806535881213,
448
+ "mean_plus_std": "62.20 \u00b1 1.60"
449
+ },
450
+ {
451
+ "model": "fast-lewm",
452
+ "dataset": "pusht",
453
+ "offset": 25,
454
+ "seed_42": 88.0,
455
+ "seed_43": 93.5,
456
+ "seed_44": 87.0,
457
+ "seed_45": 86.0,
458
+ "seed_46": 90.0,
459
+ "seeds_completed": 5,
460
+ "mean_percent": 88.9,
461
+ "std_percent": 2.9664793948382653,
462
+ "mean_plus_std": "88.90 \u00b1 2.97"
463
+ },
464
+ {
465
+ "model": "fast-lewm",
466
+ "dataset": "pusht",
467
+ "offset": 50,
468
+ "seed_42": 39.5,
469
+ "seed_43": 35.5,
470
+ "seed_44": 40.0,
471
+ "seed_45": 36.0,
472
+ "seed_46": 36.5,
473
+ "seeds_completed": 5,
474
+ "mean_percent": 37.5,
475
+ "std_percent": 2.091650066335189,
476
+ "mean_plus_std": "37.50 \u00b1 2.09"
477
+ },
478
+ {
479
+ "model": "fast-lewm",
480
+ "dataset": "pusht",
481
+ "offset": 75,
482
+ "seed_42": 16.5,
483
+ "seed_43": 13.5,
484
+ "seed_44": 18.0,
485
+ "seed_45": 15.5,
486
+ "seed_46": 18.5,
487
+ "seeds_completed": 5,
488
+ "mean_percent": 16.4,
489
+ "std_percent": 2.0124611797498106,
490
+ "mean_plus_std": "16.40 \u00b1 2.01"
491
+ },
492
+ {
493
+ "model": "fast-lewm",
494
+ "dataset": "pusht",
495
+ "offset": 100,
496
+ "seed_42": 8.0,
497
+ "seed_43": 8.0,
498
+ "seed_44": 9.5,
499
+ "seed_45": 9.0,
500
+ "seed_46": 9.5,
501
+ "seeds_completed": 5,
502
+ "mean_percent": 8.8,
503
+ "std_percent": 0.758287544405155,
504
+ "mean_plus_std": "8.80 \u00b1 0.76"
505
+ },
506
+ {
507
+ "model": "gcbc",
508
+ "dataset": "tworoom",
509
+ "offset": 25,
510
+ "seed_42": null,
511
+ "seed_43": null,
512
+ "seed_44": null,
513
+ "seed_45": null,
514
+ "seed_46": null,
515
+ "seeds_completed": 0,
516
+ "mean_percent": null,
517
+ "std_percent": null,
518
+ "mean_plus_std": null
519
+ },
520
+ {
521
+ "model": "gcbc",
522
+ "dataset": "tworoom",
523
+ "offset": 50,
524
+ "seed_42": null,
525
+ "seed_43": null,
526
+ "seed_44": null,
527
+ "seed_45": null,
528
+ "seed_46": null,
529
+ "seeds_completed": 0,
530
+ "mean_percent": null,
531
+ "std_percent": null,
532
+ "mean_plus_std": null
533
+ },
534
+ {
535
+ "model": "gcbc",
536
+ "dataset": "tworoom",
537
+ "offset": 75,
538
+ "seed_42": null,
539
+ "seed_43": null,
540
+ "seed_44": null,
541
+ "seed_45": null,
542
+ "seed_46": null,
543
+ "seeds_completed": 0,
544
+ "mean_percent": null,
545
+ "std_percent": null,
546
+ "mean_plus_std": null
547
+ },
548
+ {
549
+ "model": "gcbc",
550
+ "dataset": "tworoom",
551
+ "offset": 100,
552
+ "seed_42": null,
553
+ "seed_43": null,
554
+ "seed_44": null,
555
+ "seed_45": null,
556
+ "seed_46": null,
557
+ "seeds_completed": 0,
558
+ "mean_percent": null,
559
+ "std_percent": null,
560
+ "mean_plus_std": null
561
+ },
562
+ {
563
+ "model": "gcbc",
564
+ "dataset": "cube",
565
+ "offset": 25,
566
+ "seed_42": null,
567
+ "seed_43": null,
568
+ "seed_44": null,
569
+ "seed_45": null,
570
+ "seed_46": null,
571
+ "seeds_completed": 0,
572
+ "mean_percent": null,
573
+ "std_percent": null,
574
+ "mean_plus_std": null
575
+ },
576
+ {
577
+ "model": "gcbc",
578
+ "dataset": "cube",
579
+ "offset": 50,
580
+ "seed_42": null,
581
+ "seed_43": null,
582
+ "seed_44": null,
583
+ "seed_45": null,
584
+ "seed_46": null,
585
+ "seeds_completed": 0,
586
+ "mean_percent": null,
587
+ "std_percent": null,
588
+ "mean_plus_std": null
589
+ },
590
+ {
591
+ "model": "gcbc",
592
+ "dataset": "cube",
593
+ "offset": 75,
594
+ "seed_42": null,
595
+ "seed_43": null,
596
+ "seed_44": null,
597
+ "seed_45": null,
598
+ "seed_46": null,
599
+ "seeds_completed": 0,
600
+ "mean_percent": null,
601
+ "std_percent": null,
602
+ "mean_plus_std": null
603
+ },
604
+ {
605
+ "model": "gcbc",
606
+ "dataset": "cube",
607
+ "offset": 100,
608
+ "seed_42": null,
609
+ "seed_43": null,
610
+ "seed_44": null,
611
+ "seed_45": null,
612
+ "seed_46": null,
613
+ "seeds_completed": 0,
614
+ "mean_percent": null,
615
+ "std_percent": null,
616
+ "mean_plus_std": null
617
+ },
618
+ {
619
+ "model": "gcbc",
620
+ "dataset": "pusht",
621
+ "offset": 25,
622
+ "seed_42": null,
623
+ "seed_43": null,
624
+ "seed_44": null,
625
+ "seed_45": null,
626
+ "seed_46": null,
627
+ "seeds_completed": 0,
628
+ "mean_percent": null,
629
+ "std_percent": null,
630
+ "mean_plus_std": null
631
+ },
632
+ {
633
+ "model": "gcbc",
634
+ "dataset": "pusht",
635
+ "offset": 50,
636
+ "seed_42": null,
637
+ "seed_43": null,
638
+ "seed_44": null,
639
+ "seed_45": null,
640
+ "seed_46": null,
641
+ "seeds_completed": 0,
642
+ "mean_percent": null,
643
+ "std_percent": null,
644
+ "mean_plus_std": null
645
+ },
646
+ {
647
+ "model": "gcbc",
648
+ "dataset": "pusht",
649
+ "offset": 75,
650
+ "seed_42": null,
651
+ "seed_43": null,
652
+ "seed_44": null,
653
+ "seed_45": null,
654
+ "seed_46": null,
655
+ "seeds_completed": 0,
656
+ "mean_percent": null,
657
+ "std_percent": null,
658
+ "mean_plus_std": null
659
+ },
660
+ {
661
+ "model": "gcbc",
662
+ "dataset": "pusht",
663
+ "offset": 100,
664
+ "seed_42": null,
665
+ "seed_43": null,
666
+ "seed_44": null,
667
+ "seed_45": null,
668
+ "seed_46": null,
669
+ "seeds_completed": 0,
670
+ "mean_percent": null,
671
+ "std_percent": null,
672
+ "mean_plus_std": null
673
+ },
674
+ {
675
+ "model": "gciql",
676
+ "dataset": "tworoom",
677
+ "offset": 25,
678
+ "seed_42": null,
679
+ "seed_43": null,
680
+ "seed_44": null,
681
+ "seed_45": null,
682
+ "seed_46": null,
683
+ "seeds_completed": 0,
684
+ "mean_percent": null,
685
+ "std_percent": null,
686
+ "mean_plus_std": null
687
+ },
688
+ {
689
+ "model": "gciql",
690
+ "dataset": "tworoom",
691
+ "offset": 50,
692
+ "seed_42": null,
693
+ "seed_43": null,
694
+ "seed_44": null,
695
+ "seed_45": null,
696
+ "seed_46": null,
697
+ "seeds_completed": 0,
698
+ "mean_percent": null,
699
+ "std_percent": null,
700
+ "mean_plus_std": null
701
+ },
702
+ {
703
+ "model": "gciql",
704
+ "dataset": "tworoom",
705
+ "offset": 75,
706
+ "seed_42": null,
707
+ "seed_43": null,
708
+ "seed_44": null,
709
+ "seed_45": null,
710
+ "seed_46": null,
711
+ "seeds_completed": 0,
712
+ "mean_percent": null,
713
+ "std_percent": null,
714
+ "mean_plus_std": null
715
+ },
716
+ {
717
+ "model": "gciql",
718
+ "dataset": "tworoom",
719
+ "offset": 100,
720
+ "seed_42": null,
721
+ "seed_43": null,
722
+ "seed_44": null,
723
+ "seed_45": null,
724
+ "seed_46": null,
725
+ "seeds_completed": 0,
726
+ "mean_percent": null,
727
+ "std_percent": null,
728
+ "mean_plus_std": null
729
+ },
730
+ {
731
+ "model": "gciql",
732
+ "dataset": "cube",
733
+ "offset": 25,
734
+ "seed_42": null,
735
+ "seed_43": null,
736
+ "seed_44": null,
737
+ "seed_45": null,
738
+ "seed_46": null,
739
+ "seeds_completed": 0,
740
+ "mean_percent": null,
741
+ "std_percent": null,
742
+ "mean_plus_std": null
743
+ },
744
+ {
745
+ "model": "gciql",
746
+ "dataset": "cube",
747
+ "offset": 50,
748
+ "seed_42": null,
749
+ "seed_43": null,
750
+ "seed_44": null,
751
+ "seed_45": null,
752
+ "seed_46": null,
753
+ "seeds_completed": 0,
754
+ "mean_percent": null,
755
+ "std_percent": null,
756
+ "mean_plus_std": null
757
+ },
758
+ {
759
+ "model": "gciql",
760
+ "dataset": "cube",
761
+ "offset": 75,
762
+ "seed_42": null,
763
+ "seed_43": null,
764
+ "seed_44": null,
765
+ "seed_45": null,
766
+ "seed_46": null,
767
+ "seeds_completed": 0,
768
+ "mean_percent": null,
769
+ "std_percent": null,
770
+ "mean_plus_std": null
771
+ },
772
+ {
773
+ "model": "gciql",
774
+ "dataset": "cube",
775
+ "offset": 100,
776
+ "seed_42": null,
777
+ "seed_43": null,
778
+ "seed_44": null,
779
+ "seed_45": null,
780
+ "seed_46": null,
781
+ "seeds_completed": 0,
782
+ "mean_percent": null,
783
+ "std_percent": null,
784
+ "mean_plus_std": null
785
+ },
786
+ {
787
+ "model": "gciql",
788
+ "dataset": "pusht",
789
+ "offset": 25,
790
+ "seed_42": null,
791
+ "seed_43": null,
792
+ "seed_44": null,
793
+ "seed_45": null,
794
+ "seed_46": null,
795
+ "seeds_completed": 0,
796
+ "mean_percent": null,
797
+ "std_percent": null,
798
+ "mean_plus_std": null
799
+ },
800
+ {
801
+ "model": "gciql",
802
+ "dataset": "pusht",
803
+ "offset": 50,
804
+ "seed_42": null,
805
+ "seed_43": null,
806
+ "seed_44": null,
807
+ "seed_45": null,
808
+ "seed_46": null,
809
+ "seeds_completed": 0,
810
+ "mean_percent": null,
811
+ "std_percent": null,
812
+ "mean_plus_std": null
813
+ },
814
+ {
815
+ "model": "gciql",
816
+ "dataset": "pusht",
817
+ "offset": 75,
818
+ "seed_42": null,
819
+ "seed_43": null,
820
+ "seed_44": null,
821
+ "seed_45": null,
822
+ "seed_46": null,
823
+ "seeds_completed": 0,
824
+ "mean_percent": null,
825
+ "std_percent": null,
826
+ "mean_plus_std": null
827
+ },
828
+ {
829
+ "model": "gciql",
830
+ "dataset": "pusht",
831
+ "offset": 100,
832
+ "seed_42": null,
833
+ "seed_43": null,
834
+ "seed_44": null,
835
+ "seed_45": null,
836
+ "seed_46": null,
837
+ "seeds_completed": 0,
838
+ "mean_percent": null,
839
+ "std_percent": null,
840
+ "mean_plus_std": null
841
+ },
842
+ {
843
+ "model": "gcivl",
844
+ "dataset": "tworoom",
845
+ "offset": 25,
846
+ "seed_42": null,
847
+ "seed_43": null,
848
+ "seed_44": null,
849
+ "seed_45": null,
850
+ "seed_46": null,
851
+ "seeds_completed": 0,
852
+ "mean_percent": null,
853
+ "std_percent": null,
854
+ "mean_plus_std": null
855
+ },
856
+ {
857
+ "model": "gcivl",
858
+ "dataset": "tworoom",
859
+ "offset": 50,
860
+ "seed_42": null,
861
+ "seed_43": null,
862
+ "seed_44": null,
863
+ "seed_45": null,
864
+ "seed_46": null,
865
+ "seeds_completed": 0,
866
+ "mean_percent": null,
867
+ "std_percent": null,
868
+ "mean_plus_std": null
869
+ },
870
+ {
871
+ "model": "gcivl",
872
+ "dataset": "tworoom",
873
+ "offset": 75,
874
+ "seed_42": null,
875
+ "seed_43": null,
876
+ "seed_44": null,
877
+ "seed_45": null,
878
+ "seed_46": null,
879
+ "seeds_completed": 0,
880
+ "mean_percent": null,
881
+ "std_percent": null,
882
+ "mean_plus_std": null
883
+ },
884
+ {
885
+ "model": "gcivl",
886
+ "dataset": "tworoom",
887
+ "offset": 100,
888
+ "seed_42": null,
889
+ "seed_43": null,
890
+ "seed_44": null,
891
+ "seed_45": null,
892
+ "seed_46": null,
893
+ "seeds_completed": 0,
894
+ "mean_percent": null,
895
+ "std_percent": null,
896
+ "mean_plus_std": null
897
+ },
898
+ {
899
+ "model": "gcivl",
900
+ "dataset": "cube",
901
+ "offset": 25,
902
+ "seed_42": null,
903
+ "seed_43": null,
904
+ "seed_44": null,
905
+ "seed_45": null,
906
+ "seed_46": null,
907
+ "seeds_completed": 0,
908
+ "mean_percent": null,
909
+ "std_percent": null,
910
+ "mean_plus_std": null
911
+ },
912
+ {
913
+ "model": "gcivl",
914
+ "dataset": "cube",
915
+ "offset": 50,
916
+ "seed_42": null,
917
+ "seed_43": null,
918
+ "seed_44": null,
919
+ "seed_45": null,
920
+ "seed_46": null,
921
+ "seeds_completed": 0,
922
+ "mean_percent": null,
923
+ "std_percent": null,
924
+ "mean_plus_std": null
925
+ },
926
+ {
927
+ "model": "gcivl",
928
+ "dataset": "cube",
929
+ "offset": 75,
930
+ "seed_42": null,
931
+ "seed_43": null,
932
+ "seed_44": null,
933
+ "seed_45": null,
934
+ "seed_46": null,
935
+ "seeds_completed": 0,
936
+ "mean_percent": null,
937
+ "std_percent": null,
938
+ "mean_plus_std": null
939
+ },
940
+ {
941
+ "model": "gcivl",
942
+ "dataset": "cube",
943
+ "offset": 100,
944
+ "seed_42": null,
945
+ "seed_43": null,
946
+ "seed_44": null,
947
+ "seed_45": null,
948
+ "seed_46": null,
949
+ "seeds_completed": 0,
950
+ "mean_percent": null,
951
+ "std_percent": null,
952
+ "mean_plus_std": null
953
+ },
954
+ {
955
+ "model": "gcivl",
956
+ "dataset": "pusht",
957
+ "offset": 25,
958
+ "seed_42": null,
959
+ "seed_43": null,
960
+ "seed_44": null,
961
+ "seed_45": null,
962
+ "seed_46": null,
963
+ "seeds_completed": 0,
964
+ "mean_percent": null,
965
+ "std_percent": null,
966
+ "mean_plus_std": null
967
+ },
968
+ {
969
+ "model": "gcivl",
970
+ "dataset": "pusht",
971
+ "offset": 50,
972
+ "seed_42": null,
973
+ "seed_43": null,
974
+ "seed_44": null,
975
+ "seed_45": null,
976
+ "seed_46": null,
977
+ "seeds_completed": 0,
978
+ "mean_percent": null,
979
+ "std_percent": null,
980
+ "mean_plus_std": null
981
+ },
982
+ {
983
+ "model": "gcivl",
984
+ "dataset": "pusht",
985
+ "offset": 75,
986
+ "seed_42": null,
987
+ "seed_43": null,
988
+ "seed_44": null,
989
+ "seed_45": null,
990
+ "seed_46": null,
991
+ "seeds_completed": 0,
992
+ "mean_percent": null,
993
+ "std_percent": null,
994
+ "mean_plus_std": null
995
+ },
996
+ {
997
+ "model": "gcivl",
998
+ "dataset": "pusht",
999
+ "offset": 100,
1000
+ "seed_42": null,
1001
+ "seed_43": null,
1002
+ "seed_44": null,
1003
+ "seed_45": null,
1004
+ "seed_46": null,
1005
+ "seeds_completed": 0,
1006
+ "mean_percent": null,
1007
+ "std_percent": null,
1008
+ "mean_plus_std": null
1009
+ }
1010
+ ]