Release STCOcc-finetuned six-frame World Model checkpoint
Browse files- README.md +13 -4
- SHA256SUMS +1 -0
- bev_world_6f_stc.pth +3 -0
README.md
CHANGED
|
@@ -9,28 +9,37 @@ tags:
|
|
| 9 |
|
| 10 |
# LO-World
|
| 11 |
|
| 12 |
-
Pretrained PyTorch checkpoints for
|
| 13 |
|
| 14 |
## Download
|
| 15 |
|
| 16 |
```bash
|
| 17 |
hf download JimmyLiaoo/LO-World \
|
| 18 |
bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
|
| 19 |
-
bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
|
| 20 |
```
|
| 21 |
|
| 22 |
## Checkpoints
|
| 23 |
|
| 24 |
-
The release contains
|
| 25 |
|
| 26 |
| File | Model |
|
| 27 |
| --- | --- |
|
| 28 |
| bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
|
| 29 |
| bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
|
|
|
|
| 30 |
| bev_world_6f_waymo.pth | 6-frame Waymo World Model |
|
| 31 |
| occ_lidar_vae.pth | Joint occupancy-LiDAR tokenizer |
|
| 32 |
|
| 33 |
-
Use the corresponding configuration from the
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
## Verify downloads
|
| 36 |
|
|
|
|
| 9 |
|
| 10 |
# LO-World
|
| 11 |
|
| 12 |
+
Pretrained PyTorch checkpoints for LO-World, a BEV latent world model for joint future occupancy and LiDAR prediction.
|
| 13 |
|
| 14 |
## Download
|
| 15 |
|
| 16 |
```bash
|
| 17 |
hf download JimmyLiaoo/LO-World \
|
| 18 |
bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
|
| 19 |
+
bev_world_6f_stc.pth bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
|
| 20 |
```
|
| 21 |
|
| 22 |
## Checkpoints
|
| 23 |
|
| 24 |
+
The release contains five checkpoints for inference and result reproduction.
|
| 25 |
|
| 26 |
| File | Model |
|
| 27 |
| --- | --- |
|
| 28 |
| bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
|
| 29 |
| bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
|
| 30 |
+
| bev_world_6f_stc.pth | 6-frame nuScenes World Model fine-tuned on STCOcc-conditioned latents |
|
| 31 |
| bev_world_6f_waymo.pth | 6-frame Waymo World Model |
|
| 32 |
| occ_lidar_vae.pth | Joint occupancy-LiDAR tokenizer |
|
| 33 |
|
| 34 |
+
Use the corresponding configuration from the LO-World code repository. The Layout checkpoint is the physical v1 fine-tuned epoch 8 EMA and must be paired with the corrected layouts extracted to `data/bev_layout/`. World Model checkpoints include the tokenizer parameters. Training and evaluation require separately prepared dataset files and tokenizer latents.
|
| 35 |
+
|
| 36 |
+
For `bev_world_6f_stc.pth`, use
|
| 37 |
+
`configs/world_model/bev_world_6f_stc_occ.py` and matching STCOcc-conditioned
|
| 38 |
+
validation latents at `data/stc_occ_lidar_latent/<sample_token>.npz`.
|
| 39 |
+
This checkpoint contains its embedded tokenizer parameters, which differ from
|
| 40 |
+
`occ_lidar_vae.pth`. Input latents must use the tokenizer employed during
|
| 41 |
+
STCOcc fine-tuning. Evaluation targets remain the original Occ3D labels and
|
| 42 |
+
LiDAR range images.
|
| 43 |
|
| 44 |
## Verify downloads
|
| 45 |
|
SHA256SUMS
CHANGED
|
@@ -1,4 +1,5 @@
|
|
| 1 |
d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
|
| 2 |
a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
|
|
|
|
| 3 |
0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
|
| 4 |
0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
|
|
|
|
| 1 |
d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
|
| 2 |
a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
|
| 3 |
+
b8f3f3d0552cf5aacc6b974e76f72c0dfac700e3008c69d450a39387d0fcdc63 bev_world_6f_stc.pth
|
| 4 |
0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
|
| 5 |
0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
|
bev_world_6f_stc.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b8f3f3d0552cf5aacc6b974e76f72c0dfac700e3008c69d450a39387d0fcdc63
|
| 3 |
+
size 240367756
|