JimmyLiaoo commited on
Commit
ec02f47
·
verified ·
1 Parent(s): ff42f04

Release STCOcc-finetuned six-frame World Model checkpoint

Browse files
Files changed (3) hide show
  1. README.md +13 -4
  2. SHA256SUMS +1 -0
  3. bev_world_6f_stc.pth +3 -0
README.md CHANGED
@@ -9,28 +9,37 @@ tags:
9
 
10
  # LO-World
11
 
12
- Pretrained PyTorch checkpoints for UniAV-World, a BEV latent world model for joint future occupancy and LiDAR prediction.
13
 
14
  ## Download
15
 
16
  ```bash
17
  hf download JimmyLiaoo/LO-World \
18
  bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
19
- bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
20
  ```
21
 
22
  ## Checkpoints
23
 
24
- The release contains four checkpoints for inference and result reproduction.
25
 
26
  | File | Model |
27
  | --- | --- |
28
  | bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
29
  | bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
 
30
  | bev_world_6f_waymo.pth | 6-frame Waymo World Model |
31
  | occ_lidar_vae.pth | Joint occupancy-LiDAR tokenizer |
32
 
33
- Use the corresponding configuration from the UniAV-World code repository. The Layout checkpoint is the physical v1 fine-tuned epoch 8 EMA and must be paired with the corrected layouts extracted to `data/bev_layout/`. World Model checkpoints include the tokenizer parameters. Training and evaluation require separately prepared dataset files and tokenizer latents.
 
 
 
 
 
 
 
 
34
 
35
  ## Verify downloads
36
 
 
9
 
10
  # LO-World
11
 
12
+ Pretrained PyTorch checkpoints for LO-World, a BEV latent world model for joint future occupancy and LiDAR prediction.
13
 
14
  ## Download
15
 
16
  ```bash
17
  hf download JimmyLiaoo/LO-World \
18
  bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
19
+ bev_world_6f_stc.pth bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
20
  ```
21
 
22
  ## Checkpoints
23
 
24
+ The release contains five checkpoints for inference and result reproduction.
25
 
26
  | File | Model |
27
  | --- | --- |
28
  | bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
29
  | bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
30
+ | bev_world_6f_stc.pth | 6-frame nuScenes World Model fine-tuned on STCOcc-conditioned latents |
31
  | bev_world_6f_waymo.pth | 6-frame Waymo World Model |
32
  | occ_lidar_vae.pth | Joint occupancy-LiDAR tokenizer |
33
 
34
+ Use the corresponding configuration from the LO-World code repository. The Layout checkpoint is the physical v1 fine-tuned epoch 8 EMA and must be paired with the corrected layouts extracted to `data/bev_layout/`. World Model checkpoints include the tokenizer parameters. Training and evaluation require separately prepared dataset files and tokenizer latents.
35
+
36
+ For `bev_world_6f_stc.pth`, use
37
+ `configs/world_model/bev_world_6f_stc_occ.py` and matching STCOcc-conditioned
38
+ validation latents at `data/stc_occ_lidar_latent/<sample_token>.npz`.
39
+ This checkpoint contains its embedded tokenizer parameters, which differ from
40
+ `occ_lidar_vae.pth`. Input latents must use the tokenizer employed during
41
+ STCOcc fine-tuning. Evaluation targets remain the original Occ3D labels and
42
+ LiDAR range images.
43
 
44
  ## Verify downloads
45
 
SHA256SUMS CHANGED
@@ -1,4 +1,5 @@
1
  d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
2
  a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
 
3
  0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
4
  0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
 
1
  d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
2
  a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
3
+ b8f3f3d0552cf5aacc6b974e76f72c0dfac700e3008c69d450a39387d0fcdc63 bev_world_6f_stc.pth
4
  0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
5
  0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
bev_world_6f_stc.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8f3f3d0552cf5aacc6b974e76f72c0dfac700e3008c69d450a39387d0fcdc63
3
+ size 240367756