JimmyLiaoo commited on
Commit
2c8a334
·
verified ·
1 Parent(s): 4b72450

Release six-frame source checkpoint for STCOcc and Waymo fine-tuning

Browse files
Files changed (3) hide show
  1. README.md +11 -1
  2. SHA256SUMS +1 -0
  3. bev_world_6f.pth +3 -0
README.md CHANGED
@@ -15,16 +15,18 @@ Pretrained PyTorch checkpoints for LO-World, a BEV latent world model for joint
15
 
16
  ```bash
17
  hf download JimmyLiaoo/LO-World \
 
18
  bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
19
  bev_world_6f_stc.pth bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
20
  ```
21
 
22
  ## Checkpoints
23
 
24
- The release contains five checkpoints for inference and result reproduction.
25
 
26
  | File | Model |
27
  | --- | --- |
 
28
  | bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
29
  | bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
30
  | bev_world_6f_stc.pth | 6-frame nuScenes World Model fine-tuned on STCOcc-conditioned latents |
@@ -40,6 +42,14 @@ generated with the `r50_704_256_16f_occ3d` checkpoint from
40
  Use `configs/tokenizer/occ_lidar_vae_stc_latent.py` to prepare the matching
41
  input latents.
42
 
 
 
 
 
 
 
 
 
43
  For `bev_world_6f_stc.pth`, use
44
  `configs/world_model/bev_world_6f_stc_occ.py` and matching STCOcc-conditioned
45
  validation latents at `data/stc_occ_lidar_latent/<sample_token>.npz`.
 
15
 
16
  ```bash
17
  hf download JimmyLiaoo/LO-World \
18
+ bev_world_6f.pth \
19
  bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
20
  bev_world_6f_stc.pth bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
21
  ```
22
 
23
  ## Checkpoints
24
 
25
+ The release contains six checkpoints for inference, fine-tuning and result reproduction.
26
 
27
  | File | Model |
28
  | --- | --- |
29
+ | bev_world_6f.pth | 6-frame nuScenes World Model; source for STCOcc and Waymo fine-tuning |
30
  | bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
31
  | bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
32
  | bev_world_6f_stc.pth | 6-frame nuScenes World Model fine-tuned on STCOcc-conditioned latents |
 
42
  Use `configs/tokenizer/occ_lidar_vae_stc_latent.py` to prepare the matching
43
  input latents.
44
 
45
+ `bev_world_6f.pth` is the shared source checkpoint for STCOcc and Waymo
46
+ fine-tuning. Both adaptations predict six future frames at 2 Hz (0.5–3
47
+ seconds). Their configurations load this complete checkpoint through
48
+ `load_from`, keeping the tokenizer frozen. The STCOcc fine-tuning
49
+ configuration is `configs/world_model/bev_world_6f_stc_occ.py` (8 epochs,
50
+ AdamW learning rate 1e-5); the Waymo configuration is
51
+ `configs/world_model/bev_world_6f_waymo.py`.
52
+
53
  For `bev_world_6f_stc.pth`, use
54
  `configs/world_model/bev_world_6f_stc_occ.py` and matching STCOcc-conditioned
55
  validation latents at `data/stc_occ_lidar_latent/<sample_token>.npz`.
SHA256SUMS CHANGED
@@ -1,5 +1,6 @@
1
  d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
2
  a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
 
3
  5ef4a63a5f3788f6bf6fe5299e06f7a3dcb13c9fdbc8a6641a5863a4d0bbe69d bev_world_6f_stc.pth
4
  0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
5
  0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
 
1
  d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
2
  a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
3
+ b6a6fc3bd1a7dd18d9b5f0402315c9cc40706d959c8c1aed7cc52265e4733183 bev_world_6f.pth
4
  5ef4a63a5f3788f6bf6fe5299e06f7a3dcb13c9fdbc8a6641a5863a4d0bbe69d bev_world_6f_stc.pth
5
  0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
6
  0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
bev_world_6f.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6a6fc3bd1a7dd18d9b5f0402315c9cc40706d959c8c1aed7cc52265e4733183
3
+ size 240368405