Release six-frame source checkpoint for STCOcc and Waymo fine-tuning
Browse files- README.md +11 -1
- SHA256SUMS +1 -0
- bev_world_6f.pth +3 -0
README.md
CHANGED
|
@@ -15,16 +15,18 @@ Pretrained PyTorch checkpoints for LO-World, a BEV latent world model for joint
|
|
| 15 |
|
| 16 |
```bash
|
| 17 |
hf download JimmyLiaoo/LO-World \
|
|
|
|
| 18 |
bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
|
| 19 |
bev_world_6f_stc.pth bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
|
| 20 |
```
|
| 21 |
|
| 22 |
## Checkpoints
|
| 23 |
|
| 24 |
-
The release contains
|
| 25 |
|
| 26 |
| File | Model |
|
| 27 |
| --- | --- |
|
|
|
|
| 28 |
| bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
|
| 29 |
| bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
|
| 30 |
| bev_world_6f_stc.pth | 6-frame nuScenes World Model fine-tuned on STCOcc-conditioned latents |
|
|
@@ -40,6 +42,14 @@ generated with the `r50_704_256_16f_occ3d` checkpoint from
|
|
| 40 |
Use `configs/tokenizer/occ_lidar_vae_stc_latent.py` to prepare the matching
|
| 41 |
input latents.
|
| 42 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
For `bev_world_6f_stc.pth`, use
|
| 44 |
`configs/world_model/bev_world_6f_stc_occ.py` and matching STCOcc-conditioned
|
| 45 |
validation latents at `data/stc_occ_lidar_latent/<sample_token>.npz`.
|
|
|
|
| 15 |
|
| 16 |
```bash
|
| 17 |
hf download JimmyLiaoo/LO-World \
|
| 18 |
+
bev_world_6f.pth \
|
| 19 |
bev_world_12f_autoregressive.pth bev_world_12f_layout_autoregressive.pth \
|
| 20 |
bev_world_6f_stc.pth bev_world_6f_waymo.pth occ_lidar_vae.pth SHA256SUMS --local-dir ckpts
|
| 21 |
```
|
| 22 |
|
| 23 |
## Checkpoints
|
| 24 |
|
| 25 |
+
The release contains six checkpoints for inference, fine-tuning and result reproduction.
|
| 26 |
|
| 27 |
| File | Model |
|
| 28 |
| --- | --- |
|
| 29 |
+
| bev_world_6f.pth | 6-frame nuScenes World Model; source for STCOcc and Waymo fine-tuning |
|
| 30 |
| bev_world_12f_autoregressive.pth | 12-frame autoregressive World Model |
|
| 31 |
| bev_world_12f_layout_autoregressive.pth | 12-frame autoregressive World Model with physical v1 BEVLayout conditioning |
|
| 32 |
| bev_world_6f_stc.pth | 6-frame nuScenes World Model fine-tuned on STCOcc-conditioned latents |
|
|
|
|
| 42 |
Use `configs/tokenizer/occ_lidar_vae_stc_latent.py` to prepare the matching
|
| 43 |
input latents.
|
| 44 |
|
| 45 |
+
`bev_world_6f.pth` is the shared source checkpoint for STCOcc and Waymo
|
| 46 |
+
fine-tuning. Both adaptations predict six future frames at 2 Hz (0.5–3
|
| 47 |
+
seconds). Their configurations load this complete checkpoint through
|
| 48 |
+
`load_from`, keeping the tokenizer frozen. The STCOcc fine-tuning
|
| 49 |
+
configuration is `configs/world_model/bev_world_6f_stc_occ.py` (8 epochs,
|
| 50 |
+
AdamW learning rate 1e-5); the Waymo configuration is
|
| 51 |
+
`configs/world_model/bev_world_6f_waymo.py`.
|
| 52 |
+
|
| 53 |
For `bev_world_6f_stc.pth`, use
|
| 54 |
`configs/world_model/bev_world_6f_stc_occ.py` and matching STCOcc-conditioned
|
| 55 |
validation latents at `data/stc_occ_lidar_latent/<sample_token>.npz`.
|
SHA256SUMS
CHANGED
|
@@ -1,5 +1,6 @@
|
|
| 1 |
d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
|
| 2 |
a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
|
|
|
|
| 3 |
5ef4a63a5f3788f6bf6fe5299e06f7a3dcb13c9fdbc8a6641a5863a4d0bbe69d bev_world_6f_stc.pth
|
| 4 |
0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
|
| 5 |
0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
|
|
|
|
| 1 |
d38a6988f1da654ab7fb713e750aa8fe23fd4f208f15c18aca6a9812e161fbc9 bev_world_12f_autoregressive.pth
|
| 2 |
a2c725491a70f34d6ac8962ba5b44bd2d5d8fb27e31aad787895d55e55fc4383 bev_world_12f_layout_autoregressive.pth
|
| 3 |
+
b6a6fc3bd1a7dd18d9b5f0402315c9cc40706d959c8c1aed7cc52265e4733183 bev_world_6f.pth
|
| 4 |
5ef4a63a5f3788f6bf6fe5299e06f7a3dcb13c9fdbc8a6641a5863a4d0bbe69d bev_world_6f_stc.pth
|
| 5 |
0662648dec4a5b13c4b3ef9fb96309adaaf578d0c667b772791c6617cbce495e bev_world_6f_waymo.pth
|
| 6 |
0ef9756b6e1df8e5e357b53421fb8a4be6fa76f0590332152ba6d58e39d3a901 occ_lidar_vae.pth
|
bev_world_6f.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b6a6fc3bd1a7dd18d9b5f0402315c9cc40706d959c8c1aed7cc52265e4733183
|
| 3 |
+
size 240368405
|