abkp commited on
Commit
a0dc586
·
verified ·
1 Parent(s): a39f151

Release pretrained LonGaussian checkpoint

Browse files
Files changed (4) hide show
  1. README.md +70 -0
  2. SHA256SUMS +1 -0
  3. checkpoint.json +17 -0
  4. stage2b.pt +3 -0
README.md ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # LonGaussian
2
+
3
+ Pretrained weights for **LonGaussian: Tracking Foundation Priors for
4
+ Long-Context Feedforward Gaussian Reconstruction**.
5
+
6
+ [Paper](https://arxiv.org/abs/2610.23250) ·
7
+ [Code](https://github.com/hustvl/LonGaussian) ·
8
+ [Project page](https://abearkeeper.github.io/LonGaussian.github.io/)
9
+
10
+ ## Checkpoint
11
+
12
+ `stage2b.pt` provides the pretrained Gaussian modules for LonGaussian.
13
+ Use it with the standard `merge_mode=neural` reconstruction pipeline.
14
+
15
+ | File | Size | SHA256 |
16
+ | --- | --- | --- |
17
+ | `stage2b.pt` | 272,167,298 bytes (272.2 MB / 259.6 MiB) | `9f49fab3604ac174e323c8d74bdc44966e257f3b6be32ef35c338f6fb0bb1feb` |
18
+
19
+ The file contains the Gaussian decoder, Gaussian attribute head and learned
20
+ track merger. Frozen LoGeR, AllTracker and sky-segmentation weights are obtained
21
+ separately from their original hosts. This is a PyTorch checkpoint for the
22
+ LonGaussian codebase, not a self-contained Transformers model.
23
+
24
+ ## Download and run
25
+
26
+ Download [stage2b.pt](https://huggingface.co/abkp/LonGaussian/resolve/main/stage2b.pt?download=true)
27
+ or use Python:
28
+
29
+ ```python
30
+ from huggingface_hub import hf_hub_download
31
+
32
+ checkpoint = hf_hub_download(
33
+ repo_id="abkp/LonGaussian",
34
+ filename="stage2b.pt",
35
+ local_dir="/path/to/weights",
36
+ )
37
+ ```
38
+
39
+ Install the code repository's dependencies, then download the frozen models:
40
+
41
+ ```bash
42
+ python scripts/download_assets.py weights --output /path/to/weights
43
+ ```
44
+
45
+ Run the full reconstruction pipeline using the downloaded checkpoint:
46
+
47
+ ```bash
48
+ INPUT=/path/to/calibrated_scene NUM_FRAMES=24 OUTPUT_DIR=/path/to/new_inference \
49
+ MODEL_NAME=/path/to/weights/LoGeR_star/latest.pt \
50
+ GAUSSIAN_HEAD=/path/to/weights/stage2b.pt \
51
+ ALLTRACKER_CHECKPOINT=/path/to/weights/alltracker.pth \
52
+ SKY_MASK_ONNX=/path/to/weights/skyseg.onnx \
53
+ bash scripts/infer_longaussian.sh
54
+ ```
55
+
56
+ Training datasets and Stage-I/IIa checkpoints are not required for inference.
57
+ Inputs must follow the repository's calibrated image-sequence format. Camera
58
+ poses are predicted by the model. See the repository for data preparation and
59
+ the complete evaluation protocol.
60
+
61
+ ## Hardware and scope
62
+
63
+ CUDA is required by the full reconstruction/rendering pipeline. The validated
64
+ reference hardware is an RTX 3090 with 24 GB VRAM. Memory usage depends on
65
+ input resolution, sequence length, scene content and runtime settings.
66
+
67
+ LonGaussian targets static-scene reconstruction. Dynamic objects, inaccurate
68
+ camera poses and distant loop revisits may cause artifacts. Frozen third-party
69
+ weights are downloaded separately; see the original sources and the code
70
+ repository's [third-party notices](https://github.com/hustvl/LonGaussian/blob/main/THIRD_PARTY_LICENSES.md).
SHA256SUMS ADDED
@@ -0,0 +1 @@
 
 
1
+ 9f49fab3604ac174e323c8d74bdc44966e257f3b6be32ef35c338f6fb0bb1feb stage2b.pt
checkpoint.json ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "format": "longaussian_checkpoint_v1",
3
+ "file": "stage2b.pt",
4
+ "size_bytes": 272167298,
5
+ "sha256": "9f49fab3604ac174e323c8d74bdc44966e257f3b6be32ef35c338f6fb0bb1feb",
6
+ "modules": [
7
+ "gaussian_decoder",
8
+ "gaussian_head",
9
+ "neural_track_merger"
10
+ ],
11
+ "tensor_count": 128,
12
+ "merge_mode": "neural",
13
+ "frozen_dependencies_bundled": false,
14
+ "code_url": "https://github.com/hustvl/LonGaussian",
15
+ "paper_url": "https://arxiv.org/abs/2610.23250",
16
+ "usage": "GAUSSIAN_HEAD=/path/to/weights/stage2b.pt bash scripts/infer_longaussian.sh (also supply the documented input and frozen dependencies)"
17
+ }
stage2b.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f49fab3604ac174e323c8d74bdc44966e257f3b6be32ef35c338f6fb0bb1feb
3
+ size 272167298