PLUS-WAVE commited on
Commit
4ade2ff
·
verified ·
1 Parent(s): 562b76c

Add model card and demo

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +60 -0
  3. assets/github_demo.gif +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ assets/github_demo.gif filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - 3d
4
+ - gaussian-splatting
5
+ - novel-view-synthesis
6
+ - computer-vision
7
+ ---
8
+
9
+ <div align="center">
10
+
11
+ # InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis
12
+
13
+ [Project Page](https://pluswave.top/InfiniSplat-page/) | [Code](https://github.com/PLUS-WAVE/InfiniSplat-oss) | [Gallery](https://pluswave.top/InfiniSplat-page/#visualization)
14
+
15
+ <img src="assets/github_demo.gif" alt="InfiniSplat demo" width="90%" />
16
+
17
+ </div>
18
+
19
+ ## Overview
20
+
21
+ InfiniSplat reconstructs a 3D Gaussian scene representation from a single image. It supports RGB-only reconstruction and depth-sensor-guided reconstruction from a spatially aligned RGB-depth pair.
22
+
23
+ | Checkpoint | Input | Output |
24
+ | --- | --- | --- |
25
+ | [`infinisplat_rgb.ckpt`](checkpoints/infinisplat_rgb.ckpt) | RGB image | 3D Gaussian Splatting scene |
26
+ | [`infinisplat_lidar.ckpt`](checkpoints/infinisplat_lidar.ckpt) | RGB image + aligned depth | 3D Gaussian Splatting scene |
27
+
28
+ The released checkpoints contain the complete inference weights required by their respective encoders.
29
+
30
+ ## Usage
31
+
32
+ Clone the [InfiniSplat repository](https://github.com/PLUS-WAVE/InfiniSplat-oss), follow the [installation guide](https://github.com/PLUS-WAVE/InfiniSplat-oss/blob/main/INSTALL.md), and download the checkpoints:
33
+
34
+ ```bash
35
+ bash scripts/download_checkpoints.sh
36
+ ```
37
+
38
+ RGB-only inference:
39
+
40
+ ```bash
41
+ python -m src.demo.infer_batch_images --input examples/data/rgb_demo/pexels-masi.jpg
42
+ ```
43
+
44
+ Depth-sensor-guided inference:
45
+
46
+ ```bash
47
+ python -m src.demo.infer_batch_images \
48
+ --mode lidar \
49
+ --input examples/data/lidar_demo/eth3d_kicker.png
50
+ ```
51
+
52
+ The input path may also be a directory for batch inference. In LiDAR mode, RGB and depth files are paired by filename stem. See the full [inference guide](https://github.com/PLUS-WAVE/InfiniSplat-oss/blob/main/docs/inference.md) for supported depth formats, camera intrinsics, outputs, and optional arguments.
53
+
54
+ ## Outputs
55
+
56
+ Inference always exports a Gaussian PLY. Novel-view MP4 rendering is available when `gsplat` is installed, and interactive HTML export is available when the PlayCanvas `splat-transform` CLI is installed.
57
+
58
+ ## Acknowledgments
59
+
60
+ InfiniSplat builds on [DINOv3](https://github.com/facebookresearch/dinov3), [Depth Pro](https://github.com/apple/ml-depth-pro), [InfiniDepth](https://github.com/zju3dv/InfiniDepth), and [gsplat](https://github.com/nerfstudio-project/gsplat). We thank their authors for their excellent work.
assets/github_demo.gif ADDED

Git LFS Details

  • SHA256: 5404cba207de26991e016da78dcdf48b27157d3967bc53a895d0990d7dfb4dc1
  • Pointer size: 132 Bytes
  • Size of remote file: 9.59 MB