Add model card and demo
Browse files- .gitattributes +1 -0
- README.md +60 -0
- assets/github_demo.gif +3 -0
.gitattributes
CHANGED
|
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
| 33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
assets/github_demo.gif filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,60 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- 3d
|
| 4 |
+
- gaussian-splatting
|
| 5 |
+
- novel-view-synthesis
|
| 6 |
+
- computer-vision
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
<div align="center">
|
| 10 |
+
|
| 11 |
+
# InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis
|
| 12 |
+
|
| 13 |
+
[Project Page](https://pluswave.top/InfiniSplat-page/) | [Code](https://github.com/PLUS-WAVE/InfiniSplat-oss) | [Gallery](https://pluswave.top/InfiniSplat-page/#visualization)
|
| 14 |
+
|
| 15 |
+
<img src="assets/github_demo.gif" alt="InfiniSplat demo" width="90%" />
|
| 16 |
+
|
| 17 |
+
</div>
|
| 18 |
+
|
| 19 |
+
## Overview
|
| 20 |
+
|
| 21 |
+
InfiniSplat reconstructs a 3D Gaussian scene representation from a single image. It supports RGB-only reconstruction and depth-sensor-guided reconstruction from a spatially aligned RGB-depth pair.
|
| 22 |
+
|
| 23 |
+
| Checkpoint | Input | Output |
|
| 24 |
+
| --- | --- | --- |
|
| 25 |
+
| [`infinisplat_rgb.ckpt`](checkpoints/infinisplat_rgb.ckpt) | RGB image | 3D Gaussian Splatting scene |
|
| 26 |
+
| [`infinisplat_lidar.ckpt`](checkpoints/infinisplat_lidar.ckpt) | RGB image + aligned depth | 3D Gaussian Splatting scene |
|
| 27 |
+
|
| 28 |
+
The released checkpoints contain the complete inference weights required by their respective encoders.
|
| 29 |
+
|
| 30 |
+
## Usage
|
| 31 |
+
|
| 32 |
+
Clone the [InfiniSplat repository](https://github.com/PLUS-WAVE/InfiniSplat-oss), follow the [installation guide](https://github.com/PLUS-WAVE/InfiniSplat-oss/blob/main/INSTALL.md), and download the checkpoints:
|
| 33 |
+
|
| 34 |
+
```bash
|
| 35 |
+
bash scripts/download_checkpoints.sh
|
| 36 |
+
```
|
| 37 |
+
|
| 38 |
+
RGB-only inference:
|
| 39 |
+
|
| 40 |
+
```bash
|
| 41 |
+
python -m src.demo.infer_batch_images --input examples/data/rgb_demo/pexels-masi.jpg
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
Depth-sensor-guided inference:
|
| 45 |
+
|
| 46 |
+
```bash
|
| 47 |
+
python -m src.demo.infer_batch_images \
|
| 48 |
+
--mode lidar \
|
| 49 |
+
--input examples/data/lidar_demo/eth3d_kicker.png
|
| 50 |
+
```
|
| 51 |
+
|
| 52 |
+
The input path may also be a directory for batch inference. In LiDAR mode, RGB and depth files are paired by filename stem. See the full [inference guide](https://github.com/PLUS-WAVE/InfiniSplat-oss/blob/main/docs/inference.md) for supported depth formats, camera intrinsics, outputs, and optional arguments.
|
| 53 |
+
|
| 54 |
+
## Outputs
|
| 55 |
+
|
| 56 |
+
Inference always exports a Gaussian PLY. Novel-view MP4 rendering is available when `gsplat` is installed, and interactive HTML export is available when the PlayCanvas `splat-transform` CLI is installed.
|
| 57 |
+
|
| 58 |
+
## Acknowledgments
|
| 59 |
+
|
| 60 |
+
InfiniSplat builds on [DINOv3](https://github.com/facebookresearch/dinov3), [Depth Pro](https://github.com/apple/ml-depth-pro), [InfiniDepth](https://github.com/zju3dv/InfiniDepth), and [gsplat](https://github.com/nerfstudio-project/gsplat). We thank their authors for their excellent work.
|
assets/github_demo.gif
ADDED
|
Git LFS Details
|