Spaces:
Running on Zero
Running on Zero
File size: 2,196 Bytes
7166b72 7405e85 7166b72 c9ad6b5 7405e85 7166b72 7405e85 c9ad6b5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 | ---
title: CodecSplat
emoji: 🗜️
colorFrom: red
colorTo: yellow
sdk: gradio
sdk_version: 6.30.0
app_file: app.py
short_description: Compress a 3D Gaussian scene into a few KB
python_version: "3.12"
startup_duration_timeout: 1h
models:
- pengpeng-yu/CodecSplat
---
# CodecSplat: Ultra-Compact Latent Coding for Feed-Forward 3D Gaussian Splatting
Interactive demo of [CodecSplat](https://huggingface.co/papers/2605.25563)
([code](https://github.com/pengpeng-yu/CodecSplat), MIT;
[weights](https://huggingface.co/pengpeng-yu/CodecSplat)).
Upload overlapping photos of a static scene. The Space:
1. runs **COLMAP** (`pycolmap`, CPU) to estimate intrinsics and camera poses,
2. picks 8 context views by farthest-point sampling and resizes them to 256x448
(the `codecsplat-base-dl3dv-256x448-view8` checkpoint),
3. runs the authors' **complete bitstream path** (`EncoderCodecSplat.codec_forward`):
it encodes the latent features into a real entropy-coded scene bitstream at the
chosen rate point λ (16-1024), then decodes that bitstream back to 3D Gaussians,
4. renders held-out views (with PSNR/SSIM against the real photos) and a
fly-through with `gsplat`, and shows the Gaussians in an interactive viewer.
You can download both the `.bin` bitstream and the decoded `.ply`.
## Implementation notes
* Model construction uses the exact Hydra overrides of the authors'
`scripts/test_dl3dv_view8_256x448.sh` (bf16 autocast, gsplat antialiased rasterizer).
* COLMAP stage and scene loader are adapted from the
[ReSplat Space](https://huggingface.co/spaces/hugging-apps/resplat-recurrent-gs) / the ReSplat
reference `scripts/infer_colmap.py` (same DepthSplat camera conventions). The reconstruction is
normalised to a fixed extent so that the DL3DV near/far planes (0.5 / 200) are meaningful.
* `gsplat`'s CUDA kernels are JIT-compiled once at startup (no prebuilt sm_120 wheel).
## Example assets
`examples/kitchen` and `examples/garden` are 14 frames each from the
[Mip-NeRF 360](https://jonbarron.info/mipnerf360/) dataset (Barron et al.), downscaled to 960px,
as redistributed by [`nvs-bench/mipnerf360`](https://huggingface.co/datasets/nvs-bench/mipnerf360) (MIT).
|