|
Download docs/processing.md from SiddhuG01/PanoGS: direct link, hf CLI and curl.
- Browser
- Download file 2.29 kB
-
https://huggingface.co/spaces/SiddhuG01/PanoGS/resolve/main/docs/processing.md
- Command line
-
hf download hf://spaces/SiddhuG01/PanoGS/docs/processing.md
-
curl -L -o processing.md https://huggingface.co/spaces/SiddhuG01/PanoGS/resolve/main/docs/processing.md
2.29 kB
| # Point Cloud Processing & Filtering | |
| This document details the geometric filtering, spatial decimation, and surface normal estimation pipeline in PanoGS. | |
| --- | |
| ## 1. Voxel Grid Downsampling | |
| Raw monocular backprojections generate dense point concentrations that overload memory and slow down Gaussian optimization. | |
| ### Method | |
| 1. Discretize coordinates $\mathbf{p} = (x, y, z)$ into integer voxel keys: | |
| $$\mathbf{v} = \left\lfloor \frac{\mathbf{p}}{s} \right\rfloor$$ | |
| where $s$ is the voxel cell size in meters (default $s = 0.04\text{m}$). | |
| 2. Compute the exact centroid $\bar{\mathbf{p}}_k$ and averaged color $\bar{\mathbf{c}}_k$ for all points falling into voxel cell $k$: | |
| $$\bar{\mathbf{p}}_k = \frac{1}{|V_k|} \sum_{\mathbf{p} \in V_k} \mathbf{p}, \quad \bar{\mathbf{c}}_k = \frac{1}{|V_k|} \sum_{\mathbf{c} \in V_k} \mathbf{c}$$ | |
| --- | |
| ## 2. Statistical Outlier Removal (SOR) | |
| Floating artifacts and depth edge discontinuities are purged using a statistical distance filter: | |
| 1. For each point $\mathbf{p}_i$, find its $k$ nearest neighbors ($k = 20$) and compute mean distance $\bar{d}_i$: | |
| $$\bar{d}_i = \frac{1}{k} \sum_{j \in \mathcal{N}_k(i)} \|\mathbf{p}_i - \mathbf{p}_j\|_2$$ | |
| 2. Calculate the global mean $\mu$ and standard deviation $\sigma$ across all $\bar{d}_i$. | |
| 3. Retain points satisfying: | |
| $$\bar{d}_i \le \mu + \alpha \cdot \sigma \quad (\alpha = 2.0)$$ | |
| --- | |
| ## 3. Surface Normal Estimation via Local PCA | |
| Each Gaussian in 3DGS is initialized with an orientation aligned to the underlying scene surface. | |
| ### Method | |
| 1. For each point $\mathbf{p}_i$, compute the local $3 \times 3$ covariance matrix over its $k$ nearest neighbors: | |
| $$\mathbf{C}_i = \frac{1}{k} \sum_{j \in \mathcal{N}_k(i)} (\mathbf{p}_j - \bar{\mathbf{p}}_i)(\mathbf{p}_j - \bar{\mathbf{p}}_i)^T$$ | |
| 2. Decompose $\mathbf{C}_i = \mathbf{V} \mathbf{\Lambda} \mathbf{V}^T$ with eigenvalues $\lambda_1 \le \lambda_2 \le \lambda_3$. | |
| 3. The surface normal $\mathbf{n}_i$ is the eigenvector $\mathbf{v}_1$ corresponding to the smallest eigenvalue $\lambda_1$. | |
| 4. **Camera Consistency**: Ensure normals point towards the camera center $\mathbf{C}_{\text{cam}}$: | |
| $$\text{If } \mathbf{n}_i \cdot (\mathbf{C}_{\text{cam}} - \mathbf{p}_i) < 0 \implies \mathbf{n}_i \leftarrow -\mathbf{n}_i$$ | |