Papers
arxiv:2611.21383

The Mask Is Not the Object: Volumetric Supervision for 3D Gaussian Segmentation

Published on Nov 16
ยท Submitted by
Jeonghwan Cho
on Nov 20
Authors:
,
,

Abstract

A plug-and-play objective, VODA, groups per-pixel contributors by local depth to supervise all Gaussians in selected depth clusters, improving volumetric segmentation and enabling evaluation via Removal-3D and Removal Depth Error.

3D Gaussian Splatting enables object-level operations on Gaussian primitives, yet existing segmentation methods are largely trained and evaluated through rendered views. This mismatch can produce accurate rendered masks from incomplete 3D selections since alpha-blended feature supervision concentrates learning on dominant contributors while leaving occluded or low-contribution Gaussians weakly supervised. We propose VODA, a plug-and-play supervision objective that exploits local depth structure to group per-pixel contributors and directly supervises all Gaussians in selected depth clusters, bypassing contribution-weighted gradient delivery. To evaluate volumetric completeness, we introduce Removal-3D, a synthetic object-removal benchmark, and the Removal Depth Error (RDE), a metric comparing predicted and ground-truth depth changes. Across four rendering-based baselines, VODA consistently improves volumetric segmentation on Removal-3D while maintaining or improving performance on LERF and ScanNet. Further analysis shows that VODA recovers lower-contribution Gaussians, while simple gradient reweighting and spatial propagation fail to reproduce comparable gains.

Community

Paper author Paper submitter

Paper author Paper submitter

Are we really doing "3D" segmentation?

In 3D Gaussian Splatting, accurate 2D masks don't necessarily mean complete 3D object segmentation.

We introduce VODA, a plug-and-play volumetric supervision approach that directly supervises object-associated Gaussians beyond conventional rendering-based supervision.

VODA consistently improves existing 3DGS segmentation methods, and we introduce Removal-3D to evaluate volumetric completeness through object removal.

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2611.21383
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2611.21383 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2611.21383 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2611.21383 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.