无需外部掩码,直接从高斯点中挖掘物体结构,实现快速精准分割。
Intrinsic 4D Gaussian Segmentation from Scene Cues

- 基于外观、朝向、尺度等五类线索构建高斯点间亲和图
- 在Neu3D上达0.746 mIoU,几何版达0.902,媲美有监督方法
- 运行速度比依赖掩码的方法快12.5倍,适合无可靠掩码场景
动态4D高斯点阵能高保真重建形变场景,但后续编辑与分析需先进行分割——将高斯点划分为连贯物体。现有方法依赖外部2D掩码(如SAM)并将其提升至高斯表示,但在动态场景中需跨多帧生成掩码,成本高昂且结果受掩码质量影响。本文提出Intrinsic-GS,一种无需训练、无需掩码的方法:通过外观、朝向、尺度、形变轨迹及非学习的渲染边界线索,在高斯点间构建稀疏亲和图,再用Leiden社区检测进行分割。在标准基准Neu3D和HyperNeRF上,Intrinsic-GS实现无掩码分割,分别取得0.746和0.575的mIoU;其中仅用几何信息的变体在Neu3D上达0.902,与SAM监督的TRASE相当;在HyperNeRF上,其处理速度比依赖掩码生成与特征渲染的管线快12.5倍。结果表明,高斯表示本身已蕴含大量分割信号,为3D/4D高斯分割提供了一条高效、鲁棒的无掩码新路径。
原文摘要 · Abstract (English)
Dynamic 4D Gaussian Splatting reconstructs deforming scenes with high fidelity and is increasingly adopted as a representation for dynamic 3D scenes. Putting such a scene to use, for editing, manipulation or motion analysis, first requires segmenting it: grouping the Gaussian primitives into coherent objects. Current pipelines obtain this grouping by importing 2D masks from foundation models such as SAM and lifting or distilling them into the Gaussian representation. In dynamic scenes these masks must be generated across many frames and views, which is costly, and the resulting segmentation can depend strongly on the quality and consistency of those external masks. We ask how much object-level structure can instead be recovered from the Gaussians themselves, and propose Intrinsic-GS, a training-free, mask-free method that builds a sparse affinity graph over Gaussian primitives from appearance, orientation, scale, deformation-trajectory and non-learned rendered-boundary cues. The graph is partitioned with Leiden community detection, requiring no foundation model and no learned feature field. On the standard 4D Gaussian segmentation benchmarks, Neu3D and HyperNeRF, Intrinsic-GS recovers substantial object structure without mask supervision, reaching 0.746 mIoU on Neu3D and 0.575 on HyperNeRF; on Neu3D, a geometry-only variant reaches 0.902 mIoU, matching SAM-supervised TRASE. On HyperNeRF, Intrinsic-GS runs 12.5x faster than the mask-generation and feature-rendering stages used by mask-supervised pipelines. These results suggest that much of the segmentation signal is already encoded in the Gaussians themselves, offering a fast, mask-free direction for 3D and 4D Gaussian segmentation that may also point toward more generalizable, robust segmentation in settings where external masks are unreliable or expensive.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。