arXiv:2502.16303cs.CV2025-02IJCV被引 6

提出新方法实现3D场景分割的视角一致与紧凑表示。

Pointmap Association and Piecewise-Plane Constraint for Consistent and Compact 3D Gaussian Segmentation Field

  • 通过点图关联与匈牙利算法匹配像素,解决物体临时消失导致的错连问题。
  • 在ScanNet和Replica数据集上,2D全景分割与3D高斯分割均优于现有方法。
  • 适合关注3D场景理解与重建中语义一致性研究者。

实现一致且紧凑的3D分割场对于保持多视角语义连贯性和准确表示场景结构至关重要。以往的3D场景分割方法依赖视频分割模型处理多视角不一致性,但缺乏空间信息常导致物体短暂消失后重新出现时发生误关联。此外,在3D场景重建过程中,分割与优化常被分开处理,优化阶段通常忽略语义类别信息,易产生语义模糊的浮点。为此,本文提出CCGS方法,同时实现视角一致的2D分割与紧凑的3D高斯分割场。CCGS引入点图关联与分段平面约束:首先通过最小化相邻图像点图间的欧氏距离建立像素对应关系,并重定义物体掩码重叠;再使用匈牙利算法以最小化总匹配代价优化掩码关联,支持部分匹配。为增强紧凑性,分段平面约束在优化中限制点在局部平面内的位移,从而保持结构完整性。在ScanNet与Replica数据集上的实验表明,CCGS在2D全景分割与3D高斯分割任务上均优于现有方法。

原文摘要 · Abstract (English)

Achieving a consistent and compact 3D segmentation field is crucial for maintaining semantic coherence across views and accurately representing scene structures. Previous 3D scene segmentation methods rely on video segmentation models to address inconsistencies across views, but the absence of spatial information often leads to object misassociation when object temporarily disappear and reappear. Furthermore, in the process of 3D scene reconstruction, segmentation and optimization are often treated as separate tasks. As a result, optimization typically lacks awareness of semantic category information, which can result in floaters with ambiguous segmentation. To address these challenges, we introduce CCGS, a method designed to achieve both view consistent 2D segmentation and a compact 3D Gaussian segmentation field. CCGS incorporates pointmap association and a piecewise-plane constraint. First, we establish pixel correspondence between adjacent images by minimizing the Euclidean distance between their pointmaps. We then redefine object mask overlap accordingly. The Hungarian algorithm is employed to optimize mask association by minimizing the total matching cost, while allowing for partial matches. To further enhance compactness, the piecewise-plane constraint restricts point displacement within local planes during optimization, thereby preserving structural integrity. Experimental results on ScanNet and Replica datasets demonstrate that CCGS outperforms existing methods in both 2D panoptic segmentation and 3D Gaussian segmentation.

3D分割高斯溅射语义一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。