arXiv:2503.19443cs.CV2025-03CVPR被引 26

提升3D高斯散点分割边界清晰度,解决模糊重叠问题。

COB-GS: Clear Object Boundaries in 3DGS Segmentation Based on Boundary-Adaptive Gaussian Splitting

  • 基于语义梯度自适应分裂模糊高斯体,贴合物体边缘。
  • 在保持视觉质量前提下,边界分割精度显著提升。
  • 适合需要精细分割的3D场景理解任务。

准确的物体分割对3D视觉中的高质量场景理解至关重要。然而,基于3D高斯散点(3DGS)的3D分割在精确划定物体边界方面存在困难,因为高斯原语固有的体积特性及训练中缺乏语义引导,常导致其跨越物体边缘。为此,我们提出一种名为COB-GS的方法,旨在通过清晰界定场景内交错高斯体的模糊边界来提升分割精度。与现有移除模糊高斯体并牺牲视觉质量的方法不同,COB-GS作为3DGS优化方法,联合优化语义与视觉信息,实现两者的有效协同。具体而言,语义引导方面引入边界自适应高斯分裂技术,利用语义梯度统计识别并分裂模糊高斯体,使其紧密贴合物体边界;视觉优化方面,则修复3DGS场景中因分割导致的退化纹理,尤其在精细化边界区域。实验结果表明,COB-GS显著提升了分割精度与鲁棒性,对预训练模型产生的不准确掩码具有较强容忍能力,在保留高视觉质量的同时生成清晰边界。代码已开源:https://github.com/ZestfulJX/COB-GS。

原文摘要 · Abstract (English)

Accurate object segmentation is crucial for high-quality scene understanding in the 3D vision domain. However, 3D segmentation based on 3D Gaussian Splatting (3DGS) struggles with accurately delineating object boundaries, as Gaussian primitives often span across object edges due to their inherent volume and the lack of semantic guidance during training. In order to tackle these challenges, we introduce Clear Object Boundaries for 3DGS Segmentation (COB-GS), which aims to improve segmentation accuracy by clearly delineating blurry boundaries of interwoven Gaussian primitives within the scene. Unlike existing approaches that remove ambiguous Gaussians and sacrifice visual quality, COB-GS, as a 3DGS refinement method, jointly optimizes semantic and visual information, allowing the two different levels to cooperate with each other effectively. Specifically, for the semantic guidance, we introduce a boundary-adaptive Gaussian splitting technique that leverages semantic gradient statistics to identify and split ambiguous Gaussians, aligning them closely with object boundaries. For the visual optimization, we rectify the degraded suboptimal texture of the 3DGS scene, particularly along the refined boundary structures. Experimental results show that COB-GS substantially improves segmentation accuracy and robustness against inaccurate masks from pre-trained model, yielding clear boundaries while preserving high visual quality. Code is available at https://github.com/ZestfulJX/COB-GS.

3D分割高斯散点边界优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。