arXiv:2512.24763cs.CV2025-12AAAI

用对比学习统一3D实例分割流程,提升精度与效率。

UniC-Lift: Unified 3D Instance Segmentation via Contrastive Learning

论文配图:UniC-Lift: Unified 3D Instance Segmentation via Contrastive Learning
图 1 · 摘自论文原文
  • 将2D标签对齐与3D分割融合为统一框架,减少训练步骤。
  • 在ScanNet等数据集上优于基线,边界处误差降低显著。
  • 适合做3D场景理解、点云分割的工程师和研究者。

3D高斯泼溅(3DGS)和神经辐射场(NeRF)推动了新视角合成的发展。近期方法将多视图2D分割扩展至3D,实现更好的场景理解。关键挑战在于2D实例标签在不同视角间不一致,导致3D预测质量下降。现有方法采用两阶段流程,部分依赖超参数敏感的对比学习聚类,另一些则需预处理标签以保证一致性。本文提出统一框架,融合上述步骤,通过可学习的高斯原语特征嵌入实现分割,再通过新型“嵌入转标签”过程高效解码,实现优化整合。尽管该框架优势明显,但发现物体边界存在伪影。为此,提出在边界区域进行难例挖掘。直接对特征嵌入应用难例挖掘不稳定,因此在光栅化特征嵌入前加入线性层,再计算三元组损失,稳定训练并显著提升性能。实验表明,本方法在ScanNet、Replica3D和Messy-Rooms数据集上均优于基线,定性和定量结果均更优。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) have advanced novel-view synthesis. Recent methods extend multi-view 2D segmentation to 3D, enabling instance/semantic segmentation for better scene understanding. A key challenge is the inconsistency of 2D instance labels across views, leading to poor 3D predictions. Existing methods use a two-stage approach in which some rely on contrastive learning with hyperparameter-sensitive clustering, while others preprocess labels for consistency. We propose a unified framework that merges these steps, reducing training time and improving performance by introducing a learnable feature embedding for segmentation in Gaussian primitives. This embedding is then efficiently decoded into instance labels through a novel "Embedding-to-Label" process, effectively integrating the optimization. While this unified framework offers substantial benefits, we observed artifacts at the object boundaries. To address the object boundary issues, we propose hard-mining samples along these boundaries. However, directly applying hard mining to the feature embeddings proved unstable. Therefore, we apply a linear layer to the rasterized feature embeddings before calculating the triplet loss, which stabilizes training and significantly improves performance. Our method outperforms baselines qualitatively and quantitatively on the ScanNet, Replica3D, and Messy-Rooms datasets.

3D分割对比学习高斯泼溅

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。