arXiv:2512.08673cs.CV2025-12

提出双分支中心-周围对比框架,提升3D点云自监督学习性能。

Dual-Branch Center-Surrounding Contrast: Rethinking Contrastive Learning for 3D Point Clouds

  • 分中心与周围区域分别掩码,构建双分支特征表示。
  • 在ScanObjectNN上,相比基线最高提升10.3%(MLP-LINEAR协议)。
  • 适合需要精细几何建模的3D点云下游任务研究者。

现有3D点云自监督学习方法多依赖基于掩码自编码器(MAE)的生成式方法,但这类方法难以有效捕捉高层判别性特征,导致线性探测等下游任务表现不佳。相比之下,对比学习在图像数据中表现出色,但在3D领域仍较少应用,且直接将2D对比方法用于3D无法有效学习局部几何细节。为此,本文提出一种新型双分支中心-周围对比(CSCon)框架:分别对中心和周围区域进行掩码,构建中心偏置与周围偏置的双分支输入,以更充分捕捉几何信息;同时引入块级对比损失,增强高层语义与局部敏感性。在FULL和ALL协议下,性能可媲美生成式方法;在MLP-LINEAR、MLP-3和ONLY-NEW协议下,达到当前最优,甚至超越跨模态方法。尤其在MLP-LINEAR协议下,相较于基线Point-MAE,在三个变体的ScanObjectNN上分别提升7.9%、6.7%和10.3%。代码将公开。

原文摘要 · Abstract (English)

Most existing self-supervised learning (SSL) approaches for 3D point clouds are dominated by generative methods based on Masked Autoencoders (MAE). However, these generative methods have been proven to struggle to capture high-level discriminative features effectively, leading to poor performance on linear probing and other downstream tasks. In contrast, contrastive methods excel in discriminative feature representation and generalization ability on image data. Despite this, contrastive learning (CL) in 3D data remains scarce. Besides, simply applying CL methods designed for 2D data to 3D fails to effectively learn 3D local details. To address these challenges, we propose a novel Dual-Branch \textbf{C}enter-\textbf{S}urrounding \textbf{Con}trast (CSCon) framework. Specifically, we apply masking to the center and surrounding parts separately, constructing dual-branch inputs with center-biased and surrounding-biased representations to better capture rich geometric information. Meanwhile, we introduce a patch-level contrastive loss to further enhance both high-level information and local sensitivity. Under the FULL and ALL protocols, CSCon achieves performance comparable to generative methods; under the MLP-LINEAR, MLP-3, and ONLY-NEW protocols, our method attains state-of-the-art results, even surpassing cross-modal approaches. In particular, under the MLP-LINEAR protocol, our method outperforms the baseline (Point-MAE) by \textbf{7.9\%}, \textbf{6.7\%}, and \textbf{10.3\%} on the three variants of ScanObjectNN, respectively. The code will be made publicly available.

3D点云对比学习自监督几何建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。