通过生成条件伪负样本,让点云模型更敏感于变换差异。
Point-PNG: Conditional Pseudo-Negatives Generation for Point Cloud Pre-Training
- 在隐空间生成与变换相关的伪负样本,增强模型对变化的感知能力。
- 在ModelNet40和ScanObjectNN上表现优于现有自监督方法,相对位姿估计更准确。
- 适合做点云预训练、需区分微小变换场景的研究者使用。
我们提出Point-PNG,一种新颖的自监督学习框架,通过在隐空间生成条件伪负样本,学习既具有判别性又对变换敏感的点云表示。传统自监督方法侧重于实现不变性,忽略了变换信息;近期方法虽显式建模原始与变换输入间关系,但常出现不变性崩溃现象,导致预测器退化为恒等映射,隐表示在变换间变化有限。为此,我们提出Point-PNG,通过伪负样本生成显式惩罚不变性崩溃,使网络能捕捉更丰富的变换线索,同时保持判别性表示。为此,引入参数化网络COPE,学习变换引起的隐空间局部位移。联合训练COPE与MAE时,易收敛至平凡恒等映射。为此,设计基于变换条件的伪负样本损失函数,惩罚此类平凡不变解,强制有意义表示学习。在形状分类与相对位姿估计任务上验证,Point-PNG在ModelNet40和ScanObjectNN挑战性评测协议下表现优异,相对位姿估计精度优于监督基线。
原文摘要 · Abstract (English)
We propose Point-PNG, a novel self-supervised learning framework that generates conditional pseudo-negatives in the latent space to learn point cloud representations that are both discriminative and transformation-sensitive. Conventional self-supervised learning methods focus on achieving invariance, discarding transformation-specific information. Recent approaches incorporate transformation sensitivity by explicitly modeling relationships between original and transformed inputs. However, they often suffer from an invariant-collapse phenomenon, where the predictor degenerates into identity mappings, resulting in latent representations with limited variation across transformations. To address this, we propose Point-PNG that explicitly penalizes invariant collapse through pseudo-negatives generation, enabling the network to capture richer transformation cues while preserving discriminative representations. To this end, we introduce a parametric network, COnditional Pseudo-Negatives Embedding (COPE), which learns localized displacements induced by transformations within the latent space. A key challenge arises when jointly training COPE with the MAE, as it tends to converge to trivial identity mappings. To overcome this, we design a loss function based on pseudo-negatives conditioned on the transformation, which penalizes such trivial invariant solutions and enforces meaningful representation learning. We validate Point-PNG on shape classification and relative pose estimation tasks, showing competitive performance on ModelNet40 and ScanObjectNN under challenging evaluation protocols, and achieving superior accuracy in relative pose estimation compared to supervised baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。