arXiv:2409.06956cs.CV2024-09被引 3

通过自监督几何增强,提升点云表示在真实与合成数据间的泛化能力。

Bridging Domain Gap of Point Cloud Representations via Self-Supervised Geometric Augmentation

  • 设计双自监督几何增强任务,学习跨域几何不变特征。
  • 在PointDA-10上达到当前最优性能,显著提升真实场景点云分类准确率。
  • 适合做3D视觉中领域适应、点云表征学习的研究者参考。

近期语义点云分析的进步主要依赖于合成数据(如ModelNet和ShapeNet),这些数据通常完整、对齐良好且无噪声。因此,此类理想合成点云的表示在几何视角下变化有限,可在多项3D视觉任务(如点云分类)中表现优异。但在无监督域适应(UDA)场景下,为合成数据设计的表征学习难以捕捉不完整、含噪点云中的域不变几何模式。为此,本文提出一种新方案,通过引入两个自监督几何增强任务,正则化表征学习,实现跨域几何不变性。一方面,提出预测增强样本平移距离的新预训练任务,缓解遮挡与噪声引起的点云质心偏移;另一方面,首次以级联方式融合几何增强点云的相对自监督学习,利用增强变体与其他样本之间的内在关系,作为跨域几何特征的额外约束。在PointDA-10数据集上的实验验证了方法的有效性,达到当前最优性能。

原文摘要 · Abstract (English)

Recent progress of semantic point clouds analysis is largely driven by synthetic data (e.g., the ModelNet and the ShapeNet), which are typically complete, well-aligned and noisy free. Therefore, representations of those ideal synthetic point clouds have limited variations in the geometric perspective and can gain good performance on a number of 3D vision tasks such as point cloud classification. In the context of unsupervised domain adaptation (UDA), representation learning designed for synthetic point clouds can hardly capture domain invariant geometric patterns from incomplete and noisy point clouds. To address such a problem, we introduce a novel scheme for induced geometric invariance of point cloud representations across domains, via regularizing representation learning with two self-supervised geometric augmentation tasks. On one hand, a novel pretext task of predicting translation distances of augmented samples is proposed to alleviate centroid shift of point clouds due to occlusion and noises. On the other hand, we pioneer an integration of the relational self-supervised learning on geometrically-augmented point clouds in a cascade manner, utilizing the intrinsic relationship of augmented variants and other samples as extra constraints of cross-domain geometric features. Experiments on the PointDA-10 dataset demonstrate the effectiveness of the proposed method, achieving the state-of-the-art performance.

点云分析域适应自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。