arXiv:2503.13914cs.CV2025-03CVPR被引 9

提出新自监督方法,让点云模型学会识别物体位置和大小,提升小样本场景下的感知精度。

PSA-SSL: Pose and Size-aware Self-Supervised Learning on LiDAR Point Clouds

  • 设计包围框回归预训练任务,保留物体姿态与尺度信息。
  • 在Waymo、nuScenes等数据集上,仅用1/10标签即达顶尖分割性能。
  • 适用于自动驾驶中传感器无关的点云特征学习,适合小样本场景。

三维点云的自监督学习有望学习可迁移的特征表示,适用于多种传感器和下游感知任务。然而,现有自监督方法未能设计保留物体姿态和尺度等几何信息的预训练任务,这对下游定位及几何敏感的3D场景理解任务(如3D语义分割和3D目标检测)性能造成负面影响。本文提出PSA-SSL,一种新型点云自监督学习方法,旨在学习物体姿态与尺寸感知(PSA)特征。该方法定义了一个自监督的边界框回归预训练任务,有效保留了物体的姿态与尺寸信息。此外,通过在输入点云上引入激光雷达束图案增强,促进学习传感器无关特征。实验表明,仅使用一个预训练模型,本方法在主流自动驾驶数据集(Waymo、nuScenes、SemanticKITTI)上,以有限标注实现显著的3D语义分割性能提升。同时,在3D语义分割(最多使用10倍少的标签)和3D目标检测任务上均优于当前最先进的自监督方法。代码将发布于https://github.com/TRAILab/PSA-SSL。

原文摘要 · Abstract (English)

Self-supervised learning (SSL) on 3D point clouds has the potential to learn feature representations that can transfer to diverse sensors and multiple downstream perception tasks. However, recent SSL approaches fail to define pretext tasks that retain geometric information such as object pose and scale, which can be detrimental to the performance of downstream localization and geometry-sensitive 3D scene understanding tasks, such as 3D semantic segmentation and 3D object detection. We propose PSA-SSL, a novel extension to point cloud SSL that learns object pose and size-aware (PSA) features. Our approach defines a self-supervised bounding box regression pretext task, which retains object pose and size information. Furthermore, we incorporate LiDAR beam pattern augmentation on input point clouds, which encourages learning sensor-agnostic features. Our experiments demonstrate that with a single pretrained model, our light-weight yet effective extensions achieve significant improvements on 3D semantic segmentation with limited labels across popular autonomous driving datasets (Waymo, nuScenes, SemanticKITTI). Moreover, our approach outperforms other state-of-the-art SSL methods on 3D semantic segmentation (using up to 10 times less labels), as well as on 3D object detection. Our code will be released on https://github.com/TRAILab/PSA-SSL.

自监督学习点云处理3D感知自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。