用自监督方法预测激光雷达点云时序重叠点,减少标注依赖。
Temporal Overlapping Prediction: A Self-supervised Pre-training Method for LiDAR Moving Object Segmentation
- 通过预测相邻帧重叠点的占用状态来学习时空特征。
- 在nuScenes和SemanticKITTI上相对基线提升28.77%,小物体检测更准确。
- 适合需要减少标注成本的自动驾驶感知系统开发者。
激光雷达点云中的运动物体分割对自动驾驶至关重要。传统监督方法严重依赖昂贵的人工标注,而激光雷达序列天然包含可利用的时序运动信息。本文提出时序重叠预测(TOP),一种自监督预训练方法,以缓解标注负担。TOP利用当前帧与邻近帧间常见的时序重叠点,通过预测这些点的占用状态来学习时空表示;同时引入当前帧占据重建作为辅助目标,增强模型对当前结构的感知能力。实验发现,传统交并比(IoU)对扫描点多的物体存在明显偏差,可能忽略小或远距离物体。为此,我们提出新的物体级评估指标mIoU_obj。在nuScenes和SemanticKITTI上的大量实验表明,TOP在性能上优于从零开始的监督训练基线及其他自监督预训练方法,相对提升最高达28.77%,展现出跨激光雷达设置的强迁移能力及对其他任务的良好泛化性。代码与预训练模型将在发表后公开。
原文摘要 · Abstract (English)
Moving object segmentation (MOS) on LiDAR point clouds is crucial for autonomous systems like self-driving vehicles. Previous supervised approaches rely heavily on costly manual annotations, while LiDAR sequences naturally capture temporal motion cues that can be leveraged for self-supervised learning. In this paper, we propose Temporal Overlapping Prediction (TOP), a self-supervised pre-training method that alleviate the labeling burden for MOS. TOP explores the temporal overlapping points that commonly observed by current and adjacent scans, and learns spatiotemporal representations by predicting the occupancy states of temporal overlapping points. Moreover, we utilize current occupancy reconstruction as an auxiliary pre-training objective, which enhances the current structural awareness of the model. We conduct extensive experiments and observe that the conventional metric Intersection-over-Union (IoU) shows strong bias to objects with more scanned points, which might neglect small or distant objects. To compensate for this bias, we introduce an additional metric called mIoU_obj to evaluate object-level performance. Experiments on nuScenes and SemanticKITTI show that TOPoutperforms both supervised training-from-scratch baseline and other self-supervised pre-training baselines by up to 28.77% relative improvement, demonstrating strong transferability across LiDAR setups and generalization to other tasks. Code and pre-trained models will be publicly available upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。