arXiv:2412.08806cs.CV2024-12被引 5

解决激光雷达目标检测中伪标签噪声问题,提升无监督域适应性能。

DALI: Domain Adaptive LiDAR Object Detection via Distribution-level and Instance-level Pseudo Label Denoising

  • 通过后训练尺寸归一化减少伪标签尺寸分布偏差。
  • 提出两种点云生成策略,保证伪标签与点云的一致性。
  • 在KITTI、Waymo、nuScenes上均达到当前最优效果,适合自动驾驶场景应用。

基于激光雷达点云的目标检测依赖大量人工标注样本训练深度神经网络,但大规模数据集的3D边界框标注成本高且耗时。无监督域适应(UDA)可利用未标注的目标域数据,将源域知识迁移到新域。常用伪标签策略通过预训练模型生成目标域预测框,但常引入噪声。本文提出DALI框架,从分布和实例两个层面消除伪标签噪声:首先设计后训练尺寸归一化(PTSN)策略,在网络训练后识别无偏尺度以缓解伪标签尺寸分布偏差;其次提出射线约束和自由约束两种伪点云生成(PPCG)方法,为每个实例生成伪点云,确保训练时伪标签与伪点云的一致性。在KITTI、Waymo、nuScenes等公开数据集上验证,DALI框架显著优于现有方法,多数任务达到最新水平。代码已开源。

原文摘要 · Abstract (English)

Object detection using LiDAR point clouds relies on a large amount of human-annotated samples when training the underlying detectors' deep neural networks. However, generating 3D bounding box annotation for a large-scale dataset could be costly and time-consuming. Alternatively, unsupervised domain adaptation (UDA) enables a given object detector to operate on a novel new data, with unlabeled training dataset, by transferring the knowledge learned from training labeled \textit{source domain} data to the new unlabeled \textit{target domain}. Pseudo label strategies, which involve training the 3D object detector using target-domain predicted bounding boxes from a pre-trained model, are commonly used in UDA. However, these pseudo labels often introduce noise, impacting performance. In this paper, we introduce the Domain Adaptive LIdar (DALI) object detection framework to address noise at both distribution and instance levels. Firstly, a post-training size normalization (PTSN) strategy is developed to mitigate bias in pseudo label size distribution by identifying an unbiased scale after network training. To address instance-level noise between pseudo labels and corresponding point clouds, two pseudo point clouds generation (PPCG) strategies, ray-constrained and constraint-free, are developed to generate pseudo point clouds for each instance, ensuring the consistency between pseudo labels and pseudo points during training. We demonstrate the effectiveness of our method on the publicly available and popular datasets KITTI, Waymo, and nuScenes. We show that the proposed DALI framework achieves state-of-the-art results and outperforms leading approaches on most of the domain adaptation tasks. Our code is available at \href{https://github.com/xiaohulugo/T-RO2024-DALI}{https://github.com/xiaohulugo/T-RO2024-DALI}.

激光雷达目标检测域适应伪标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。