arXiv:2410.02646cs.CV2024-10ICLR被引 6

让自动驾驶汽车从周围车辆的检测结果中学习,高效构建3D感知模型。

Learning 3D Perception from Others' Predictions

  • 利用邻近车辆的检测预测作为伪标签,实现标签高效的3D目标检测训练。
  • 通过距离驱动的渐进式学习策略,缓解视角差异与定位误差带来的伪标签噪声。
  • 仅需少量标注数据即可训练伪标签优化模块,显著降低对人工标注的需求。

真实世界中高精度3D目标检测需要大量高质量标注数据,但获取成本高昂且需重复投入。本文提出一种新范式:让自动驾驶汽车通过学习邻近单元(如其他车辆)的检测预测来构建自身3D感知模型。例如,当车辆进入新区域时,可利用已在该区域优化过的其他交通参与者检测器的输出。该方法具备标签高效、传感器无关、通信高效的特点——只需共享预测结果。然而,直接将接收到的预测当作真值训练会带来性能下降。我们系统分析发现,视角差异与同步/定位误差导致误检、漏检及伪标签不准确。为此,提出基于距离的课程学习策略,先从视角相近的近距离单元开始学习,再通过自训练逐步提升远距离单元预测质量。进一步证明,仅需少量标注数据即可训练有效的伪标签精修模块,大幅减少训练所需标注量。我们在最新发布的协同驾驶真实数据集上验证了该方法,在多种传感器、检测器和场景下均表现优异,证明了从他人预测中高效学习3D感知的可行性。

原文摘要 · Abstract (English)

Accurate 3D object detection in real-world environments requires a huge amount of annotated data with high quality. Acquiring such data is tedious and expensive, and often needs repeated effort when a new sensor is adopted or when the detector is deployed in a new environment. We investigate a new scenario to construct 3D object detectors: learning from the predictions of a nearby unit that is equipped with an accurate detector. For example, when a self-driving car enters a new area, it may learn from other traffic participants whose detectors have been optimized for that area. This setting is label-efficient, sensor-agnostic, and communication-efficient: nearby units only need to share the predictions with the ego agent (e.g., car). Naively using the received predictions as ground-truths to train the detector for the ego car, however, leads to inferior performance. We systematically study the problem and identify viewpoint mismatches and mislocalization (due to synchronization and GPS errors) as the main causes, which unavoidably result in false positives, false negatives, and inaccurate pseudo labels. We propose a distance-based curriculum, first learning from closer units with similar viewpoints and subsequently improving the quality of other units' predictions via self-training. We further demonstrate that an effective pseudo label refinement module can be trained with a handful of annotated data, largely reducing the data quantity necessary to train an object detector. We validate our approach on the recently released real-world collaborative driving dataset, using reference cars' predictions as pseudo labels for the ego car. Extensive experiments including several scenarios (e.g., different sensors, detectors, and domains) demonstrate the effectiveness of our approach toward label-efficient learning of 3D perception from other units' predictions.

3D检测协同感知伪标签自训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。