arXiv:2412.04337cs.CV2024-12被引 3

用反思式教师网络减少伪标签导致的知识遗忘,提升少样本3D目标检测性能。

Reflective Teacher: Semi-Supervised Multimodal 3D Object Detection in Bird's-Eye-View via Uncertainty Measure

  • 学生网络同时学习真实与伪标签数据,通过正则化逐步将知识传回教师网络。
  • 在nuScenes和Waymo上仅用25%和22%标注数据即可达到全监督模型效果。
  • 提出几何感知特征融合模块,有效对齐相机与激光雷达的鸟瞰图特征。

在自动驾驶的鸟瞰图(BEV)3D目标检测中,伪标签技术在标注数据有限时表现优异。现有方法多采用指数移动平均(EMA)调整教师网络权重,但易引发教师网络灾难性遗忘。本文提出一种新型反射式教师机制:学生网络利用真实与伪标签数据训练,其知识通过正则化逐步传递回教师网络,以保留历史知识。此外,设计几何感知的BEV特征融合(GA-BEVFusion)模块,实现相机与激光雷达特征在鸟瞰图中的高效对齐,增强激光点云的几何信息与图像语义的协同提取。在nuScenes和Waymo数据集上的实验表明:1)在全监督与半监督设置下均优于当前最优方法;2)反射式教师仅需25%(nuScenes)和22%(Waymo)的标注数据,即可达到全监督方法性能。

原文摘要 · Abstract (English)

Applying pseudo labeling techniques has been found to be advantageous in semi-supervised 3D object detection (SSOD) in Bird's-Eye-View (BEV) for autonomous driving, particularly where labeled data is limited. In the literature, Exponential Moving Average (EMA) has been used for adjustments of the weights of teacher network by the student network. However, the same induces catastrophic forgetting in the teacher network. In this work, we address this issue by introducing a novel concept of Reflective Teacher where the student is trained by both labeled and pseudo labeled data while its knowledge is progressively passed to the teacher through a regularizer to ensure retention of previous knowledge. Additionally, we propose Geometry Aware BEV Fusion (GA-BEVFusion) for efficient alignment of multi-modal BEV features, thus reducing the disparity between the modalities - camera and LiDAR. This helps to map the precise geometric information embedded among LiDAR points reliably with the spatial priors for extraction of semantic information from camera images. Our experiments on the nuScenes and Waymo datasets demonstrate: 1) improved performance over state-of-the-art methods in both fully supervised and semi-supervised settings; 2) Reflective Teacher achieves equivalent performance with only 25% and 22% of labeled data for nuScenes and Waymo datasets respectively, in contrast to other fully supervised methods that utilize the full labeled dataset.

3D目标检测半监督学习多模态融合鸟瞰图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。