用少量标注数据实现3D目标检测高精度,打破半监督与主动学习的瓶颈
Breaking the SSL-AL Barrier: A Synergistic Semi-Supervised Active Learning Framework for 3D Object Detection
- 融合半监督与主动学习,通过协同预训练和模型级联提升数据利用效率
- 仅用2%标注数据即在KITTI上达到全量数据训练效果
- 适合标注成本高的自动驾驶3D感知场景
为缓解基于激光雷达的3D目标检测中的标注负担,主动学习(AL)方法提供了一条可行路径。然而,传统AL方法仅依赖少量标注数据训练初始模型进行数据选择,忽视了未标注数据的潜力。近期将半监督学习(SSL)引入AL以利用未标注数据的努力,因两种范式间的冲突而表现不佳。为此,本文提出协同半监督主动学习框架S-SSAL。从SSL视角,提出协同伪场景预训练(CPSP),有效利用未标注数据且不引入负面影响;从AL视角,设计协同主动学习(CAL),通过模型级联补充不确定性与多样性策略,充分挖掘CPSP预训练模型潜力。在KITTI和Waymo上的大量实验表明,该框架有效。特别地,在KITTI上仅使用2%标注数据,即可达到全量数据训练模型的性能。代码已开源。
原文摘要 · Abstract (English)
To address the annotation burden in LiDAR-based 3D object detection, active learning (AL) methods offer a promising solution. However, traditional active learning approaches solely rely on a small amount of labeled data to train an initial model for data selection, overlooking the potential of leveraging the abundance of unlabeled data. Recently, attempts to integrate semi-supervised learning (SSL) into AL with the goal of leveraging unlabeled data have faced challenges in effectively resolving the conflict between the two paradigms, resulting in less satisfactory performance. To tackle this conflict, we propose a Synergistic Semi-Supervised Active Learning framework, dubbed as S-SSAL. Specifically, from the perspective of SSL, we propose a Collaborative PseudoScene Pre-training (CPSP) method that effectively learns from unlabeled data without introducing adverse effects. From the perspective of AL, we design a Collaborative Active Learning (CAL) method, which complements the uncertainty and diversity methods by model cascading. This allows us to fully exploit the potential of the CPSP pre-trained model. Extensive experiments conducted on KITTI and Waymo demonstrate the effectiveness of our S-SSAL framework. Notably, on the KITTI dataset, utilizing only 2% labeled data, S-SSAL can achieve performance comparable to models trained on the full dataset. The code has been released at https://github.com/LandDreamer/S_SSAL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。