用语义伪标签和原型学习,实现无监督与稀疏标注下的3D目标检测统一框架。
Unified Unsupervised and Sparsely-Supervised 3D Object Detection by Semantic Pseudo-Labeling and Prototype Learning
- 融合图像语义、点云几何与时间信息生成高质量伪标签。
- 在KITTI和nuScenes上优于现有方法,无标注时提升6.8%以上。
- 适合自动驾驶中数据标注成本高的场景,支持灵活标注比例。
3D目标检测对自动驾驶与机器人感知至关重要,但依赖大规模人工标注限制了其可扩展性与适应性。为降低标注依赖,无监督与稀疏监督范式应运而生,但面临伪标签质量差、特征挖掘不稳定及缺乏统一训练框架等挑战。本文提出SPL(Semantic Pseudo-Labeling and Prototype Learning),一种统一的无监督与稀疏监督3D目标检测框架。SPL通过融合图像语义、点云几何与时间线索生成高质量伪标签,输出密集物体的3D边界框与稀疏物体的3D点标签。这些伪标签不直接使用,而是作为概率先验,嵌入新颖的多阶段原型学习策略。该策略通过基于记忆的初始化与动量更新的原型机制,稳定特征表示学习,有效从有标签与无标签数据中挖掘特征。在KITTI与nuScenes数据集上的大量实验表明,SPL在两种设置下均显著优于当前最优方法。本工作为仅需极少或无需人工标注的3D目标检测器学习提供了鲁棒且通用的解决方案。代码已公开于https://github.com/TossherO/SPL。
原文摘要 · Abstract (English)
3D object detection is essential for autonomous driving and robotic perception, yet its reliance on large-scale manually annotated data limits scalability and adaptability. To reduce annotation dependency, unsupervised and sparsely-supervised paradigms have emerged. However, they face intertwined challenges: low-quality pseudo-labels, unstable feature mining, and a lack of a unified training framework. This paper proposes SPL, a unified training framework for both unsupervised and sparsely-supervised 3D object detection via \underline{S}emantic \underline{P}seudo-labeling and prototype \underline{L}earning. SPL first generates high-quality pseudo-labels by integrating image semantics, point cloud geometry, and temporal cues, producing both 3D bounding boxes for dense objects and 3D point labels for sparse ones. These pseudo-labels are not used directly but as probabilistic priors within a novel, multi-stage prototype learning strategy. This strategy stabilizes feature representation learning through memory-based initialization and momentum-based prototype updating, effectively mining features from both labeled and unlabeled data. Extensive experiments on KITTI and nuScenes datasets demonstrate that SPL significantly outperforms state-of-the-art methods in both settings. Our work provides a robust and generalizable solution for learning 3D object detectors with minimal or no manual annotations. Our code is available at https://github.com/TossherO/SPL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。