用通道增强提升3D目标检测性能,仅需少量标注数据即可达到顶尖水平。
Semi-Supervised 3D Object Detection with Channel Augmentation using Transformation Equivariance
- 通过变换等变性探测器对点云进行多通道增强,构建师生框架
- 在KITTI上实现显著性能提升,超越现有半监督3D检测模型
- 适合追求少标注训练的自动驾驶与机器人研发人员
准确的3D目标检测对于自动驾驶车辆和机器人安全有效地导航与环境交互至关重要。然而,3D检测器的性能依赖大量数据和标注,而标注成本高昂。因此,如何在有限标注数据下训练成为迫切需求。本文提出一种新型师生框架,结合通道增强与变换等变性探测器(TED),用于3D半监督目标检测。传统师生方法采用弱增强用于教师、强增强用于学生;本文则在双网络中均引入多通道增强,并利用TED探索点云的不同增强组合,高效聚合多通道变换等变特征。通过为教师网络固定通道增强,学生可基于可靠伪标签稳定训练;强通道增强则提升数据多样性,增强对变换的鲁棒性并提高学生网络泛化能力。以当前最优的层级监督为基础,本文改进其双阈值策略,提出通道交并比一致性(channel IoU consistency)。在KITTI数据集上的实验表明,该方法实现显著性能跃升,超越现有最先进3D半监督检测模型。
原文摘要 · Abstract (English)
Accurate 3D object detection is crucial for autonomous vehicles and robots to navigate and interact with the environment safely and effectively. Meanwhile, the performance of 3D detector relies on the data size and annotation which is expensive. Consequently, the demand of training with limited labeled data is growing. We explore a novel teacher-student framework employing channel augmentation for 3D semi-supervised object detection. The teacher-student SSL typically adopts a weak augmentation and strong augmentation to teacher and student, respectively. In this work, we apply multiple channel augmentations to both networks using the transformation equivariance detector (TED). The TED allows us to explore different combinations of augmentation on point clouds and efficiently aggregates multi-channel transformation equivariance features. In principle, by adopting fixed channel augmentations for the teacher network, the student can train stably on reliable pseudo-labels. Adopting strong channel augmentations can enrich the diversity of data, fostering robustness to transformations and enhancing generalization performance of the student network. We use SOTA hierarchical supervision as a baseline and adapt its dual-threshold to TED, which is called channel IoU consistency. We evaluate our method with KITTI dataset, and achieved a significant performance leap, surpassing SOTA 3D semi-supervised object detection models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。