无需人工标注,通过多智能体激光雷达协作实现高质量3D目标检测
Learning to Detect Objects from Multi-Agent LiDAR Scans without Manual Labels
- 利用多智能体共享的自身位姿与形状初始化检测器,生成初步伪标签
- 通过智能体间互补观测进行多尺度编码,区分高质量与低质量伪标签
- 伪标签作为提示引导特征学习,适用于多种协同感知场景
无监督3D目标检测为离线标注提供重要解决方案。然而,由于数据稀疏和视角受限,基于聚类的伪标签生成常产生低质量结果。多智能体协作数据集通过智能体间互补观测,有望突破此瓶颈。本文提出一种新型无监督方法DOtA,从多智能体激光雷达扫描中检测物体,无需外部标签。DOtA首先利用协作智能体内部共享的自车位姿与自车形状初始化检测器,借助神经网络泛化能力生成初步伪标签。随后,利用智能体间互补观测对初步伪标签进行多尺度编码,解码出高质量与低质量伪标签。这些伪标签进一步作为提示,引导正确特征学习过程,从而提升无监督3D目标检测性能。在V2V4Real和OPV2V数据集上的大量实验表明,DOtA优于当前最先进的无监督3D目标检测方法。此外,我们还在多种协同感知框架下验证了DOtA伪标签的有效性。代码已开源:https://github.com/xmuqimingxia/DOtA。
原文摘要 · Abstract (English)
Unsupervised 3D object detection serves as an important solution for offline 3D object annotation. However, due to the data sparsity and limited views, the clustering-based label fitting in unsupervised object detection often generates low-quality pseudo-labels. Multi-agent collaborative dataset, which involves the sharing of complementary observations among agents, holds the potential to break through this bottleneck. In this paper, we introduce a novel unsupervised method that learns to Detect Objects from Multi-Agent LiDAR scans, termed DOtA, without using labels from external. DOtA first uses the internally shared ego-pose and ego-shape of collaborative agents to initialize the detector, leveraging the generalization performance of neural networks to infer preliminary labels. Subsequently,DOtA uses the complementary observations between agents to perform multi-scale encoding on preliminary labels, then decodes high-quality and low-quality labels. These labels are further used as prompts to guide a correct feature learning process, thereby enhancing the performance of the unsupervised object detection task. Extensive experiments on the V2V4Real and OPV2V datasets show that our DOtA outperforms state-of-the-art unsupervised 3D object detection methods. Additionally, we also validate the effectiveness of the DOtA labels under various collaborative perception frameworks.The code is available at https://github.com/xmuqimingxia/DOtA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。