无需标注数据,利用多智能体协作提升单/多智能体3D感知性能
Unsupervised Multi-agent and Single-agent Perception from Cooperative Views
- 通过多智能体共享点云数据,提升点云密度以辅助无监督分类
- 在无监督条件下,多智能体协同视图使单智能体检测精度显著提升
- 适合自动驾驶、机器人环境感知等需要低成本标注的场景
基于激光雷达的多智能体与单智能体感知在机器人与自动驾驶环境理解中表现优异。然而,现有方法尚无法在无监督条件下同时解决多智能体与单智能体感知问题。通过多智能体间通信共享传感器数据,本文发现两个关键洞察:1)协同视角下的点云密度提升有助于无监督目标分类;2)多智能体协同视图可作为单视角3D目标检测的无监督引导信号。基于此,提出无监督多智能体与单智能体(UMS)感知框架,通过多智能体协作实现无需人工标注的双任务同步求解。UMS采用基于学习的候选框净化模块,结合渐进式候选框稳定模块(按难易程度递进学习),生成可靠伪标签。此外,设计跨视图一致性学习机制,利用多智能体协同视图指导单智能体检测。在公开数据集V2V4Real与OPV2V上的实验表明,该方法在无监督设置下,于多智能体与单智能体感知任务上均显著优于当前最优方法。
原文摘要 · Abstract (English)
The LiDAR-based multi-agent and single-agent perception has shown promising performance in environmental understanding for robots and automated vehicles. However, there is no existing method that simultaneously solves both multi-agent and single-agent perception in an unsupervised way. By sharing sensor data between multiple agents via communication, this paper discovers two key insights: 1) Improved point cloud density after the data sharing from cooperative views could benefit unsupervised object classification, 2) Cooperative view of multiple agents can be used as unsupervised guidance for the 3D object detection in the single view. Based on these two discovered insights, we propose an Unsupervised Multi-agent and Single-agent (UMS) perception framework that leverages multi-agent cooperation without human annotations to simultaneously solve multi-agent and single-agent perception. UMS combines a learning-based Proposal Purifying Filter to better classify the candidate proposals after multi-agent point cloud density cooperation, followed by a Progressive Proposal Stabilizing module to yield reliable pseudo labels by the easy-to-hard curriculum learning. Furthermore, we design a Cross-View Consensus Learning to use multi-agent cooperative view to guide detection in single-agent view. Experimental results on two public datasets V2V4Real and OPV2V show that our UMS method achieved significantly higher 3D detection performance than the state-of-the-art methods on both multi-agent and single-agent perception tasks in an unsupervised setting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。