arXiv:2507.02430cs.ROeess.IV2025-07ICRA被引 3

不共享模型也能高效融合多车感知结果,降低通信成本。

A Late Collaborative Perception Framework for 3D Multi-Object and Multi-Source Association and Fusion

  • 仅用3D框属性(类别/大小/位置/朝向)实现多源感知融合。
  • 位置误差降低5倍,尺度误差降7.5倍,方向误差减半。
  • 兼容不同系统,保持100%检测精度,适合真实自动驾驶场景。

在自动驾驶中,基于深度学习的协同感知研究日益增多,旨在克服单个感知系统的局限性。尽管现有方法精度高,但依赖高带宽通信,并需访问各智能体的检测模型架构与参数,这在现实场景中受限于通信瓶颈及对自有模型的保护需求。为此,我们提出一种新的3D多源多目标融合的后期协同框架,仅通过共享3D边界框属性(类别、尺寸、位置、朝向)实现融合,无需直接获取检测模型。该框架在后期融合中达到新基准,位置误差相比现有方法降低至五分之一,尺度误差减少7.5倍,方向误差减少一半,且在异构感知系统融合时保持100%精确率与召回率。结果表明,该方法有效应对真实世界协同感知挑战,为高效可扩展的多智能体融合树立新标准。

原文摘要 · Abstract (English)

In autonomous driving, recent research has increasingly focused on collaborative perception based on deep learning to overcome the limitations of individual perception systems. Although these methods achieve high accuracy, they rely on high communication bandwidth and require unrestricted access to each agent's object detection model architecture and parameters. These constraints pose challenges real-world autonomous driving scenarios, where communication limitations and the need to safeguard proprietary models hinder practical implementation. To address this issue, we introduce a novel late collaborative framework for 3D multi-source and multi-object fusion, which operates solely on shared 3D bounding box attributes-category, size, position, and orientation-without necessitating direct access to detection models. Our framework establishes a new state-of-the-art in late fusion, achieving up to five times lower position error compared to existing methods. Additionally, it reduces scale error by a factor of 7.5 and orientation error by half, all while maintaining perfect 100% precision and recall when fusing detections from heterogeneous perception systems. These results highlight the effectiveness of our approach in addressing real-world collaborative perception challenges, setting a new benchmark for efficient and scalable multi-agent fusion.

协同感知3D融合自动驾驶边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。