arXiv:2503.13946cs.CV2025-03ICRA被引 8

提出锚点中心框架,让多智能体感知更灵活高效。

Is Discretization Fusion All You Need for Collaborative Perception?

  • 以锚点为中心设计通信与融合机制,避免网格精度限制。
  • 通信量减少40%以上,检测性能在两个数据集上显著提升。
  • 适合自动驾驶等需要低延迟协作感知的场景。

多智能体协同感知通过交换互补信息提升整体感知能力。现有方法依赖离散特征图进行融合,但缺乏对关键特征的灵活提取与传输能力。为此,本文提出锚点中心协同目标检测框架(ACCO),通过三个核心组件实现:(1) 锚点特征块(AFB)生成锚点提案并投影锚点查询至图像特征;(2) 锚点置信度生成器(ACG)仅传输高置信度锚点的特征,减少通信量;(3) 局部-全局融合模块,包含基于锚点对齐的局部融合(LAAF)和空间感知交叉注意力(SACA),二者分层迭代执行,实现锚点提议的动态优化。在OPV2V和Dair-V2X数据集上的大量实验表明,ACCO有效降低通信开销,扩大感知范围,并提升检测性能。代码已开源。

原文摘要 · Abstract (English)

Collaborative perception in multi-agent system enhances overall perceptual capabilities by facilitating the exchange of complementary information among agents. Current mainstream collaborative perception methods rely on discretized feature maps to conduct fusion, which however, lacks flexibility in extracting and transmitting the informative features and can hardly focus on the informative features during fusion. To address these problems, this paper proposes a novel Anchor-Centric paradigm for Collaborative Object detection (ACCO). It avoids grid precision issues and allows more flexible and efficient anchor-centric communication and fusion. ACCO is composed by three main components: (1) Anchor featuring block (AFB) that targets to generate anchor proposals and projects prepared anchor queries to image features. (2) Anchor confidence generator (ACG) is designed to minimize communication by selecting only the features in the confident anchors to transmit. (3) A local-global fusion module, in which local fusion is anchor alignment-based fusion (LAAF) and global fusion is conducted by spatial-aware cross-attention (SACA). LAAF and SACA run in multi-layers, so agents conduct anchor-centric fusion iteratively to adjust the anchor proposals. Comprehensive experiments are conducted to evaluate ACCO on OPV2V and Dair-V2X datasets, which demonstrate ACCO's superiority in reducing the communication volume, and in improving the perception range and detection performances. Code can be found at: \href{https://github.com/sidiangongyuan/ACCO}{https://github.com/sidiangongyuan/ACCO}.

协同感知目标检测低通信多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。