arXiv:2502.11003cs.CV2025-02中稿 · JCRAI 2024

解决多智能体协作感知中的位姿噪声问题,提升环境理解精度。

FeaKM: Robust Collaborative Perception under Noisy Pose Conditions

  • 通过特征级关键点匹配校正智能体间位姿差异
  • 在DAIR-V2X数据集上显著超越现有方法
  • 适合自动驾驶等需要高精度协同感知的场景

协作感知对感知能力有限的智能体网络至关重要,可通过信息交换实现对环境的鲁棒、全面理解。然而,定位不准确常导致空间信息传递出现偏差,削弱协作效果。为此,我们提出FeaKM,一种基于特征级关键点匹配的新方法,有效纠正协作智能体间的位姿差异。首先利用置信度图从中间特征表示中识别并提取显著点,计算其描述符,确保系统聚焦于最相关信息,提升匹配精度。随后采用目标匹配策略生成分配矩阵,关联不同智能体检测到的关键点,建立准确对应关系,这对有效协作至关重要。最后,通过细粒度变换矩阵同步所有智能体特征,确定其相对状态,保障通信一致性。实验结果表明,FeaKM在DAIR-V2X数据集上显著优于现有方法,即使在严重噪声条件下仍具鲁棒性。

原文摘要 · Abstract (English)

Collaborative perception is essential for networks of agents with limited sensing capabilities, enabling them to work together by exchanging information to achieve a robust and comprehensive understanding of their environment. However, localization inaccuracies often lead to significant spatial message displacement, which undermines the effectiveness of these collaborative efforts. To tackle this challenge, we introduce FeaKM, a novel method that employs Feature-level Keypoints Matching to effectively correct pose discrepancies among collaborating agents. Our approach begins by utilizing a confidence map to identify and extract salient points from intermediate feature representations, allowing for the computation of their descriptors. This step ensures that the system can focus on the most relevant information, enhancing the matching process. We then implement a target-matching strategy that generates an assignment matrix, correlating the keypoints identified by different agents. This is critical for establishing accurate correspondences, which are essential for effective collaboration. Finally, we employ a fine-grained transformation matrix to synchronize the features of all agents and ascertain their relative statuses, ensuring coherent communication among them. Our experimental results demonstrate that FeaKM significantly outperforms existing methods on the DAIR-V2X dataset, confirming its robustness even under severe noise conditions. The code and implementation details are available at https://github.com/uestchjw/FeaKM.

协同感知位姿估计自动驾驶特征匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。