arXiv:2409.08840cs.CV2024-09ICRA被引 20

让自动驾驶车主动聚焦关键方向,提升感知精度。

Directed-CP: Directed Collaborative Perception for Connected and Autonomous Vehicles via Proactive Attention

  • 通过主动标记关注方向,智能分配感知资源。
  • 在关键方向上感知准确率提升19.8%,整体提升2.5%。
  • 适合车联网中通信带宽受限的实时感知场景。

协同感知(CP)利用联网自动驾驶车辆(CAV)的视觉数据扩展自身视场(FoV)。现有方法通常均等扩展360度感知范围,面临两大挑战:一是在交通分布不均区域,关注低流量方向收益有限;二是受限于通信预算,向非关键方向分配过多带宽会降低关键区域的感知精度。为此,我们提出Directed-CP,一种主动、定向的协同感知系统,旨在提升特定方向的感知性能。核心思想是使主车主动指示关注方向,并动态调整注意力以增强局部感知效果。我们设计了基于路侧单元(RSU)的方向掩码机制,辅助主车识别关键方向;提出方向感知的选择性注意力模块,根据主车优先级、通信预算及CAV位置数据,智能聚合相关特征;并引入方向加权检测损失(DWLoss),捕捉不同方向感知结果与真实值的差异,支持有效训练。在V2X-Sim 2.0数据集上的大量实验表明,该方法在感兴趣方向的局部感知准确率比当前最优方法高19.8%,整体感知准确率提升2.5%。代码已开源:https://github.com/yihangtao/Directed-CP.git。

原文摘要 · Abstract (English)

Collaborative perception (CP) leverages visual data from connected and autonomous vehicles (CAV) to enhance an ego vehicle's field of view (FoV). Despite recent progress, current CP methods expand the ego vehicle's 360-degree perceptual range almost equally, which faces two key challenges. Firstly, in areas with uneven traffic distribution, focusing on directions with little traffic offers limited benefits. Secondly, under limited communication budgets, allocating excessive bandwidth to less critical directions lowers the perception accuracy in more vital areas. To address these issues, we propose Direct-CP, a proactive and direction-aware CP system aiming at improving CP in specific directions. Our key idea is to enable an ego vehicle to proactively signal its interested directions and readjust its attention to enhance local directional CP performance. To achieve this, we first propose an RSU-aided direction masking mechanism that assists an ego vehicle in identifying vital directions. Additionally, we design a direction-aware selective attention module to wisely aggregate pertinent features based on ego vehicle's directional priorities, communication budget, and the positional data of CAVs. Moreover, we introduce a direction-weighted detection loss (DWLoss) to capture the divergence between directional CP outcomes and the ground truth, facilitating effective model training. Extensive experiments on the V2X-Sim 2.0 dataset demonstrate that our approach achieves 19.8\% higher local perception accuracy in interested directions and 2.5\% higher overall perception accuracy than the state-of-the-art methods in collaborative 3D object detection tasks. Codes are available at https://github.com/yihangtao/Directed-CP.git.

协同感知自动驾驶方向注意力车联网

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。