arXiv:2608.09541cs.CV2026-08中稿 · journal SN Compute…

通过协同感知与预测融合,提升自动驾驶车辆对复杂交通环境的判断能力。

Towards Collaborative Joint Perception and Prediction: Framework, Baseline Evaluation, and Deployment Perspectives

  • 将感知与预测统一建模,减少误差累积和视线遮挡影响。
  • 预测层融合效果差,检测层或追踪层融合更优,性能提升显著。
  • 端到端原型实现34倍压缩通信量,仍保持预测精度优势,适合部署。

联网自动驾驶车辆(CAVs)越来越多地利用车对外通信(V2X)交换多源传感器信息,实现高级协同感知(CP)功能。本文进一步聚焦于协同联合感知与预测(Co-P&P),该范式将感知与运动预测融合,以缓解感知误差累积和视觉遮挡两大长期挑战。我们提出一个概念性框架,旨在提升周边道路使用者的运动预测能力,从而增强复杂动态交通环境中的态势感知。基于前期研究,本工作对比了不同融合策略,为感知与预测模块化设计建立了基线性能。实验表明,预测级融合导致整体系统性能下降,而检测级或追踪级融合表现更优。此外,我们实现了一个最小端到端的Co-P&P原型,采用REN0神经编码器共享点云数据,并结合FutureDet进行联合检测与预测,结果表明协作可提升预测准确性,且神经压缩在约34倍降低通信带宽的同时仍保持该优势。

原文摘要 · Abstract (English)

Connected Autonomous Vehicles (CAVs) increasingly exploit Vehicle-to-Everything (V2X) communication to exchange multi-source sensor information, enabling advanced Collaborative Perception (CP) capabilities. Extending beyond these capabilities, this work focuses on Collaborative Joint Perception and Prediction (Co-P&P), a paradigm that unifies CP with motion prediction to mitigate two persistent challenges: the accumulation of perception errors and visual occlusions. We present a conceptual framework for Collaborative Joint Perception and Prediction (Co-P&P) that improves motion prediction of surrounding road users, thereby enhancing situational awareness in complex and dynamic traffic environments. Building upon our preliminary study, this extended version compares the performance of different fusion strategies and establishes baseline performance for a modular design of perception and prediction. Experimental results show that prediction-level fusion leads to a decline in overall system performance compared to detection-level or tracking-level fusion. We further implement a minimal end-to-end Co-P&P prototype that couples collaborative point-cloud sharing via the RENO neural codec with joint detection-forecasting via FutureDet, showing that collaboration improves forecasting accuracy while neural compression preserves this benefit at roughly 34x lower communication bandwidth.

协同感知运动预测车联网端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。