arXiv:2502.16589cs.LGcs.AI2025-02ICRA被引 22

利用V2X融合多时序信息,提升自动驾驶轨迹预测精度。

Co-MTP: A Cooperative Trajectory Prediction Framework with Multi-Temporal Fusion for Autonomous Driving

  • 设计异构图变压器融合多车历史与未来交互特征
  • 在真实数据集V2X-Seq上达到当前最佳性能
  • 适合需要高精度协同感知的自动驾驶系统

车联网技术(V2X)已成为扩展感知范围、克服遮挡问题的理想方案。现有研究多集中于单帧协同感知,但如何利用V2X捕捉帧间时序线索以支持轨迹预测甚至规划任务仍待探索。本文提出Co-MTP框架,一种基于多时序融合的通用协同轨迹预测方法。在历史域中,V2X可补全单车感知的不完整历史轨迹,采用异构图变压器学习多智能体历史特征融合并捕获历史交互;在未来的规划需求驱动下,V2X可提供周围物体的预测结果,进一步扩展图变压器以捕获自车规划与其它车辆意图之间的未来交互,获得特定规划动作下的最终未来场景状态。在真实世界数据集V2X-Seq上的评估表明,Co-MTP达到当前最优性能,且历史与未来融合均显著提升预测效果。

原文摘要 · Abstract (English)

Vehicle-to-everything technologies (V2X) have become an ideal paradigm to extend the perception range and see through the occlusion. Exiting efforts focus on single-frame cooperative perception, however, how to capture the temporal cue between frames with V2X to facilitate the prediction task even the planning task is still underexplored. In this paper, we introduce the Co-MTP, a general cooperative trajectory prediction framework with multi-temporal fusion for autonomous driving, which leverages the V2X system to fully capture the interaction among agents in both history and future domains to benefit the planning. In the history domain, V2X can complement the incomplete history trajectory in single-vehicle perception, and we design a heterogeneous graph transformer to learn the fusion of the history feature from multiple agents and capture the history interaction. Moreover, the goal of prediction is to support future planning. Thus, in the future domain, V2X can provide the prediction results of surrounding objects, and we further extend the graph transformer to capture the future interaction among the ego planning and the other vehicles' intentions and obtain the final future scenario state under a certain planning action. We evaluate the Co-MTP framework on the real-world dataset V2X-Seq, and the results show that Co-MTP achieves state-of-the-art performance and that both history and future fusion can greatly benefit prediction.

自动驾驶轨迹预测V2X图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。