arXiv:2409.00904cs.CVcs.AI2024-09被引 17

解决车辆轨迹缺失问题,提升自动驾驶预测精度。

Multi-scale Temporal Fusion Transformer for Incomplete Vehicle Trajectory Prediction

  • 分多尺度并行捕捉轨迹运动特征,缓解数据缺失影响。
  • 融合时序连续性信息,使预测轨迹更符合真实运动趋势。
  • 在四个真实场景数据集上性能提升超39%,适合交通预测应用。

运动预测在自动驾驶系统中至关重要,可基于周围车辆的轨迹预测实现更精准的局部路径规划与驾驶决策。然而,现有方法忽视了因目标遮挡、感知故障等导致的轨迹缺失问题,这在真实交通场景中不可避免地降低预测性能。为此,本文提出一种新型端到端不完整车辆轨迹预测框架——多尺度时间融合变压器(MTFT),包含多尺度注意力头(MAH)和连续性表征引导的多尺度融合(CRMF)模块。MAH利用多头注意力机制,从不同时间粒度并行捕捉轨迹的多尺度运动表征,有效缓解缺失值对预测的负面影响。随后,多尺度运动表征输入至CRMF模块进行融合,提取鲁棒的时间特征。融合过程中,先提取车辆运动在时间步上的连续性表征以引导融合,确保所得时序特征同时包含细节信息与整体运动趋势,从而促进未来轨迹的准确解码,且与车辆运动趋势一致。在四个源自高速公路与城市交通场景的数据集上评估,实验结果表明,相比现有最优模型,该方法在HighD数据集上综合性能提升超过39%。

原文摘要 · Abstract (English)

Motion prediction plays an essential role in autonomous driving systems, enabling autonomous vehicles to achieve more accurate local-path planning and driving decisions based on predictions of the surrounding vehicles. However, existing methods neglect the potential missing values caused by object occlusion, perception failures, etc., which inevitably degrades the trajectory prediction performance in real traffic scenarios. To address this limitation, we propose a novel end-to-end framework for incomplete vehicle trajectory prediction, named Multi-scale Temporal Fusion Transformer (MTFT), which consists of the Multi-scale Attention Head (MAH) and the Continuity Representation-guided Multi-scale Fusion (CRMF) module. Specifically, the MAH leverages the multi-head attention mechanism to parallelly capture multi-scale motion representation of trajectory from different temporal granularities, thus mitigating the adverse effect of missing values on prediction. Furthermore, the multi-scale motion representation is input into the CRMF module for multi-scale fusion to obtain the robust temporal feature of the vehicle. During the fusion process, the continuity representation of vehicle motion is first extracted across time steps to guide the fusion, ensuring that the resulting temporal feature incorporates both detailed information and the overall trend of vehicle motion, which facilitates the accurate decoding of future trajectory that is consistent with the vehicle's motion trend. We evaluate the proposed model on four datasets derived from highway and urban traffic scenarios. The experimental results demonstrate its superior performance in the incomplete vehicle trajectory prediction task compared with state-of-the-art models, e.g., a comprehensive performance improvement of more than 39% on the HighD dataset.

轨迹预测自动驾驶多尺度融合缺失数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。