arXiv:2505.15703cs.CVcs.AI2025-05被引 6

将场景理解与未来轨迹预测联合建模,提升自动驾驶预测精度。

HAMF: A Hybrid Attention-Mamba Framework for Joint Scene Context Understanding and Future Motion Representation Learning

  • 用注意力机制统一建模场景与未来轨迹特征
  • 在Argoverse 2上实现最新最优性能
  • 适合关注自动驾驶轨迹预测的研究者

运动预测是自动驾驶系统中的关键挑战,需准确预测周围交通参与者未来的轨迹。现有方法虽从历史轨迹和道路布局中提取场景特征进行预测,但存在特征编码过程中的信息衰减问题。为此,我们提出HAMF——一种新型运动预测框架,通过联合学习场景上下文编码与未来运动表示,实现场景理解与轨迹预测的协同优化。首先将观测到的车辆状态和地图信息嵌入为一维标记序列,并将目标多模态未来运动特征作为可学习标记。随后设计统一的基于注意力的编码器,协同使用自注意力与交叉注意力机制,联合建模场景上下文信息并聚合未来运动特征。解码阶段引入Mamba模块,进一步保持已学习运动表示之间的一致性与相关性,生成更准确且多样化的最终轨迹。在Argoverse 2基准上的大量实验表明,该混合注意力-Mamba模型以简单轻量的架构实现了当前最优的运动预测性能。

原文摘要 · Abstract (English)

Motion forecasting represents a critical challenge in autonomous driving systems, requiring accurate prediction of surrounding agents' future trajectories. While existing approaches predict future motion states with the extracted scene context feature from historical agent trajectories and road layouts, they suffer from the information degradation during the scene feature encoding. To address the limitation, we propose HAMF, a novel motion forecasting framework that learns future motion representations with the scene context encoding jointly, to coherently combine the scene understanding and future motion state prediction. We first embed the observed agent states and map information into 1D token sequences, together with the target multi-modal future motion features as a set of learnable tokens. Then we design a unified Attention-based encoder, which synergistically combines self-attention and cross-attention mechanisms to model the scene context information and aggregate future motion features jointly. Complementing the encoder, we implement the Mamba module in the decoding stage to further preserve the consistency and correlations among the learned future motion representations, to generate the accurate and diverse final trajectories. Extensive experiments on Argoverse 2 benchmark demonstrate that our hybrid Attention-Mamba model achieves state-of-the-art motion forecasting performance with the simple and lightweight architecture.

自动驾驶轨迹预测注意力机制Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。