用状态空间模型替代注意力机制,实现高效精准的车辆轨迹预测。
Trajectory Mamba: Efficient Attention-Mamba Forecasting Model Based on Selective SSM
- 用选择性状态空间模型重构编码器-解码器结构,时间复杂度线性下降。
- 在Argoverse数据集上推理速度提升4倍,参数量减少40%以上。
- 适合需要实时推理的自动驾驶场景,尤其关注效率与精度平衡者。
运动预测对自动驾驶至关重要,可基于历史输入准确预测未来车辆轨迹。本文提出Trajectory Mamba,一种基于选择性状态空间模型(SSM)的新颖高效轨迹预测框架。传统注意力模型随目标数增加导致计算开销呈二次增长,难以应用于高动态环境。为此,我们利用SSM重设计编码器-解码器中的自注意力机制,实现线性时间复杂度。为弥补注意力机制修改可能带来的精度下降,提出联合多段线编码策略,更好捕捉静态与动态上下文关联,提升预测精度。此外,为平衡精度与推理速度,解码器结构完全区别于编码器,通过跨状态空间注意力,所有目标代理共享场景上下文,使SSM在解码阶段与共享场景表征交互,从而推断不同未来轨迹。在Argoverse 1和Argoverse 2数据集上,该模型在推理速度与参数效率方面达到当前最优,相比现有方法减少4倍浮点运算量(FLOPs),参数量降低超40%,且性能超越多数先前方法。结果验证了Trajectory Mamba在轨迹预测任务中的有效性。
原文摘要 · Abstract (English)
Motion prediction is crucial for autonomous driving, as it enables accurate forecasting of future vehicle trajectories based on historical inputs. This paper introduces Trajectory Mamba, a novel efficient trajectory prediction framework based on the selective state-space model (SSM). Conventional attention-based models face the challenge of computational costs that grow quadratically with the number of targets, hindering their application in highly dynamic environments. In response, we leverage the SSM to redesign the self-attention mechanism in the encoder-decoder architecture, thereby achieving linear time complexity. To address the potential reduction in prediction accuracy resulting from modifications to the attention mechanism, we propose a joint polyline encoding strategy to better capture the associations between static and dynamic contexts, ultimately enhancing prediction accuracy. Additionally, to balance prediction accuracy and inference speed, we adopted the decoder that differs entirely from the encoder. Through cross-state space attention, all target agents share the scene context, allowing the SSM to interact with the shared scene representation during decoding, thus inferring different trajectories over the next prediction steps. Our model achieves state-of-the-art results in terms of inference speed and parameter efficiency on both the Argoverse 1 and Argoverse 2 datasets. It demonstrates a four-fold reduction in FLOPs compared to existing methods and reduces parameter count by over 40% while surpassing the performance of the vast majority of previous methods. These findings validate the effectiveness of Trajectory Mamba in trajectory prediction tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。