arXiv:2412.13419cs.ROcs.CV2024-12被引 7

融合Transformer与LSTM,提升轨迹预测中的时空特征学习能力。

Exploring Transformer-Augmented LSTM for Temporal and Spatial Feature Learning in Trajectory Prediction

  • 用LSTM处理时间序列,Transformer捕捉车辆间复杂交互
  • 网格化环境通过掩码散射机制提取邻车空间特征
  • 模型可解释性强,适合需要透明决策的自动驾驶系统

精准的车辆轨迹预测对保障自动驾驶安全高效至关重要。本文探索将基于Transformer的模型与基于LSTM的技术结合,以增强车辆轨迹预测中的时空特征学习能力。提出一种混合模型:利用LSTM进行时间编码,同时采用Transformer编码器捕捉车辆间的复杂交互。在基于网格的环境中,邻车的空间轨迹特征经由掩码散射机制处理,并与车辆自身的时间轨迹数据融合。该联合轨迹数据通过序列LSTM编码和基于Transformer的注意力层进行学习。模型在STA-LSTM、SA-LSTM、CS-LSTM和NaiveLSTM等前代LSTM方法上进行对比测试。结果表明,尽管未超越前代模型性能,但验证了将Transformer与LSTM结合构建可解释轨迹预测模型的潜力。未来工作将探索基于Transformer的替代架构以进一步提升性能。本研究为利用Transformer架构改进轨迹预测模型提供了有前景的方向,有助于构建更鲁棒、可解释的车辆轨迹预测系统。

原文摘要 · Abstract (English)

Accurate vehicle trajectory prediction is crucial for ensuring safe and efficient autonomous driving. This work explores the integration of Transformer based model with Long Short-Term Memory (LSTM) based technique to enhance spatial and temporal feature learning in vehicle trajectory prediction. Here, a hybrid model that combines LSTMs for temporal encoding with a Transformer encoder for capturing complex interactions between vehicles is proposed. Spatial trajectory features of the neighboring vehicles are processed and goes through a masked scatter mechanism in a grid based environment, which is then combined with temporal trajectory of the vehicles. This combined trajectory data are learned by sequential LSTM encoding and Transformer based attention layers. The proposed model is benchmarked against predecessor LSTM based methods, including STA-LSTM, SA-LSTM, CS-LSTM, and NaiveLSTM. Our results, while not outperforming it's predecessor, demonstrate the potential of integrating Transformers with LSTM based technique to build interpretable trajectory prediction model. Future work will explore alternative architectures using Transformer applications to further enhance performance. This study provides a promising direction for improving trajectory prediction models by leveraging transformer based architectures, paving the way for more robust and interpretable vehicle trajectory prediction system.

轨迹预测LSTMTransformer自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。