基于场景感知的轻量级行人轨迹预测模型,兼顾环境与交互信息。
ASTRA: A Scene-aware TRAnsformer-based model for trajectory prediction
- 融合场景、社交互动与时间动态的图注意力编码器
- 在ETH-UCY和PIE数据集上分别提升27%/10%和26%
- 参数量仅为当前最优模型的1/7,支持多视角输入
我们提出ASTRA(Scene-aware TRAnsformer-based model for trajectory prediction),一种轻量级行人轨迹预测模型,通过整合场景上下文、空间动力学、社会交互关系与时间演化过程,实现高精度预测。采用基于U-Net的特征提取器捕获场景表征,结合图感知变压器编码器建模社交互动,生成代理-场景感知嵌入,以学习空间动态并预测未来轨迹。模型支持确定性与随机性输出,后者通过条件变分自编码器(CVAE)实现。提出一种简单有效的加权惩罚损失函数,显著提升预测性能。在ETH-UCY数据集上,确定性与随机性设置下平均提升27%和10%;在PIE数据集上提升26%。模型参数量仅为现有最先进模型的七分之一(见图1)。此外,该模型具备跨视角泛化能力,适用于鸟瞰图(BEV)与车体视角(EVV)。
原文摘要 · Abstract (English)
We present ASTRA (A} Scene-aware TRAnsformer-based model for trajectory prediction), a light-weight pedestrian trajectory forecasting model that integrates the scene context, spatial dynamics, social inter-agent interactions and temporal progressions for precise forecasting. We utilised a U-Net-based feature extractor, via its latent vector representation, to capture scene representations and a graph-aware transformer encoder for capturing social interactions. These components are integrated to learn an agent-scene aware embedding, enabling the model to learn spatial dynamics and forecast the future trajectory of pedestrians. The model is designed to produce both deterministic and stochastic outcomes, with the stochastic predictions being generated by incorporating a Conditional Variational Auto-Encoder (CVAE). ASTRA also proposes a simple yet effective weighted penalty loss function, which helps to yield predictions that outperform a wide array of state-of-the-art deterministic and generative models. ASTRA demonstrates an average improvement of 27%/10% in deterministic/stochastic settings on the ETH-UCY dataset, and 26% improvement on the PIE dataset, respectively, along with seven times fewer parameters than the existing state-of-the-art model (see Figure 1). Additionally, the model's versatility allows it to generalize across different perspectives, such as Bird's Eye View (BEV) and Ego-Vehicle View (EVV).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。