用几何特征和自监督视觉表征预测室内人行轨迹,效果优于现有方法。
SITUATE: Indoor Human Trajectory Prediction through Geometric Features and Self-Supervised Vision Representation
- 结合等变/不变几何特征建模室内运动规律
- 在THÖR和Supermarket数据集上达到顶尖性能
- 模型泛化能力强,室外场景也表现良好
由于环境范围与人群意图差异,室内外人类运动模式显著不同。尽管室外轨迹预测已受广泛关注,但室内预测仍属研究空白。本文提出SITUATE,通过利用等变与不变的几何特征以及自监督视觉表征来应对室内人行轨迹预测问题。几何学习模块捕捉室内空间固有的对称性与运动模式,尤其适用于包含多尺度自环和快速转向的轨迹。视觉表征模块则提取环境的空间语义信息,提升未来位置预测精度。我们在两大知名室内轨迹数据集THÖR和Supermarket上进行了全面实验,取得当前最优性能。此外,在室外场景中也获得有竞争力的结果,表明面向室内的模型具有更强的泛化能力。代码已开源:https://github.com/intelligolabs/SITUATE。
原文摘要 · Abstract (English)
Patterns of human motion in outdoor and indoor environments are substantially different due to the scope of the environment and the typical intentions of people therein. While outdoor trajectory forecasting has received significant attention, indoor forecasting is still an underexplored research area. This paper proposes SITUATE, a novel approach to cope with indoor human trajectory prediction by leveraging equivariant and invariant geometric features and a self-supervised vision representation. The geometric learning modules model the intrinsic symmetries and human movements inherent in indoor spaces. This concept becomes particularly important because self-loops at various scales and rapid direction changes often characterize indoor trajectories. On the other hand, the vision representation module is used to acquire spatial-semantic information about the environment to predict users' future locations more accurately. We evaluate our method through comprehensive experiments on the two most famous indoor trajectory forecasting datasets, i.e., THÖR and Supermarket, obtaining state-of-the-art performance. Furthermore, we also achieve competitive results in outdoor scenarios, showing that indoor-oriented forecasting models generalize better than outdoor-oriented ones. The source code is available at https://github.com/intelligolabs/SITUATE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。