用Transformer模型精准填补轨迹缺失,兼顾时空一致性。
TrajGPT: Controlled Synthetic Trajectory Generation Using a Multitask Transformer-Based Spatiotemporal Model
- 借鉴语言模型思路,将轨迹补全视为文本填空
- 时空联合建模,时间预测准确率提升26倍,空间准确率超98%
- 适合城市规划、疫情传播模拟等需精准轨迹生成的场景
人类移动性建模与合成轨迹生成在城市规划、灾害应对和流行病学中至关重要。这两项任务常需填补部分指定访问序列中的空白,我们称之为“可控”合成轨迹生成。现有方法因缺乏约束生成序列的能力而无法解决此问题。此外,现有方法(1)常将时空视为独立因素,这在真实场景中不成立;(2)在时间预测上存在精度挑战,未能处理混合分布及隐变量(如星期几)带来的多模式关系。这些局限在填补序列空白时尤为突出。本文提出TrajGPT,一种基于Transformer的多任务联合时空生成模型。受大语言模型启发,将可控轨迹生成问题转化为自然语言中的文本填空。通过贝叶斯概率模型在Transformer架构中融合时空模块,确保访问序列填补具有时空一致性。在公开与私有数据集上的实验表明,TrajGPT不仅在可控合成轨迹生成上表现优异,还在下一位置预测任务中超越对比模型:相对而言,时间预测准确率提升26倍,平均空间准确率保持在98%以上。
原文摘要 · Abstract (English)
Human mobility modeling from GPS-trajectories and synthetic trajectory generation are crucial for various applications, such as urban planning, disaster management and epidemiology. Both of these tasks often require filling gaps in a partially specified sequence of visits - a new problem that we call "controlled" synthetic trajectory generation. Existing methods for next-location prediction or synthetic trajectory generation cannot solve this problem as they lack the mechanisms needed to constrain the generated sequences of visits. Moreover, existing approaches (1) frequently treat space and time as independent factors, an assumption that fails to hold true in real-world scenarios, and (2) suffer from challenges in accuracy of temporal prediction as they fail to deal with mixed distributions and the inter-relationships of different modes with latent variables (e.g., day-of-the-week). These limitations become even more pronounced when the task involves filling gaps within sequences instead of solely predicting the next visit. We introduce TrajGPT, a transformer-based, multi-task, joint spatiotemporal generative model to address these issues. Taking inspiration from large language models, TrajGPT poses the problem of controlled trajectory generation as that of text infilling in natural language. TrajGPT integrates the spatial and temporal models in a transformer architecture through a Bayesian probability model that ensures that the gaps in a visit sequence are filled in a spatiotemporally consistent manner. Our experiments on public and private datasets demonstrate that TrajGPT not only excels in controlled synthetic visit generation but also outperforms competing models in next-location prediction tasks - Relatively, TrajGPT achieves a 26-fold improvement in temporal accuracy while retaining more than 98% of spatial accuracy on average.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。