用预训练语言模型恢复稀疏轨迹,提升精度与泛化能力
PLMTrajRec: A Scalable and Generalizable Trajectory Recovery Method with Pre-trained Language Models
- 将采样间隔转为自然语言输入,让语言模型理解不同时间跨度
- 在两个数据集上三种采样间隔下均实现优于基线的恢复准确率
- 适合交通分析、轨迹补全等需要高鲁棒性恢复的场景
时空轨迹数据对诸多应用至关重要。然而设备故障与网络不稳定常导致轨迹稀疏,丢失详细运动信息。恢复稀疏轨迹中的缺失点以还原完整运动过程十分关键。现有方法仍面临三大挑战:缺乏大规模稠密轨迹数据,难以从零训练恢复模型;不同采样间隔带来多变的时空相关性,影响泛化能力;缺少位置信息,难以获取缺失点处的道路状况。为此,我们提出新型轨迹恢复模型PLMTrajRec,利用预训练语言模型(PLM)的可扩展性,仅需少量稠密轨迹即可微调。针对不同采样间隔,我们将采样间隔与运动特征转换为自然语言表示,使PLM识别时间跨度。引入轨迹编码器,统一不同时段轨迹至同一间隔,并捕捉其时空关系。为获取缺失点道路状况,提出区域流量引导的隐式轨迹提示,通过收集各区域交通流量建模道路状态;并设计道路状态传递机制,利用观测点状态推断缺失点状态。在两个公开轨迹数据集上,每种数据集设置三种采样间隔,实验验证了PLMTrajRec在有效性、可扩展性与泛化能力上的优势。
原文摘要 · Abstract (English)
Spatiotemporal trajectory data is crucial for various applications. However, issues such as device malfunctions and network instability often cause sparse trajectories, leading to lost detailed movement information. Recovering the missing points in sparse trajectories to restore the detailed information is thus essential. Despite recent progress, several challenges remain. First, the lack of large-scale dense trajectory data makes it difficult to train a trajectory recovery model from scratch. Second, the varying spatiotemporal correlations in sparse trajectories make it hard to generalize recovery across different sampling intervals. Third, the lack of location information complicates the extraction of road conditions for missing points. To address these challenges, we propose a novel trajectory recovery model called PLMTrajRec. It leverages the scalability of a pre-trained language model (PLM) and can be fine-tuned with only a limited set of dense trajectories. To handle different sampling intervals in sparse trajectories, we first convert each trajectory's sampling interval and movement features into natural language representations, allowing the PLM to recognize its interval. We then introduce a trajectory encoder to unify trajectories of varying intervals into a single interval and capture their spatiotemporal relationships. To obtain road conditions for missing points, we propose an area flow-guided implicit trajectory prompt, which models road conditions by collecting traffic flows in each region. We also introduce a road condition passing mechanism that uses observed points' road conditions to infer those of the missing points. Experiments on two public trajectory datasets with three sampling intervals each demonstrate the effectiveness, scalability, and generalization ability of PLMTrajRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。