arXiv:2411.03859cs.ETcs.AI2024-11NeurIPS被引 25

构建全球轨迹大模型,实现跨区域、多任务的通用轨迹预测。

UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces

  • 基于245万条全球轨迹数据,设计自适应重采样与掩码预训练策略。
  • 在多任务测试中超越现有方法,展现强泛化与可扩展性。
  • 适合交通规划、行为分析等需要通用轨迹理解的场景。

构建通用轨迹基础模型是解决现有轨迹建模方法任务专一、区域依赖和数据敏感性的有效方案。然而,数据准备、预训练策略设计与架构创新面临重大挑战。为此,我们提出UniTraj,通过三项关键创新克服上述问题:第一,构建包含245万条轨迹、跨越70个国家、覆盖数十亿个GPS点的全球最大规模轨迹数据集WorldTrace,提供跨区域建模所需多样性;第二,设计自适应轨迹重采样与自监督轨迹掩码两种新型预训练策略,有效处理不同采样率和质量的异构轨迹数据;第三,设计灵活模型架构,支持多种轨迹任务,精准捕捉复杂运动模式。大量实验表明,UniTraj在多个任务与真实数据集上持续优于现有方法,具备优异的可扩展性、适应性与泛化能力,WorldTrace可作为理想但非唯一训练资源。

原文摘要 · Abstract (English)

Building a universal trajectory foundation model is a promising solution to address the limitations of existing trajectory modeling approaches, such as task specificity, regional dependency, and data sensitivity. Despite its potential, data preparation, pre-training strategy development, and architectural design present significant challenges in constructing this model. Therefore, we introduce UniTraj, a Universal Trajectory foundation model that aims to address these limitations through three key innovations. First, we construct WorldTrace, an unprecedented dataset of 2.45 million trajectories with billions of GPS points spanning 70 countries, providing the diverse geographic coverage essential for region-independent modeling. Second, we develop novel pre-training strategies--Adaptive Trajectory Resampling and Self-supervised Trajectory Masking--that enable robust learning from heterogeneous trajectory data with varying sampling rates and quality. Finally, we tailor a flexible model architecture to accommodate a variety of trajectory tasks, effectively capturing complex movement patterns to support broad applicability. Extensive experiments across multiple tasks and real-world datasets demonstrate that UniTraj consistently outperforms existing methods, exhibiting superior scalability, adaptability, and generalization, with WorldTrace serving as an ideal yet non-exclusive training resource.

轨迹建模大模型时空数据预训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。