arXiv:2602.20643cs.LGcs.AI2026-02被引 1

用强化学习增强的Transformer生成城市出行轨迹,解决隐私与数据稀缺难题。

TrajGPT-R: Generating Urban Mobility Trajectory with Reinforcement Learning-Enhanced Generative Pre-trained Transformer

  • 分两阶段训练:先用RL优化轨迹生成,再用逆RL构建奖励模型
  • 在多个数据集上生成轨迹的可靠性和多样性显著优于现有方法
  • 适合交通规划、城市设计等需要仿真数据的研究者使用

出行轨迹对理解城市动态和改善城市规划至关重要,但隐私问题常阻碍数据获取。本研究提出一种生成大规模城市出行轨迹的创新框架,采用基于Transformer的预训练-微调双阶段方法。首先将轨迹生成建模为离线强化学习(RL)问题,并通过降维词表空间实现高效标记;引入逆强化学习(IRL)从历史数据中推断个体出行偏好,捕捉轨迹级奖励信号。随后,利用构建的奖励模型对预训练模型进行微调,有效克服传统基于RL的自回归方法在长程信用分配和稀疏奖励环境下的挑战。在多个数据集上的综合评估表明,该框架在可靠性与多样性方面显著优于现有模型。研究成果不仅推动了城市出行建模的发展,也为城市数据仿真提供了稳健方法,对交通管理与城市规划具有重要意义。代码已开源:https://github.com/Wangjw6/TrajGPT_R。

原文摘要 · Abstract (English)

Mobility trajectories are essential for understanding urban dynamics and enhancing urban planning, yet access to such data is frequently hindered by privacy concerns. This research introduces a transformative framework for generating large-scale urban mobility trajectories, employing a novel application of a transformer-based model pre-trained and fine-tuned through a two-phase process. Initially, trajectory generation is conceptualized as an offline reinforcement learning (RL) problem, with a significant reduction in vocabulary space achieved during tokenization. The integration of Inverse Reinforcement Learning (IRL) allows for the capture of trajectory-wise reward signals, leveraging historical data to infer individual mobility preferences. Subsequently, the pre-trained model is fine-tuned using the constructed reward model, effectively addressing the challenges inherent in traditional RL-based autoregressive methods, such as long-term credit assignment and handling of sparse reward environments. Comprehensive evaluations on multiple datasets illustrate that our framework markedly surpasses existing models in terms of reliability and diversity. Our findings not only advance the field of urban mobility modeling but also provide a robust methodology for simulating urban data, with significant implications for traffic management and urban development planning. The implementation is publicly available at https://github.com/Wangjw6/TrajGPT_R.

轨迹生成强化学习城市计算Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。