用大规模移动数据训练通用城市感知模型,实现动态人流分析。
JiuTian Chuanliu: A Large Spatiotemporal Model for General-purpose Dynamic Urban Sensing
- 构建动态图模型,将人与区域视为节点,建模时空交互关系。
- 自监督学习自动提取通用移动特征,在多任务上表现优异。
- 适合城市规划、交通管理等需要全局人流理解的场景。
作为城市感知的窗口,人类移动性蕴含丰富的时空信息,反映居民行为偏好与城市功能。现有方法多针对特定任务,难以全面建模移动性且知识迁移能力有限。本文提出将海量移动数据注入时空模型,挖掘行为背后隐含语义,支持多种城市感知任务。通过遍布的基站系统采集大规模覆盖的人类移动数据,提出通用动态人类移动嵌入框架(GDHME)。该框架采用自监督学习,第一阶段将人与区域建模为动态图中节点,以连续时间编码器动态计算节点表征,捕捉人与区域的演化状态,并设计自回归自监督任务引导通用嵌入学习;第二阶段利用这些表征支持各类下游任务。为评估效果,构建多任务城市感知基准。离线实验表明,GDHME能从海量数据中自动学习有价值节点特征。此外,本框架已应用于部署「九天传流」大模型,该系统于2023年中国移动全球合作伙伴大会亮相。
原文摘要 · Abstract (English)
As a window for urban sensing, human mobility contains rich spatiotemporal information that reflects both residents' behavior preferences and the functions of urban areas. The analysis of human mobility has attracted the attention of many researchers. However, existing methods often address specific tasks from a particular perspective, leading to insufficient modeling of human mobility and limited applicability of the learned knowledge in various downstream applications. To address these challenges, this paper proposes to push massive amounts of human mobility data into a spatiotemporal model, discover latent semantics behind mobility behavior and support various urban sensing tasks. Specifically, a large-scale and widely covering human mobility data is collected through the ubiquitous base station system and a framework named General-purpose and Dynamic Human Mobility Embedding (GDHME) for urban sensing is introduced. The framework follows the self-supervised learning idea and contains two major stages. In stage 1, GDHME treats people and regions as nodes within a dynamic graph, unifying human mobility data as people-region-time interactions. An encoder operating in continuous-time dynamically computes evolving node representations, capturing dynamic states for both people and regions. Moreover, an autoregressive self-supervised task is specially designed to guide the learning of the general-purpose node embeddings. In stage 2, these representations are utilized to support various tasks. To evaluate the effectiveness of our GDHME framework, we further construct a multi-task urban sensing benchmark. Offline experiments demonstrate GDHME's ability to automatically learn valuable node features from vast amounts of data. Furthermore, our framework is used to deploy the JiuTian ChuanLiu Big Model, a system that has been presented at the 2023 China Mobile Worldwide Partner Conference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。