arXiv:2411.12164cs.LGcs.AI2024-11NeurIPS被引 15

UrbanDiT用扩散Transformer统一建模城市时空数据,支持多任务零样本预测。

Diffusion Transformers as Open-World Spatiotemporal Foundation Models

  • 将网格与图结构数据转为序列,统一多源输入
  • 支持双向预测、插值、外推等8类任务,零样本性能超多数基线
  • 适合城市计算、交通预测等开放场景研究者使用

城市环境由多样化人类活动和交互带来的复杂时空动态构成。有效建模这些动态对理解与优化城市系统至关重要。本文提出UrbanDiT,一种面向开放世界的城市时空基础模型,首次成功将扩散Transformer扩展至该领域。UrbanDiT开创性地构建了统一框架,整合多种数据源与类型,在不同城市和场景间学习通用时空模式,实现多数据与多任务的统一建模,有效支持广泛时空应用。其核心创新在于精细化的提示学习框架,可自适应生成数据驱动与任务特异性提示,引导模型在各类城市应用中表现优异。该模型具备三大优势:1)将网格与图结构数据统一转化为序列格式;2)通过任务提示支持双向时空预测、时间插值、空间外推及时空补全等任务;3)在开放世界场景中具有良好泛化能力,零样本性能显著优于多数有训练数据的基线模型。UrbanDiT为城市时空领域基础模型设立了新基准。代码与数据集已公开于https://github.com/tsinghua-fib-lab/UrbanDiT。

原文摘要 · Abstract (English)

The urban environment is characterized by complex spatio-temporal dynamics arising from diverse human activities and interactions. Effectively modeling these dynamics is essential for understanding and optimizing urban systems. In this work, we introduce UrbanDiT, a foundation model for open-world urban spatio-temporal learning that successfully scales up diffusion transformers in this field. UrbanDiT pioneers a unified model that integrates diverse data sources and types while learning universal spatio-temporal patterns across different cities and scenarios. This allows the model to unify both multi-data and multi-task learning, and effectively support a wide range of spatio-temporal applications. Its key innovation lies in the elaborated prompt learning framework, which adaptively generates both data-driven and task-specific prompts, guiding the model to deliver superior performance across various urban applications. UrbanDiT offers three advantages: 1) It unifies diverse data types, such as grid-based and graph-based data, into a sequential format; 2) With task-specific prompts, it supports a wide range of tasks, including bi-directional spatio-temporal prediction, temporal interpolation, spatial extrapolation, and spatio-temporal imputation; and 3) It generalizes effectively to open-world scenarios, with its powerful zero-shot capabilities outperforming nearly all baselines with training data. UrbanDiT sets up a new benchmark for foundation models in the urban spatio-temporal domain. Code and datasets are publicly available at https://github.com/tsinghua-fib-lab/UrbanDiT.

城市计算扩散模型时空建模零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。