arXiv:2410.10524cs.LGcs.AI2024-10NeurIPS被引 18

提出连续多任务时空学习框架,让城市智能系统持续适应新环境。

Get Rid of Isolation: A Continuous Multi-task Spatio-Temporal Learning Framework

  • 设计多维时空交互网络,捕捉不同任务间的共性与个性化特征。
  • 在三座城市数据集上实现比现有最优方法更高的准确率,尤其在少样本和新领域任务中。
  • 适合需要长期学习和跨域适应的城市计算、交通预测等场景。

时空学习已成为实现城市智能的关键技术。传统模型通常针对特定任务,假设训练与测试分布一致,但城市系统动态性强、多源异构且数据分布不均衡,导致现有单任务模型难以泛化到新城市环境或适应新领域。为此,本文提出连续多任务时空学习框架(CMuST),将城市时空学习从单域转向协同的多维多任务学习。CMuST引入多维时空交互网络(MSTI),实现上下文与主观测之间的跨维度交互,以及空间与时间维度内的自交互,以揭示任务级共性和个性化特征。为支持持续学习,设计滚动适应训练方案(RoAda),通过数据摘要驱动的任务提示保留任务独特性,并通过迭代模型行为建模挖掘任务间相关性。我们在三个城市建立多任务时空学习基准,实验证明CMuST在少样本流式数据和新领域任务上显著优于现有最先进方法。代码已开源。

原文摘要 · Abstract (English)

Spatiotemporal learning has become a pivotal technique to enable urban intelligence. Traditional spatiotemporal models mostly focus on a specific task by assuming a same distribution between training and testing sets. However, given that urban systems are usually dynamic, multi-sourced with imbalanced data distributions, current specific task-specific models fail to generalize to new urban conditions and adapt to new domains without explicitly modeling interdependencies across various dimensions and types of urban data. To this end, we argue that there is an essential to propose a Continuous Multi-task Spatio-Temporal learning framework (CMuST) to empower collective urban intelligence, which reforms the urban spatiotemporal learning from single-domain to cooperatively multi-dimensional and multi-task learning. Specifically, CMuST proposes a new multi-dimensional spatiotemporal interaction network (MSTI) to allow cross-interactions between context and main observations as well as self-interactions within spatial and temporal aspects to be exposed, which is also the core for capturing task-level commonality and personalization. To ensure continuous task learning, a novel Rolling Adaptation training scheme (RoAda) is devised, which not only preserves task uniqueness by constructing data summarization-driven task prompts, but also harnesses correlated patterns among tasks by iterative model behavior modeling. We further establish a benchmark of three cities for multi-task spatiotemporal learning, and empirically demonstrate the superiority of CMuST via extensive evaluations on these datasets. The impressive improvements on both few-shot streaming data and new domain tasks against existing SOAT methods are achieved. Code is available at https://github.com/DILab-USTCSZ/CMuST.

多任务学习时空建模城市智能持续学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。