arXiv:2506.18939cs.LGcs.AI2025-06中稿 · ICDE 2026被引 5

用高效Mamba模型解决城市时空预测跨域泛化难题

Damba-ST: Domain-Adaptive Mamba for Efficient Urban Spatio-Temporal Prediction

  • 设计领域自适应Mamba架构,分离共享与领域特异性特征空间
  • 在多个城市数据集上实现领先性能,零样本迁移效果显著
  • 适合需要快速部署到新城市的智慧城市系统开发者

训练能跨区域泛化的城市时空基础模型对在未知或数据稀疏地区部署城市服务至关重要。现有研究多采用融合多域时空数据的统一Transformer模型,但其存在二次计算复杂度和高内存开销,限制了可扩展性与实际应用。受线性复杂度的Mamba状态空间模型启发,本文探索其在高效城市时空预测中的潜力。然而,直接使用Mamba作为时空主干会导致负迁移和严重性能下降,主要源于时空异质性及Mamba隐藏状态递归更新机制对跨域泛化的限制。为此,提出Damba-ST,一种新型领域自适应的Mamba模型。该模型保留线性复杂度优势,同时大幅提升跨域适应能力:(1) 设计领域自适应状态空间模型,将隐表示空间划分为共享子空间(学习跨域共性)和独立领域特异子空间(捕捉域内差异特征);(2) 引入三种不同结构的领域适配器,作为领域感知代理,弥合不同领域分布差异,促进跨域共性对齐。大量实验表明,Damba-ST具备优异的泛化能力与效率,在多项预测任务中达到当前最优表现,并展现出强大的零样本泛化能力,可在无需大量重训练或微调的情况下无缝部署至新城市环境。

原文摘要 · Abstract (English)

Training urban spatio-temporal foundation models that generalize well across diverse regions and cities is critical for deploying urban services in unseen or data-scarce regions. Recent studies have typically focused on fusing cross-domain spatio-temporal data to train unified Transformer-based models. However, these models suffer from quadratic computational complexity and high memory overhead, limiting their scalability and practical deployment. Inspired by the efficiency of Mamba, a state space model with linear time complexity, we explore its potential for efficient urban spatio-temporal prediction. However, directly applying Mamba as a spatio-temporal backbone leads to negative transfer and severe performance degradation. This is primarily due to spatio-temporal heterogeneity and the recursive mechanism of Mamba's hidden state updates, which limit cross-domain generalization. To overcome these challenges, we propose Damba-ST, a novel domain-adaptive Mamba-based model for efficient urban spatio-temporal prediction. Damba-ST retains Mamba's linear complexity advantage while significantly enhancing its adaptability to heterogeneous domains. Specifically, we introduce two core innovations: (1) a domain-adaptive state space model that partitions the latent representation space into a shared subspace for learning cross-domain commonalities and independent, domain-specific subspaces for capturing intra-domain discriminative features; (2) three distinct Domain Adapters, which serve as domain-aware proxies to bridge disparate domain distributions and facilitate the alignment of cross-domain commonalities. Extensive experiments demonstrate the generalization and efficiency of Damba-ST. It achieves state-of-the-art performance on prediction tasks and demonstrates strong zero-shot generalization, enabling seamless deployment in new urban environments without extensive retraining or fine-tuning.

城市预测Mamba跨域泛化高效建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。