arXiv:2501.00305cs.LG2025-01

提出diffIRM框架,提升图结构时空预测的分布外泛化能力。

diffIRM: A Diffusion-Augmented Invariant Risk Minimization Framework for Spatiotemporal Prediction over Graphs

  • 用因果掩码与图扩散模型生成多样化环境数据
  • 在真实人类移动数据集上显著优于基线方法
  • 适合需要鲁棒时空预测的交通、城市规划场景

基于图的时空预测(STPG)面临分布外(OOD)泛化挑战,测试数据分布与训练数据差异大。现有不变风险最小化(IRM)方法主要针对欧式数据,难以适应图结构数据中的空间相关性。当前图级OOD方法多依赖不变性或环境多样性之一,缺乏二者结合。本文提出扩散增强的不变风险最小化框架(diffIRM),融合双重原则:首先通过因果掩码生成器识别因果特征,再以图扩散模型生成扩展环境数据;其次在增强数据上设计不变性惩罚项,作为正则项训练预测模型。实验使用SafeGraph、PeMS04和PeMS08三个真实人类移动数据集,结果表明diffIRM在多个指标上超越基线方法。

原文摘要 · Abstract (English)

Spatiotemporal prediction over graphs (STPG) is challenging, because real-world data suffers from the Out-of-Distribution (OOD) generalization problem, where test data follow different distributions from training ones. To address this issue, Invariant Risk Minimization (IRM) has emerged as a promising approach for learning invariant representations across different environments. However, IRM and its variants are originally designed for Euclidean data like images, and may not generalize well to graph-structure data such as spatiotemporal graphs due to spatial correlations in graphs. To overcome the challenge posed by graph-structure data, the existing graph OOD methods adhere to the principles of invariance existence, or environment diversity. However, there is little research that combines both principles in the STPG problem. A combination of the two is crucial for efficiently distinguishing between invariant features and spurious ones. In this study, we fill in this research gap and propose a diffusion-augmented invariant risk minimization (diffIRM) framework that combines these two principles for the STPG problem. Our diffIRM contains two processes: i) data augmentation and ii) invariant learning. In the data augmentation process, a causal mask generator identifies causal features and a graph-based diffusion model acts as an environment augmentor to generate augmented spatiotemporal graph data. In the invariant learning process, an invariance penalty is designed using the augmented data, and then serves as a regularizer for training the spatiotemporal prediction model. The real-world experiment uses three human mobility datasets, i.e. SafeGraph, PeMS04, and PeMS08. Our proposed diffIRM outperforms baselines.

时空预测图神经网络OOD泛化扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。