通过因果不变学习提升动态图的分布外泛化能力
Towards OOD Generalization in Dynamic Graphs via Causal Invariant Learning
- 从因果视角识别动态图中不变的时空模式
- 在真实与合成数据集上显著优于现有基线方法
- 适合处理复杂分布外变化的动态图任务
尽管动态图神经网络(DyGNNs)表现出良好性能,但现有方法普遍忽略动态图中常见的分布外(OOD)漂移。动态图的OOD泛化面临三大挑战:1)在复杂的图演化中识别不变与可变模式;2)从这些模式中捕捉内在演化机制;3)在数据分布观测有限的情况下实现跨多样OOD漂移的泛化。虽已有若干尝试,但均未能同时解决所有问题,且在复杂场景下存在局限。为此,我们提出动态图因果不变学习(DyCIL)模型,通过因果视角挖掘不变的时空模式。首先构建动态因果子图生成器以显式识别因果动态子图;其次设计因果感知的时空注意力模块,提取不变模式背后的内在演化逻辑;最后引入自适应环境生成器,捕捉分布漂移的底层动态。在真实与合成动态图数据集上的大量实验表明,该模型在应对OOD漂移方面显著优于当前最优基线。
原文摘要 · Abstract (English)
Although dynamic graph neural networks (DyGNNs) have demonstrated promising capabilities, most existing methods ignore out-of-distribution (OOD) shifts that commonly exist in dynamic graphs. Dynamic graph OOD generalization is non-trivial due to the following challenges: 1) Identifying invariant and variant patterns amid complex graph evolution, 2) Capturing the intrinsic evolution rationale from these patterns, and 3) Ensuring model generalization across diverse OOD shifts despite limited data distribution observations. Although several attempts have been made to tackle these challenges, none has successfully addressed all three simultaneously, and they face various limitations in complex OOD scenarios. To solve these issues, we propose a Dynamic graph Causal Invariant Learning (DyCIL) model for OOD generalization via exploiting invariant spatio-temporal patterns from a causal view. Specifically, we first develop a dynamic causal subgraph generator to identify causal dynamic subgraphs explicitly. Next, we design a causal-aware spatio-temporal attention module to extract the intrinsic evolution rationale behind invariant patterns. Finally, we further introduce an adaptive environment generator to capture the underlying dynamics of distributional shifts. Extensive experiments on both real-world and synthetic dynamic graph datasets demonstrate the superiority of our model over state-of-the-art baselines in handling OOD shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。