提出新框架,让图神经网络在动态环境中更好泛化到分布外数据。
Evolving Graph Learning for Out-of-Distribution Generalization in Non-stationary Environments
- 基于环境演化建模与不变模式识别,提升对非平稳环境的适应性。
- 在真实与合成数据上均显著优于现有方法,尤其在分布偏移下表现突出。
- 适合研究动态图学习、鲁棒机器学习及复杂系统建模的科研人员。
图神经网络在动态图的空间与时间模式挖掘中表现出色,但在分布变化场景下泛化能力较差,这在动态环境中难以避免。随着潜在非平稳环境演化推进,动态图生成过程受到其影响,亟需从环境演化角度研究其对分布外(OOD)泛化的影响。本文提出一种新型环境感知的演化图学习框架(EvoOOD),通过环境感知的不变模式识别实现对分布外数据的预测。首先,设计环境序列变分自编码器以建模环境演化并推断底层环境分布;其次,引入环境感知的不变模式识别机制,针对推断出的分布应对环境多样性;最后,利用实例化环境样本的混合方式对节点进行细粒度因果干预,帮助区分时空不变模式。实验表明,EvoOOD在真实与合成动态数据集上均在分布偏移下表现出优越性能。据我们所知,这是首个从环境演化视角研究动态图分布外泛化问题的工作。
原文摘要 · Abstract (English)
Graph neural networks have shown remarkable success in exploiting the spatial and temporal patterns on dynamic graphs. However, existing GNNs exhibit poor generalization ability under distribution shifts, which is inevitable in dynamic scenarios. As dynamic graph generation progresses amid evolving latent non-stationary environments, it is imperative to explore their effects on out-of-distribution (OOD) generalization. This paper proposes a novel Evolving Graph Learning framework for OOD generalization (EvoOOD) by environment-aware invariant pattern recognition. Specifically, we first design an environment sequential variational auto-encoder to model environment evolution and infer the underlying environment distribution. Then, we introduce a mechanism for environment-aware invariant pattern recognition, tailored to address environmental diversification through inferred distributions. Finally, we conduct fine-grained causal interventions on individual nodes using a mixture of instantiated environment samples. This approach helps to distinguish spatio-temporal invariant patterns for OOD prediction, especially in non-stationary environments. Experimental results demonstrate the superiority of EvoGOOD on both real-world and synthetic dynamic datasets under distribution shifts. To the best of our knowledge, it is the first attempt to study the dynamic graph OOD generalization problem from the environment evolution perspective.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。