arXiv:2501.12595cs.LGcs.AI2025-01KDD被引 10

提出统一框架提升图神经网络在分布外数据上的泛化能力

A Unified Invariant Learning Framework for Graph Classification

  • 同时考虑图结构与语义的不变性,识别更鲁棒的稳定特征
  • 在多个环境上显著提升分布外分类性能,超越主流基线方法
  • 适合关注图神经网络泛化性与因果推理的研究者

不变性学习在提升图神经网络(GNN)对分布外(OOD)数据的泛化能力方面展现出巨大潜力。其核心思想是识别图数据中因果决定标签的稳定特征,这些特征对分布变化具有不变性。现有方法主要聚焦于语义空间中的显式子结构(如掩码或注意力子图),并仅在图表示层面强制不变性。然而,我们指出仅关注语义空间可能无法准确识别稳定特征。为此,本文提出统一不变性学习(UIL)框架,从结构和语义双角度建模不变性。在图空间中,通过缩小不同环境下稳定特征对应的图翁(graphon)距离来实现结构不变性;同时,确保图表示在多种环境中均表现优异以验证语义不变性。理论与实证分析表明,该方法能有效识别更优的稳定特征。大量实验及深入分析显示,UIL显著提升OOD泛化性能,优于现有领先方法。

原文摘要 · Abstract (English)

Invariant learning demonstrates substantial potential for enhancing the generalization of graph neural networks (GNNs) with out-of-distribution (OOD) data. It aims to recognize stable features in graph data for classification, based on the premise that these features causally determine the target label, and their influence is invariant to changes in distribution. Along this line, most studies have attempted to pinpoint these stable features by emphasizing explicit substructures in the graph, such as masked or attentive subgraphs, and primarily enforcing the invariance principle in the semantic space, i.e., graph representations. However, we argue that focusing only on the semantic space may not accurately identify these stable features. To address this, we introduce the Unified Invariant Learning (UIL) framework for graph classification. It provides a unified perspective on invariant graph learning, emphasizing both structural and semantic invariance principles to identify more robust stable features. In the graph space, UIL adheres to the structural invariance principle by reducing the distance between graphons over a set of stable features across different environments. Simultaneously, to confirm semantic invariance, UIL underscores that the acquired graph representations should demonstrate exemplary performance across diverse environments. We present both theoretical and empirical evidence to confirm our method's ability to recognize superior stable features. Moreover, through a series of comprehensive experiments complemented by in-depth analyses, we demonstrate that UIL considerably enhances OOD generalization, surpassing the performance of leading baseline methods. Our codes are available at https://github.com/yongduosui/UIL.

图神经网络不变性学习泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。