提出生成式方法提升图数据分布外泛化能力
Generative Risk Minimization for Out-of-Distribution Generalization on Graphs
- 用生成方式构造不变子图,替代传统离散结构提取
- 理论证明目标函数可优化,实验验证在多数据集上更优
- 适合研究图神经网络泛化与因果建模的学者
图数据上的分布外(OOD)泛化旨在处理测试图分布与训练分布不同的场景。相较于图像等独立同分布数据,图结构数据因非独立同分布特性和复杂结构信息,使得该问题更具挑战性。现有工作尝试提取跨分布共享关键分类信息的不变子图,但离散结构提取可能损失有效信息或引入虚假关联。本文提出生成式风险最小化(GRM)框架,为每个待分类图生成一个不变子图,而非提取。为解决缺乏最优不变子图(即真实标签)时的优化难题,通过引入潜在因果变量推导出可计算的目标函数形式,并通过理论分析验证其有效性。在多种真实世界图数据集上进行节点级和图级的广泛实验,结果表明GRM框架显著优于现有方法。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) generalization on graphs aims at dealing with scenarios where the test graph distribution differs from the training graph distributions. Compared to i.i.d. data like images, the OOD generalization problem on graph-structured data remains challenging due to the non-i.i.d. property and complex structural information on graphs. Recently, several works on graph OOD generalization have explored extracting invariant subgraphs that share crucial classification information across different distributions. Nevertheless, such a strategy could be suboptimal for entirely capturing the invariant information, as the extraction of discrete structures could potentially lead to the loss of invariant information or the involvement of spurious information. In this paper, we propose an innovative framework, named Generative Risk Minimization (GRM), designed to generate an invariant subgraph for each input graph to be classified, instead of extraction. To address the challenge of optimization in the absence of optimal invariant subgraphs (i.e., ground truths), we derive a tractable form of the proposed GRM objective by introducing a latent causal variable, and its effectiveness is validated by our theoretical analysis. We further conduct extensive experiments across a variety of real-world graph datasets for both node-level and graph-level OOD generalization, and the results demonstrate the superiority of our framework GRM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。