arXiv:2512.06154cs.LGcs.AI2025-12

通过冗余信息识别因果图结构,提升模型在分布外场景下的泛化能力。

Learning Invariant Graph Representations Through Redundant Information

  • 利用信息分解技术精准定位因果与伪相关子图间的冗余信息
  • 提出多层级优化框架RIG,实现对冗余信息的显式最大化
  • 适用于存在复杂分布偏移的图数据任务,尤其适合可靠性要求高的场景

面向分布外(OOD)泛化,学习不变图表示仍具挑战性,因现有方法常保留虚假关联。本文引入信息论新工具——部分信息分解(PID),突破传统信息度量局限,精确聚焦于伪子图 $G_s$ 与因果子图 $G_c$ 之间关于目标 $Y$ 的冗余信息。针对仅依赖经典信息度量的方法缺陷,提出多级优化框架——冗余引导不变图学习(RIG),通过交替估计冗余信息下界并最大化其值,同时分离伪相关与因果子图,实现多种分布偏移下的良好泛化。在合成与真实图数据集上的实验验证了RIG的有效性。

原文摘要 · Abstract (English)

Learning invariant graph representations for out-of-distribution (OOD) generalization remains challenging because the learned representations often retain spurious components. To address this challenge, this work introduces a new tool from information theory called Partial Information Decomposition (PID) that goes beyond classical information-theoretic measures. We identify limitations in existing approaches for invariant representation learning that solely rely on classical information-theoretic measures, motivating the need to precisely focus on redundant information about the target $Y$ shared between spurious subgraphs $G_s$ and invariant subgraphs $G_c$ obtained via PID. Next, we propose a new multi-level optimization framework that we call -- Redundancy-guided Invariant Graph learning (RIG) -- that maximizes redundant information while isolating spurious and causal subgraphs, enabling OOD generalization under diverse distribution shifts. Our approach relies on alternating between estimating a lower bound of redundant information (which itself requires an optimization) and maximizing it along with additional objectives. Experiments on both synthetic and real-world graph datasets demonstrate the generalization capabilities of our proposed RIG framework.

图神经网络不变学习信息论分布外泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。