arXiv:2605.13126cs.LGcs.AI2026-05

解决多标签图神经网络中信息过压缩问题,提升模型表达力与鲁棒性。

MLGIB: Multi-Label Graph Information Bottleneck for Expressive and Robust Message Passing

论文配图:MLGIB: Multi-Label Graph Information Bottleneck for Expressive and Robust Message Passing
图 1 · 摘自论文原文
  • 基于信息瓶颈理论设计标签感知的消息传递机制
  • 在多个基准上相比现有方法显著提升性能
  • 适合处理标签噪声大、节点间标签差异大的复杂图数据

图神经网络在深层消息传递中面临过压缩问题,即指数增长的邻域信息被压缩为固定维度表示。我们发现,在多标签图中,该问题表现为显著失效:相邻节点常仅共享少量标签,而多数标签无关,导致预测信号被噪声标签稀释。为此,我们提出多标签图信息瓶颈(MLGIB),将多标签消息传递建模为在无关标签噪声下的受限信息传输。MLGIB通过构建马尔可夫依赖空间并推导可计算的变分界,下界最大化与目标标签的互信息,上界约束冗余源信息,从而实现表达力与鲁棒性的平衡。该框架导出端到端的标签感知消息传递架构。在多个基准上的大量实验表明,其持续优于现有方法,验证了该框架的有效性与通用性。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) suffer from over-squashing in deep message passing, where information from exponentially growing neighborhoods is compressed into fixed-dimensional representations. We show that this issue becomes a distinct failure mode in multi-label graphs: neighboring nodes often share only limited labels while differing across many irrelevant ones, causing predictive signals to be diluted by noisy label information. To address this challenge, we propose the Multi-Label Graph Information Bottleneck (MLGIB), which formulates multi-label message passing as constrained information transmission under irrelevant label noise. MLGIB balances expressiveness and robustness by preserving predictive label signals while suppressing irrelevant noise. Specifically, it constructs a Markovian dependence space and derives tractable variational bounds, where the lower bound maximizes mutual information with target labels and the upper bound constrains redundant source information. These bounds lead to an end-to-end label-aware message-passing architecture. Extensive experiments on multiple benchmarks demonstrate consistent improvements over existing methods, validating the effectiveness and generality of the proposed framework.

图神经网络信息瓶颈多标签学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。