arXiv:2602.04709cs.LG2026-02

揭示图神经网络性能瓶颈,提出多关系与谱卷积解决方案

Towards Understanding and Avoiding Limitations of Convolutions on Graphs

  • 发现消息传递中组件放大与主导现象,导致节点表征秩坍缩
  • 提出MRS和MIMO-GC框架,通过多关系图避免信息重复放大
  • 基于PageRank设计无限迭代模型,保留初始特征不被淹没

尽管消息传递神经网络(MPNNs)表现良好,其实际应用仍受限。本文深入分析了影响MPNN性能的若干关键理论性质:共享组件放大(SCA)——每轮消息传递均增强所有特征通道中的相同成分;以及组件主导(CD)——单一成分随迭代次数增加被持续放大。这两种现象共同导致节点表征的秩坍缩,是过平滑现象的广义形式。通过分解和泛化过平滑,本研究实现了对MPNN更深的理解,为精准改进提供了方向。为避免SCA,提出多关系分割(MRS)框架,可将任意现有MPNN转换为利用多条边关系的模型;同时引入多输入多输出图卷积(MIMO-GC),天然支持多计算图。其局部变体LMGC在保持优势的同时实现高效近似。为应对CD,揭示了MPNN与PageRank算法的紧密联系,提出基于个性化PageRank的变体,支持无限消息传递迭代,同时保留初始节点特征。这些成果深化了对MPNN的理论认知。

原文摘要 · Abstract (English)

While message-passing neural networks (MPNNs) have shown promising results, their real-world impact remains limited. Although various limitations have been identified, their theoretical foundations remain poorly understood, leading to fragmented research efforts. In this thesis, we provide an in-depth theoretical analysis and identify several key properties limiting the performance of MPNNs. Building on these findings, we propose several frameworks that address these shortcomings. We identify two properties exhibited by many MPNNs: shared component amplification (SCA), where each message-passing iteration amplifies the same components across all feature channels, and component dominance (CD), where a single component gets increasingly amplified as more message-passing steps are applied. These properties lead to the observable phenomenon of rank collapse of node representations, which generalizes the established over-smoothing phenomenon. By generalizing and decomposing over-smoothing, we enable a deeper understanding of MPNNs, more targeted solutions, and more precise communication within the field. To avoid SCA, we show that utilizing multiple computational graphs or edge relations is necessary. Our multi-relational split (MRS) framework transforms any existing MPNN into one that leverages multiple edge relations. Additionally, we introduce the spectral graph convolution for multiple feature channels (MIMO-GC), which naturally uses multiple computational graphs. A localized variant, LMGC, approximates the MIMO-GC while inheriting its beneficial properties. To address CD, we demonstrate a close connection between MPNNs and the PageRank algorithm. Based on personalized PageRank, we propose a variant of MPNNs that allows for infinitely many message-passing iterations, while preserving initial node features. Collectively, these results deepen the theoretical understanding of MPNNs.

图神经网络消息传递过平滑谱卷积

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。