arXiv:2502.11394cs.LG2025-02NeurIPS被引 3

通过符号图理论解释并缓解图神经网络的过平滑问题

A Signed Graph Approach to Understanding and Mitigating Oversmoothing in GNNs

  • 用符号图统一解释现有缓解过平滑的方法
  • 在9个数据集上300层深度仍保持高准确率
  • 适合研究深度图神经网络和消息传递机制的学者

深度图神经网络常因节点表示随层数增加趋于同质而出现过平滑问题。本文提出基于符号图的统一理论视角,表明诸多现有方法(如归一化、残差连接)实质上隐式引入负边以改变消息传递过程,从而抑制过平滑。然而,若负边无结构地添加,则效果有限;符号传播的渐近行为关键取决于正负边的强度与组织方式。为此,我们引入结构平衡理论,通过将相似节点连正边、相异节点连负边,实现稳定且保留聚类结构的动态。提出可即插即用的结构平衡传播(SBP),依据标签或特征相似性自动分配符号边。在九个基准数据集(涵盖同质与异质场景)上的实验表明,SBP在高达300层的深度下持续提升分类精度并有效缓解过平滑。结果为已有缓解方法提供了原理性解释,并开辟了符号消息传递设计的新方向。

原文摘要 · Abstract (English)

Deep graph neural networks (GNNs) often suffer from oversmoothing, where node representations become overly homogeneous with increasing depth. While techniques like normalization, residual connections, and edge dropout have been proposed to mitigate oversmoothing, they are typically developed independently, with limited theoretical understanding of their underlying mechanisms. In this work, we present a unified theoretical perspective based on the framework of signed graphs, showing that many existing strategies implicitly introduce negative edges that alter message-passing to resist oversmoothing. However, we show that merely adding negative edges in an unstructured manner is insufficient-the asymptotic behavior of signed propagation depends critically on the strength and organization of positive and negative edges. To address this limitation, we leverage the theory of structural balance, which promotes stable, cluster-preserving dynamics by connecting similar nodes with positive edges and dissimilar ones with negative edges. We propose Structural Balanced Propagation (SBP), a plug-and-play method that assigns signed edges based on either labels or feature similarity to explicitly enhance structural balance in the constructed signed graphs. Experiments on nine benchmarks across both homophilic and heterophilic settings demonstrate that SBP consistently improves classification accuracy and mitigates oversmoothing, even at depths of up to 300 layers. Our results provide a principled explanation for prior oversmoothing remedies and introduce a new direction for signed message-passing design in deep GNNs.

图神经网络过平滑符号图结构平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。