arXiv:2504.15075cs.AIcs.LG2025-04中稿 · IEEE TNSE被引 10

通过可学习结构增强和自注意力机制,缓解图神经网络中节点度数偏差问题。

Mitigating Degree Bias in Graph Representation Learning with Learnable Structural Augmentation and Structural Self-Attention

  • 利用非邻接节点间的结构相似性生成新边,补充低度节点信息
  • 在6个数据集上提升节点分类与聚类性能,显著改善度数公平性
  • 适合处理长尾度分布的复杂图结构,如社交网络、知识图谱

图神经网络通过消息传递更新节点表示,依赖同质性假设——相邻节点特征相似。然而,在具有长尾度分布的真实图中,高节点度主导消息传递,导致低度节点信息不足,形成度数偏差。现有方法难以在不破坏原图结构的前提下,为低度节点引入有效非邻接信息。为此,本文提出DegFairGT模型,通过可学习的结构增强发现非邻接节点间的结构相似性,并结合结构自注意力机制捕捉节点对之间的角色相似性。该方法在保持社区内同质性的前提下,为具有相似角色的节点生成有信息量的连接。同时,设计自监督任务以保留p步转移概率,约束图增强过程,防止结构破坏。在六个数据集上的实验表明,DegFairGT在度数公平性分析、节点分类和聚类任务中均优于当前最优基线。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) update node representations through message passing, which is primarily based on the homophily principle, assuming that adjacent nodes share similar features. However, in real-world graphs with long-tailed degree distributions, high-degree nodes dominate message passing, causing a degree bias where low-degree nodes remain under-represented due to inadequate messages. The main challenge in addressing degree bias is how to discover non-adjacent nodes to provide additional messages to low-degree nodes while reducing excessive messages for high-degree nodes. Nevertheless, exploiting non-adjacent nodes to provide valuable messages is challenging, as it could generate noisy information and disrupt the original graph structures. To solve it, we propose a novel Degree Fairness Graph Transformer, named DegFairGT, to mitigate degree bias by discovering structural similarities between non-adjacent nodes through learnable structural augmentation and structural self-attention. Our key idea is to exploit non-adjacent nodes with similar roles in the same community to generate informative edges under our augmentation, which could provide informative messages between nodes with similar roles while ensuring that the homophily principle is maintained within the community. To enable DegFairGT to learn such structural similarities, we then propose a structural self-attention to capture the similarities between node pairs. To preserve global graph structures and prevent graph augmentation from hindering graph structure, we propose a Self-Supervised Learning task to preserve p-step transition probability and regularize graph augmentation. Extensive experiments on six datasets showed that DegFairGT outperformed state-of-the-art baselines in degree fairness analysis, node classification, and node clustering tasks.

图神经网络度数偏差结构增强自注意力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。