arXiv:2504.11699cs.LGcs.SI2025-04

新图神经网络同时搞定同质与异质图,自监督学习效果更优。

H$^3$GNNs: Harmonizing Heterophily and Homophily in GNNs via Joint Structural Node Encoding and Self-Supervised Learning

论文配图:H$^3$GNNs: Harmonizing Heterophily and Homophily in GNNs via Joint Structural Node Encoding and Self-Supervised Learning
图 1 · 摘自论文原文
  • 联合结构编码融合线性非线性特征,用注意力机制感知图结构特性。
  • 教师-学生框架配合动态掩码策略,在七大数据集上均表现领先。
  • 特别适合处理复杂异质图,也兼容传统同质图任务。

图神经网络在表示学习中难以平衡同质性与异质性,这一挑战在自监督设置下更加突出。本文提出H³GNNs,一种端到端的自监督学习框架,通过两项关键创新实现两种结构特性的调和:(i) 联合结构节点编码。将节点嵌入统一空间,结合线性与非线性特征投影,利用加权图卷积网络(WGCN)融合K跳结构表示,并通过交叉注意力机制增强对同质与异质性的感知与适应能力。(ii) 基于教师-学生预测架构的自监督学习,采用节点难度驱动的动态掩码策略。学生模型观察被掩码的输入图,预测教师模型在完整图中推断出的节点特征(位于联合编码空间中)。为提升学习难度,引入两种基于节点预测难度的新型掩码策略。在七个基准数据集上的实验验证了其有效性与效率,涵盖四个异质图与三个同质图数据集。H³GNNs在四个异质图数据集上达到整体最先进性能,同时在三个同质图数据集上保持与先前最先进方法相当的水平。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) struggle to balance heterophily and homophily in representation learning, a challenge further amplified in self-supervised settings. We propose H$^3$GNNs, an end-to-end self-supervised learning framework that harmonizes both structural properties through two key innovations: (i) Joint Structural Node Encoding. We embed nodes into a unified space combining linear and non-linear feature projections with K-hop structural representations via a Weighted Graph Convolution Network(WGCN). A cross-attention mechanism enhances awareness and adaptability to heterophily and homophily. (ii) Self-Supervised Learning Using Teacher-Student Predictive Architectures with Node-Difficulty Driven Dynamic Masking Strategies. We use a teacher-student model, the student sees the masked input graph and predicts node features inferred by the teacher that sees the full input graph in the joint encoding space. To enhance learning difficulty, we introduce two novel node-predictive-difficulty-based masking strategies. Experiments on seven benchmarks (four heterophily datasets and three homophily datasets) confirm the effectiveness and efficiency of H$^3$GNNs across diverse graph types. Our H$^3$GNNs achieves overall state-of-the-art performance on the four heterophily datasets, while retaining on-par performance to previous state-of-the-art methods on the three homophily datasets.

图神经网络自监督学习异质图结构编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。