解决异质图上图神经网络粗化训练的性能下降问题
Remedying Coarsening-Based GNN Training under Heterophily via Adaptive Complementary Enhancement
- 通过自适应补全机制重建粗化中丢失的节点特征
- 在异质图上实现显著性能提升,同质图上保持竞争力
- 无需修改模型,开销极小,适合大规模图应用
基于粗化的图神经网络(GNN)训练方法,即在粗化图上而非原始大规模图上进行训练,已成为扩展GNN至海量图的有前景方向。然而,现有工作几乎仅在同质图上评估,对更具挑战性的异质图设置关注不足。我们通过实验和理论证明,现有粗化训练方法在异质图上因粗化过程不可避免的信息损失而出现严重性能退化。为此,我们提出{f A}daptive {f C}omplementary {f E}nhancement(ACE),一种即插即用、模型无关的策略,重新整合粗化过程中丢弃的信息:ACE学习一个投影器以重构原始节点特征,并引入 extit{各向异性结构正则化}来嵌入局部异质性。此外,采用 extit{同方差不确定性加权},自适应平衡主粗化图训练损失与完整图辅助损失,后者使用异质性感知投影器重构的节点特征。大量实验表明,ACE在异质图基准上持续提升性能,同时在同质图上保持竞争力,且计算开销极小。代码已开源于GitHub:https://github.com/vasile-paskardlgm/ACE。
原文摘要 · Abstract (English)
Coarsening-based training for graph neural networks (GNNs), i.e.\ training on coarsened graphs rather than the original large ones, has become a promising direction for scaling GNNs to massive graphs. However, prior work has been evaluated almost exclusively on \textit{homophilic} graphs, leaving the more challenging \textit{heterophilic} settings underexplored. We show, both empirically and theoretically, that existing coarsening-based training methods suffer significant performance degradation on heterophilic graphs due to inevitable loss of graph information during coarsening. To address this, we propose {\bf A}daptive {\bf C}omplementary {\bf E}nhancement, a plug-and-play, model-agnostic strategy that reintegrates the information discarded in coarsening: ACE learns a projector for re-constructing original node features and applies \textit{anisotropic structural regularization} to embed local heterophily. We further adopt \textit{homoscedastic uncertainty weighting} to adaptively balance the combined training objective of primary coarsened-graph training loss and full-graph auxiliary loss with augmented node features re-constructed by the heterophily-aware projector. Extensive experiments show that ACE drives consistent gains on heterophilic benchmarks while preserving competitive results on homophilic graphs with minimal computational overhead. Code is available at the GitHub repository: https://github.com/vasile-paskardlgm/ACE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。