arXiv:2501.02969cs.LG2025-01AAAI被引 10

通过融合高低频图信号,提升图神经网络在不同同质性数据上的表现。

LOHA: Direct Graph Spectral Contrastive Learning Between Low-pass and High-pass Views

  • 利用高低频滤波构建对比视图,融合信号趋势作为复合特征。
  • 在9个真实数据集上平均提升2.8%,部分超越全监督模型。
  • 适合处理同质性差异大的图数据,尤其适用于谱图神经网络研究者。

谱图神经网络能有效处理不同同质性水平的图数据,其中低通滤波挖掘特征平滑性,高通滤波捕捉差异。当这两种滤波可自然形成对立视图用于自监督学习时,同一节点在对应视图间的共性未被充分探索,导致性能受限。本文提出一种简单有效的自监督对比框架LOHA,以实现“差异中的和谐”。不同于仅最大化视图间差异(可能引发特征分离),LOHA通过将高低频视图的图信号传播视为复合特征,实现多样性协调。具体地,提出一种新型高维特征——谱信号趋势,作为复合特征基础,其对滤波变化不敏感,仅关注原始特征差异。LOHA在9个同质性各异的真实数据集上平均性能优于次优模型2.8%。值得注意的是,在多个数据集上甚至超越全监督模型,凸显其在多样化图结构中提升谱图神经网络效能的巨大潜力。

原文摘要 · Abstract (English)

Spectral Graph Neural Networks effectively handle graphs with different homophily levels, with low-pass filter mining feature smoothness and high-pass filter capturing differences. When these distinct filters could naturally form two opposite views for self-supervised learning, the commonalities between the counterparts for the same node remain unexplored, leading to suboptimal performance. In this paper, a simple yet effective self-supervised contrastive framework, LOHA, is proposed to address this gap. LOHA optimally leverages low-pass and high-pass views by embracing "harmony in diversity". Rather than solely maximizing the difference between these distinct views, which may lead to feature separation, LOHA harmonizes the diversity by treating the propagation of graph signals from both views as a composite feature. Specifically, a novel high-dimensional feature named spectral signal trend is proposed to serve as the basis for the composite feature, which remains relatively unaffected by changing filters and focuses solely on original feature differences. LOHA achieves an average performance improvement of 2.8% over runner-up models on 9 real-world datasets with varying homophily levels. Notably, LOHA even surpasses fully-supervised models on several datasets, which underscores the potential of LOHA in advancing the efficacy of spectral GNNs for diverse graph structures.

图神经网络自监督学习谱方法对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。