arXiv:2412.00742cs.AI2024-12NeurIPS被引 15

从谱聚类视角改进自监督异构图学习,提升表示质量和任务泛化能力

Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective

  • 基于谱聚类理论,引入秩约束与双一致性正则化增强表示
  • 在多个下游任务上显著优于现有方法,性能提升明显
  • 适合关注图学习鲁棒性与聚类信息利用的研究者

自监督异构图学习(SHGL)在多种场景中展现出潜力。然而,现有方法虽与聚类思路相似,仍存在两大局限:(i) 消息传递过程常引入图结构噪声,削弱节点表示;(ii) 群集级信息捕获不足,影响下游任务表现。本文从谱聚类视角重新审视SHGL,提出一种融合秩约束与双一致性约束的新框架。该框架采用秩约束的谱聚类方法,有效修正邻接矩阵以剔除噪声;同时引入节点级与群集级一致性约束,协同捕捉不变特征与聚类结构,促进下游任务学习。理论上证明所学表示能根据类别数划分为独立分区,并具备更强跨任务泛化能力。实验验证了方法优越性,在多个下游任务中实现显著性能提升。

原文摘要 · Abstract (English)

Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios. However, while existing SHGL methods share a similar essential with clustering approaches, they encounter two significant limitations: (i) noise in graph structures is often introduced during the message-passing process to weaken node representations, and (ii) cluster-level information may be inadequately captured and leveraged, diminishing the performance in downstream tasks. In this paper, we address these limitations by theoretically revisiting SHGL from the spectral clustering perspective and introducing a novel framework enhanced by rank and dual consistency constraints. Specifically, our framework incorporates a rank-constrained spectral clustering method that refines the affinity matrix to exclude noise effectively. Additionally, we integrate node-level and cluster-level consistency constraints that concurrently capture invariant and clustering information to facilitate learning in downstream tasks. We theoretically demonstrate that the learned representations are divided into distinct partitions based on the number of classes and exhibit enhanced generalization ability across tasks. Experimental results affirm the superiority of our method, showcasing remarkable improvements in several downstream tasks compared to existing methods.

图学习自监督谱聚类异构图

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。