用新型网络提升图对比学习,生成更有效的难样本。
Khan-GCL: Kolmogorov-Arnold Network Based Graph Contrastive Learning with Hard Negatives
- 引入Kolmogorov-Arnold网络增强编码器表达能力
- 基于参数信息生成有语义区别的难负样本
- 在多个数据集上达到当前最佳性能
图对比学习(GCL)在无标签数据上学习可泛化图表示方面展现出巨大潜力。然而,传统GCL方法存在两大局限:(1) 基于多层感知机(MLP)的编码器表达能力受限;(2) 负样本质量不佳,随机增强生成的负样本无法提供有效‘难负例’,而现有难负样本生成方法未充分考虑图数据中关键的语义差异。为此,我们提出Khan-GCL,将柯尔莫哥洛夫-阿诺德网络(KAN)融入GCL编码器架构,显著提升其表示能力。此外,利用KAN系数参数中蕴含的丰富信息,提出两种新型关键特征识别技术,实现对每张图表示生成语义有意义的难负样本。这些精心构造的难负样本通过强调图间关键语义差异,引导编码器学习更具判别性的特征。大量实验表明,该方法在多种数据集和任务上均优于现有GCL方法,达到当前最优水平。
原文摘要 · Abstract (English)
Graph contrastive learning (GCL) has demonstrated great promise for learning generalizable graph representations from unlabeled data. However, conventional GCL approaches face two critical limitations: (1) the restricted expressive capacity of multilayer perceptron (MLP) based encoders, and (2) suboptimal negative samples that either from random augmentations-failing to provide effective 'hard negatives'-or generated hard negatives without addressing the semantic distinctions crucial for discriminating graph data. To this end, we propose Khan-GCL, a novel framework that integrates the Kolmogorov-Arnold Network (KAN) into the GCL encoder architecture, substantially enhancing its representational capacity. Furthermore, we exploit the rich information embedded within KAN coefficient parameters to develop two novel critical feature identification techniques that enable the generation of semantically meaningful hard negative samples for each graph representation. These strategically constructed hard negatives guide the encoder to learn more discriminative features by emphasizing critical semantic differences between graphs. Extensive experiments demonstrate that our approach achieves state-of-the-art performance compared to existing GCL methods across a variety of datasets and tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。