提出单视图图对比学习框架SIGNA,通过软邻域感知提升性能
Single-View Graph Contrastive Learning with Soft Neighborhood Awareness
- 用丢弃法生成带噪声的邻居嵌入对作为潜在正样本
- 在不同轮次切换部分邻居的正负角色,实现概率化对比
- 可替代复杂GCN,使推理速度提升109至331倍,适合高效建模
大多数图对比学习(GCL)方法严重依赖跨视图对比,面临增强设计复杂、视图间信息损失及计算成本高等问题。为减少对跨视图对比的依赖,本文提出新型单视图图对比学习框架SIGNA。针对邻域结构连接与语义相似性不一致的问题,引入软邻域感知机制:利用丢弃法获取结构相关但随机带噪的邻居嵌入对,作为潜在正样本;每轮迭代中,部分邻居的角色在正负样本间动态切换,实现概率化邻域对比学习。此外,提出基于归一化Jensen-Shannon散度的估计器以提升对比效果。在多种节点级任务上的实验表明,该简单框架性能持续优于现有方法,最高提升达21.74%(在PPI数据集上)。尤其在软邻域感知下,SIGNA可采用MLP代替复杂GCN作为编码器,在归纳学习任务中使推理速度提升109至331倍。源码已公开于https://github.com/sunisfighting/SIGNA。
原文摘要 · Abstract (English)
Most graph contrastive learning (GCL) methods heavily rely on cross-view contrast, thus facing several concomitant challenges, such as the complexity of designing effective augmentations, the potential for information loss between views, and increased computational costs. To mitigate reliance on cross-view contrasts, we propose \ttt{SIGNA}, a novel single-view graph contrastive learning framework. Regarding the inconsistency between structural connection and semantic similarity of neighborhoods, we resort to soft neighborhood awareness for GCL. Specifically, we leverage dropout to obtain structurally-related yet randomly-noised embedding pairs for neighbors, which serve as potential positive samples. At each epoch, the role of partial neighbors is switched from positive to negative, leading to probabilistic neighborhood contrastive learning effect. Furthermore, we propose a normalized Jensen-Shannon divergence estimator for a better effect of contrastive learning. Surprisingly, experiments on diverse node-level tasks demonstrate that our simple single-view GCL framework consistently outperforms existing methods by margins of up to 21.74% (PPI). In particular, with soft neighborhood awareness, SIGNA can adopt MLPs instead of complicated GCNs as the encoder to generate representations in transductive learning tasks, thus speeding up its inference process by 109 times to 331 times. The source code is available at https://github.com/sunisfighting/SIGNA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。