让图对比学习读懂图结构中的常识知识,提升表征能力
Str-GCL: Structural Commonsense Driven Graph Contrastive Learning
- 用一阶逻辑规则显式表达图结构常识,融入对比学习框架
- 在多个数据集上超越现有方法,最高提升6.2%准确率
- 适合研究图神经网络与常识推理融合的学者参考
图对比学习(GCL)是自监督图表示学习中广泛采用的方法,通过对比目标生成有效表示。然而,当前GCL方法主要关注隐含语义关系,常忽略图结构与属性中蕴含的结构性常识,而这些常识对有效表示学习至关重要。由于一般图中缺乏明确信息和清晰指引,识别并整合此类结构性常识在GCL中面临重大挑战。为此,我们提出一种新框架Str-GCL,首次直接将结构性常识引入GCL。Str-GCL利用一阶逻辑规则表示结构性常识,不修改原始图结构,通过拓扑与属性规则,并采用表示对齐机制引导编码器有效捕捉该常识。大量实验表明,Str-GCL优于现有GCL方法,为利用结构性常识提供了新视角。
原文摘要 · Abstract (English)
Graph Contrastive Learning (GCL) is a widely adopted approach in self-supervised graph representation learning, applying contrastive objectives to produce effective representations. However, current GCL methods primarily focus on capturing implicit semantic relationships, often overlooking the structural commonsense embedded within the graph's structure and attributes, which contains underlying knowledge crucial for effective representation learning. Due to the lack of explicit information and clear guidance in general graph, identifying and integrating such structural commonsense in GCL poses a significant challenge. To address this gap, we propose a novel framework called Structural Commonsense Unveiling in Graph Contrastive Learning (Str-GCL). Str-GCL leverages first-order logic rules to represent structural commonsense and explicitly integrates them into the GCL framework. It introduces topological and attribute-based rules without altering the original graph and employs a representation alignment mechanism to guide the encoder in effectively capturing this commonsense. To the best of our knowledge, this is the first attempt to directly incorporate structural commonsense into GCL. Extensive experiments demonstrate that Str-GCL outperforms existing GCL methods, providing a new perspective on leveraging structural commonsense in graph representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。