arXiv:2501.18357cs.LG2025-01被引 1

通过对比学习与伪标签混合增强,实现图表示中局部与全局信息的协同优化。

Contrastive Learning Meets Pseudo-label-assisted Mixup Augmentation: A Comprehensive Graph Representation Framework from Local to Global

  • 用对比学习隐式平滑局部信息,提升全局建模可靠性。
  • 在六大数据集上节点分类准确率显著优于现有方法。
  • 适合需要兼顾局部细节与全局结构的图学习任务研究者。

图神经网络(GNN)在图表示学习任务中表现优异,但多数模型仅依赖显式图卷积捕捉局部信息,忽视了全局消息传递,限制了局部与全局信息间的协作。为此,本文提出综合图表示学习框架ComGRL,将局部信息融入全局信息以生成强大表征。该框架通过灵活的图对比学习隐式平滑局部信息,确保后续全局探索的可靠性;再将局部表征输入多头自注意力模块,揭示多样且丰富的全局关联,增强判别能力。为在自监督伪标签下动态优化局部信息,ComGRL采用三重采样策略构建混合节点对,并在属性与结构上应用可靠的Mixup增强进行局部对比学习,扩大感受野,促进局部与全局表示的相互强化。在六个常用图数据集上的实验表明,ComGRL在节点分类任务中取得优异性能。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness in various graph representation learning tasks. However, most existing GNNs focus primarily on capturing local information through explicit graph convolution, often neglecting global message-passing. This limitation hinders the establishment of a collaborative interaction between global and local information, which is crucial for comprehensively understanding graph data. To address these challenges, we propose a novel framework called Comprehensive Graph Representation Learning (ComGRL). ComGRL integrates local information into global information to derive powerful representations. It achieves this by implicitly smoothing local information through flexible graph contrastive learning, ensuring reliable representations for subsequent global exploration. Then ComGRL transfers the locally derived representations to a multi-head self-attention module, enhancing their discriminative ability by uncovering diverse and rich global correlations. To further optimize local information dynamically under the self-supervision of pseudo-labels, ComGRL employs a triple sampling strategy to construct mixed node pairs and applies reliable Mixup augmentation across attributes and structure for local contrastive learning. This approach broadens the receptive field and facilitates coordination between local and global representation learning, enabling them to reinforce each other. Experimental results across six widely used graph datasets demonstrate that ComGRL achieves excellent performance in node classification tasks. The code could be available at https://github.com/JinluWang1002/ComGRL.

图神经网络对比学习伪标签混合增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。