通过细粒度正样本提升超图对比学习性能
Closer through commonality: Enhancing hypergraph contrastive learning with shared groups
- 在节点特征加噪声实现无损增强,避免破坏超图结构
- 引入弱正样本机制,使正样本区分更精细,平均排名提升显著
- 在10个数据集上优于主流方法,训练快且显存消耗低
超图能更好建模现实世界中以群体形式发生的复杂多维关系,克服传统同质图的局限。然而,针对超图的对比学习研究较少,现有图对比学习方法未能充分挖掘超图中的高阶相关性。本文提出一种细粒度超图对比学习方法(HyFi),不依赖破坏超图拓扑的传统图增强手段,而是通过向节点特征添加噪声实现高效学习增强。同时,突破传统对比学习中正负样本二元对立的范式,引入弱正样本关系,强调细粒度正样本的重要性。实验表明,HyFi能生成高质量嵌入,在10个数据集上的节点分类平均排名均超越监督与无监督基线方法。该方法有效利用了超图的高维信息,相较现有基于图的对比学习方法有显著提升,且在训练速度和GPU内存占用方面表现高效。源代码已公开于https://github.com/Noverse0/HyFi.git。
原文摘要 · Abstract (English)
Hypergraphs provide a superior modeling framework for representing complex multidimensional relationships in the context of real-world interactions that often occur in groups, overcoming the limitations of traditional homogeneous graphs. However, there have been few studies on hypergraphbased contrastive learning, and existing graph-based contrastive learning methods have not been able to fully exploit the highorder correlation information in hypergraphs. Here, we propose a Hypergraph Fine-grained contrastive learning (HyFi) method designed to exploit the complex high-dimensional information inherent in hypergraphs. While avoiding traditional graph augmentation methods that corrupt the hypergraph topology, the proposed method provides a simple and efficient learning augmentation function by adding noise to node features. Furthermore, we expands beyond the traditional dichotomous relationship between positive and negative samples in contrastive learning by introducing a new relationship of weak positives. It demonstrates the importance of fine-graining positive samples in contrastive learning. Therefore, HyFi is able to produce highquality embeddings, and outperforms both supervised and unsupervised baselines in average rank on node classification across 10 datasets. Our approach effectively exploits high-dimensional hypergraph information, shows significant improvement over existing graph-based contrastive learning methods, and is efficient in terms of training speed and GPU memory cost. The source code is available at https://github.com/Noverse0/HyFi.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。