arXiv:2409.19169cs.IR2024-09被引 1

用双编码器替代随机增强,提升推荐系统精度与效率。

TwinCL: A Twin Graph Contrastive Learning Model for Collaborative Filtering

  • 引入双编码器生成动态对比视图,避免破坏图结构信息
  • 训练初期强扰动,后期弱扰动,平均提升NDCG@10达5.6%
  • 优化嵌入对齐与均匀性,缓解热门物品偏差

在推荐系统与协同过滤领域,图对比学习(GCL)已成为重要方法。然而,对比学习有效性的内在机制仍不清晰。本文挑战传统在图结构或嵌入空间使用随机增强的做法,因其可能破坏图神经网络固有的结构与语义信息。固定率增强效果不如自适应率增强:训练初期需较强扰动,接近收敛时则宜较弱扰动。为此,我们提出双编码器机制,取代传统随机增强,证明其冗余性。该机制在训练早期生成更多样对比视图,后期趋于相似。同时,从超球面上的对齐与均匀性角度优化表示学习。所提模型TwinCL在用户与物品嵌入及双编码器输出间实现对齐,并保持嵌入均匀性。理论分析与实验表明,该模型在三个公开数据集上平均提升NDCG@10达5.6%,训练速度更快,且有效缓解流行度偏差。

原文摘要 · Abstract (English)

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well understood. In this paper, we challenge the conventional use of random augmentations on graph structure or embedding space in GCL, which may disrupt the structural and semantic information inherent in Graph Neural Networks. Moreover, fixed-rate data augmentation proves to be less effective compared to augmentation with an adaptive rate. In the initial training phases, significant perturbations are more suitable, while as the training approaches convergence, milder perturbations yield better results. We introduce a twin encoder in place of random augmentations, demonstrating the redundancy of traditional augmentation techniques. The twin encoder updating mechanism ensures the generation of more diverse contrastive views in the early stages, transitioning to views with greater similarity as training progresses. In addition, we investigate the learned representations from the perspective of alignment and uniformity on a hypersphere to optimize more efficiently. Our proposed Twin Graph Contrastive Learning model -- TwinCL -- aligns positive pairs of user and item embeddings and the representations from the twin encoder while maintaining the uniformity of the embeddings on the hypersphere. Our theoretical analysis and experimental results show that the proposed model optimizing alignment and uniformity with the twin encoder contributes to better recommendation accuracy and training efficiency performance. In comprehensive experiments on three public datasets, our proposed TwinCL achieves an average improvement of 5.6% (NDCG@10) in recommendation accuracy with faster training speed, while effectively mitigating popularity bias.

推荐系统图对比学习双编码器协同过滤

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。