揭示对比学习隐含的邻居聚合能力,提出高效推荐新方法
Unveiling Contrastive Learning's Capability of Neighborhood Aggregation for Collaborative Filtering
- 发现对比学习本质等价于图卷积,天然支持邻居聚合
- 在三个稀疏数据集上提升推荐精度与训练效率
- 适合关注推荐系统性能优化的研究者与工程师
个性化推荐广泛应用于网络应用,图对比学习(GCL)因其能从原始交互数据中提取自监督信号,有效缓解数据稀疏问题,已成为推荐系统主流方法。传统GCL通过图卷积中的数据增强生成对比视图,并在此基础上进行对比学习以获取丰富自监督信号。尽管该范式有效,其性能提升的内在原因仍不明晰。本文通过理论推导首次揭示:对比学习目标的梯度下降过程形式上等价于图卷积,表明其天然具备在交互图上进行邻居聚合的能力。实验验证了该能力,并指出此前方法在正样本选择上的常见误解限制了对比学习潜力。基于此,我们提出轻量级对比协同过滤(LightCCF),引入新型邻居聚合目标,使用户更接近所有交互项,同时远离其他正样本对,实现高质量邻居聚合且时间复杂度极低。在三个高稀疏公共数据集上,该方法有效聚合邻居信息并防止图过平滑,在训练效率和推荐准确率上显著优于现有GCL方法。代码已公开。
原文摘要 · Abstract (English)
Personalized recommendation is widely used in the web applications, and graph contrastive learning (GCL) has gradually become a dominant approach in recommender systems, primarily due to its ability to extract self-supervised signals from raw interaction data, effectively alleviating the problem of data sparsity. A classic GCL-based method typically uses data augmentation during graph convolution to generates more contrastive views, and performs contrast on these new views to obtain rich self-supervised signals. Despite this paradigm is effective, the reasons behind the performance gains remain a mystery. In this paper, we first reveal via theoretical derivation that the gradient descent process of the CL objective is formally equivalent to graph convolution, which implies that CL objective inherently supports neighborhood aggregation on interaction graphs. We further substantiate this capability through experimental validation and identify common misconceptions in the selection of positive samples in previous methods, which limit the potential of CL objective. Based on this discovery, we propose the Light Contrastive Collaborative Filtering (LightCCF) method, which introduces a novel neighborhood aggregation objective to bring users closer to all interacted items while pushing them away from other positive pairs, thus achieving high-quality neighborhood aggregation with very low time complexity. On three highly sparse public datasets, the proposed method effectively aggregate neighborhood information while preventing graph over-smoothing, demonstrating significant improvements over existing GCL-based counterparts in both training efficiency and recommendation accuracy. Our implementations are publicly accessible.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。