针对跨域推荐中对比学习训练不稳问题,提出分阶段渐进式学习框架。
Separated Contrastive Learning for Matching in Cross-domain Recommendation with Curriculum Scheduling
- 分离源域与目标域的内部对比任务,避免混合干扰
- 按重叠用户负样本难度动态调整训练策略,提升效果
- 在真实工业数据上验证,显著优于现有方法
跨域推荐旨在通过源域信息提升目标域推荐性能。对比学习被广泛用于域内(intra-CL)和域间(inter-CL)用户/物品表示学习与知识迁移。然而,直接混合使用intra-CL与inter-CL任务会忽略域间学习难度高于域内,导致严重训练不稳定性,影响表示学习质量。为此,本文提出SCCDR框架,采用分离的intra-CL与inter-CL范式,并引入停止梯度操作。该框架包含两个专用课程阶段:域内分离阶段显式为源域与目标域分别构建独立的对比视图;域间课程调度阶段则基于重叠用户锚定的负样本难度,设计有效课程策略。在多个开源数据集及一个来自真实推荐系统的离线工业数据集上进行实验,并通过在线A/B测试验证,SCCDR在多个基线方法上达到当前最优性能。
原文摘要 · Abstract (English)
Cross-domain recommendation (CDR) is a task that aims to improve the recommendation performance in a target domain by leveraging the information from source domains. Contrastive learning methods have been widely adopted among intra-domain (intra-CL) and inter-domain (inter-CL) users/items for their representation learning and knowledge transfer during the matching stage of CDR. However, we observe that directly employing contrastive learning on mixed-up intra-CL and inter-CL tasks ignores the difficulty of learning from inter-domain over learning from intra-domain, and thus could cause severe training instability. Therefore, this instability deteriorates the representation learning process and hurts the quality of generated embeddings. To this end, we propose a novel framework named SCCDR built up on a separated intra-CL and inter-CL paradigm and a stop-gradient operation to handle the drawback. Specifically, SCCDR comprises two specialized curriculum stages: intra-inter separation and inter-domain curriculum scheduling. The former stage explicitly uses two distinct contrastive views for the intra-CL task in the source and target domains, respectively. Meanwhile, the latter stage deliberately tackles the inter-CL tasks with a curriculum scheduling strategy that derives effective curricula by accounting for the difficulty of negative samples anchored by overlapping users. Empirical experiments on various open-source datasets and an offline proprietary industrial dataset extracted from a real-world recommender system, and an online A/B test verify that SCCDR achieves state-of-the-art performance over multiple baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。