通过多源负样本采样,解决推荐模型陷入局部最优的问题。
Divergence Meets Consensus: A Multi-Source Negative Sampling Framework for Sequential Recommendation

- 引入教师-同伴-自我的三源评分机制,打破模型自循环。
- 在六大数据集上显著提升推荐效果,超越现有方法。
- 适合需要高多样性负样本的序列推荐场景。
在隐式反馈下,负样本采样对序列推荐模型训练至关重要。主流自引导难负样本采样方法依赖当前模型状态,存在三大缺陷:(1)采样与模型更新耦合导致陷入局部最优;(2)仅基于当前参数采样,缩小候选物品范围,降低多样性,影响泛化能力;(3)识别难负样本需遍历全部候选集,计算开销大但信息增益低。为此,我们提出MDCNS(多源分歧-共识负样本采样),受维果斯基最近发展区理论启发,构建“教师-同伴-自我”框架。该方法包含三部分:多源评分引入外部负样本信号,打破自增强循环;分歧重排序利用自模型与同伴模型预测差异,提升采样多样性;共识蒸馏通过KL散度对齐自模型与教师模型,同时优化计算效率。在六个真实世界数据集和五种主干模型上的实验表明,MDCNS持续优于当前最优负样本采样方法,展现出强有效性与泛化能力。
原文摘要 · Abstract (English)
Negative sampling is significant for training sequential recommendation models under implicit feedback. The predominant strategy, self-guided hard negative sampling, selects negatives based on the model's current state but suffers from three limitations: (1) the coupling between sampling and model updates triggers a vicious cycle that drives the model into local optima; (2) relying on current model parameters narrows sampling to a small region of the item space, reducing diversity and harming generalization; (3) identifying a hard negative requires scoring the entire candidate pool, causing substantial computational overhead with minimal information gain. To address these challenges, we propose MDCNS (Multi-source Divergence-Consensus for Negative Sampling), a novel "Teacher-Peer-Self" framework inspired by Vygotsky's Zone of Proximal Development (ZPD) theory. The proposed method comprises three components, including multi-source scoring, divergence re-ranking, and consensus distillation. Firstly, multi-source scoring incorporates peer and ensemble teacher models to inject external negative signals and break the self-reinforcement loop. Then, divergence re-ranking exploits prediction discrepancy between self and peer models to enhance sampling diversity. Finally, consensus distillation aligns the self model with the teacher via KL divergence, simultaneously improving computational cost utilization. Extensive experiments on six real-world datasets and five backbone models show that MDCNS consistently outperforms state-of-the-art negative sampling methods, demonstrating strong effectiveness and generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。