用新目标函数让扩散模型更好推荐个性化排序结果。
Preference Diffusion for Recommendation
- 设计专属排序损失,结合多重负样本建模用户偏好。
- 相比传统方法,提升推荐准确率并加快收敛速度。
- 适合追求高精度排序的推荐系统研究者使用。
推荐系统基于用户历史行为数据生成的偏好分布,预测个性化项目排名。近年来,扩散模型(DMs)因其建模复杂分布的能力受到关注,但现有基于扩散模型的推荐系统多依赖均方误差(MSE)或传统推荐目标,这些目标并非为个性化排序任务优化,也未能充分发挥扩散模型的生成潜力。为此,我们提出 PreferDiff,一种专为基于扩散模型的推荐系统设计的优化目标。PreferDiff 将BPR转化为对数似然排序目标,并引入多个负样本以更精准捕捉用户偏好。具体地,采用变分推断处理不可计算项,通过最小化变分上界实现;同时用余弦误差替代MSE,增强与推荐任务的对齐性。最后,通过平衡生成与偏好学习,提升扩散模型训练稳定性。PreferDiff具有三大优势:首次为基于扩散模型的推荐系统设计个性化排序损失;通过解决难负样本问题,提升排序性能并加速收敛;理论证明其与直接偏好优化(DPO)存在关联,表明其具备通过生成建模对齐用户偏好的潜力。在三个基准数据集上的大量实验验证了其卓越的推荐性能和出色的通用序列推荐能力。代码已公开于 https://github.com/lswhim/PreferDiff。
原文摘要 · Abstract (English)
Recommender systems predict personalized item rankings based on user preference distributions derived from historical behavior data. Recently, diffusion models (DMs) have gained attention in recommendation for their ability to model complex distributions, yet current DM-based recommenders often rely on traditional objectives like mean squared error (MSE) or recommendation objectives, which are not optimized for personalized ranking tasks or fail to fully leverage DM's generative potential. To address this, we propose PreferDiff, a tailored optimization objective for DM-based recommenders. PreferDiff transforms BPR into a log-likelihood ranking objective and integrates multiple negative samples to better capture user preferences. Specifically, we employ variational inference to handle the intractability through minimizing the variational upper bound and replaces MSE with cosine error to improve alignment with recommendation tasks. Finally, we balance learning generation and preference to enhance the training stability of DMs. PreferDiff offers three key benefits: it is the first personalized ranking loss designed specifically for DM-based recommenders and it improves ranking and faster convergence by addressing hard negatives. We also prove that it is theoretically connected to Direct Preference Optimization which indicates that it has the potential to align user preferences in DM-based recommenders via generative modeling. Extensive experiments across three benchmarks validate its superior recommendation performance and commendable general sequential recommendation capabilities. Our codes are available at https://github.com/lswhim/PreferDiff.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。