arXiv:2410.19429cs.LG2024-10被引 2

用扩散模型提升序列推荐,让用户兴趣更灵活表达。

Generative Diffusion Models for Sequential Recommendations

  • 将物品嵌入表示为分布而非固定向量,增强表达灵活性。
  • 在三个数据集上优于现有基线,显著提升推荐准确率。
  • 适合关注个性化推荐与生成式建模的研究者。

生成模型如变分自编码器(VAEs)和生成对抗网络(GANs)在序列推荐任务中展现出潜力,但面临后验崩溃和表征能力有限等问题。Li 等人(2023)提出一种新方法,利用扩散模型将物品嵌入表示为分布而非固定向量,更自适应地反映用户多样兴趣和物品多维特征。在扩散阶段,通过加噪将目标物品嵌入转化为高斯分布,以表征序列物品分布并引入不确定性;近似器(Approximator)处理噪声后的表示以重建目标物品。在反向阶段,模型利用用户历史交互反向去噪,并通过取整操作完成物品预测。研究对 DiffuRec 架构进行改进,包括在扩散过程中加入偏移噪声以提升鲁棒性,并在近似器中引入交叉注意力机制以更好捕捉用户-物品交互。由此提出的 DiffuRecSys 模型在三个公开基准数据集上的实验表明,这些改进增强了物品表征能力,有效捕捉多样化用户偏好,显著优于现有基线。

原文摘要 · Abstract (English)

Generative models such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs) have shown promise in sequential recommendation tasks. However, they face challenges, including posterior collapse and limited representation capacity. The work by Li et al. (2023) introduces a novel approach that leverages diffusion models to address these challenges by representing item embeddings as distributions rather than fixed vectors. This approach allows for a more adaptive reflection of users' diverse interests and various item aspects. During the diffusion phase, the model converts the target item embedding into a Gaussian distribution by adding noise, facilitating the representation of sequential item distributions and the injection of uncertainty. An Approximator then processes this noisy item representation to reconstruct the target item. In the reverse phase, the model utilizes users' past interactions to reverse the noise and finalize the item prediction through a rounding operation. This research introduces enhancements to the DiffuRec architecture, particularly by adding offset noise in the diffusion process to improve robustness and incorporating a cross-attention mechanism in the Approximator to better capture relevant user-item interactions. These contributions led to the development of a new model, DiffuRecSys, which improves performance. Extensive experiments conducted on three public benchmark datasets demonstrate that these modifications enhance item representation, effectively capture diverse user preferences, and outperform existing baselines in sequential recommendation research.

序列推荐扩散模型生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。