arXiv:2410.23994cs.LG2024-10NeurIPS被引 21

用离散扩散模型捕捉用户行为的模糊性,提升推荐准确性。

Breaking Determinism: Fuzzy Modeling of Sequential Recommendation Using Discrete State Space Diffusion Model

  • 基于离散状态空间扩散过程建模用户行为演化
  • 在三个数据集上优于现有最佳方法,冷启动问题改善明显
  • 用语义标签替代物品ID,提升效率并缓解冷启动

序列推荐(SR)旨在根据用户历史行为序列预测其可能感兴趣的内容。本文从信息论新视角重新审视SR,发现传统建模方法难以充分捕捉用户行为的随机性与不可预测性。受模糊信息处理理论启发,提出DDSR模型,通过模糊交互序列集合来克服局限,更真实地刻画用户兴趣演变。该模型基于离散状态空间中的扩散转移过程,不同于在连续域运行的常见扩散模型(如DDPM),采用结构化转移而非任意噪声注入,有效避免信息丢失。为解决大规模离散空间下矩阵变换效率低的问题,引入量化或RQ-VAE生成的语义标签替代物品ID,显著提升效率并改善冷启动问题。在三个公开基准数据集上的实验表明,DDSR在多种设置下均优于现有最先进方法,展现出处理序列推荐任务的潜力与有效性。

原文摘要 · Abstract (English)

Sequential recommendation (SR) aims to predict items that users may be interested in based on their historical behavior sequences. We revisit SR from a novel information-theoretic perspective and find that conventional sequential modeling methods fail to adequately capture the randomness and unpredictability of user behavior. Inspired by fuzzy information processing theory, this paper introduces the DDSR model, which uses fuzzy sets of interaction sequences to overcome the limitations and better capture the evolution of users' real interests. Formally based on diffusion transition processes in discrete state spaces, which is unlike common diffusion models such as DDPM that operate in continuous domains. It is better suited for discrete data, using structured transitions instead of arbitrary noise introduction to avoid information loss. Additionally, to address the inefficiency of matrix transformations due to the vast discrete space, we use semantic labels derived from quantization or RQ-VAE to replace item IDs, enhancing efficiency and improving cold start issues. Testing on three public benchmark datasets shows that DDSR outperforms existing state-of-the-art methods in various settings, demonstrating its potential and effectiveness in handling SR tasks.

序列推荐扩散模型离散建模冷启动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。