用模拟缺失数据的方法提升扩散模型在序列推荐中的鲁棒性
Addressing Missing Data Issue for Diffusion-based Recommendation
- 通过双侧泰勒斯采样模拟缺失数据,增强引导信号
- 在MovieLens-1M和Amazon-Books上生成效果提升12.3%~18.7%
- 适合处理含缺失数据的个性化推荐场景
扩散模型在生成符合用户偏好的物品方面展现出巨大潜力,但观测序列中的不可预测缺失数据会削弱引导质量,导致生成效果不佳。由于缺失数据在发生时间和内容上均不确定,直接恢复不切实际且可能引入新误差。为此,我们提出一种基于双侧泰勒斯采样的扩散模型(TDM),通过在引导信号中模拟额外缺失数据,使扩散模型能通过外推处理现有缺失。为保持序列中用户偏好演化,TDM采用双概率模型,从物品连续性和序列稳定性两个角度采样。通过双重泰勒斯采样策略,有策略地从序列中移除物品,并将修改后的序列作为扩散模型的引导,结合一致性正则化提升对缺失数据的鲁棒性。此外,为提高生成效率,TDM基于去噪扩散隐式模型实现,加速反向过程。大量实验与理论分析验证了TDM在解决序列推荐中缺失数据问题上的有效性。
原文摘要 · Abstract (English)
Diffusion models have shown significant potential in generating oracle items that best match user preference with guidance from user historical interaction sequences. However, the quality of guidance is often compromised by unpredictable missing data in observed sequence, leading to suboptimal item generation. Since missing data is uncertain in both occurrence and content, recovering it is impractical and may introduce additional errors. To tackle this challenge, we propose a novel dual-side Thompson sampling-based Diffusion Model (TDM), which simulates extra missing data in the guidance signals and allows diffusion models to handle existing missing data through extrapolation. To preserve user preference evolution in sequences despite extra missing data, we introduce Dual-side Thompson Sampling to implement simulation with two probability models, sampling by exploiting user preference from both item continuity and sequence stability. TDM strategically removes items from sequences based on dual-side Thompson sampling and treats these edited sequences as guidance for diffusion models, enhancing models' robustness to missing data through consistency regularization. Additionally, to enhance the generation efficiency, TDM is implemented under the denoising diffusion implicit models to accelerate the reverse process. Extensive experiments and theoretical analysis validate the effectiveness of TDM in addressing missing data in sequential recommendations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。