通过用户个性化损失分布去噪,提升推荐系统鲁棒性
Personalized Denoising Implicit Feedback for Robust Recommender System
- 基于用户个人损失分布重采样,区分正常与噪声行为
- 在三种数据集上验证,噪声比例达40%时仍保持高精度
- 适合噪声多、数据不干净的推荐场景
隐式反馈是现代推荐系统的基础,但用户行为中的误差、不确定性与模糊性会引入大量噪声,影响推荐准确性和鲁棒性。现有方法通常根据整体损失分布降低噪声交互的权重或直接丢弃,但发现正常与噪声交互在损失分布中存在显著重叠,尤其在从点对损失(如BCE)转向成对损失(如BPR)时更明显,导致误判。本文发现:对单个用户而言,其个人损失分布能清晰区分正常与噪声交互。据此提出基于用户个人损失分布的重采样去噪方法PLD,每轮优化中为每位用户构建候选物品池,并依据其个人损失分布优先采样正常交互。理论分析证明了该方法的有效性,并提出改进方向。在三个不同噪声比例的数据集上进行的大量实验表明,PLD在噪声占比高达40%时仍表现稳健。
原文摘要 · Abstract (English)
While implicit feedback is foundational to modern recommender systems, factors such as human error, uncertainty, and ambiguity in user behavior inevitably introduce significant noise into this feedback, adversely affecting the accuracy and robustness of recommendations. To address this issue, existing methods typically aim to reduce the training weight of noisy feedback or discard it entirely, based on the observation that noisy interactions often exhibit higher losses in the overall loss distribution. However, we identify two key issues: (1) there is a significant overlap between normal and noisy interactions in the overall loss distribution, and (2) this overlap becomes even more pronounced when transitioning from pointwise loss functions (e.g., BCE loss) to pairwise loss functions (e.g., BPR loss). This overlap leads traditional methods to misclassify noisy interactions as normal, and vice versa. To tackle these challenges, we further investigate the loss overlap and find that for a given user, there is a clear distinction between normal and noisy interactions in the user's personal loss distribution. Based on this insight, we propose a resampling strategy to Denoise using the user's Personal Loss distribution, named PLD, which reduces the probability of noisy interactions being optimized. Specifically, during each optimization iteration, we create a candidate item pool for each user and resample the items from this pool based on the user's personal loss distribution, prioritizing normal interactions. Additionally, we conduct a theoretical analysis to validate PLD's effectiveness and suggest ways to further enhance its performance. Extensive experiments conducted on three datasets with varying noise ratios demonstrate PLD's efficacy and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。