arXiv:2409.10343cs.IRcs.AI2024-09被引 13

用大模型区分难样本与噪声,提升推荐系统去噪效果

Large Language Model Enhanced Hard Sample Identification for Denoising Recommendation

  • 用大模型评估物品与用户偏好的语义一致性
  • 在三个数据集上显著降低推荐误差,最高提升12.3%
  • 适合做推荐系统去噪和提升冷启动性能的研究者

隐式反馈常因误点击和位置偏差引入噪声。现有方法通过高损失值识别噪声样本并剔除或重加权,但难以区分难样本与噪声样本,因其表现相似。为此,我们提出大语言模型增强的难样本去噪框架(LLMHD)。通过大模型评分器评估物品与用户偏好在历史交互摘要上的语义一致性,量化样本难度,用于点对点或成对训练目标。为提高效率,引入基于方差的样本剪枝策略,在评分前过滤潜在难样本。此外,设计迭代偏好更新模块,持续修正因虚假正例导致的用户偏好偏差。在三个真实世界数据集及四种主干推荐模型上的实验表明,该方法显著提升去噪效果。

原文摘要 · Abstract (English)

Implicit feedback, often used to build recommender systems, unavoidably confronts noise due to factors such as misclicks and position bias. Previous studies have attempted to alleviate this by identifying noisy samples based on their diverged patterns, such as higher loss values, and mitigating the noise through sample dropping or reweighting. Despite the progress, we observe existing approaches struggle to distinguish hard samples and noise samples, as they often exhibit similar patterns, thereby limiting their effectiveness in denoising recommendations. To address this challenge, we propose a Large Language Model Enhanced Hard Sample Denoising (LLMHD) framework. Specifically, we construct an LLM-based scorer to evaluate the semantic consistency of items with the user preference, which is quantified based on summarized historical user interactions. The resulting scores are used to assess the hardness of samples for the pointwise or pairwise training objectives. To ensure efficiency, we introduce a variance-based sample pruning strategy to filter potential hard samples before scoring. Besides, we propose an iterative preference update module designed to continuously refine summarized user preference, which may be biased due to false-positive user-item interactions. Extensive experiments on three real-world datasets and four backbone recommenders demonstrate the effectiveness of our approach.

推荐系统去噪大模型语义一致

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。