用语义一致性识别并降权噪声点击,提升推荐系统鲁棒性
Semantics-Aware Denoising: A PLM-Guided Sample Reweighting Strategy for Robust Recommendation
- 基于预训练语言模型计算用户兴趣与商品描述的语义相似度
- 在两个真实数据集上相比强基线提升最高2.2%的AUC
- 无需修改主模型,仅调整损失函数,适合工业部署
隐式反馈(如用户点击)是现代推荐系统的主要数据来源,但点击行为本身包含大量噪声,如误点、标题党点击和探索性浏览,这些不反映真实偏好。使用此类噪声正样本训练模型会降低预测准确率,导致推荐不可靠。本文提出SAID(语义感知隐式去噪)框架,利用用户兴趣与商品内容之间的语义一致性来识别并降权潜在噪声交互。方法通过历史行为构建文本化用户兴趣画像,并使用预训练语言模型(PLM)编码器计算与目标商品描述的语义相似度。相似度得分转化为样本权重,调节训练损失,从而减弱语义不一致点击的影响。与需要复杂辅助网络或多阶段训练的现有方法不同,SAID仅修改损失函数,保持主推荐模型不变。在两个真实数据集上的大量实验表明,SAID持续提升推荐性能,在高噪声条件下表现尤为稳健,相比强基线最高实现2.2%的相对AUC提升。
原文摘要 · Abstract (English)
Implicit feedback, such as user clicks, serves as the primary data source for modern recommender systems. However, click interactions inherently contain substantial noise, including accidental clicks, clickbait-induced interactions, and exploratory browsing behaviors that do not reflect genuine user preferences. Training recommendation models with such noisy positive samples leads to degraded prediction accuracy and unreliable recommendations. In this paper, we propose SAID (Semantics-Aware Implicit Denoising), a simple yet effective framework that leverages semantic consistency between user interests and item content to identify and downweight potentially noisy interactions. Our approach constructs textual user interest profiles from historical behaviors and computes semantic similarity with target item descriptions using pre-trained language model (PLM) based text encoders. The similarity scores are then transformed into sample weights that modulate the training loss, effectively reducing the impact of semantically inconsistent clicks. Unlike existing denoising methods that require complex auxiliary networks or multi-stage training procedures, SAID only modifies the loss function while keeping the backbone recommendation model unchanged. Extensive experiments on two real-world datasets demonstrate that SAID consistently improves recommendation performance, achieving up to 2.2% relative improvement in AUC over strong baselines, with particularly notable robustness under high noise conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。