用大模型区分推荐系统中的难样本与噪声样本,提升推荐效果。
Hard vs. Noise: Resolving Hard-Noisy Sample Confusion in Recommender Systems via Large Language Models
- 通过大模型生成语义和逻辑双重相关性信号,区分难样本与噪声样本。
- 在真实数据集上,推荐准确率提升显著,较基线最高增益达6.2%。
- 适合关注推荐系统去噪与大模型融合的工程师与研究者。
隐式反馈在训练推荐系统时不可避免地受到噪声影响,如误点击和位置偏差。以往研究通过损失值异常等模式识别噪声样本并进行丢弃或重加权。然而我们发现,噪声样本与难样本呈现相似特征,导致难-噪混淆问题,而难样本对建模用户偏好至关重要。为此,我们提出LLMHNI框架,利用大语言模型(LLM)生成的两个辅助用户-物品相关性信号来区分两者。LLMHNI从LLM编码嵌入中获取用户-物品语义相关性,用于负样本选择,以保留难负例并过滤噪声假负例。提出目标对齐策略,将原本用于通用语言任务的LLM嵌入投影到优化后的用户-物品相关性表示空间。同时,利用LLM推断的逻辑相关性构建交互图,通过跨图对比对齐实现去噪。为抑制因LLM幻觉引入的不可靠交互,设计图对比学习策略,通过随机删边视图对齐来削弱不可靠边的影响。实验表明,LLMHNI显著提升了去噪能力和推荐性能。
原文摘要 · Abstract (English)
Implicit feedback, employed in training recommender systems, unavoidably confronts noise due to factors such as misclicks and position bias. Previous studies have attempted to identify noisy samples through their diverged data patterns, such as higher loss values, and mitigate their influence through sample dropping or reweighting. However, we observed that noisy samples and hard samples display similar patterns, leading to hard-noisy confusion issue. Such confusion is problematic as hard samples are vital for modeling user preferences. To solve this problem, we propose LLMHNI framework, leveraging two auxiliary user-item relevance signals generated by Large Language Models (LLMs) to differentiate hard and noisy samples. LLMHNI obtains user-item semantic relevance from LLM-encoded embeddings, which is used in negative sampling to select hard negatives while filtering out noisy false negatives. An objective alignment strategy is proposed to project LLM-encoded embeddings, originally for general language tasks, into a representation space optimized for user-item relevance modeling. LLMHNI also exploits LLM-inferred logical relevance within user-item interactions to identify hard and noisy samples. These LLM-inferred interactions are integrated into the interaction graph and guide denoising with cross-graph contrastive alignment. To eliminate the impact of unreliable interactions induced by LLM hallucination, we propose a graph contrastive learning strategy that aligns representations from randomly edge-dropped views to suppress unreliable edges. Empirical results demonstrate that LLMHNI significantly improves denoising and recommendation performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。