arXiv:2511.20177cs.IR2025-11

用大模型知识增强推荐,抗幻觉且更懂用户动态兴趣

Enhancing Sequential Recommendation with World Knowledge from Large Language Models

  • 通过生成+检索融合,结合大模型世界知识与相似用户/物品
  • 在公开和工业数据集上均超越现有方法,提升推荐准确率
  • 适合想提升推荐系统上下文理解力的研究者和工程师

序列推荐系统(SRS)在现代社会中至关重要,基于用户历史行为预测后续动作。然而,传统基于协同过滤的序列推荐模型因协同信号信息有限,表现不佳。随着大语言模型(LLM)的快速发展,越来越多工作尝试将LLM的世界知识融入序列推荐。尽管取得显著进展,这些方法通常假设LLM输出正确,仍易受幻觉噪声影响。为此,我们提出GRASP(Generation Augmented Retrieval with Holistic Attention for Sequential Prediction),一个灵活框架:通过生成增强检索实现描述性合成与相似性检索,并引入全局注意力增强机制,利用多层级注意力有效利用带有幻觉的LLM知识,更好捕捉用户动态兴趣。检索得到的相似用户/物品作为辅助上下文信息,供全局注意力模块使用,有效缓解监督方法中的噪声干扰。在两个公开基准数据集和一个工业数据集上的全面评估表明,GRASP在集成多种骨干模型时均持续达到最先进性能。代码已开源。

原文摘要 · Abstract (English)

Sequential Recommendation System~(SRS) has become pivotal in modern society, which predicts subsequent actions based on the user's historical behavior. However, traditional collaborative filtering-based sequential recommendation models often lead to suboptimal performance due to the limited information of their collaborative signals. With the rapid development of LLMs, an increasing number of works have incorporated LLMs' world knowledge into sequential recommendation. Although they achieve considerable gains, these approaches typically assume the correctness of LLM-generated results and remain susceptible to noise induced by LLM hallucinations. To overcome these limitations, we propose GRASP (Generation Augmented Retrieval with Holistic Attention for Sequential Prediction), a flexible framework that integrates generation augmented retrieval for descriptive synthesis and similarity retrieval, and holistic attention enhancement which employs multi-level attention to effectively employ LLM's world knowledge even with hallucinations and better capture users' dynamic interests. The retrieved similar users/items serve as auxiliary contextual information for the later holistic attention enhancement module, effectively mitigating the noisy guidance of supervision-based methods. Comprehensive evaluations on two public benchmarks and one industrial dataset reveal that GRASP consistently achieves state-of-the-art performance when integrated with diverse backbones. The code is available at: https://anonymous.4open.science/r/GRASP-SRS.

序列推荐大模型知识增强注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。