用推理增强检索的LLM推荐系统,提升用户兴趣捕捉与推荐精准度。
RALLRec+: Retrieval Augmented Large Language Model Recommendation with Reasoning
- 融合文本与协同信号,动态更新用户偏好进行精准检索
- 引入推理模型与一致性融合,显著提升推荐结果可解释性
- 适合关注推荐系统可解释性与个性化建模的研究者
大型语言模型(LLMs)被引入推荐系统以增强对用户行为的理解。检索增强生成(RAG)技术进一步被整合,以检索更相关项目并提升系统性能。然而现有RAG方法存在两大缺陷:(i)在检索阶段,主要依赖文本语义,难以捕捉最相关项目,限制了系统效果;(ii)在生成阶段,缺乏显式的思维链推理,进一步制约其潜力。本文提出表示学习与推理增强的检索增强大语言模型推荐系统(RALLRec+)。针对检索阶段,我们通过提示LLM生成详细项目描述,并进行联合表示学习,融合来自LLM的文本信号与推荐模型的协同信号;为捕捉用户兴趣随时间变化,提出简单有效的重排序方法。针对生成阶段,先评估推理型LLM在推荐任务中的表现,发现关键洞见;随后引入知识注入提示与一致性融合策略,将推理型LLM与通用型LLM结合,显著提升整体性能。在三个真实世界数据集上的大量实验验证了该方法的有效性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items and improve system performance. However, existing RAG methods have two shortcomings. \textit{(i)} In the \textit{retrieval} stage, they rely primarily on textual semantics and often fail to incorporate the most relevant items, thus constraining system effectiveness. \textit{(ii)} In the \textit{generation} stage, they lack explicit chain-of-thought reasoning, further limiting their potential. In this paper, we propose Representation learning and \textbf{R}easoning empowered retrieval-\textbf{A}ugmented \textbf{L}arge \textbf{L}anguage model \textbf{Rec}ommendation (RALLRec+). Specifically, for the retrieval stage, we prompt LLMs to generate detailed item descriptions and perform joint representation learning, combining textual and collaborative signals extracted from the LLM and recommendation models, respectively. To account for the time-varying nature of user interests, we propose a simple yet effective reranking method to capture preference dynamics. For the generation phase, we first evaluate reasoning LLMs on recommendation tasks, uncovering valuable insights. Then we introduce knowledge-injected prompting and consistency-based merging approach to integrate reasoning LLMs with general-purpose LLMs, enhancing overall performance. Extensive experiments on three real world datasets validate our method's effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。