arXiv:2507.05863cs.IR2025-07被引 7

用知识图谱增强大模型推荐,减少幻觉并提升准确性

KERAG_R: Knowledge-Enhanced Retrieval-Augmented Generation for Recommendation

  • 通过图注意力网络筛选相关知识三元组,精准注入推荐上下文
  • 在三个公开数据集上超越10种现有方法,显著提升推荐效果
  • 适合需要高可信度推荐的场景,如电商、内容平台

大语言模型(LLMs)因其上下文学习与泛化能力,在推荐系统中展现出巨大潜力。现有基于LLM的推荐方法通常使用特定提示词来利用其上下文能力,并使输出更贴近人类偏好以提升推荐性能。然而,由于预训练语料库中缺乏领域特定知识,导致模型在推荐时可能出现错误或误导性信息,引发幻觉问题。此外,直接引入知识图谱(KG)会带来冗余和噪声信息,影响模型推理过程或超出输入长度限制,降低推荐效果。为此,我们提出一种新型模型——知识增强的检索增强生成推荐模型(KERAG_R)。具体而言,通过图检索增强生成(GraphRAG)组件,将知识图谱中的额外信息融入指令,使大模型能协同利用文本用户行为与知识图谱信号,更准确地估计用户偏好。特别地,我们预先训练图注意力网络(GAT)以选择最相关的三元组用于目标用户,从而增强模型同时减少冗余噪声。在三个公开数据集上的大量实验表明,所提模型显著优于十种现有先进推荐方法。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown strong potential in recommender systems due to their contextual learning and generalisation capabilities. Existing LLM-based recommendation approaches typically formulate the recommendation task using specialised prompts designed to leverage their contextual abilities, and aligning their outputs closely with human preferences to yield an improved recommendation performance. However, the use of LLMs for recommendation tasks is limited by the absence of domain-specific knowledge. This lack of relevant relational knowledge about the items to be recommended in the LLM's pre-training corpus can lead to inaccuracies or hallucinations, resulting in incorrect or misleading recommendations. Moreover, directly using information from the knowledge graph introduces redundant and noisy information, which can affect the LLM's reasoning process or exceed its input context length, thereby reducing the performance of LLM-based recommendations. To address the lack of domain-specific knowledge, we propose a novel model called Knowledge-Enhanced Retrieval-Augmented Generation for Recommendation (KERAG_R). Specifically, we leverage a graph retrieval-augmented generation (GraphRAG) component to integrate additional information from a knowledge graph (KG) into instructions, enabling the LLM to collaboratively exploit recommendation signals from both text-based user interactions and the knowledge graph to better estimate the users' preferences in a recommendation context. In particular, we perform graph RAG by pre-training a graph attention network (GAT) to select the most relevant triple for the target users for the used LLM, thereby enhancing the LLM while reducing redundant and noisy information. Our extensive experiments on three public datasets show that our proposed KERAG_R model significantly outperforms ten existing state-of-the-art recommendation methods.

推荐系统知识图谱大模型检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。