arXiv:2509.16502cs.LG2025-09EMNLP被引 2

让大模型与知识图谱联合优化,提升复杂推理能力。

GRIL: Knowledge Graph Retrieval-Integrated Learning with Large Language Models

  • 端到端训练图检索器,动态增删节点以适应推理需求。
  • 在三个问答数据集上达顶尖性能,多跳推理更准确。
  • 无需标注实体,适合开放域应用,适合做智能问答的团队参考。

检索增强生成(RAG)通过引入外部知识缓解了大语言模型(LLM)的幻觉问题。近期基于图结构的RAG拓展为多跳推理提供了新方向,但现有方法通常将检索与推理分离,导致检索器无法根据推理需求调整;且在大规模图上进行多跳扩展时效率低,或依赖难以获取的标注实体。为此,本文提出一种与LLM端到端联合训练的图检索器,采用注意力驱动的动态增长与剪枝机制,自适应导航多跳相关实体并过滤噪声。在提取的子图中,通过软令牌编码结构知识,用显式图描述融合语义特征,共同注入LLM,增强其推理能力,并支持检索器与推理器的交互式联合训练。实验表明,该方法在三个QA基准上持续达到最先进水平。特别地,框架通过直接使用LLM输出概率作为隐式反馈优化检索器,无需预设真实实体,在开放域场景下表现尤为出色。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) has significantly mitigated the hallucinations of Large Language Models (LLMs) by grounding the generation with external knowledge. Recent extensions of RAG to graph-based retrieval offer a promising direction, leveraging the structural knowledge for multi-hop reasoning. However, existing graph RAG typically decouples retrieval and reasoning processes, which prevents the retriever from adapting to the reasoning needs of the LLM. They also struggle with scalability when performing multi-hop expansion over large-scale graphs, or depend heavily on annotated ground-truth entities, which are often unavailable in open-domain settings. To address these challenges, we propose a novel graph retriever trained end-to-end with LLM, which features an attention-based growing and pruning mechanism, adaptively navigating multi-hop relevant entities while filtering out noise. Within the extracted subgraph, structural knowledge and semantic features are encoded via soft tokens and the verbalized graph, respectively, which are infused into the LLM together, thereby enhancing its reasoning capability and facilitating interactive joint training of the graph retriever and the LLM reasoner. Experimental results across three QA benchmarks show that our approach consistently achieves state-of-the-art performance, validating the strength of joint graph-LLM optimization for complex reasoning tasks. Notably, our framework eliminates the need for predefined ground-truth entities by directly optimizing the retriever using LLM logits as implicit feedback, making it especially effective in open-domain settings.

知识图谱大模型推理增强RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。