让大模型自己选路径,边推理边导航知识图谱。
Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs
- 大模型自主决策下一步跳转关系,结合上下文与历史路径。
- 在6个基准上超越现有方法,无需微调且跨图谱通用。
- 适合需要精准推理的开放域问答场景。
大语言模型(LLM)结合知识图谱(KG)为知识密集型推理提供了新途径。关键在于如何选择合理的推理路径,但现有方法常依赖独立模块进行路径选择,其判断标准与推理目标关联较弱,导致选择错误关系或过早剪枝有效路径。本文提出Search-on-Graph(SoG),通过让大模型自身基于图结构和完整推理历史,主动决定下一步应遵循的关系,实现观察-思考-导航的闭环流程。该机制使路径选择与推理目标紧密对齐,充分调动大模型的推理能力。在六个知识图谱问答(KGQA)基准上的实验表明,SoG显著优于当前最优方法,且无需任务特定微调,可泛化至不同图谱模式。
原文摘要 · Abstract (English)
Large language models (LLMs) augmented with knowledge graphs (KGs) offer a promising approach for knowledge-intensive reasoning. Central to this approach is the selection of appropriate reasoning paths in the KG. Yet, existing methods face a common limitation: reasoning path selection is often performed by separate modules using criteria that are only weakly connected to the reasoning requirements. This often results in selecting incorrect relations or premature pruning of relevant paths. We propose Search-on-Graph (SoG), a method that strengthens the connection between path selection and reasoning by having the LLM itself select which relations to follow, informed by both the available KG structure and the complete reasoning history. SoG follows an \textit{observe-think-navigate} paradigm: at each step, the LLM observes the relational connections available at the current entity, reasons about which path best advances toward answering the question, and navigates accordingly. This context-aware navigation fully exploits the LLM's reasoning capabilities rather than relying on independent selection modules with surrogate criteria. Experiments on six knowledge graph question answering (KGQA) benchmarks demonstrate that SoG outperforms state-of-the-art methods while requiring no task-specific fine-tuning and generalizing across different KG schemas.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。