用三步法让大模型更准地推理知识图谱,减少干扰、降低计算量。
PathMind: A Retrieve-Prioritize-Reason Framework for Knowledge Graph Reasoning with Large Language Models
- 先检索子图,再按重要性排序路径,最后分阶段训练提升逻辑一致性。
- 在复杂任务上表现优于基线,且输入更少,推理更高效。
- 适合需要高可信度和可解释性的知识推理场景。
知识图谱推理(KGR)是通过逻辑推断从知识图谱中发现新知识的任务。近期大型语言模型(LLMs)在复杂推理任务中展现出卓越性能。然而,现有基于LLM的KGR方法仍存在两大关键局限:一是方法常无差别地提取推理路径,引入无关噪声,误导模型;二是多数方法依赖动态探索路径,需频繁调用LLM,带来高检索开销。为此,本文提出PathMind,一种新型框架,通过选择性引导重要推理路径,提升推理的忠实性与可解释性。PathMind采用“检索-优先级排序-推理”范式:首先通过检索模块从知识图谱中获取查询子图;其次引入语义感知的路径优先级函数,综合考虑累积成本与未来预期成本,识别关键路径;最后通过双阶段训练策略生成准确且逻辑一致的回答,包括任务特定指令微调与路径级偏好对齐。在多个基准数据集上的实验表明,PathMind在复杂推理任务中持续优于对比基线,尤其在输入令牌数较少时表现更优,能有效识别核心推理路径。
原文摘要 · Abstract (English)
Knowledge graph reasoning (KGR) is the task of inferring new knowledge by performing logical deductions on knowledge graphs. Recently, large language models (LLMs) have demonstrated remarkable performance in complex reasoning tasks. Despite promising success, current LLM-based KGR methods still face two critical limitations. First, existing methods often extract reasoning paths indiscriminately, without assessing their different importance, which may introduce irrelevant noise that misleads LLMs. Second, while many methods leverage LLMs to dynamically explore potential reasoning paths, they require high retrieval demands and frequent LLM calls. To address these limitations, we propose PathMind, a novel framework designed to enhance faithful and interpretable reasoning by selectively guiding LLMs with important reasoning paths. Specifically, PathMind follows a "Retrieve-Prioritize-Reason" paradigm. First, it retrieves a query subgraph from KG through the retrieval module. Next, it introduces a path prioritization mechanism that identifies important reasoning paths using a semantic-aware path priority function, which simultaneously considers the accumulative cost and the estimated future cost for reaching the target. Finally, PathMind generates accurate and logically consistent responses via a dual-phase training strategy, including task-specific instruction tuning and path-wise preference alignment. Extensive experiments on benchmark datasets demonstrate that PathMind consistently outperforms competitive baselines, particularly on complex reasoning tasks with fewer input tokens, by identifying essential reasoning paths.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。