arXiv:2511.10240cs.AIcs.CL2025-11被引 3

通过分步推理与动态证据筛选,提升知识图谱问答的准确性和可靠性。

ProgRAG: Hallucination-Resistant Progressive Retrieval and Reasoning over Knowledge Graphs

  • 将复杂问题拆解为子问题,逐步扩展推理路径
  • 结合外部检索与不确定感知过滤,减少错误证据干扰
  • 适合需要高可信度推理的复杂知识问答场景

大型语言模型(LLMs)虽具备强大推理能力,但易产生幻觉且过程不透明。近期基于知识图谱(KG)增强的LLM在复杂知识密集型任务中表现更优,但仍面临检索不准、推理失败等问题,常因长上下文遮蔽关键信息或上下文构造无法捕捉不同问题类型的逻辑方向。许多方法依赖LLM直接从KG中检索证据并自我评估证据充分性,导致过早或错误推理。为此,我们提出ProgRAG,一种多跳知识图谱问答(KGQA)框架:将复杂问题分解为子问题,逐次回答并逐步扩展推理路径。每一步由外部检索器获取候选证据,再经由LLM进行不确定性感知的剪枝。最终通过重组和优化子问题答案所得的部分推理路径,构建高质量的推理上下文。在三个主流数据集上的实验表明,ProgRAG优于现有基线,在多跳KGQA任务中显著提升了可靠性和推理质量。

原文摘要 · Abstract (English)

Large Language Models (LLMs) demonstrate strong reasoning capabilities but struggle with hallucinations and limited transparency. Recently, KG-enhanced LLMs that integrate knowledge graphs (KGs) have been shown to improve reasoning performance, particularly for complex, knowledge-intensive tasks. However, these methods still face significant challenges, including inaccurate retrieval and reasoning failures, often exacerbated by long input contexts that obscure relevant information or by context constructions that struggle to capture the richer logical directions required by different question types. Furthermore, many of these approaches rely on LLMs to directly retrieve evidence from KGs, and to self-assess the sufficiency of this evidence, which often results in premature or incorrect reasoning. To address the retrieval and reasoning failures, we propose ProgRAG, a multi-hop knowledge graph question answering (KGQA) framework that decomposes complex questions into sub-questions, and progressively extends partial reasoning paths by answering each sub-question. At each step, external retrievers gather candidate evidence, which is then refined through uncertainty-aware pruning by the LLM. Finally, the context for LLM reasoning is optimized by organizing and rearranging the partial reasoning paths obtained from the sub-question answers. Experiments on three well-known datasets demonstrate that ProgRAG outperforms existing baselines in multi-hop KGQA, offering improved reliability and reasoning quality.

知识图谱推理增强抗幻觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。