用因果图增强大模型推理,让医学问答更准确可信。
Causal Graphs Meet Thoughts: Enhancing Complex Reasoning in Graph-Augmented LLMs
- 构建因果导向的图检索流程,匹配模型思考步骤。
- 医疗问答任务中准确率最高提升10个百分点。
- 适合需要可解释推理的医疗、法律等高风险领域。
在知识密集型任务中,尤其在医疗、法律等高风险领域,不仅需获取相关信息,还需提供因果推理与可解释性。大型语言模型(LLMs)虽在自然语言理解与生成任务中表现优异,但存在难以融入新知识、产生幻觉及难以解释推理过程等问题。将知识图谱与图检索增强生成(Graph RAG)结合成为有效解决方案。传统Graph RAG方法多依赖简单图遍历或语义相似度,难以捕捉因果关系或与模型内部推理步骤对齐。本文提出一种新流程:过滤大规模知识图谱以突出因果边,使检索过程与模型的思维链(CoT)对齐,并通过多阶段路径优化增强推理能力。在医疗问答任务上的实验表明,该方法在多个大型语言模型上均取得稳定提升,绝对性能最高提高10%。结果证明,结合因果推理与分步检索可生成更具可解释性与逻辑基础的复杂问题解答。
原文摘要 · Abstract (English)
In knowledge-intensive tasks, especially in high-stakes domains like medicine and law, it is critical not only to retrieve relevant information but also to provide causal reasoning and explainability. Large language models (LLMs) have achieved remarkable performance in natural language understanding and generation tasks. However, they often suffer from limitations such as difficulty in incorporating new knowledge, generating hallucinations, and explaining their reasoning process. To address these challenges, integrating knowledge graphs with Graph Retrieval-Augmented Generation (Graph RAG) has emerged as an effective solution. Traditional Graph RAG methods often rely on simple graph traversal or semantic similarity, which do not capture causal relationships or align well with the model's internal reasoning steps. This paper proposes a novel pipeline that filters large knowledge graphs to emphasize cause-effect edges, aligns the retrieval process with the model's chain-of-thought (CoT), and enhances reasoning through multi-stage path improvements. Experiments on medical question-answering tasks show consistent gains, with up to a 10\% absolute improvement across multiple large language models (LLMs). This approach demonstrates the value of combining causal reasoning with stepwise retrieval, leading to more interpretable and logically grounded solutions for complex queries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。