用LLM引导的树搜索,让知识图谱问答更准更快
DAMR: Efficient and Adaptive Context-Aware Knowledge Graph Question Answering with LLM-Guided MCTS
- 用LLM选关键关系缩小搜索范围,动态优化推理路径
- 轻量级Transformer评分器提升多跳推理的准确性
- 自动生成训练信号,让模型在搜索中持续自我改进
知识图谱问答(KGQA)旨在通过结构化推理理解自然语言查询并从知识图谱中获取准确答案。现有方法要么采用静态路径提取的‘检索-推理’范式,缺乏上下文适应性;要么依赖大模型提示进行动态路径生成,但计算开销大、评估精度有限。为此,本文提出基于动态自适应蒙特卡洛树搜索(DAMR)的框架,融合LLM引导的MCTS与自适应路径评估机制。DAMR在每步扩展中由LLM规划器选出前k个语义相关的关系,有效压缩搜索空间;引入轻量级Transformer评分器,通过交叉注意力联合编码问题与关系序列,实现上下文感知的合理性评估;此外,设计动态伪路径精炼机制,定期从搜索过程中探索的部分路径生成训练信号,使评分器持续适应推理轨迹分布。在多个KGQA基准上的实验表明,DAMR显著优于现有最先进方法。
原文摘要 · Abstract (English)
Knowledge Graph Question Answering (KGQA) aims to interpret natural language queries and perform structured reasoning over knowledge graphs by leveraging their relational and semantic structures to retrieve accurate answers. Existing methods primarily follow either the retrieve-then-reason paradigm, which relies on Graph Neural Networks or heuristic rules to extract static candidate paths, or dynamic path generation strategies that employ LLMs with prompting to jointly perform retrieval and reasoning. However, the former lacks adaptability due to static path extraction and the absence of contextual refinement, while the latter suffers from high computational costs and limited evaluation accuracy because of their dependence on fixed scoring functions and repeated LLM calls. To address these issues, this paper proposes Dynamically Adaptive MCTS-based Reasoning (DAMR), a novel framework that integrates LLM-guided Monte Carlo Tree Search (MCTS) with adaptive path evaluation to enable efficient and context-aware KGQA. DAMR leverages MCTS as a backbone, where an LLM-based planner selects the top-$k$ semantically relevant relations at each expansion step to effectively reduce the search space. To enhance evaluation accuracy, we introduce a lightweight Transformer-based scorer that performs context-aware plausibility estimation by jointly encoding the question and relation sequence through cross-attention, thereby capturing fine-grained semantic shifts during multi-hop reasoning. Furthermore, to mitigate the scarcity of high-quality supervision, DAMR incorporates a dynamic pseudo-path refinement mechanism that periodically generates training signals from partial paths explored during search, enabling the scorer to continually adapt to the evolving distribution of reasoning trajectories. Extensive experiments on multiple KGQA benchmarks show that DAMR significantly outperforms SOTA methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。