arXiv:2506.00331cs.CL2025-06EMNLP

用语法树分步拆解复杂问题,提升问答准确率。

TreeRare: Syntax Tree-Guided Retrieval and Reasoning for Knowledge-Intensive Question Answering

  • 基于语法树自底向上分解问题,逐节点生成查询并检索
  • 在五个数据集上显著优于现有方法,尤其在多跳推理任务中表现突出
  • 适合需要深度推理和跨源信息整合的复杂问答场景

现实中的问题通常复杂且依赖知识,要求大语言模型识别问题的多面性并跨多个信息源进行推理。迭代自适应检索(即模型根据推理过程决定何时及检索什么)是解决此类问题的有前景方法,但其性能受限于推理错误累积与检索结果错位。为此,我们提出 TreeRare(语法树引导的检索与推理)框架,利用语法树指导信息检索与推理。遵循组合性原则,TreeRare 采用自底向上的方式遍历语法树,在每个节点生成基于子组件的查询并检索相关段落以解决局部不确定性。随后,子组件问答模块将这些段落整合为简洁、上下文感知的证据。最后,TreeRare 在整个树结构上聚合证据生成最终答案。在涉及模糊或多跳推理的五个问答数据集上的实验表明,TreeRare 显著优于现有最先进方法。

原文摘要 · Abstract (English)

In real practice, questions are typically complex and knowledge-intensive, requiring Large Language Models (LLMs) to recognize the multifaceted nature of the question and reason across multiple information sources. Iterative and adaptive retrieval, where LLMs decide when and what to retrieve based on their reasoning, has been shown to be a promising approach to resolve complex, knowledge-intensive questions. However, the performance of such retrieval frameworks is limited by the accumulation of reasoning errors and misaligned retrieval results. To overcome these limitations, we propose TreeRare (Syntax Tree-Guided Retrieval and Reasoning), a framework that utilizes syntax trees to guide information retrieval and reasoning for question answering. Following the principle of compositionality, TreeRare traverses the syntax tree in a bottom-up fashion, and in each node, it generates subcomponent-based queries and retrieves relevant passages to resolve localized uncertainty. A subcomponent question answering module then synthesizes these passages into concise, context-aware evidence. Finally, TreeRare aggregates the evidence across the tree to form a final answer. Experiments across five question answering datasets involving ambiguous or multi-hop reasoning demonstrate that TreeRare achieves substantial improvements over existing state-of-the-art methods.

问答系统语法树多跳推理LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。