提出STRIDE框架,让大模型分步推理更准更稳。
STRIDE: Strategic Iterative Decision-Making for Retrieval-Augmented Multi-Hop Question Answering

- 用元规划构建无实体的逻辑骨架,避免过早锁定错误实体
- 动态控制执行顺序,支持并行与串行协同,减少冗余查询
- 适合需要复杂推理的开放域问答,尤其提升开源模型表现
多跳问答(MHQA)通过跨文档检索与推理,实现对复杂问题的精准回答。现有方法多依赖迭代式检索增强生成,存在两大缺陷:1)过早锁定表面实体,受词汇歧义影响,导致问题分解错误;2)忽略推理步骤间的逻辑依赖,造成执行不协调。为此,我们提出STRIDE框架,将战略规划、动态控制与实体执行分离。核心是元规划器先构建无实体的推理骨架,抽象捕捉查询逻辑,推迟实体定位,缓解因过早词义绑定引发的歧义错误。监督器则按依赖关系调度子问题执行,支持可并行时并行,需依赖时串行,动态决定是否检索新证据或基于已有事实推断,避免冗余与错误传播,并融合跨分支信息、重写失败查询以增强鲁棒性。实体提取与逻辑推理交由专用模块处理,确保忠实性。此外,我们提出STRIDE-FT,一种模块化微调框架,利用STRIDE自生成的执行轨迹进行训练,无需人工标注或更强教师模型。实验表明,STRIDE在多跳问答中实现稳健准确的推理,而STRIDE-FT能有效提升开源大模型性能。
原文摘要 · Abstract (English)
Multi-hop question answering (MHQA) enables accurate answers to complex queries by retrieving and reasoning over evidence dispersed across multiple documents. Existing MHQA approaches mainly rely on iterative retrieval-augmented generation, which suffer from the following two major issues. 1) Existing methods prematurely commit to surface-level entities rather than underlying reasoning structures, making question decomposition highly vulnerable to lexical ambiguity. 2) Existing methods overlook the logical dependencies among reasoning steps, resulting in uncoordinated execution. To address these issues, we propose STRIDE, a framework that separates strategic planning, dynamic control, and grounded execution. At its core, a Meta-Planner first constructs an entity-agnostic reasoning skeleton to capture the abstract logic of the query, thereby deferring entity grounding until after the reasoning structure is established, which mitigates disambiguation errors caused by premature lexical commitment. A Supervisor then orchestrates sub-question execution in a dependency-aware manner, enabling efficient parallelization where possible and sequential coordination when necessary. By dynamically deciding whether to retrieve new evidence or infer from existing facts, it avoids redundant queries and error propagation, while fusing cross-branch information and reformulating failed queries to enhance robustness. Grounded fact extraction and logical inference are delegated to specialized execution modules, ensuring faithfulness through explicit separation of retrieval and reasoning. We further propose STRIDE-FT, a modular fine-tuning framework that uses self-generated execution trajectories from STRIDE, requiring neither human annotations nor stronger teacher models. Experiments show that STRIDE achieves robust and accurate reasoning, while STRIDE-FT effectively enhances open-source LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。