arXiv:2510.05577cs.CLcs.AI2025-10被引 1

让大模型动态调整推理路径,提升开放域多跳问答准确率。

Mission Impossible: Feedback-Guided Dynamic Interactive Planning for Improving Reasoning on LLMs

  • 基于反馈和历史错误动态生成推理节点,灵活探索信息。
  • 在HotpotQA上达54.47% F1,StrategyQA上达70.05%,优于基线。
  • 适合需要深度推理的开放域问答任务,尤其关注路径优化。

近期语言代理在多跳推理任务中取得显著进展,但现有方法在处理开放域问题时仍受限于固定动作序列,需依赖大量信息检索。为此,我们提出反馈引导的动态交互规划(FGDIP),通过动态自适应策略提升大模型在开放域多跳推理中的表现。该方法首先识别与问题相关的关键实体作为推理起点,随后结合历史错误分析与实时反馈,动态生成并优化推理子节点。通过融合深度优先搜索与创新的节点生成机制,框架能根据过往错误路径及同层节点实时调整策略,有效拓展搜索空间并推动推理系统性收敛至正确答案。实验表明,FGDIP在HotpotQA数据集上达到54.47% F1,在StrategyQA上达到70.05%,分别超越最佳基线5.03%和7.25%,展现其在多跳推理任务中的通用性与潜力。

原文摘要 · Abstract (English)

Recent advancements in language agents have led to significant improvements in multi-hop reasoning tasks. However, existing approaches often struggle with handling open-domain problems, which require massive information retrieval due to their reliance on a fixed sequence of actions. To address this, we propose Feedback-Guided Dynamic Interactive Planning (FGDIP), a novel framework tailored to enhance reasoning in LLMs by utilizing dynamic and adaptive strategies for information exploration in open-domain multi-hop reasoning tasks. Our approach begins by identifying key entities relevant to the problem, which serve as the initial nodes in the reasoning process. From these initial nodes, we then generate reasoning child nodes with the process being refined through a combination of historical error analysis and real-time feedback, which allows the framework to dynamically adjust and optimize its reasoning strategies. By integrating depth-first search with an innovative node generation technique, our framework adapts based on both prior error paths and concurrently generated nodes at the same hierarchical level. This dynamic strategy effectively expands the search space while ensuring the reasoning process systematically converges toward accurate solutions. Experimental results show that FGDIP achieved up to 54.47% F1 score on the HotpotQA dataset and 70.05% on the StrategyQA dataset, surpassing the best baseline by 5.03% and 7.25% respectively, highlighting its versatility and potential to enhance language agents in multi-hop reasoning tasks.

多跳推理动态规划大模型问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。