arXiv:2607.12267cs.LGcs.AI2026-07

让语言代理显式管理推理状态,显著提升复杂多步问题求解能力。

Track, Rank, Crack: Epistemic Working Memory Scales Multi-Hop Reasoning in Language Agents

论文配图:Track, Rank, Crack: Epistemic Working Memory Scales Multi-Hop Reasoning in Language Agents
图 1 · 摘自论文原文
  • 构建结构化认知工作记忆,显式存储已确认事实、待验证假设和待解决问题。
  • 在4跳任务上性能提升11分,远超传统方法,且越难的任务提升越明显。
  • 组织化推理状态是高效决策的关键,适合需要深度逻辑推理的研究与应用。

语言代理在交替进行推理与工具调用时,随着推理链变长性能急剧下降,即使每一步都很简单。我们将其归因于上下文稀释:代理的调查状态(已确认、怀疑或仍需探究的内容)仅隐含于不断增长的上下文窗口中,早期发现被后续检索结果淹没。我们提出SLEUTH,通过结构化的认知工作记忆使该状态显式可操作:代理维护基于来源的已确认事实、按证据排序的活跃假设,以及直接驱动下一步行动的开放问题。在五个多跳基准测试和五个基线模型上,SLEUTH的优势随难度增加而扩大,从HotpotQA的+5分到4跳链的+11分,超越Reflexion无需多轮。分析剩余差距,我们识别出证据充分性问题:代理常找到答案却不愿确认,过度消耗预算进行无谓验证。一个轻量级承诺触发器可解决此问题,但仅当代理已具备结构化状态时有效;若应用于非结构化代理,则无改善,表明有组织的认知状态是有效承诺的必要条件。最后,在较弱模型上强制执行协议,可在最难题目上恢复高达+19分,表明推理组织方式而非模型能力,是提升多跳推理的核心因素。

原文摘要 · Abstract (English)

Language agents that interleave reasoning and tool use degrade sharply as reasoning chains lengthen, even when each individual step is easy. We trace this to context dilution: an agent's investigative state (what it has confirmed, what it suspects, and what it still needs) lives only implicitly in a growing context window, where early discoveries are buried under later retrievals. We introduce SLEUTH, which makes this state explicit and actionable through a structured epistemic working memory: the agent maintains Confirmed Facts grounded to sources, Active Hypotheses ranked by evidence, and Open Questions that directly drive its next action. Across five multi-hop benchmarks and five established baselines, SLEUTH's advantage grows with difficulty, from +5 points on HotpotQA to +11 on 4-hop chains, surpassing Reflexion without multiple episodes. Analyzing where the remaining gap lies, we identify the evidence sufficiency problem: agents often find the answer but fail to commit, exhausting their budget on needless verification. A lightweight commitment trigger fixes this, but only when the agent already maintains structured state: the identical trigger applied to an unstructured agent yields no improvement, isolating organized epistemic state as the necessary condition for effective commitment. Finally, enforcing protocol adherence on a weaker model recovers up to +19 points on the hardest problems, showing that how an agent organizes its reasoning, not raw model capability, is the active ingredient for scaling multi-hop reasoning.

多跳推理语言代理认知建模推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。