arXiv:2608.13667cs.AIcs.SE2026-08

让大模型在等待环境反馈时并行思考,提升推理效率

Second Thought: Reasoning in Parallel as LLM Agents Act and Observe

论文配图:Second Thought: Reasoning in Parallel as LLM Agents Act and Observe
图 1 · 摘自论文原文
  • 在思考阶段结束后并行启动四个辅助思考分支
  • 平均减少43%主路径解码量,部分场景提速20%
  • 无需训练,适合各类大模型和复杂推理任务

LLM代理在ReAct范式中按思考-行动-观察顺序执行,但思考仅限于思考阶段;行动与观察之间的空档期存在推理闲置窗口。本文提出Second Thought,一种无需训练的推理框架:每当思考阶段结束,立即分叉出四个辅助分支,并与主流程并行解码,待环境观测结果返回后合并思考内容。该方法将额外推理移出主序列路径。在三个代理基准测试和三种推理型大模型上,所有九组组合均降低平均回合数,六组主路径解码减少达43%(平均约20%),一组合计基本不变;Pass@1在七组中无显著变化,两组分别提升12.4和10.2点。与计算量匹配的对照组相比,在四个适用场景中均实现更高Pass@1,且主路径串行解码量减少1.3至3.2步。

原文摘要 · Abstract (English)

LLM agents in the ReAct paradigm alternate between reasoning, acting, and observing, but deliberate reasoning is confined to the Thought phase: while the agent serializes an action and waits for the environment, its reasoning is frozen. We identify this recurring interval for Action and Observation as a reasoning idle window and ask whether it can host additional reasoning in parallel that serves future turns. Therefore, we propose Second Thought, a training-free inference framework that forks four auxiliary branches the instant each Thought phase concludes, decodes them concurrently with the main loop, and merges the generated thoughts back when the environment observation arrives. In this way, Second Thought relocates the added reasoning off the main thread's sequential decoding path. Across three agentic benchmarks and three reasoning LLMs, Second Thought lowers the average turn count in all nine (model,benchmark) pairs and reduces main thread decoding in six of them by up to 43% (roughly 20% on average among those settings), while leaving it essentially unchanged in a seventh; Pass@1 shows no significant change in seven of nine pairs and the two significant differences are +12.4 and +10.2 points. Against a compute-matched control that forces an equivalent budget onto the main thread's own reasoning, it attains strictly higher Pass@1 with 1.3 to 3.2 less sequential decoding in all four settings where the control applies.

大模型代理并行推理ReAct效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。