让AI在思考时分步输出计划,用户可提前干预,提速超60%。
Plantain: Plan-Answer Interleaved Reasoning
- AI思考与回答交替进行,先输出任务计划
- 数学与编程任务上准确率提升6%,首响应快60%以上
- 适合需要用户纠错或实时反馈的交互场景
传统推理模型在生成答案前长时间沉默,用户无法判断其思路是否正确,易造成无效等待。我们提出交错推理(IR),让模型在思考过程中交替输出中间结果。进一步提出Plantain(计划-思考-回答交错):首个中间输出为任务的分步计划,使用户可在后续步骤前介入纠正。实验表明,在多个复杂数学与编码基准上,Plantain实现pass@1提升约6%,同时将首次响应时间减少超过60%,显著改善用户体验而不牺牲最终答案质量。
原文摘要 · Abstract (English)
Reasoning models often spend a significant amount of time thinking before they generate a visible response. In the meantime, they do not give the user any hints as to whether their reasoning is on the right track, and do not give the user any recourse to stop and correct them if their reasoning is flawed. This creates a frustrating, but unfortunately common, experience: the user's time is wasted while the model reasons from a false premise that could have easily been corrected. In contrast, human speakers typically perform lightweight, incremental grounding acts to ensure that participants in the conversation are on the same page; here we ask if language models can learn to leverage a similar type of behavior? With this motivation, we propose interleaved reasoning (IR), in which the model alternates between thinking and surfacing intermediate responses, as an alternative to the standard "think-then-answer" approach. By providing useful information to the user earlier, IR reduces perceived latency, the time a user waits for an initial output, without compromising the quality of the final response. We further introduce a specialization of interleaved reasoning, Plantain (Plan-Thought-Answer Interleaving), where the first intermediate response is an explicit, step-by-step plan for executing the task. This plan-first strategy allows for user intervention and early feedback for subsequent reasoning steps. We demonstrate that Plantain yields an ~6% improvement in pass@1 across several challenging math reasoning and coding benchmarks, while reducing time-to-first-response by over 60% relative to think-then-answer baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。