大模型推理时答案很早就确定,后续步骤多为无效解释。
Large Language Models Decide Early and Explain Later

- 用强制填空法追踪模型每步预测,发现32%问题答案中途未变。
- 答案一旦锁定,模型平均还会生成760个冗余推理词。
- 提前停止可省500词/次,准确率仅降2%,适合高效部署。
大语言模型常通过长链式思维推理实现高精度,但其最终答案何时真正确定尚不明确。若答案在中间阶段已固定,后续推理可能仅为决策后的解释,增加推理成本却无助于提升正确性。本文通过强制答案补全方法,获取模型在部分推理前缀下的中间预测结果。以Qwen3-4B为对象,跨所有数据集平均分析发现,仅有32%的查询中答案在推理过程中发生变化。一旦最终答案发生切换,模型平均每题还会生成760个额外推理标记,占总推理预算的相当大比例。基于此,我们探索了早期停止策略,即在答案稳定后终止生成。结果表明,简单的探测类停止机制可在每题减少约500个推理词的同时,仅导致准确率下降2%。整体说明,大量链式思维生成存在冗余,可通过最小性能损失显著压缩推理开销。
原文摘要 · Abstract (English)
Large Language Models often achieve strong performance by generating long intermediate chain-of-thought reasoning. However, it remains unclear when a model's final answer is actually determined during generation. If the answer is already fixed at an intermediate stage, subsequent reasoning tokens may constitute post-decision explanation, increasing inference cost and latency without improving correctness. We study the evolution of predicted answers over reasoning steps using forced answer completion, which elicits the model's intermediate predictions at partial reasoning prefixes. Focusing on Qwen3-4B and averaging results across all datasets considered, we find that predicted answers change in only 32% of queries. Moreover, once the final answer switch occurs, the model generates an average of 760 additional reasoning tokens per query, accounting for a substantial fraction of the total reasoning budget. Motivated by these findings, we investigate early stopping strategies that halt generation once the answer has stabilized. We show that simple heuristics, including probe-based stopping, can reduce reasoning token usage by 500 tokens per query while incurring only a 2% drop in accuracy. Together, our results indicate that a large portion of chain-of-thought generation is redundant and can be reduced with minimal impact on performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。