让模型先答后解释,零成本提升回答准确率
Post Reasoning: Improving the Performance of Non-Thinking Models at No Cost
- 模型答完再补理由,不增加延迟和耗 token
- 117组测试中88.2%表现提升,平均提高17.37%
- 适合追求高精度且怕推理开销的实用场景
随着大语言模型广泛应用,中间推理过程带来的令牌消耗显著增加了推理延迟和运营成本。近期研究发现,许多实际任务并不需要显式推理,额外推理甚至会降低性能。本文提出「后推理」(Post-Reasoning),一种简单有效的方法:在生成最终答案后,让指令微调模型补充解释。该方法无需额外延迟或令牌开销,仅通过指令增强即可提升性能。我们在117个模型-基准组合上评估,涵盖13个开源与专有模型、4个模型家族及9个多样化推理与知识密集型基准(包括AMC、HMMT、GSM8K、GPQA、MMLU-Pro、BIG-Bench Hard)。后推理在超过88.19%的设置中提升性能,平均相对提升17.37%。我们还提出监督后推理微调,进一步在91.11%的设置中表现更优,平均超越提示式后推理基线8.01%,证明后推理可通过训练内化。最终,后推理为直接回答能力树立了新性能上限。
原文摘要 · Abstract (English)
As the widespread adoption of Large Language Models (LLMs) accelerates, token consumption from intermediate reasoning traces increasingly contributes to inference latency and operational cost. Recent studies suggest that many real-world tasks require little to no explicit reasoning, with additional reasoning sometimes even degrading performance. In this work, we propose \textbf{Post-Reasoning}, a simple yet effective approach that improves instruction-tuned models by conditioning them to justify their answers after generating the final response. By design, it enables the final answer to be obtained without additional latency or token cost, while still improving performance through simple instruction augmentation. We evaluate Post-Reasoning across \(117\) model--benchmark settings spanning \(13\) open and proprietary models, \(4\) model families, and \(9\) diverse reasoning and knowledge-intensive benchmarks, including AMC, HMMT, GSM8K, GPQA, MMLU-Pro, and BIG-Bench Hard. Post-Reasoning improves performance in over \(88.19\%\) of evaluated settings, achieving a mean relative improvements of \(17.37\%\). Furthermore, we propose supervised post-reason tuning, which further improves performance in over \(91.11\%\) of evaluated settings, and exceeds the prompt-based post-reasoning baseline by an average of \(8.01\%\), demonstrating that post-reasoning can be effectively internalized through training. Ultimately, Post-Reasoning establishes a new performance ceiling for direct-answer capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。