arXiv:2604.02967cs.AIcs.CL2026-04ACL被引 14

发现推理模型首个解法最佳,提出新框架提升效率与准确率

FoE: Forest of Errors Makes the First Solution the Best in Large Reasoning Models

论文配图:FoE: Forest of Errors Makes the First Solution the Best in Large Reasoning Models
图 1 · 摘自论文原文
  • 构建错误森林模型,揭示多解路径中错误随时间累积
  • 新框架RED使性能提升最高达19.0%,耗token减少37.7%~70.4%
  • 适合追求高效高精度推理的AI研发人员使用

近期大型推理模型(如DeepSeek-R1)在复杂推理任务中表现优异,展现出类似人类探索多种解法的模式。然而深入分析发现,首个解法往往最优,后续解法不仅不优,反而可能有害。这一现象挑战了传统的测试时扩展规律,我们推测推理过程中的错误随测试时间同步增长。通过系统实验,我们提出错误森林(FoE)结构,证明其导致‘首解最优’现象,并基于此设计自引导高效推理框架RED:一为‘精炼首解’,抑制首个解法中错误增长;二为‘剔除次解’,通过双一致性机制剪枝后续错误路径。在五个基准和六种骨干模型上的实验表明,RED超越八种基线,性能最高提升19.0%,同时节省37.7%~70.4%的生成token。对比实验进一步揭示了其有效性来源。

原文摘要 · Abstract (English)

Recent Large Reasoning Models (LRMs) like DeepSeek-R1 have demonstrated remarkable success in complex reasoning tasks, exhibiting human-like patterns in exploring multiple alternative solutions. Upon closer inspection, however, we uncover a surprising phenomenon: The First is The Best, where alternative solutions are not merely suboptimal but potentially detrimental. This observation challenges widely accepted test-time scaling laws, leading us to hypothesize that errors within the reasoning path scale concurrently with test time. Through comprehensive empirical analysis, we characterize errors as a forest-structured Forest of Errors (FoE) and conclude that FoE makes the First the Best, which is underpinned by rigorous theoretical analysis. Leveraging these insights, we propose RED, a self-guided efficient reasoning framework comprising two components: I) Refining First, which suppresses FoE growth in the first solution; and II) Discarding Subs, which prunes subsequent FoE via dual-consistency. Extensive experiments across five benchmarks and six backbone models demonstrate that RED outperforms eight competitive baselines, achieving performance gains of up to 19.0% while reducing token consumption by 37.7% ~ 70.4%. Moreover, comparative experiments on FoE metrics shed light on how RED achieves effectiveness.

推理优化错误建模高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。