arXiv:2607.19962cs.AI2026-07中稿 · IJCAI

通过自修剪与顿悟优化,让大模型少走弯路、更快找到正确解法。

EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization

论文配图:EvoThink: Evolving Thinking in Large Reasoning Models via Self-Pruning and Aha-Moment Preference Optimization
图 1 · 摘自论文原文
  • 自修剪训练自动删减冗余推理步骤,生成精简路径。
  • 顿悟偏好优化挖掘失败中的关键突破点,提升解题能力。
  • 适合追求高效高精度推理的AI研发与应用者。

大型推理模型(LRM)常因冗余验证步骤而出现过度思考问题。现有缓解方法如快慢思维切换和推理轨迹压缩,难以精细区分有益与冗余步骤,可能在追求效率时损害推理能力。为此,我们提出EvoThink框架,通过减少冗余验证并鼓励探索新推理路径,同时提升推理效率与能力。该框架包含两个核心组件:自修剪训练(SPT),一种无监督方法,可迭代剪除冗余步骤,并在精简轨迹上自我训练;以及顿悟时刻偏好优化(AMPO),受遗传算法启发,识别有价值的失败推理尝试,构建从错误到正确的顿悟数据,优化模型内化此类推理模式。在数学推理与代码生成多个基准上的广泛评估表明,EvoThink不仅显著降低推理阶段的令牌消耗,还提升了LRM的推理能力。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) often suffer from overthinking due to redundant verification steps. Existing approaches for mitigating overthinking, such as fast-slow thinking switching and reasoning trajectory compression, fail to make a fine-grained distinction between beneficial and redundant steps within the LRM's reasoning process, and may thus impair reasoning capability in their pursuit of efficiency. To simultaneously improve reasoning efficiency and capability, we propose EvoThink, a framework that reduces redundant verification and encourages the exploration of new reasoning paths. EvoThink comprises two key components: Self-Pruning Training (SPT), an unsupervised method that iteratively prunes redundant reasoning steps and self-trains on the concise trajectories; and Aha-Moment Preference Optimization (AMPO), which, inspired by genetic algorithms, identifies valuable failed reasoning attempts, synthesizes from-wrong-to-right aha-moment data, and optimizes the model to internalize this reasoning pattern. Extensive evaluations across mathematical reasoning and code generation benchmarks demonstrate that EvoThink not only substantially reduces inference-time token usage but also improves the reasoning capability of LRMs.

推理优化大模型自修剪顿悟机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。