让大模型自动判断推理何时够用,又快又准。
SuCo: Sufficiency-guided Continuous Adaptive Reasoning

- 定义最短有效推理路径MSC,动态调整思考长度。
- 在数学、代码、科学任务上同时提升准确率与效率。
- 适合需要高效推理的部署场景或资源受限应用。
尽管大型推理模型在复杂任务上表现优异,但常产生过长的思维链(CoT),导致计算成本高昂,即使面对简单问题亦然。现有方法多依赖离散推理模式或固定预算层级,缺乏判断推理是否充分的理论依据。本文提出最小充分思维链(MSC),即生成正确答案所需的最短思维链前缀。实证表明,使用MSC不仅减少推理令牌数量,还能提升各难度等级下的准确率。基于MSC,我们提出连续自适应推理框架SuCo,包含两阶段训练:第一阶段,通过问题自适应的充分性阈值构建MSC数据,并微调模型以学习简洁而充分的推理模式;第二阶段,通过强化学习优化模型,结合动态复杂度追踪与充分性感知奖励,惩罚过度和不足推理。在数学、编程及科学基准上的大量实验显示,SuCo持续提升准确率与推理效率。
原文摘要 · Abstract (English)
Despite remarkable performance on complex tasks, Large Reasoning Models (LRMs) often generate excessively long Chain-of-Thoughts (CoT), inflating computational costs even for simple queries. Existing efforts to mitigate this inefficiency typically rely on discrete reasoning modes or fixed budget tiers, lacking a principled criterion of when reasoning is sufficient. In this work, we introduce Minimal Sufficient CoT (MSC), defined as the shortest prefix of a CoT trajectory which is adequate for producing the correct answer. We empirically show that MSC not only reduces reasoning tokens, but also improves accuracy across difficulty levels. Building on MSC, we propose Sufficiency-guided Continuous Adaptive Reasoning (SuCo), a two-stage training framework for autonomous reasoning control along a continuous spectrum. In stage 1, MSC-Aligned Fine-Tuning (MFT) constructs MSC data using problem-adaptive sufficiency thresholds that naturally scale with question difficulty, then fine-tunes the model to internalize concise yet sufficient reasoning patterns. In stage 2, Sufficiency-Aware Policy Optimization (SAPO) further optimizes the model through reinforcement learning with dynamic complexity tracking and sufficiency-aware rewards that penalize both over- and under-thinking. Extensive experiments across mathematics, code, and science benchmarks show that SuCo consistently achieves improvements in both accuracy and reasoning efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。