arXiv:2603.12372cs.AIcs.CL2026-03中稿 · ICLR被引 4

让大模型既不瞎想也不少想,高效又准确。

Efficient Reasoning with Balanced Thinking

  • 用置信度变化识别过度思考和思考不足,动态调节推理路径。
  • 在0.5B到32B模型上测试,减少冗余输出同时提升准确率。
  • 无需训练、即插即用,适合资源有限场景部署大模型。

大型推理模型虽具备强大推理能力,但常出现过度思考(对简单问题做冗余计算)或思考不足(未能充分探索推理路径)的问题,导致效率低下且可能出错,限制了其在资源受限环境中的应用。现有缓解过度思考的方法(如抑制反思关键词或调整推理长度)可能引发思考不足,影响准确性。为此,我们提出ReBalance——一种无需训练的框架,实现平衡推理。ReBalance利用置信度作为连续推理动态指标:通过高置信度方差识别过度思考,通过持续高置信度识别思考不足。基于小规模数据集的隐藏状态聚类生成推理模式原型,计算引导向量以调控大模型推理轨迹。动态控制函数根据实时置信度调节该向量的强度与方向,在过度思考时剪枝冗余,在思考不足时促进探索。在四个模型(0.5B至32B)及九个基准任务(数学推理、通用问答、编程)上的实验表明,ReBalance有效减少输出冗余并提升准确率,提供一种通用、免训练、即插即用的高效可靠大模型部署方案。项目页与代码见 https://rebalance-ai.github.io。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they often suffer from overthinking, expending redundant computational steps on simple problems, or underthinking, failing to explore sufficient reasoning paths despite inherent capabilities. These issues lead to inefficiencies and potential inaccuracies, limiting practical deployment in resource-constrained settings. Existing methods to mitigate overthinking, such as suppressing reflective keywords or adjusting reasoning length, may inadvertently induce underthinking, compromising accuracy. Therefore, we propose ReBalance, a training-free framework that achieves efficient reasoning with balanced thinking. ReBalance leverages confidence as a continuous indicator of reasoning dynamics, identifying overthinking through high confidence variance and underthinking via consistent overconfidence. By aggregating hidden states from a small-scale dataset into reasoning mode prototypes, we compute a steering vector to guide LRMs' reasoning trajectories. A dynamic control function modulates this vector's strength and direction based on real-time confidence, pruning redundancy during overthinking, and promoting exploration during underthinking. Extensive experiments conducted on four models ranging from 0.5B to 32B, and across nine benchmarks in math reasoning, general question answering, and coding tasks demonstrate that ReBalance effectively reduces output redundancy while improving accuracy, offering a general, training-free, and plug-and-play strategy for efficient and robust LRM deployment. Project page and code are available at https://rebalance-ai.github.io .

推理优化大模型平衡思考

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。