arXiv:2510.19767cs.CLcs.AI2025-10被引 2

通过智能干预阻止大模型过早放弃高潜力思路,提升推理深度与效率。

SmartSwitch: Advancing LLM Reasoning by Overcoming Underthinking via Promoting Deeper Thought Exploration

  • 检测思维切换点,用奖励模型评估前序思路价值
  • 发现被弃高潜力思路时回溯并插入深化提示
  • 无需重训练,可通用接入各类大模型提升数学推理

长链思维(LongCoT)能力是大语言模型在复杂推理任务中取得突破的核心。然而,模型常出现‘浅层思考’问题,即频繁切换思路却未充分探索,导致性能下降和生成效率降低。为此,本文提出一种简单有效的推理策略——SmartSwitch推理框架。该框架可作为即插即用方案集成到任意大模型中,持续监控推理过程,识别思维切换节点,并利用现成的流程奖励模型(PRM)评估前序思路的潜力。若发现高潜力思路被过早放弃,干预模块将中断当前推理,回溯至切换前位置,插入‘深化提示’以引导模型深入探索该路径。在多个高难度数学推理基准上的大量实验表明,该方法显著提升了不同规模大模型的推理性能。

原文摘要 · Abstract (English)

The long chain-of-thought (LongCoT) capability is central to the recent breakthroughs achieved by large language models in complex reasoning tasks. However, the accompanying issue of ''underthinking'', where models exhibit shallow reasoning by frequently switching thoughts without sufficient exploration, limits both performance and token efficiency. To address this problem, we propose a simple yet effective reasoning strategy: the SmartSwitch inference framework. This framework can be easily integrated into any large language model as a plug-and-play solution, continuously monitoring the model's reasoning process to detect underthinking and guide it toward deeper exploration of promising but overlooked thoughts. Specifically, the perception module identifies points where thoughts switch and evaluates the potential of the preceding thought using an off-the-shelf process reward model (PRM). If a high-potential thought is found to be prematurely abandoned, the intervention module interrupts the ongoing inference, backtracks to the point before the switch, and inserts a "deepening prompt" to encourage further exploration along that promising path. Extensive experiments on challenging mathematical reasoning benchmarks demonstrate that our method significantly enhances the performance of various large language models of different sizes.

推理增强思维链提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。