通过动态切换显式与隐式推理,提升大模型推理的准确率和效率。
SwiReasoning: Switch-Thinking in Latent and Explicit for Pareto-Superior Reasoning LLMs
- 根据下一步词分布熵趋势判断信心,动态切换显式与隐式推理。
- 在多个基准上平均准确率提升1.8%-3.1%,受限预算下效率提升57%-79%。
- 适合对推理效率与准确性有高要求的部署场景,尤其在资源受限时。
近期研究发现,大语言模型(LLMs)不仅能通过自然语言链式思考进行推理,还能在隐空间中连续推理,每步蕴含更丰富信息,提升令牌效率。然而,纯隐式推理在无训练设置下仍面临两大挑战:一是维持多条隐式路径导致搜索分布扩大,概率质量分散、引入噪声,阻碍收敛至高置信解,降低准确率;二是即使无显式文本也存在过度思考,浪费令牌,影响效率。为此,我们提出 SwiReasoning,一种无需训练的推理框架,包含两项核心创新:1)基于分块置信度(由下一步词分布熵趋势估计)动态切换显式与隐式推理,平衡探索与利用,促进及时收敛;2)限制最大思维块切换次数,抑制过度思考,提升不同难度问题下的令牌效率。在数学、STEM、编程及通用基准上,SwiReasoning 在不同模型家族与规模的推理模型中,平均准确率提升1.8%-3.1%。在受限预算下,平均令牌效率提升57%-79%,且预算越紧,增益越大。
原文摘要 · Abstract (English)
Recent work shows that, beyond discrete reasoning through explicit chain-of-thought steps, which are limited by the boundaries of natural languages, large language models (LLMs) can also reason continuously in latent space, allowing richer information per step and thereby improving token efficiency. Despite this promise, latent reasoning still faces two challenges, especially in training-free settings: 1) purely latent reasoning broadens the search distribution by maintaining multiple implicit paths, which diffuses probability mass, introduces noise, and impedes convergence to a single high-confidence solution, thereby hurting accuracy; and 2) overthinking persists even without explicit text, wasting tokens and degrading efficiency. To address these issues, we introduce SwiReasoning, a training-free framework for LLM reasoning which features two key innovations: 1) SwiReasoning dynamically switches between explicit and latent reasoning, guided by block-wise confidence estimated from entropy trends in next-token distributions, to balance exploration and exploitation and promote timely convergence. 2) By limiting the maximum number of thinking-block switches, SwiReasoning curbs overthinking and improves token efficiency across varying problem difficulties. On widely used mathematics, STEM, coding, and general benchmarks, SwiReasoning consistently improves average accuracy by 1.8%-3.1% across reasoning LLMs of different model families and scales. Furthermore, under constrained budgets, SwiReasoning improves average token efficiency by 57%-79%, with larger gains as budgets tighten.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。