arXiv:2602.19281cs.AI2026-02被引 3

发现大模型推理有计算上限,提出动态调控方案提升长程推理能力

Limited Reasoning Space: The cage of long-horizon reasoning in LLMs

  • 用动态规划框架捕捉大模型推理边界,避免过度思考
  • 在长任务上提升性能,计算预算超过阈值时效果反而下降
  • 适合需要深度推理的复杂任务,如科学问答与多步逻辑推演

测试时计算策略(如思维链)显著提升了大语言模型解决复杂任务的能力。然而实证研究表明,单纯增加计算预算有时会导致性能崩溃,尤其在使用典型任务分解策略(如思维链)时。本文提出‘有限推理空间’假设,认为推理失败源于静态规划方法无法感知大模型推理的内在边界。通过非自治随机动力系统理论分析,揭示存在最优计算预算区间;过度规划会引入冗余反馈,损害推理能力。为此提出Halo——一种面向长时序推理任务的模型预测控制框架,采用熵驱动双控制器与‘测量后规划’策略,实现可控推理。实验表明,Halo在复杂长程任务中优于静态基线,能动态调节推理边界以利用计算扩展优势。

原文摘要 · Abstract (English)

The test-time compute strategy, such as Chain-of-Thought (CoT), has significantly enhanced the ability of large language models to solve complex tasks like logical reasoning. However, empirical studies indicate that simply increasing the compute budget can sometimes lead to a collapse in test-time performance when employing typical task decomposition strategies such as CoT. This work hypothesizes that reasoning failures with larger compute budgets stem from static planning methods, which hardly perceive the intrinsic boundaries of LLM reasoning. We term it as the Limited Reasoning Space hypothesis and perform theoretical analysis through the lens of a non-autonomous stochastic dynamical system. This insight suggests that there is an optimal range for compute budgets; over-planning can lead to redundant feedback and may even impair reasoning capabilities. To exploit the compute-scaling benefits and suppress over-planning, this work proposes Halo, a model predictive control framework for LLM planning. Halo is designed for long-horizon tasks with reason-based planning and crafts an entropy-driven dual controller, which adopts a Measure-then-Plan strategy to achieve controllable reasoning. Experimental results demonstrate that Halo outperforms static baselines on complex long-horizon tasks by dynamically regulating planning at the reasoning boundary.

大模型推理思维链动态规划长程任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。