让大模型自动决定何时用隐式推理,提升逻辑准确性。
Tyler: Typed Latent Reasoning for Language Models -- When to Think, What to Compute, and How Much to Allocate

- 动态决策何时启用隐式计算,按需分配推理预算。
- 在三个主流模型上最高提升14.49分准确率,优于传统思维链。
- 适合需要高精度推理的场景,如数学与复杂决策任务。
思维链(CoT)提示通过将中间计算以离散文本形式外化来提升大语言模型的推理能力,但这种文本接口也带来冗余和推理开销。隐式推理通过连续表示承载部分计算,是更具潜力的替代方案。然而,现有方法通常预设隐式计算的触发时机与分配策略,未解决关键问题:何时调用、执行何种计算、分配多少资源。本文提出类型化、预算感知的隐式推理框架——Tyler。该框架在每步解码时学习策略,选择输出文本或切换至针对特定推理功能的隐式计算模块。调用后,操作符将当前推理状态映射为支持全局规划、局部状态更新或可复用过程抽象的隐式标记。在三个基础大模型上的广泛实验表明,Tyler相比CoT最高提升14.49分准确率,相比最强基线提升4.30分。其在多样推理领域表现稳健,最终阶段性能最优且遗忘最少。
原文摘要 · Abstract (English)
Chain-of-thought (CoT) prompting improves reasoning in large language models (LLMs) by externalizing intermediate computation as discrete text tokens, but this textual interface also introduces redundancy and inference overhead. Latent reasoning offers a promising alternative by carrying part of the computation in continuous representations. However, existing methods typically predefine when latent computation is invoked and how it is allocated during decoding, leaving a key problem unresolved: when to invoke latent computation, what type of computation to perform, and how much budget to allocate. We propose \textbf{Ty}ped \textbf{L}at\textbf{e}nt \textbf{R}easoning (Tyler), a typed and budget-aware framework for latent reasoning during autoregressive decoding. Tyler learns a policy that, at each decoding step, chooses between emitting a text token and switching to a latent computation module specialized for a particular reasoning function. Once invoked, an operator maps the current reasoning state into latent tokens that support global planning, local state updates, or reusable procedural abstraction. Across extensive experiments on three backbone LLMs, Tyler improves accuracy by up to 14.49 points over CoT and by up to 4.30 points over the strongest competing baseline. It further generalizes across diverse reasoning domains and achieves the best final-stage performance with the lowest forgetting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。