将大模型推理过程改为可动态终止的潜空间规划,提升推理多样性与可扩展性。
Latent Chain-of-Thought as Planning: Decoupling Reasoning from Verbalization
- 用潜空间轨迹表示推理路径,分离思考与语言生成
- 在数学题上推理多样性更高,虽贪心准确率略低但更易拓展
- 适合需要深度搜索或动态终止的复杂问题求解场景
Chain-of-Thought(CoT)使大语言模型能够解决复杂问题,但在离散标记空间中受限于计算成本和推理路径坍塌。近期潜空间推理方法通过在连续隐藏状态中进行推理以提升效率,但通常作为从显式推理步骤到潜状态的黑箱端到端映射,且推理时需预设潜步数。本文提出PLaT(Planning with Latent Thoughts),将潜空间推理重新建模为规划,从根本上解耦思考与语言化。我们将推理建模为确定性的潜规划状态轨迹,由独立解码器在必要时将这些思想转化为文本。这种解耦使模型能动态决定何时终止推理,而非依赖固定超参数。在数学基准测试上的实证结果表明:尽管PLaT的贪心准确率低于基线,但在推理多样性方面表现出更优的可扩展性,说明其学习到了更鲁棒、更广泛的解空间,为推理时搜索提供了透明且可扩展的基础。代码见https://github.com/yunsaijc/PLaT。
原文摘要 · Abstract (English)
Chain-of-Thought (CoT) empowers Large Language Models (LLMs) to tackle complex problems, but remains constrained by the computational cost and reasoning path collapse when grounded in discrete token spaces. Recent latent reasoning approaches attempt to optimize efficiency by performing reasoning within continuous hidden states. However, these methods typically operate as opaque end-to-end mappings from explicit reasoning steps to latent states, and often require a pre-defined number of latent steps during inference. In this work, we introduce PLaT (Planning with Latent Thoughts), a framework that reformulates latent reasoning as planning by fundamentally decouple reasoning from verbalization. We model reasoning as a deterministic trajectory of latent planning states, while a separate Decoder grounds these thoughts into text when necessary. This decoupling allows the model to dynamically determine when to terminate reasoning rather than relying on fixed hyperparameters. Empirical results on mathematical benchmarks reveal a distinct trade-off: while PLaT achieves lower greedy accuracy than baselines, it demonstrates superior scalability in terms of reasoning diversity. This indicates that PLaT learns a robust, broader solution space, offering a transparent and scalable foundation for inference-time search. Our code can be found in https://github.com/yunsaijc/PLaT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。