用能量模型提升大模型推理一致性,不改主模型也能更准更稳。
Think Consistently, Reason Efficiently: Energy-Based Calibration for Implicit Chain-of-Thought
- 在隐空间用能量模型动态校准推理轨迹,让每步思考更连贯。
- 数学/常识/符号推理任务上,一致性和准确率显著提升。
- 适合需要稳定多步推理的场景,如自动解题、逻辑推演。
大语言模型通过链式思维(CoT)提示实现逐步推理,但显式离散推理易传播错误且受限于词汇表达,导致推理路径僵化不一致。近期研究探索在隐空间进行隐式连续推理,虽缓解部分问题,却缺乏显式机制保证各步骤一致性,常出现推理发散与结果不稳定。为此,我们提出基于能量模型的链式思维校准框架EBM-CoT,通过能量模型动态引导隐式思维表示向嵌入空间中低能量、高一致性的区域调整,从而在不修改基础语言模型的前提下,提升推理的准确性与一致性。在数学、常识和符号推理等多个基准上的实验表明,该方法显著增强了大模型多步推理的一致性与效率。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated strong reasoning capabilities through \emph{Chain-of-Thought} (CoT) prompting, which enables step-by-step intermediate reasoning. However, explicit CoT methods rely on discrete token-level reasoning processes that are prone to error propagation and limited by vocabulary expressiveness, often resulting in rigid and inconsistent reasoning trajectories. Recent research has explored implicit or continuous reasoning in latent spaces, allowing models to perform internal reasoning before generating explicit output. Although such approaches alleviate some limitations of discrete CoT, they generally lack explicit mechanisms to enforce consistency among reasoning steps, leading to divergent reasoning paths and unstable outcomes. To address this issue, we propose EBM-CoT, an Energy-Based Chain-of-Thought Calibration framework that refines latent thought representations through an energy-based model (EBM). Our method dynamically adjusts latent reasoning trajectories toward lower-energy, high-consistency regions in the embedding space, improving both reasoning accuracy and consistency without modifying the base language model. Extensive experiments across mathematical, commonsense, and symbolic reasoning benchmarks demonstrate that the proposed framework significantly enhances the consistency and efficiency of multi-step reasoning in LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。