通过挖掘模型内部注意力机制,提升思维链推理的可靠性。
Deep Hidden Cognition Facilitates Reliable Chain-of-Thought Reasoning
- 利用注意力头激活值判断每步推理真假,动态筛选最优路径。
- 在数学、符号和常识任务上显著超越现有方法,准确率更高。
- 适用于大语言模型和多模态模型,适合追求高可靠推理的研究者。
思维链(CoT)推理在大语言模型(LLMs)和多模态大语言模型(MLLMs)中展现出强大的深度推理能力,但中间步骤错误累积常导致结果不可靠。本文发现特定注意力头的激活值能稳定反映推理步骤的真实性,基于此训练了一个置信度预测器,利用这些敏感于真实性的激活值评估每一步正确性,并通过束搜索动态选择最合理的推理路径。实验表明,该方法在数学、符号和常识推理任务上显著优于当前最优基线(如少样本思维链、自一致性、自评估引导束搜索),在单模态和多模态设置下均表现出更高的准确性和可靠性。进一步验证了其在大型推理模型上的适用性,证实可推广至专用推理模型。此外,还探讨了模型自我修正能力在CoT推理中的作用。本工作为提升CoT推理可靠性提供了新路径,具有广泛应用潜力。
原文摘要 · Abstract (English)
Chain of Thought (CoT) reasoning has demonstrated remarkable deep reasoning capabilities in both large language models (LLMs) and multimodal large language models (MLLMs). However, its reliability is often undermined by the accumulation of errors in intermediate steps. This paper introduces an novel approach to calibrate the CoT reasoning accuracy by leveraging the model's intrinsic veracity encoding. We discover that specific attention head activations reliably reflect the truthfulness of reasoning steps in CoT. Based on this insight, we train a confidence predictor to evaluate the correctness of each reasoning step using these truthfulness-sensitive activations, dynamically selecting the most plausible reasoning path via beam search. Experimental results demonstrate that our method significantly outperforms the state-of-the-art baselines (e.g., Few-Shot CoT, Self-Consistency, and Self-Evaluation Guided Beam Search) across the mathematical, symbolic, and commonsense reasoning tasks, exhibiting superior accuracy and reliability in both unimodal and multimodal settings. We further validate the approach on large reasoning models, confirming its applicability to specialized reasoning models. Additionally, we explore the role of the model's self-correction ability in CoT reasoning. This work provides a novel reliability improvement path for CoT reasoning with broad application potential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。