arXiv:2505.24181cs.AI2025-05NeurIPS被引 7

让大模型通过渐进式思维链提升推理能力,无需预训练也能实现。

SCOUT: Teaching Pre-trained Language Models to Enhance Reasoning via Flow Chain-of-Thought

  • 将推理过程建模为认知状态的逐步演化轨迹,每轮迭代深化思维。
  • 在8个基准上平均提升准确率,微调后最高增益达1.8%。
  • 适合想提升模型推理深度但资源有限的研究者与开发者。

思维链(CoT)提示通过引导分步思考提升大语言模型的推理表现,但依赖显式中间步骤,限制了可扩展性和泛化能力。近期工作探索递归推理,利用内部层重用于迭代优化潜在表示,而无需显式CoT监督。尽管有潜力,这些方法常需昂贵预训练,且缺乏推理演化的系统框架。本文提出流动思维链(Flow CoT),将递归推理视为潜在认知状态的渐进轨迹,每轮迭代对应一个认知阶段,深化推理而不依赖人工标注。为此,我们设计轻量级微调框架SCOUT(基于教师的渐进认知优化),使模型无需预训练即可实现Flow CoT式推理。SCOUT采用渐进式蒸馏对齐各轮次与适配容量的教师,并引入基于交叉注意力的回溯模块,在保留原始计算流的同时融合前序输出。在8个推理基准上的实验表明,SCOUT持续提升准确率与解释质量,微调下最高获1.8%增益。定性分析显示,其推动推理逐轮深化,优化信念形成与解释粒度。结果不仅验证了SCOUT的有效性,也证明了Flow CoT作为可扩展推理增强框架的可行性。

原文摘要 · Abstract (English)

Chain of Thought (CoT) prompting improves the reasoning performance of large language models (LLMs) by encouraging step by step thinking. However, CoT-based methods depend on intermediate reasoning steps, which limits scalability and generalization. Recent work explores recursive reasoning, where LLMs reuse internal layers across iterations to refine latent representations without explicit CoT supervision. While promising, these approaches often require costly pretraining and lack a principled framework for how reasoning should evolve across iterations. We address this gap by introducing Flow Chain of Thought (Flow CoT), a reasoning paradigm that models recursive inference as a progressive trajectory of latent cognitive states. Flow CoT frames each iteration as a distinct cognitive stage deepening reasoning across iterations without relying on manual supervision. To realize this, we propose SCOUT (Stepwise Cognitive Optimization Using Teachers), a lightweight fine tuning framework that enables Flow CoT style reasoning without the need for pretraining. SCOUT uses progressive distillation to align each iteration with a teacher of appropriate capacity, and a cross attention based retrospective module that integrates outputs from previous iterations while preserving the models original computation flow. Experiments across eight reasoning benchmarks show that SCOUT consistently improves both accuracy and explanation quality, achieving up to 1.8% gains under fine tuning. Qualitative analyses further reveal that SCOUT enables progressively deeper reasoning across iterations refining both belief formation and explanation granularity. These results not only validate the effectiveness of SCOUT, but also demonstrate the practical viability of Flow CoT as a scalable framework for enhancing reasoning in LLMs.

推理增强思维链微调大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。