arXiv:2602.01982cs.CL2026-02被引 4

让大模型自动生成简洁推理链,提升效率与准确性

S3-CoT: Self-Sampled Succinct Reasoning Enables Efficient Chain-of-Thought LLMs

  • 通过激活控制实现模型自我采样推理路径,无需人工标注
  • 在数学和医学任务上均实现稳定性能提升,尤其适合资源受限场景
  • 支持无金标准数据的自进化训练,降低对高质量监督数据依赖

配备思维链(CoT)的大语言模型(LLM)展现出强大性能并揭示了模型行为。然而,近期研究表明,CoT能力的提升常伴随冗余推理过程。本文提出一种基于激活控制的自采样框架,可从目标LLM自身生成风格一致、长度可变的推理轨迹,无需教师指导,缓解了基于监督微调(SFT)方法中高质量标注数据稀缺的核心瓶颈。通过黄金答案过滤数据,我们采用(i)类人双认知系统架构与(ii)渐进压缩教学策略进行高效CoT训练;此外,还探索了一种仅依赖预测一致性可变长度样本的自进化范式,完全摆脱对黄金答案的依赖。在多个数学基准测试及跨领域医学泛化实验中,本方法对通用与R1型模型均表现出稳定的性能提升。代码与模型检查点见https://github.com/DYR1/S3-CoT。

原文摘要 · Abstract (English)

Large language models (LLMs) equipped with chain-of-thought (CoT) achieve strong performance and offer a window into LLM behavior. However, recent evidence suggests that improvements in CoT capabilities often come with redundant reasoning processes, motivating a key question: Can LLMs acquire a fast-thinking mode analogous to human System 1 reasoning? To explore this, our study presents a self-sampling framework based on activation steering for efficient CoT learning. Our method can induce style-aligned and variable-length reasoning traces from target LLMs themselves without any teacher guidance, thereby alleviating a central bottleneck of SFT-based methods-the scarcity of high-quality supervision data. Using filtered data by gold answers, we perform SFT for efficient CoT learning with (i) a human-like dual-cognitive system, and (ii) a progressive compression curriculum. Furthermore, we explore a self-evolution regime in which SFT is driven solely by prediction-consistent data of variable-length variants, eliminating the need for gold answers. Extensive experiments on math benchmarks, together with cross-domain generalization tests in medicine, show that our method yields stable improvements for both general and R1-style LLMs. Our data and model checkpoints can be found at https://github.com/DYR1/S3-CoT.

思维链自采样推理优化高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。