arXiv:2509.23619cs.AI2025-09被引 6

让小模型学会像大模型一样真正推理,而非只是模仿语言表象。

Reasoning Scaffolding: Distilling the Flow of Thought from LLMs

  • 将大模型的思考过程抽象为可解释的语义信号序列作为推理骨架
  • 小模型通过预测信号和生成步骤双任务训练,提升逻辑一致性
  • 在多个推理基准上显著超越现有蒸馏方法,适合追求真推理的小模型应用

当前从大语言模型中蒸馏推理能力的方法——基于文本理由的行为克隆——存在根本局限:它仅教会小语言模型模仿表面模式,而非底层的算法性思维结构,导致逻辑鲁棒性严重不足。本文提出将推理视为结构化生成过程,引入‘推理支架’框架,首先将教师模型的思维过程抽象为一系列离散、可解释的语义信号(如对比、添加)。学生模型通过多任务目标进行训练:一是预测下一个语义信号以预判推理流程,二是根据该信号生成对应推理步骤。这一多任务机制起到强正则化作用,促使学生内化连贯推理的计算模式。在多个高难度推理基准上,该方法显著优于现有最先进蒸馏技术,在准确率与逻辑一致性上均有提升,为构建真正具备推理能力的小型模型提供了可行路径。

原文摘要 · Abstract (English)

The prevailing approach to distilling reasoning from Large Language Models (LLMs)-behavioral cloning from textual rationales-is fundamentally limited. It teaches Small Language Models (SLMs) to mimic surface-level patterns rather than the underlying algorithmic structure of thought, resulting in a critical lack of logical robustness. We argue that instead of cloning text, distillation should transfer this algorithmic structure directly. We introduce Reasoning Scaffolding}, a framework that reframes reasoning as a structured generation process. Our method first abstracts the teacher's thought process into a sequence of discrete, interpretable semantic signals (e.g., Contrast, Addition) that act as a scaffold. The student model is then trained via a multi-task objective to both (1)predict the next semantic signal, anticipating the reasoning flow, and (2)generate the corresponding step, conditioned on that signal. This multi-task scheme acts as a powerful regularizer, compelling the student to internalize the computational patterns of coherent reasoning. On a suite of challenging reasoning benchmarks, our method significantly outperforms state-of-the-art distillation in both accuracy and logical consistency, providing a path towards creating smaller models that are genuine reasoners, not just fluent mimics.

推理蒸馏小模型思维结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。