arXiv:2504.01738cs.CLcs.AI2025-04被引 7

小模型靠模仿大模型的表达风格来推理,而非真正理解内容。

Style over Substance: Distilled Language Models Reason Via Stylistic Replication

  • 用合成文本模仿大模型的表达风格进行训练
  • 小模型在新数据上表现接近原模型,但可能答错却更自信
  • 适合研究模型泛化与推理机制的学者关注

专用推理语言模型(RLMs)通过详尽的推理链条提升性能。尽管这些链条可用于将知识蒸馏到小型指令微调模型中,但转移的推理本质尚不明确。本文系统分析推理链条中的结构与词汇模式,识别出成功推理的特征。构建两个新数据集:一个包含涌现的推理链条,另一个是显式构造的、复制这些风格的合成数据集,以精确考察其对蒸馏模型推理能力的影响。结果表明,使用合成链条训练的模型性能可媲美原模型,说明蒸馏后的推理能力高度依赖表面风格模式。令人惊讶的是,即使合成链条引导至错误答案,模型性能仍有所提升。这表明风格模式可被有效利用,以高效增强多种模型家族的推理能力。

原文摘要 · Abstract (English)

Specialized reasoning language models (RLMs) have demonstrated that scaling test-time computation through detailed reasoning traces significantly enhances performance. Although these traces effectively facilitate knowledge distillation into smaller, instruction-tuned models, the precise nature of transferred reasoning remains unclear. In this study, we investigate to what extent distilled models internalize replicated stylistic patterns during reasoning. To this end, we systematically analyze reasoning traces, identifying structural and lexical patterns that characterize successful reasoning. We then introduce two new datasets -- a dataset of emergent reasoning traces and a synthetic dataset explicitly constructed to replicate these stylistic patterns -- to precisely examine their influence on distilled models' reasoning capabilities. We find that models trained on the synthetic traces achieve comparable performance, indicating that distilled reasoning abilities rely significantly on surface-level patterns. Surprisingly, we observe an increase in performance even when the synthetic traces are altered to lead to the wrong answer. Our findings highlight how stylistic patterns can be leveraged to efficiently enhance LM reasoning across diverse model families.

风格迁移模型蒸馏推理能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。