不同教师模型生成的推理数据质量差异大,直接影响学生模型表现。
Not All Correct Answers Are Equal: Why Your Distillation Source Matters
- 用三个顶尖模型生成189万条推理数据,对比其分布特性。
- 基于AM-Thinking-v1数据训练的学生模型在多个基准上表现最优,最高达98.4分。
- 高质量推理轨迹能引导模型根据任务难度自适应调整输出长度。
知识蒸馏已成为提升开源语言模型推理能力的有效方法。本研究通过大规模实证分析,在包含189万条查询的共享语料库上,收集了三个顶级教师模型(AM-Thinking-v1、Qwen3-235B-A22B、DeepSeek-R1)的经验证推理输出,构建了三组平行数据集并分析其分布特征。结果表明,由AM-Thinking-v1生成的数据具有更高的词元长度多样性与更低的困惑度。在AIME2024、AIME2025、MATH500和LiveCodeBench等推理基准上,基于AM-Thinking-v1数据训练的学生模型表现最佳(如AIME2024达84.3分,AIME2025达72.2分,MATH500达98.4分,LiveCodeBench达65.9分),且表现出适应性输出行为——对复杂任务生成更长回答,简单任务则更简洁。研究强调高质量、经验证的推理轨迹的重要性。作者已将AM-Thinking-v1与Qwen3-235B-A22B的蒸馏数据集公开发布于Hugging Face,供后续研究使用。
原文摘要 · Abstract (English)
Distillation has emerged as a practical and effective approach to enhance the reasoning capabilities of open-source language models. In this work, we conduct a large-scale empirical study on reasoning data distillation by collecting verified outputs from three state-of-the-art teacher models-AM-Thinking-v1, Qwen3-235B-A22B, and DeepSeek-R1-on a shared corpus of 1.89 million queries. We construct three parallel datasets and analyze their distributions, revealing that AM-Thinking-v1-distilled data exhibits greater token length diversity and lower perplexity. Student models trained on each dataset are evaluated on reasoning benchmarks including AIME2024, AIME2025, MATH500, and LiveCodeBench. The model distilled from AM-Thinking-v1 consistently achieves the best performance (e.g., 84.3 on AIME2024, 72.2 on AIME2025, 98.4 on MATH500, and 65.9 on LiveCodeBench) and demonstrates adaptive output behavior-producing longer responses for harder tasks and shorter ones for simpler tasks. These findings highlight the value of high-quality, verified reasoning traces. We release the AM-Thinking-v1 and Qwen3-235B-A22B distilled datasets to support future research on open and high-performing reasoning-oriented language models. The datasets are publicly available on Hugging Face\footnote{Datasets are available on Hugging Face: \href{https://huggingface.co/datasets/a-m-team/AM-Thinking-v1-Distilled}{AM-Thinking-v1-Distilled}, \href{https://huggingface.co/datasets/a-m-team/AM-Qwen3-Distilled}{AM-Qwen3-Distilled}.}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。