arXiv:2510.10925cs.LGcs.CL2025-10ACL被引 21

根据学生模型特点选最优教师,生成更易学的合成数据

Find Your Optimal Teacher: Personalized Data Synthesis via Router-Guided Multi-Teacher Distillation

  • 用路由机制为每个问题匹配最适配的教师
  • 在指令微调和数学推理任务中表现优于或持平基线
  • 适合需要高效高质量合成数据的研究者

用强教师模型生成合成数据来训练学生模型是一种有前景的方法。然而,近期研究发现更强的教师并不总是最佳选择,存在教师输出与学生可学性不匹配的问题。为此,我们提出PerSyn(个性化数据合成)策略,采用全新的“先路由后生成”范式,为每个学生模型生成定制化数据,提升学习效率。具体而言,PerSyn首先通过查询级路由机制,综合考虑学生可学性和教师响应质量,将每个提示分配给最优教师;各教师仅为其分配的提示生成数据,相比传统“先生成后筛选”范式更高效。在不同模型家族和规模下的大量实验表明,PerSyn在指令微调和数学推理任务中均持续达到优于或相当基线的表现。进一步分析验证了其有效性,并为未来研究提供了新洞见。

原文摘要 · Abstract (English)

Training student models on synthetic data generated by strong teacher models is a promising way to distilling the capabilities of teachers. However, recent studies show that stronger models are not always optimal teachers, revealing a mismatch between teacher outputs and student learnability. To address this issue, we propose PerSyn (Personalized data Synthesis), a novel synthesis strategy that operates under a new ``Route then Generate'' paradigm to create data tailored to each student model, enabling it to learn more effectively. Specifically, PerSyn first assigns each prompt to its optimal teacher via a query-level router that jointly considers student learnability and teacher response quality. Each teacher then synthesizes data only for its assigned prompts, making the process more efficient than the conventional ``Generate then Select'' paradigm, where all teachers must generate parallel responses for the entire prompt set before constructing the final dataset. Extensive experiments across different model families and scales demonstrate that PerSyn consistently achieves superior or comparable performance to all baselines in instruct tuning and math reasoning settings. Further analysis verifies the effectiveness of PerSyn and offers extra insights to propel future research.

数据合成知识蒸馏个性化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。