通过结构化进化生成复杂推理任务,提升大模型泛化能力
Evolutionary Task Discovery: Advancing Reasoning Frontiers via Skill Composition and Complexity Scaling

- 设计双轴进化空间,用交叉与参数突变生成新技能组合
- 在多种模型和规模下实现稳定推理性能提升
- 动态近发展区过滤器确保任务可学习性,适合研究推理增强
大型语言模型的推理能力虽因后训练范式(如基于可验证奖励的强化学习)显著提升,但其效果仍受限于训练数据的多样性和复杂性。现有数据合成方法依赖无结构变异或探索,易导致同质性崩溃,无法系统拓展推理边界。为此,我们提出进化任务发现(EvoTD)框架,将数据合成视为在算法技能与复杂度属性双轴流形上的定向搜索。引入结构化进化算子:交叉算子用于合成新颖技能组合以增强多样性,参数突变算子则通过扩展输入规模、树深度等结构约束来促进鲁棒泛化。关键在于,我们集成动态近发展区过滤器,确保任务位于模型可学习范围内。实证表明,EvoTD在不同模型架构、预训练方案及规模下均实现显著且一致的推理提升,证明结构化进化课程能有效支持推理能力增强。代码已开源:https://github.com/liqinye/EvoTD。
原文摘要 · Abstract (English)
The reasoning frontier of Large Language Models (LLMs) has advanced significantly through modern post-training paradigms (e.g., Reinforcement Learning from Verifiable Rewards (RLVR)). However, the efficacy of these methods remains fundamentally constrained by the diversity and complexity of the training data. One practical solution is data synthesis; yet, prevalent methods relying on unstructured mutation or exploration suffer from homogeneity collapse, failing to systematically expand the reasoning frontier. To overcome this, we propose Evoutionary Task Discovery (EvoTD), a framework that treats data synthesis as a directed search over a dual-axis manifold of Algorithmic Skills and Complexity Attributes. We introduce structured evolutionary operators to navigate this space: a Crossover operator that synthesizes novel skill compositions to enhance diversity, and a Parametric Mutation operator that scales structural constraints (e.g., input size, tree depth) to drive robust generalization. Crucially, we integrate a dynamic Zone of Proximal Development filter, ensuring tasks lie within the learnable region of the model. Empirically, EvoTD delivers substantial reasoning gains that generalize consistently across model architectures, pretraining regimes, and scales, demonstrating that structured evolutionary curricula can effectively support reasoning improvement. We release our code on https://github.com/liqinye/EvoTD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。