arXiv:2606.29082cs.CLcs.LG2026-06

让大模型学会跨任务进化求解,提升发现新知识的能力。

Evolution Fine-Tuning: Learning to Discover Across 371 Optimization Tasks

论文配图:Evolution Fine-Tuning: Learning to Discover Across 371 Optimization Tasks
图 1 · 摘自论文原文
  • 将演化搜索轨迹转为监督信号,训练模型掌握迭代优化策略。
  • 在22个未见任务上平均性能提升10.22%,跨任务泛化显著。
  • 适合构建可复用的通用探索型智能体,如数学猜想求解者。

大型语言模型(LLMs)结合演化搜索已在优化任务中取得顶尖成果,涵盖数学猜想、GPU内核设计、科学定律发现和组合谜题等。然而,以往方法每次只针对单一任务进行搜索,完成即丢弃经验,模型自身无法积累演化能力。为此,本文提出进化微调(EFT),通过将演化搜索轨迹转化为监督信号,使模型在训练中学习跨任务演化策略。我们构建了包含156,000条轨迹、覆盖10个领域和371个优化任务的Finch Collection数据集,并对2B至9B参数量的开源LLM进行微调。实验表明,EFT实现显著跨任务泛化:在22个保留任务上,模型平均性能优于基线10.22%。此外,结合测试时强化学习,模型在两个圆打包任务上达到当前最优,在厄多斯最小重叠问题上超越基线模型。EFT为通用发现智能体提供了‘练习阶段’,使其不再从零开始应对新问题。

原文摘要 · Abstract (English)

Would experience designing faster GPU kernels also help close in on a long-standing open mathematical conjecture? Large Language Models (LLMs) integrated into evolutionary search have recently produced state-of-the-art solutions on optimization tasks, including open mathematical conjectures, GPU kernel design, scientific law discovery, and combinatorial puzzles. To achieve this, prior work applied search scaffolds to one target task at a time, so every new problem is approached from scratch and the experience accumulated during search is discarded once the model finishes its attempt. This leaves the capability of iteratively evolving a solution (e.g., knowing which part to mutate and how, deciding when to backtrack) entirely in the scaffold rather than in the model itself. Whether the model itself could acquire this capability and reuse it across different tasks has been largely unexamined. To address this, we introduce Evolution Fine-Tuning (EFT), a mid-training paradigm that teaches LLMs to evolve solutions across tasks by converting evolutionary search trajectories into supervision. We construct Finch Collection, a 156K-trajectory dataset spanning 10 domains and 371 optimization tasks, and fine-tune open-source LLMs from 2B to 9B parameters. Empirically, EFT confers cross-task generalization: across 22 held-out tasks, our models surpass their base counterparts by 10.22% on average. Furthermore, when paired with test-time RL, our model matches state-of-the-art performance on two circle-packing tasks and outperforms its base-model counterpart on the Erdős minimum-overlap problem. EFT thus serves as a "practice phase" for general-purpose discovery agents that do not solve new problems from scratch.

演化搜索大模型跨任务泛化自动发现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。