用少样本高效进化程序,突破科学发现的算力瓶颈。
ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution
- 引入父代采样与新颖性拒收策略,平衡探索与利用。
- 仅用150次采样即找到最优圆排列解,显著提升效率。
- 开源框架适合科研人员快速验证新算法与优化思路。
我们提出ShinkaEvolve:一个开源框架,利用大语言模型(LLMs)推动科学发现,实现卓越性能与前所未有的高效性。现有代码演化方法依赖LLM作为突变算子,但存在采样效率低(需数千样本)、闭源限制推广等问题。ShinkaEvolve通过三项创新解决:兼顾探索与利用的父代采样技术、基于新颖性的拒绝采样机制、基于强化学习的LLM集成选择策略。在多类任务中验证表明,该框架显著提升采样效率与解质量:仅用150次采样即发现新的最优圆排列方案;设计出高性能智能体架构用于AIME数学推理任务;改进ALE-Bench竞赛编程解法;发现新型混合专家负载均衡损失函数,揭示优化策略空间。结果证明其具备广泛适用性与极强采样效率。通过开源与成本效益,本工作使开放式计算问题求解民主化。
原文摘要 · Abstract (English)
We introduce ShinkaEvolve: a new open-source framework leveraging large language models (LLMs) to advance scientific discovery with state-of-the-art performance and unprecedented efficiency. Recent advances in scaling inference time compute of LLMs have enabled significant progress in generalized scientific discovery. These approaches rely on evolutionary agentic harnesses that leverage LLMs as mutation operators to generate candidate solutions. However, current code evolution methods suffer from critical limitations: they are sample inefficient, requiring thousands of samples to identify effective solutions, and remain closed-source, hindering broad adoption and extension. ShinkaEvolve addresses these limitations, introducing three key innovations: a parent sampling technique balancing exploration and exploitation, code novelty rejection-sampling for efficient search space exploration, and a bandit-based LLM ensemble selection strategy. We evaluate ShinkaEvolve across diverse tasks, demonstrating consistent improvements in sample efficiency and solution quality. ShinkaEvolve discovers a new state-of-the-art circle packing solution using only 150 samples, designs high-performing agentic harnesses for AIME mathematical reasoning tasks, identifies improvements to ALE-Bench competitive programming solutions, and discovers novel mixture-of-expert load balancing loss functions that illuminate the space of optimization strategies. Our results demonstrate that ShinkaEvolve achieves broad applicability with exceptional sample efficiency. By providing open-source accessibility and cost-efficiency, this work democratizes open-ended discovery across diverse computational problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。