用大模型自动设计算法,结构功能一起优化,效果超越人类专家。
From Understanding to Excelling: Template-Free Algorithm Design through Structural-Functional Co-Evolution
- 通过自然语言生成代码,双维度协同进化优化结构与功能
- 在多个任务上性能超越传统方法,且能突破已有设计框架
- 适合需要快速创新算法的科研与工程场景
大型语言模型(LLMs)显著加速了算法自动生成与优化。然而,现有方法如EoH和FunSearch主要依赖预设模板和专家指定函数,仅关注关键功能的局部演化,未能充分利用整体架构协同效应与全局优化潜力。本文提出一种基于LLM的端到端算法生成与优化框架,利用大模型的深层语义理解能力,将自然语言需求或人工论文转化为代码方案,并采用二维协同进化策略,同步优化功能与结构。该闭环流程涵盖问题分析、代码生成与全局优化,可自动识别关键算法模块并实现多层级联合优化,持续提升性能与设计创新性。大量实验表明,该方法在性能与创新性上均优于传统局部优化方法,且对未知环境具备强适应性,在结构设计上展现突破潜力。本框架基于人类研究成果,生成并优化出超越人类专家设计的新算法,拓展了大模型在算法设计中的应用边界,为自动化算法开发提供了新路径。
原文摘要 · Abstract (English)
Large language models (LLMs) have greatly accelerated the automation of algorithm generation and optimization. However, current methods such as EoH and FunSearch mainly rely on predefined templates and expert-specified functions that focus solely on the local evolution of key functionalities. Consequently, they fail to fully leverage the synergistic benefits of the overall architecture and the potential of global optimization. In this paper, we introduce an end-to-end algorithm generation and optimization framework based on LLMs. Our approach utilizes the deep semantic understanding of LLMs to convert natural language requirements or human-authored papers into code solutions, and employs a two-dimensional co-evolution strategy to optimize both functional and structural aspects. This closed-loop process spans problem analysis, code generation, and global optimization, automatically identifying key algorithm modules for multi-level joint optimization and continually enhancing performance and design innovation. Extensive experiments demonstrate that our method outperforms traditional local optimization approaches in both performance and innovation, while also exhibiting strong adaptability to unknown environments and breakthrough potential in structural design. By building on human research, our framework generates and optimizes novel algorithms that surpass those designed by human experts, broadening the applicability of LLMs for algorithm design and providing a novel solution pathway for automated algorithm development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。