arXiv:2603.07970cs.AI2026-03被引 1

用分阶段进化方法让大模型设计更靠谱的算法,工业级优化效果超越专家。

Advancing Automated Algorithm Design via Evolutionary Stagewise Design with LLMs

  • 分阶段迭代设计+实时反馈,让大模型理解问题机制
  • 2步内超越人类专家,芯片布线达到历史最优
  • 适合需要高可靠算法设计的工业场景

随着科技发展,工业问题日益复杂,传统算法设计面临挑战。基于大模型的自动化算法设计虽有潜力,但黑箱建模导致模型缺乏对问题本质的理解,产生幻觉设计。本文提出进化式分阶段算法设计(EvoStage),受思维链启发,将算法设计分解为可管理的连续阶段,并引入实时中间反馈以迭代优化设计方向。为缩小设计空间、避免局部最优,引入多智能体系统与“全局-局部视角”机制。在两种常见优化器设计中验证:一是为芯片布线设计Adam优化器的参数调度;二是为黑盒优化设计贝叶斯优化的采集函数。在开源基准上实验表明,EvoStage仅需数次进化步骤即超越人类专家设计和现有大模型方法,所有测试芯片案例均实现历史最优的半周长布线结果。部署于商用3D芯片布线工具后,性能显著超越原系统,创下效率新纪录。我们期望EvoStage能真正推动现实世界中的自动化算法设计,提升人类生产力。

原文摘要 · Abstract (English)

With the rapid advancement of human science and technology, problems in industrial scenarios are becoming increasingly challenging, bringing significant challenges to traditional algorithm design. Automated algorithm design with LLMs emerges as a promising solution, but the currently adopted black-box modeling deprives LLMs of any awareness of the intrinsic mechanism of the target problem, leading to hallucinated designs. In this paper, we introduce Evolutionary Stagewise Algorithm Design (EvoStage), a novel evolutionary paradigm that bridges the gap between the rigorous demands of industrial-scale algorithm design and the LLM-based algorithm design methods. Drawing inspiration from CoT, EvoStage decomposes the algorithm design process into sequential, manageable stages and integrates real-time intermediate feedback to iteratively refine algorithm design directions. To further reduce the algorithm design space and avoid falling into local optima, we introduce a multi-agent system and a "global-local perspective" mechanism. We apply EvoStage to the design of two types of common optimizers: designing parameter configuration schedules of the Adam optimizer for chip placement, and designing acquisition functions of Bayesian optimization for black-box optimization. Experimental results across open-source benchmarks demonstrate that EvoStage outperforms human-expert designs and existing LLM-based methods within only a couple of evolution steps, even achieving the historically state-of-the-art half-perimeter wire-length results on every tested chip case. Furthermore, when deployed on a commercial-grade 3D chip placement tool, EvoStage significantly surpasses the original performance metrics, achieving record-breaking efficiency. We hope EvoStage can significantly advance automated algorithm design in the real world, helping elevate human productivity.

算法设计大模型进化计算芯片优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。