DesignX秒级生成专用黑盒优化器,性能远超人工设计。
DesignX: Human-Competitive Algorithm Designer for Black-Box Optimization
- 用双智能体强化学习自动构建算法结构与超参
- 在10,000个任务上训练,超越人工优化器数量级
- 发现专家未预见的优化模式,适合算法设计研究者
设计高效黑盒优化器受限于问题知识不足和需人工调参,耗时数月。本文提出首个自动化算法设计框架DesignX,可在数秒内为特定黑盒优化问题生成有效优化器。基于基本原理,识别出两大关键子任务:算法结构生成与超参数控制。构建涵盖数十年研究积累的数百种算法组件的模块化空间,引入双智能体强化学习系统,通过创新协作训练目标,实现跨10,000个多样化实例的大规模元训练。经数日自主学习,DesignX生成的优化器在合成测试集及真实场景(如蛋白质对接、AutoML、无人机路径规划)中持续超越人工设计,性能达数量级提升。深入分析显示,DesignX能发现超出专家直觉的非平凡算法模式,为优化社区提供宝贵设计洞见。项目代码已开源:https://github.com/MetaEvo/DesignX。
原文摘要 · Abstract (English)
Designing effective black-box optimizers is hampered by limited problem-specific knowledge and manual control that spans months for almost every detail. In this paper, we present \textit{DesignX}, the first automated algorithm design framework that generates an effective optimizer specific to a given black-box optimization problem within seconds. Rooted in the first principles, we identify two key sub-tasks: 1) algorithm structure generation and 2) hyperparameter control. To enable systematic construction, a comprehensive modular algorithmic space is first built, embracing hundreds of algorithm components collected from decades of research. We then introduce a dual-agent reinforcement learning system that collaborates on structural and parametric design through a novel cooperative training objective, enabling large-scale meta-training across 10k diverse instances. Remarkably, through days of autonomous learning, the DesignX-generated optimizers continuously surpass human-crafted optimizers by orders of magnitude, either on synthetic testbed or on realistic optimization scenarios such as Protein-docking, AutoML and UAV path planning. Further in-depth analysis reveals DesignX's capability to discover non-trivial algorithm patterns beyond expert intuition, which, conversely, provides valuable design insights for the optimization community. We provide DesignX's Python project at~ https://github.com/MetaEvo/DesignX.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。