用AI自研优化算法,在24个函数中18个达到机器精度。
ARES-LSHADE: Autoresearch-Enhanced LSHADE with Memetic Polish for the GNBG Benchmark
- 通过大模型自研搜索与进化算法结合,设计新变异算子。
- 在31次运行中赢下744次中的510次,24函数中有18个达机器精度。
- 方法可复现,且揭示了大模型研究的黑箱边界问题。
我们提出 ARES-LSHADE,一种用于通用数值基准生成器(GNBG)竞赛的自研增强型差分进化算法。该算法基于2025年LLM-LSHADE冠军方案,引入两个新组件:(a) 由约三十次大模型驱动的设计实验生成的自适应CMA-ES融合侦察变异算子;(b) 尊重黑盒规则的多起点L-BFGS-B精炼阶段。在竞赛规定的每函数31次运行、函数评估预算条件下,该算法在744次对比中取得510胜(函数级差距低于1e-8),24个函数中有18个达到机器精度。其余6个函数呈现符合GNBG组合结构的典型平台特征,被自研循环独立识别为最难函数。本报告还指出两点方法论发现:(i) 仅允许操作符修改、仅以适应度为观测的LLM研究循环会在此基准上收敛至特征平台;(ii) 初步扩展观测空间引入基准组合元数据后,算法可全解24函数,但违反黑盒规则,此问题提交前已被识别。我们讨论大模型能力与基准完整性间的张力,作为未来基于大模型的优化算法研究的设计考量。代码与可复现材料见 https://github.com/anaeem1/ARES-LSHADE。
原文摘要 · Abstract (English)
We present ARES-LSHADE, a memetic differential-evolution variant submitted to the GECCO 2026 competition on LLM-designed evolutionary algorithms for the Generalized Numerical Benchmark Generator (GNBG). The algorithm builds on the LLM-LSHADE 2025 winner, contributing two new components: (a) a scout-augmented mutation operator with adaptive CMA-ES integration, produced by an autonomous research loop across approximately thirty LLM-driven design experiments, and (b) a multi-start L-BFGS-B polish phase that respects strict blackbox treatment of the benchmark. On the official 31-run-per-function evaluation with the competition-specified function-evaluation budgets, ARES-LSHADE obtains 510 of 744 wins (per-function gap below 1e-8), reaching machine precision on 18 of 24 functions. The remaining six functions exhibit characteristic plateau signatures consistent with GNBG's compositional structure, and were independently identified by the autoresearch loop as the hardest of the suite. Beyond the result itself, this report documents two methodological observations: (i) an LLM-driven research loop with operator-only edit surface and fitness-only observation space converges to a characteristic plateau on this benchmark; (ii) when we initially widened the observation space to include the benchmark's compositional metadata, the resulting algorithm trivially solved all 24 functions but violated the competition's blackbox rule, which we identified before submission. We discuss this tension between LLM capability and benchmark integrity as a design consideration for future LLM-driven optimization-algorithm research. Code and reproducibility artifacts are available at https://github.com/anaeem1/ARES-LSHADE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。