首次证明切换算法可让优化速度显著提升,解决经典问题更快。
When Switching Algorithms Helps: A Theoretical Study of Online Algorithm Selection
- 用动态切换两种进化算法,分阶段应对优化难点。
- 最优切换策略使求解时间缩短至O(n log log n)。
- 适合研究自适应优化与算法选择的理论学者。
在线算法选择(OAS)旨在随适应度景观变化调整优化过程,理论上应优于单一算法组合。尽管大量实证支持此预期,但迄今尚无理论证明其能实现渐进加速(除少数人工超启发式例子外)。本文首次构建理论实例,证明在OneMax问题上,通过在(1+λ) EA与(1+(λ,λ)) GA间恰当切换,可实现渐进加速:最优切换策略下期望时间降至O(n log log n),优于任一算法单独使用时的最佳表现Θ(n√(log n log log log n / log log n))。我们先分析理想切换规则,再提出实际可行策略,达到相同性能。分析结合固定起点与固定目标视角,揭示不同算法在优化不同阶段的优势。该方法为深入理解OAS提供新路径。
原文摘要 · Abstract (English)
Online algorithm selection (OAS) aims to adapt the optimization process to changes in the fitness landscape and is expected to outperform any single algorithm from a given portfolio. Although this expectation is supported by numerous empirical studies, there are currently no theoretical results proving that OAS can yield asymptotic speedups (apart from some artificial examples for hyper-heuristics). Moreover, theory-based guidelines for when and how to switch between algorithms are largely missing. In this paper, we present the first theoretical example in which switching between two algorithms -- the $(1+λ)$ EA and the $(1+(λ,λ))$ GA -- solves the OneMax problem asymptotically faster than either algorithm used in isolation. We show that an appropriate choice of population sizes for the two algorithms allows the optimum to be reached in $O(n\log\log n)$ expected time, faster than the $Θ(n\sqrt{\frac{\log n \log\log\log n}{\log\log n}})$ runtime of the best of these two algorithms with optimally tuned parameters. We first establish this bound under an idealized switching rule that changes from the $(1+λ)$ to the $(1+(λ,λ))$ GA at the optimal time. We then propose a realistic switching strategy that achieves the same performance. Our analysis combines fixed-start and fixed-target perspectives, illustrating how different algorithms dominate at different stages of the optimization process. This approach offers a promising path toward a deeper theoretical understanding of OAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。