用强化学习框架分析优化引导的遗传算法,揭示多样性关键作用
Mathematical perspective on genetic algorithms with optimization guided operators
- 将优化引导的变异与重组建模为查询复杂度问题
- 证明某些问题需生成、变异、重组协同求解
- 揭示解池多样性在实际应用中的核心价值
近年来机器学习在推理阶段应用遗传算法,通过迭代优化提升解决方案。其中的变异和重组操作已非传统随机过程:变异由机器学习模型驱动以改进目标函数,重组则基于优化策略合成更优解。此类操作虽提升效率但计算成本显著增加。本文提出通用遗传算法模型,将优化过程形式化为查询复杂度问题,采用强化学习语言进行分析。研究特定模型后发现,部分优化问题必须依赖生成、变异与重组协同求解。进一步针对该框架下的一类问题,设计出定性最优算法,揭示了解池多样性在实际机器学习遗传算法中的非平凡作用。
原文摘要 · Abstract (English)
Recent work in ML applies genetic algorithms at inference time to iteratively improve solutions to optimization problems. The basic mutation and recombination operators involved are qualitatively different from those studied classically. Mutations are no longer random; an ML algorithm mutates a solution with the goal of improving an objective. Similarly, recombination is not based on random collages of parent solutions. Instead, it is an ML optimization-based operator whose goal is to synthesize improved solutions from its inputs. Thus, these mutation and recombination operators are more likely to improve the objective, but their computational cost is much higher. We introduce a general model of genetic algorithms and formulating optimization in this model as a query-complexity problem, using the language of reinforcement learning. We then study specialized models. We show that some optimization problems require generation, mutation, and recombination to be solved. We then obtain qualitatively tight algorithms for a family of problems within this framework that captures the nontrivial role of diversity in the solution pool, a key feature of practical ML genetic algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。