用扩散模型提升进化算法的搜索效率与多样性。
Heuristically Adaptive Diffusion-Model Evolutionary Strategy
- 将扩散模型作为进化算法的生成器,迭代优化参数
- 通过历史信息保留实现高效收敛,避免早熟
- 支持细粒度控制,适合复杂优化任务
扩散模型在生成建模中取得显著进展,通过先加噪再重建的双阶段过程实现从纯噪声到数据的生成。与此同时,进化算法基于生物启发的优化策略,用于在复杂目标函数中寻找最优参数。本文揭示二者在生成机制上的本质联系:均通过迭代精炼随机初始分布生成高质量样本。通过将深度学习的扩散模型应用于各类进化任务,并利用启发式获取的数据集不断迭代优化扩散模型,可生成更适应环境的后代参数并融入后续模型。该方法在保持探索多样性的同时实现高效收敛。扩散模型为进化算法引入更强的记忆能力,能跨代保留历史信息并利用细微数据关联生成更优样本。我们使进化算法从浅层启发式走向具有深层记忆的框架。通过在参数层面使用无分类器引导进行条件采样,可精确控制进化过程中的基因型、表型或种群整体特性。本框架标志着启发式与算法的重大转变,提升了进化优化过程中的灵活性、精度与可控性。
原文摘要 · Abstract (English)
Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables pure noise-to-data generation and modular reconstruction of, images or videos. Concurrently, evolutionary algorithms employ optimization methods inspired by biological principles to refine sets of numerical parameters encoding potential solutions to rugged objective functions. Our research reveals a fundamental connection between diffusion models and evolutionary algorithms through their shared underlying generative mechanisms: both methods generate high-quality samples via iterative refinement on random initial distributions. By employing deep learning-based diffusion models as generative models across diverse evolutionary tasks and iteratively refining diffusion models with heuristically acquired databases, we can iteratively sample potentially better-adapted offspring parameters, integrating them into successive generations of the diffusion model. This approach achieves efficient convergence toward high-fitness parameters while maintaining explorative diversity. Diffusion models introduce enhanced memory capabilities into evolutionary algorithms, retaining historical information across generations and leveraging subtle data correlations to generate refined samples. We elevate evolutionary algorithms from procedures with shallow heuristics to frameworks with deep memory. By deploying classifier-free guidance for conditional sampling at the parameter level, we achieve precise control over evolutionary search dynamics to further specific genotypical, phenotypical, or population-wide traits. Our framework marks a major heuristic and algorithmic transition, offering increased flexibility, precision, and control in evolutionary optimization processes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。