arXiv:2605.05284cs.NEcs.LG2026-05

从进化原理出发,推导出可模拟达尔文演化的真实优化算法。

Direct From Darwin: Deriving Advanced Optimizers From Evolutionary First Principles

论文配图:Direct From Darwin: Deriving Advanced Optimizers From Evolutionary First Principles
图 1 · 摘自论文原文
  • 基于进化第一性原理,构建达尔文谱系模拟框架,统一费希尔与赖特的演化观点。
  • 证明多种经典优化算法(如SGD、牛顿法变体)在引入特定噪声后即可忠实模拟演化过程。
  • 为最先进优化器Adam提供改造方案,使其符合进化仿真要求,适合演化计算研究者。

进化计算长期承诺提供高性能优化工具及严格的达尔文演化科学模拟,但现代算法常放弃进化保真度,转而采用物理启发式或表面生物学类比。本文从进化第一性原理直接推导出一系列先进的梯度优化算法。提出达尔文谱系模拟(DLS),证明在无性繁殖背景下,费希尔与赖特历史上对立的演化观实际上形式等价:可将费希尔的确定性总种群划分为赖特的随机漂移子种群。我们证明,正确的记录方式需引入一种特定结构化噪声(即DLS噪声关系)。关键的是,任何满足该关系的记录选择都将产生真实的演化模拟。利用这一巨大的表示自由度,我们证明一大类经过验证的优化算法(包括随机梯度下降、牛顿法及其正则化/近似版本、自然梯度下降)已完全兼容演化动态。仅通过添加DLS噪声(即进化上准确的遗传漂移),这些算法即可成为达尔文演化的科学合理在硅模拟。最后,我们展示,即使最先进的Adam优化器,也可通过微小数学改造实现演化合规性。

原文摘要 · Abstract (English)

Evolutionary computation has long promised to deliver both high-performance optimization tools as well as rigorous scientific simulations of Darwinian evolution. However, modern algorithms frequently abandon evolutionary fidelity for physics-inspired heuristics or superficial biological metaphors. This paper derives a suite of advanced gradient-based optimization algorithms directly from evolutionary first principles. We introduce Darwinian Lineage Simulations (DLS) to prove that, in an asexual context, Fisher's and Wright's historically opposed views of evolution are actually formally equivalent; One can partition Fisher's deterministically-evolving total population into Wright's randomly-drifting sub-populations. We prove that proper bookkeeping requires introducing a specific kind of structured noise (the DLS noise relation). Crucially, any bookkeeping choices which satisfy this relation will yield a faithful simulation of evolution. Using this vast representational freedom, we prove that a broad family of battle-tested optimization algorithms are already perfectly compatible with evolutionary dynamics. These include: Stochastic Gradient Descent as well as many regularizations/approximations of Newton's method and Natural Gradient Descent. By simply adding DLS noise (i.e., evolutionarily faithful genetic drift), these algorithms become scientifically valid in silico simulations of Darwinian evolution. Finally, we demonstrate that even the state-of-the-art Adam optimizer can be brought into evolutionary compliance through a minor mathematical surgery.

优化算法进化计算演化模拟机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。