arXiv:2504.16503cs.NEcs.LG2025-04被引 2

用神经进化方法自动发现物理规律,比传统方法更优。

Neuro-Evolutionary Approach to Physics-Aware Symbolic Regression

  • 结合进化算法找网络结构,梯度法调参数
  • 仅用少量反向传播就获得高质量模型
  • 适合需要可解释物理公式的科研场景

符号回归能从数据中自动推导解析模型。传统方法主要依赖遗传编程,通过交叉和变异演化候选解。近期研究使用神经网络,通过正则化梯度优化学习整个模型的结构与系数。尽管该方法能更好调整系数,但容易过早收敛到次优结构。本文提出一种神经进化符号回归方法,将进化搜索最优神经网络拓扑的优势与梯度法调参相结合。由于进化算法计算成本高,无法对每个候选拓扑训练至完全收敛,因此本方法采用记忆策略和种群扰动,增强探索能力并降低陷入次优网络的风险。每个网络拓扑仅需少量反向传播迭代即可训练。在三个真实世界测试问题上评估表明,该方法在模型质量上优于其他基于神经网络的方法。

原文摘要 · Abstract (English)

Symbolic regression is a technique that can automatically derive analytic models from data. Traditionally, symbolic regression has been implemented primarily through genetic programming that evolves populations of candidate solutions sampled by genetic operators, crossover and mutation. More recently, neural networks have been employed to learn the entire analytical model, i.e., its structure and coefficients, using regularized gradient-based optimization. Although this approach tunes the model's coefficients better, it is prone to premature convergence to suboptimal model structures. Here, we propose a neuro-evolutionary symbolic regression method that combines the strengths of evolutionary-based search for optimal neural network (NN) topologies with gradient-based tuning of the network's parameters. Due to the inherent high computational demand of evolutionary algorithms, it is not feasible to learn the parameters of every candidate NN topology to full convergence. Thus, our method employs a memory-based strategy and population perturbations to enhance exploitation and reduce the risk of being trapped in suboptimal NNs. In this way, each NN topology can be trained using only a short sequence of backpropagation iterations. The proposed method was experimentally evaluated on three real-world test problems and has been shown to outperform other NN-based approaches regarding the quality of the models obtained.

符号回归神经进化物理建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。