arXiv:2602.08515math.NAcs.LG2026-02被引 1

用浅层网络+莱文伯格算法,高效求解非线性偏微分方程

Do physics-informed neural networks (PINNs) need to be deep? Shallow PINNs using the Levenberg-Marquardt algorithm

  • 将PINN训练转为非线性最小二乘,用莱文伯格算法优化
  • 在多个方程上收敛更快、精度更高,参数更少但效果更好
  • 适合追求高效率与低参数量的物理建模任务

本文研究了用于求解由非线性偏微分方程(PDEs)控制的正向与逆向问题的浅层物理信息神经网络(PINNs)。通过将PINN训练建模为非线性最小二乘问题,采用莱文伯格-马夸尔特(Levenberg-Marquardt, LM)算法高效优化网络参数。推导出神经网络对输入变量的精确解析导数表达式,揭示了网络输出与其时空导数之间的关系,从而更清晰地解释了PINN结构。这些表达式进一步用于推导LM算法所需的显式雅可比矩阵公式。该方法在Burgers、Schrödinger、Allen-Cahn及三维Bratu方程上进行了评估。数值结果表明,LM显著优于BFGS、L-BFGS和Adam,在收敛速度、精度和最终损失值方面表现更优。与深层网络的对比显示,浅层LM-PINNs以更少参数实现了更高精度,强调了网络架构与优化策略协同设计的重要性。显式的解析雅可比矩阵还带来了计算与内存优势,尤其适用于大规模PINNs。总体而言,这些结果表明,对于一大类PDEs,结合有效二阶优化的浅层PINNs能提供准确且计算高效的正向与逆向问题解决方案。

原文摘要 · Abstract (English)

This work investigates shallow physics-informed neural networks (PINNs) for solving forward and inverse problems governed by nonlinear partial differential equations (PDEs). By formulating PINN training as a nonlinear least-squares problem, the Levenberg-Marquardt (LM) algorithm is used to efficiently optimize the network parameters. Exact analytical expressions for neural-network derivatives with respect to the input variables are derived, revealing the relationships between the network output and its spatial and temporal derivatives and providing a clearer interpretation of the PINN architecture. These expressions are then used to derive explicit formulas for the Jacobian matrix required by LM. The proposed approach is evaluated on the Burgers, Schrödinger, Allen-Cahn, and three-dimensional Bratu equations. Numerical results show that LM substantially outperforms BFGS, L-BFGS, and Adam in convergence speed, accuracy, and final loss values. Comparisons with deeper networks further demonstrate that shallow LM-PINNs can achieve higher accuracy with substantially fewer parameters, emphasizing the importance of considering network architecture and optimization strategy jointly. The explicit analytical Jacobian also provides computational and memory advantages that are particularly relevant to large-scale PINNs. Overall, these results suggest that, for a broad class of PDEs, shallow PINNs combined with effective second-order optimization can provide accurate and computationally efficient solutions to both forward and inverse problems.

PINNs偏微分方程优化算法浅层网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。