通过解耦表示与系数学习,显著提升物理信息神经网络对高频和非线性偏微分方程的求解精度。
Alternating Levenberg-Marquardt Training of Physics-Informed Neural Networks with Fourier-Enhanced Features

- 将傅里叶增强基与莱文伯格-马尔夸特算法结合,分离网络表示学习与系数拟合过程。
- 在多个高频率、强非线性问题上,相对L2误差比现有方法降低两个数量级。
- 适用于复杂非线性耦合方程组,适合需要高精度物理模拟的研究者使用。
物理信息神经网络(PINNs)在求解具有高频或多重尺度解以及强非线性特征的偏微分方程(PDEs)时表现不佳,根源在于谱偏差(神经网络易忽略高频特征)和表征-系数耦合(表征学习与系数拟合在单一非凸目标中纠缠)。本文提出傅里叶增强交替莱文伯格-马尔夸特物理信息神经网络(FALM-PINN),通过解耦表征学习与系数拟合构建优化框架。上层问题学习傅里叶增强基,丰富潜在空间的高频成分;下层问题在该基上拟合投影系数,以莱文伯格-马尔夸特算法求解非线性最小二乘问题。该框架适用于一般非线性及耦合PDE系统,对线性PDE可退化为单步凸优化。证明了两种情形下交替训练方案的全局收敛性。多个挑战性高频率与非线性PDE数值实验表明,FALM-PINN 相对 $L^2$ 误差较前沿基线降低高达两个数量级。
原文摘要 · Abstract (English)
Physics-informed neural networks (PINNs) often fail to accurately resolve partial differential equations (PDEs) with high-frequency or multi-scale solutions, as well as strongly nonlinear problems. Two factors underlie this difficulty: spectral bias, the tendency of neural networks to underfit high-frequency features; and representation-coefficient coupling, the entanglement of representation learning and coefficient fitting within a single nonconvex optimization objective. In this work, we propose the Fourier-enhanced alternating Levenberg--Marquardt PINN (FALM-PINN), an optimization framework that decouples representation learning from coefficient fitting. The upper-level problem learns a Fourier-enhanced basis that enriches the latent space with high-frequency components, while the lower-level problem resolves the coupling by fitting the projection coefficients on this basis, solving a nonlinear least-squares problem with the Levenberg--Marquardt algorithm. The framework applies to general nonlinear and coupled PDE systems, and reduces to a single-step convex optimization problem for linear PDEs. We prove global convergence of the alternating training scheme in both cases. Numerical examples on multiple challenging high-frequency and nonlinear PDEs show that FALM-PINN achieves relative $L^2$ errors up to two orders of magnitude lower than state-of-the-art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。