用自然对偶梯度法高效求解各类偏微分方程,精度与稳定性更优。
A Natural Primal-Dual Hybrid Gradient Method for Adversarial Neural Network Training on Solving Partial Differential Equations
- 将PDE转化为对偶变分问题,用预条件对偶梯度法优化神经网络
- 在1到50维方程上测试,相比PINNs等方法收敛更稳、误差更低
- 适合求解高维、非线性及最优传输类偏微分方程,尤其擅长椭圆型
我们提出一种可扩展的预条件对偶梯度算法用于求解偏微分方程(PDE)。通过将PDE乘以对偶测试函数,构造出包含低阶微分算子的inf-sup问题,进而采用对偶梯度(PDHG)算法求解该鞍点问题。引入合适的预条件算子于PDHG的近端步中,获得一种自然梯度上升-下降优化方案以更新神经网络参数。利用克雷洛夫子空间方法(MINRES)高效计算自然梯度,通过矩阵-向量乘法实现预条件矩阵的逆运算。针对一般线性PDE建立了时间连续版本的后验收敛分析;通过引入边界损失项,进一步得到散度形式椭圆方程的改进先验收敛结果。该方法在1至50维的各类PDE上进行了测试,包括线性/非线性椭圆方程、反应-扩散方程及来自L²最优传输问题的Monge-Ampère方程。与物理信息神经网络(PINNs)、DeepRitz方法和弱对抗网络(WANs)在Adam或L-BFGS优化器下的表现对比表明,所提方法效率更高、鲁棒性更强,且收敛更稳定、精度更高。
原文摘要 · Abstract (English)
We propose a scalable preconditioned primal-dual hybrid gradient algorithm for solving partial differential equations (PDEs). We multiply the PDE with a dual test function to obtain an inf-sup problem whose loss functional involves lower-order differential operators. The Primal-Dual Hybrid Gradient (PDHG) algorithm is then leveraged for this saddle point problem. By introducing suitable precondition operators to the proximal steps in the PDHG algorithm, we obtain an alternative natural gradient ascent-descent optimization scheme for updating the neural network parameters. We apply the Krylov subspace method (MINRES) to evaluate the natural gradients efficiently. Such treatment readily handles the inversion of precondition matrices via matrix-vector multiplication. An \textit{a posteriori} convergence analysis is established for the time-continuous version of the proposed algorithm for general linear PDEs. By incorporating appropriate boundary loss terms, we further obtain a refined \textit{a priori} convergence result for elliptic equations in divergence form. The algorithm is tested on various types of PDEs with dimensions ranging from $1$ to $50$, including linear and nonlinear elliptic equations, reaction-diffusion equations, and Monge-Ampère equations stemming from the $L^2$ optimal transport problems. We compare the performance of the proposed method with several commonly used deep learning algorithms such as physics-informed neural networks (PINNs), the DeepRitz method and weak adversarial networks (WANs) using either the Adam or the L-BFGS optimizer. The numerical results suggest that the proposed method performs efficiently and robustly and converges more stably with higher accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。