arXiv:2410.06820cs.LG2024-10ICLR被引 9

用神经网络学习求解参数化偏微分方程,提升物理信息模型的训练速度与稳定性。

Learning a Neural Solver for Parametric PDE to Enhance Physics-Informed Methods

  • 训练神经求解器,自适应调整梯度下降以加速求解过程。
  • 在多个数据集上实现更快收敛,测试时优化性能提升显著。
  • 可处理参数化偏微分方程,支持系数、初值、边界条件变化。

物理信息深度学习常因求解偏微分方程(PDE)的复杂性面临优化难题,包括探索大解空间、需大量迭代及训练不稳定等问题,主要源于损失函数中微分项导致的病态优化问题。为此,我们提出学习一个求解器,即通过数据训练物理信息迭代算法来求解PDE。该方法学习对梯度下降进行条件化,自动适应每个PDE实例,显著加速并稳定优化过程,促进物理感知模型更快收敛。此外,不同于传统方法仅针对单个PDE实例,本方法扩展至参数化PDE,将物理损失梯度与PDE参数(如系数、初始条件、边界条件)联合建模,实现对参数分布的求解。我们在多个数据集上通过实验验证了该方法的有效性,对比了训练和测试时的优化性能。代码已开源:https://github.com/2ailesB/neural-parametric-solver。

原文摘要 · Abstract (English)

Physics-informed deep learning often faces optimization challenges due to the complexity of solving partial differential equations (PDEs), which involve exploring large solution spaces, require numerous iterations, and can lead to unstable training. These challenges arise particularly from the ill-conditioning of the optimization problem caused by the differential terms in the loss function. To address these issues, we propose learning a solver, i.e., solving PDEs using a physics-informed iterative algorithm trained on data. Our method learns to condition a gradient descent algorithm that automatically adapts to each PDE instance, significantly accelerating and stabilizing the optimization process and enabling faster convergence of physics-aware models. Furthermore, while traditional physics-informed methods solve for a single PDE instance, our approach extends to parametric PDEs. Specifically, we integrate the physical loss gradient with PDE parameters, allowing our method to solve over a distribution of PDE parameters, including coefficients, initial conditions, and boundary conditions. We demonstrate the effectiveness of our approach through empirical experiments on multiple datasets, comparing both training and test-time optimization performance. The code is available at https://github.com/2ailesB/neural-parametric-solver.

PDE求解物理信息神经求解器参数化问题

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。