arXiv:2412.19235math.NAcs.AI2024-12被引 5

单隐层神经网络在物理信息问题中仍具竞争力,可实现高精度求解。

Are Two Hidden Layers Still Enough for the Physics-Informed Neural Networks?

  • 采用确定性初始化与无梯度参数调整方法,提升训练稳定性。
  • 在常微分方程和偏微分方程求解中达到先进水平精度。
  • 适合对模型泛化能力有精确控制需求的研究者使用。

本文探讨了单隐层神经网络的初始化与训练方法,并提出一种可分离的物理信息神经网络(SPINN),用于求解由常微分方程(ODE)和偏微分方程(PDE)描述的物理问题。提出了严格确定性的单隐层网络初始化方法,改进了损失函数加权策略,包括基于二阶导数、预测解和相对残差的新方法。还提出了无需优化器的逐神经元无梯度拟合方法。该方法扩展至二维问题,通过可分离结构实现高效求解。大量实验表明,这些方法在单隐层或双隐层设置下,对各类ODE和PDE求解均能实现竞争性甚至领先的精度表现。

原文摘要 · Abstract (English)

The article discusses the development of various methods and techniques for initializing and training neural networks with a single hidden layer, as well as training a separable physics-informed neural network consisting of neural networks with a single hidden layer to solve physical problems described by ordinary differential equations (ODEs) and partial differential equations (PDEs). A method for strictly deterministic initialization of a neural network with one hidden layer for solving physical problems described by an ODE is proposed. Modifications to existing methods for weighting the loss function are given, as well as new methods developed for training strictly deterministic-initialized neural networks to solve ODEs (detaching, additional weighting based on the second derivative, predicted solution-based weighting, relative residuals). An algorithm for physics-informed data-driven initialization of a neural network with one hidden layer is proposed. A neural network with pronounced generalizing properties is presented, whose generalizing abilities of which can be precisely controlled by adjusting network parameters. A metric for measuring the generalization of such neural network has been introduced. A gradient-free neuron-by-neuron fitting method has been developed for adjusting the parameters of a single-hidden-layer neural network, which does not require the use of an optimizer or solver for its implementation. The proposed methods have been extended to 2D problems using the separable physics-informed neural networks approach. Numerous experiments have been carried out to develop the above methods and approaches. Experiments on physical problems, such as solving various ODEs and PDEs, have demonstrated that these methods for initializing and training neural networks with one or two hidden layers (SPINN) achieve competitive accuracy and, in some cases, state-of-the-art results.

神经网络物理信息微分方程无梯度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。