用随机初始化+深度集成,让PINN自动发现非线性方程的多个解。
Learning and discovering multiple solutions using physics-informed neural networks with random initialization and deep ensemble
- 利用随机初始值与深度集成,激发PINN探索多解能力。
- 在Allen-Cahn方程和腔流问题中成功找到稳定与不稳定解。
- 可为传统求解器提供高质量初值,提升求解效率与精度。
我们探索物理信息神经网络(PINNs)发现多解的能力。许多由非线性微分方程(DEs)描述的真实现象,如流体流动,在相同条件下存在多个解,但捕捉这种解的多重性仍是一大挑战。关键难点在于提供合适的初始条件或初值,而广泛使用的时步推进法和牛顿迭代法对此极为敏感。尽管机器学习模型(尤其是PINNs)在求解DEs方面展现出潜力,其发现多解的能力仍待深入研究。本文提出一种简单且实用的方法,利用PINNs学习并发现多解。我们首次揭示:结合随机初始化与深度集成方法(原用于不确定性量化),PINNs能有效发现非线性常微分方程(ODEs)与偏微分方程(PDEs)的多个解。该方法凸显了初始化在塑造解多样性中的关键作用,弥补了科学计算中常被忽视的环节。此外,我们建议将PINN生成的解作为传统数值求解器的初值或初猜,以提升捕捉多解的精度与效率。大量数值实验,包括Allen-Cahn方程与腔流问题,均验证了方法的有效性。结果表明,该方法为非线性微分方程的多解问题提供了通用且高效的新框架。
原文摘要 · Abstract (English)
We explore the capability of physics-informed neural networks (PINNs) to discover multiple solutions. Many real-world phenomena governed by nonlinear differential equations (DEs), such as fluid flow, exhibit multiple solutions under the same conditions, yet capturing this solution multiplicity remains a significant challenge. A key difficulty is giving appropriate initial conditions or initial guesses, to which the widely used time-marching schemes and Newton's iteration method are very sensitive in finding solutions for complex computational problems. While machine learning models, particularly PINNs, have shown promise in solving DEs, their ability to capture multiple solutions remains underexplored. In this work, we propose a simple and practical approach using PINNs to learn and discover multiple solutions. We first reveal that PINNs, when combined with random initialization and deep ensemble method -- originally developed for uncertainty quantification -- can effectively uncover multiple solutions to nonlinear ordinary and partial differential equations (ODEs/PDEs). Our approach highlights the critical role of initialization in shaping solution diversity, addressing an often-overlooked aspect of machine learning for scientific computing. Furthermore, we propose utilizing PINN-generated solutions as initial conditions or initial guesses for conventional numerical solvers to enhance accuracy and efficiency in capturing multiple solutions. Extensive numerical experiments, including the Allen-Cahn equation and cavity flow, where our approach successfully identifies both stable and unstable solutions, validate the effectiveness of our method. These findings establish a general and efficient framework for addressing solution multiplicity in nonlinear differential equations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。