用物理方程约束神经网络,同时解决微分方程的正反问题。
Applications and Manipulations of Physics-Informed Neural Networks in Solving Differential Equations
- 将微分方程残差嵌入损失函数,实现物理知识与数据驱动结合。
- 在稀疏数据下仍能准确外推,避免过拟合,提升泛化能力。
- 适用于科学计算中正问题求解与逆问题参数识别,适合科研人员参考。
神经网络在求解复杂微分方程和优化参数方面具有强大能力,分别对应正问题与逆问题的求解。正问题通过优化权重和偏置预测给定输入下的输出;逆问题则寻找能有效拟合数据的方程参数或系数。物理信息神经网络(PINN)可同时解决这两类问题。PINN将关于数据的先验解析信息引入损失函数,以提升模型在训练集外的表现。该方法利用微分方程作为先验信息,通过最小化方程左右两边的残差来求解微分方程,并充分利用已有知识。在此框架中,解和模型参数均被嵌入损失函数进行联合优化,从而同时求得神经网络权重与模型参数,完成正反问题的求解。本文构建了包含线性、二次及热方程等不同复杂度残差的PINN模型,主要使用Python语言与PyTorch库开展研究。
原文摘要 · Abstract (English)
Mathematical models in neural networks are powerful tools for solving complex differential equations and optimizing their parameters; that is, solving the forward and inverse problems, respectively. A forward problem predicts the output of a network for a given input by optimizing weights and biases. An inverse problem finds equation parameters or coefficients that effectively model the data. A Physics-Informed Neural Network (PINN) can solve both problems. PINNs inject prior analytical information about the data into the cost function to improve model performance outside the training set boundaries. This also allows PINNs to efficiently solve problems with sparse data without overfitting by extrapolating the model to fit larger trends in the data. The prior information we implement is in the form of differential equations. Residuals are the differences between the left-hand and right-hand sides of corresponding differential equations; PINNs minimize these residuals to effectively solve the differential equation and take advantage of prior knowledge. In this way, the solution and parameters are embedded into the loss function and optimized, allowing both the weights of the neural network and the model parameters to be found simultaneously, solving both the forward and inverse problems in the process. In this paper, we will create PINNs with residuals of varying complexity, beginning with linear and quadratic models and then expanding to fit models for the heat equation and other complex differential equations. We will mainly use Python as the computing language, using the PyTorch library to aid us in our research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。