用小波变换提升物理信息神经网络求解多尺度问题的效率与精度
An efficient wavelet-based physics-informed neural network for multiscale problems
- 在小波空间中表示解,降低自由度并弱化多尺度特征
- 无需自动微分且不依赖解的先验信息,训练更快更稳定
- 适合奇异摄动、突变行为等复杂物理问题,如流体与波动方程
物理信息神经网络(PINNs)利用微分方程作为先验知识解决数据稀缺下的复杂问题,但对快速振荡、陡峭梯度或奇异性问题仍具挑战。为此,本文提出基于小波的高效物理信息神经网络(W-PINN),在小波空间中学习解的表示。该方法通过局部化小波基函数实现低自由度建模,同时保留复杂物理动态。由于小波域中多尺度特征较弱,模型可在更优空间内训练,提升效率。所提架构无需自动微分计算损失函数中的导数,也不需要关于解的突变位置等先验知识,显著减少训练时间并保持精度。结合小波与PINNs的策略使模型能有效捕捉局部非线性信息,适用于奇异摄动及多尺度问题。通过神经正切核理论对比分析收敛性,验证了其有效性。实验涵盖FitzHugh-Nagumo模型、赫姆霍兹方程、麦克斯韦方程、Allen-Cahn方程、拖曳腔流等典型多尺度问题,以及多个高度奇异的非线性微分方程。
原文摘要 · Abstract (English)
Physics-informed neural networks (PINNs) are a class of deep learning models that utilize physics in the form of differential equations to address complex problems, including those with limited data availability. However, solving differential equations with rapid oscillations, steep gradients, or singular behavior remains challenging for PINNs. To address this, we propose an efficient wavelet-based physics-informed neural network (W-PINN) that learns solutions in wavelet space. Here, we represent the solution using localized wavelets. This framework represents the solution of a differential equation with significantly fewer degrees of freedom while retaining the dynamics of complex physical phenomena. The proposed architecture enables training to search for solutions within the wavelet domain, where multiscale characteristics are less pronounced compared to the physical domain. This facilitates more efficient training for such problems. Furthermore, the proposed model does not rely on automatic differentiation for derivatives in the loss function and does not require prior information regarding the behavior of the solution, such as the location of abrupt features. The removal of AD significantly reduces training time while maintaining accuracy. Thus, through a strategic fusion of wavelets with PINNs, W-PINNs capture localized nonlinear information, making them well-suited for problems with abrupt behavior, such as singularly perturbed and other multiscale problems. We further analyze the convergence behavior of W-PINN through a comparative study using Neural Tangent Kernel theory. The efficiency and accuracy of the proposed model are demonstrated across various problems, including the FitzHugh--Nagumo (FHN) model, Helmholtz equation, Maxwell equation, Allen--Cahn equation, and lid-driven cavity flow, along with other highly singularly perturbed nonlinear differential equations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。