动态优化神经网络求解PDE的采样点位置,提升高维问题精度。
PACMANN: Point Adaptive Collocation Method for Artificial Neural Networks
- 基于损失梯度迭代迁移采样点至残差大区域
- 高维问题下精度显著优于现有自适应方法
- 计算开销低,可无缝集成到现有PINN框架
物理信息神经网络(PINNs)已成为求解偏微分方程(PDE)正向与逆向问题的有效工具。PINNs通过最小化包含一组采样点上PDE残差的损失函数来逼近解。已有研究表明,采样点的数量与分布对PINN解的精度有显著影响。因此,采样点的高效布置成为研究热点。然而,现有自适应采样方法在高维问题中存在计算成本过高的缺陷。本文提出点自适应配点法(PACMANN),通过梯度下降算法,依据PINN损失函数的梯度(即平方形式的PDE残差)逐步将采样点移向残差较大的区域。该方法在正向与逆向问题中均表现优异,在低维问题中达到当前最优精度-效率权衡,且在高维问题中超越已有方法。其关键优势包括低计算开销和易于集成到现有PINN流程中。代码已开源:https://github.com/CoenVisser/PACMANN。
原文摘要 · Abstract (English)
Physics-Informed Neural Networks (PINNs) have emerged as a tool for approximating the solution of Partial Differential Equations (PDEs) in both forward and inverse problems. PINNs minimize a loss function which includes the PDE residual determined for a set of collocation points. Previous work has shown that the number and distribution of these collocation points have a significant influence on the accuracy of the PINN solution. Therefore, the effective placement of these collocation points is an active area of research. Specifically, available adaptive collocation point sampling methods have been reported to scale poorly in terms of computational cost when applied to high-dimensional problems. In this work, we address this issue and present the Point Adaptive Collocation Method for Artificial Neural Networks (PACMANN). PACMANN incrementally moves collocation points toward regions of higher residuals using gradient-based optimization algorithms guided by the gradient of the PINN loss function, that is, the squared PDE residual. We apply PACMANN for forward and inverse problems, and demonstrate that this method matches the performance of state-of-the-art methods in terms of the accuracy/efficiency tradeoff for the low-dimensional problems, while outperforming available approaches for high-dimensional problems. Key features of the method include its low computational cost and simplicity of integration into existing physics-informed neural network pipelines. The code is available at https://github.com/CoenVisser/PACMANN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。