arXiv:2410.18153math.NAcond-mat.dis-nn2024-10NeurIPS被引 8

用神经网络+柱状近似求解难算的功能微分方程,误差可低至10^{-3}。

Physics-informed Neural Networks for Functional Differential Equations: Cylindrical Approximation and Its Convergence Guarantees

  • 将功能微分方程转为高维偏微分方程,用正交基展开函数和泛函导数
  • 证明了近似解和泛函导数的收敛性,确保方法可靠性
  • 结合物理信息神经网络,比传统方法更高效,适合复杂问题

我们提出了首个针对功能微分方程(FDEs)的学习方法。FDEs在物理、数学和最优控制中具有基础作用,但其数值分析长期面临计算成本过高难题。现有近似方法常过度简化解。为此,我们提出一种混合方法:将物理信息神经网络(PINNs)与柱状近似相结合。柱状近似利用正交基展开函数与泛函导数,将FDEs转化为高维偏微分方程。为验证该近似的可靠性,我们证明了近似泛函导数与解的收敛定理。随后,使用PINNs数值求解所得高维PDE。得益于PINNs能力,本方法能更高效处理更广泛的泛函导数,提升柱状近似的可扩展性。作为概念验证,我们在两个FDE上实验,结果表明模型成功达到典型PINN级别的$ L^1 $相对误差约$ 10^{-3} $。整体而言,本工作为物理学家、数学家及机器学习研究者提供了分析以往难以处理的FDEs的坚实基础,推动其数值分析的普及化。代码已公开于 exttt{https://github.com/TaikiMiyagawa/FunctionalPINN}。

原文摘要 · Abstract (English)

We propose the first learning scheme for functional differential equations (FDEs). FDEs play a fundamental role in physics, mathematics, and optimal control. However, the numerical analysis of FDEs has faced challenges due to its unrealistic computational costs and has been a long standing problem over decades. Thus, numerical approximations of FDEs have been developed, but they often oversimplify the solutions. To tackle these two issues, we propose a hybrid approach combining physics-informed neural networks (PINNs) with the \textit{cylindrical approximation}. The cylindrical approximation expands functions and functional derivatives with an orthonormal basis and transforms FDEs into high-dimensional PDEs. To validate the reliability of the cylindrical approximation for FDE applications, we prove the convergence theorems of approximated functional derivatives and solutions. Then, the derived high-dimensional PDEs are numerically solved with PINNs. Through the capabilities of PINNs, our approach can handle a broader class of functional derivatives more efficiently than conventional discretization-based methods, improving the scalability of the cylindrical approximation. As a proof of concept, we conduct experiments on two FDEs and demonstrate that our model can successfully achieve typical $L^1$ relative error orders of PINNs $\sim 10^{-3}$. Overall, our work provides a strong backbone for physicists, mathematicians, and machine learning experts to analyze previously challenging FDEs, thereby democratizing their numerical analysis, which has received limited attention. Code is available at \url{https://github.com/TaikiMiyagawa/FunctionalPINN}.

功能微分方程物理信息神经网络柱状近似数值分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。