提出无需反向传播的神经网络,加速求解微分方程。
Physics-Informed Stochastic Configuration Machine: A Backpropagation-Free Neural Network with Fast Training for Nonlinear Differential Equations

- 用解析法计算局部雅可比,将物理损失线性化。
- 通过最小二乘求解权重,训练速度比传统方法快数个量级。
- 适合需要实时求解的科学机器学习场景。
尽管物理信息神经网络(PINNs)已成为求解复杂微分方程的革新范式,但其依赖基于反向传播的梯度下降与自动微分(AD),带来了显著的计算瓶颈和严重的非凸优化挑战。为克服这些根本限制,我们提出物理信息随机配置机(PI-SCM),一种用于微分方程正问题与逆问题的无反向传播框架。核心数学贡献在于对非线性微分算子的局部雅可比进行解析评估,实现物理损失的线性化表示,并将其投影至统一的线性代数子空间。该重构使最优网络权重可通过一系列广义线性最小二乘求解器显式确定,有效规避了传统非线性优化器的迭代陷阱。我们设计了包括局部构建(PI-SC-I)、滑动窗口更新(PI-SC-II)和全局更新(PI-SC-III)在内的渐进算法套件,并严格建立了其通用逼近性质。大量实验表明,PI-SCM在保持高保真预测精度和鲁棒参数识别的同时,相比标准PINNs实现了数量级的训练加速。本工作为下一代实时科学机器学习应用提供了高效且可扩展的基础。
原文摘要 · Abstract (English)
While Physics-Informed Neural Networks (PINNs) have emerged as a transformative paradigm for solving complex differential equations, their reliance on backpropagation-based gradient descent and automatic differentiation (AD) imposes significant computational bottlenecks and severe non-convex optimization challenges. To overcome these fundamental limitations, we propose the Physics-Informed Stochastic Configuration Machine (PI-SCM), a novel backpropagation-free framework for both forward and inverse problems in differential equations. The core mathematical contribution lies in the analytical evaluation of local Jacobians for nonlinear differential operators, which facilitates a linearized representation of the physical loss and projects it into a unified, linearized algebraic subspace. This reformulation allows for the explicit determination of optimal network weights via a sequence of generalized linear least squares solvers, effectively bypassing the iterative traps of traditional nonlinear optimizers. We develop a progressive algorithmic suite comprising localized construction (PI-SC-I), sliding-window updating (PI-SC-II), and global updating (PI-SC-III), and rigorously establish their universal approximation properties. Extensive experiments demonstrate that PI-SCM achieves high-fidelity predictive accuracy and robust parameter identification while accelerating the training process by orders of magnitude compared to standard PINNs. Our work provides a highly efficient and scalable foundation for next-generation, real-time Scientific Machine Learning applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。