提出SCORE方法,提升PINN训练的收敛精度与稳定性。
From Non-Convex Self-Concordant Regularization to Scalable Quasi-Newton Training of PINNs

- 基于自协调准则与位移修正拟牛顿几何,统一步长选择与更新机制。
- 在多个偏微分方程上实现低于BFGS和自缩放布罗伊登法的最终误差。
- 无需黑塞矩阵计算,适合大规模PINN高效训练,适合科研与工程应用。
物理信息神经网络(PINNs)常需高精度拟牛顿优化以获得可靠的偏微分方程解,但其残差目标函数常呈现不定、近奇异且病态尺度的局部曲率。正则化拟牛顿方法可稳定割线模型,自协调方法则提供依赖曲率的步长选择规则。本文结合二者,提出SCORE:一种受自协调启发的拟牛顿方法,采用减量耦合的位移修正割线几何。其核心机制为:从学习的逆度量计算单一拟牛顿减量,同时决定满足强沃尔夫条件的候选步长与用于定义下一轮割线几何的自适应位移。位移代表平均位移度量沿接受步长的作用,无需构造黑塞矩阵或进行黑塞-向量乘积。在局部谱等价条件下,证明了拟牛顿减量与候选步长仍与正位移度量下的对应量相当,并在匹配度量情况下恢复归一化自协调规则。强沃尔夫接受准则、退避线搜索与标准曲率保护措施实现全局收敛,不修改原生PINN目标。在黏性伯格斯、库拉莫托-希瓦辛斯基、科特韦格-德弗里斯及复杂吉涅堡-兰道方程上的实验表明,SCORE在最终误差上优于测试的BFGS与自缩放布罗伊登基线。伯格斯方程消融实验进一步表明,位移曲率稳定与减量步长选择对高精度优化具有互补贡献。
原文摘要 · Abstract (English)
Physics-informed neural networks (PINNs) often require high-accuracy quasi-Newton refinement to obtain reliable partial differential equation solutions, but their residual objectives can exhibit indefinite, nearly singular, and poorly scaled local curvature. Regularized quasi-Newton methods provide established mechanisms for stabilizing secant models, while self-concordant methods provide local-metric rules for curvature-dependent step selection. Building on these two lines of work, we propose SCORE, a self-concordance-inspired quasi-Newton method with decrement-coupled shifted secant geometry for PINN training. Its distinguishing mechanism is that a single quasi-Newton decrement computed from the learned inverse metric jointly determines a strong-Wolfe-tested candidate step and an adaptive shift used to define the next secant geometry. The shifted displacement represents the action of an averaged shifted metric along the accepted step, while requiring neither Hessian construction nor Hessian-vector products. Under a local spectral-equivalence condition, we show that the quasi-Newton decrement and candidate step remain comparable to their counterparts in a positive shifted metric, and recover the normalized self-concordant rule in the matched-metric case. Strong Wolfe acceptance, fallback line search, and standard curvature safeguards provide globalization without modifying the underlying PINN objective. Experiments on the viscous Burgers, Kuramoto--Sivashinsky, Korteweg--de Vries, and complex Ginzburg--Landau equations show that SCORE attains lower final errors than the tested BFGS and self-scaled Broyden baselines. The Burgers ablation further indicates that shifted curvature stabilization and decrement-based step selection make complementary contributions to high-accuracy refinement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。