arXiv:2605.04502cs.LG2026-05

IC门控函数影响训练稳定性,不同刚度下选择不同门控方式可降低误差。

Gradient Scaling Effects in Adaptive Spectral PINNs for Stiff Nonlinear ODEs

论文配图:Gradient Scaling Effects in Adaptive Spectral PINNs for Stiff Nonlinear ODEs
图 1 · 摘自论文原文
  • 通过对比指数与线性门控函数,研究其对梯度尺度的影响。
  • 在刚度为60时,线性门控比指数门控误差更低,且结果更稳定。
  • 适用于求解高刚度非线性常微分方程的PINN优化设计参考。

物理信息神经网络(PINNs)在求解刚性与振荡动力系统时常因优化条件不佳而难以稳定训练。尽管已有研究关注谱参数化等表示方法,但自适应谱PINNs中初始条件(IC)嵌入的优化影响尚未充分阐明。本文发现,IC门控函数会引入显式的时间依赖梯度缩放,与谱表示共同作用于训练过程。以非线性刚性弹簧摆方程为基准测试,比较了指数与线性门控函数在固定与自适应傅里叶谱主干下的表现。结果表明:在中等刚度(k=20)时,指数门控通常误差更低但随机种子间行为不一致;而在更高刚度(k=60)时,线性门控更优,且在更大刚度下出现反转现象。这些趋势在相对L²误差和最大点误差上均成立,并经配对威尔科克森符号秩检验与霍姆校正验证。总体而言,IC嵌入并非中性设计选择,其引发的梯度缩放显著影响刚性场景下的优化条件,基线与自适应谱模型表现出不同的敏感模式。

原文摘要 · Abstract (English)

Physics-Informed Neural Networks (PINNs) often struggle to train reliably on stiff and oscillatory dynamical systems due to poor optimization conditioning. While prior work has emphasized representational remedies such as spectral parameterizations, the optimization implications of initial-condition (IC) embeddings in adaptive spectral PINNs have not been well characterized. In this work, we show that the choice of IC gating function induces explicit time-dependent gradient scaling, which interacts with spectral representations during training. Using a nonlinear stiff spring-pendulum ODE as a controlled benchmark, we compare exponential and linear IC gates in combination with fixed and adaptive Fourier spectral trunks. We observe stiffness-dependent changes in relative dominance for adaptive PINNs: at moderate stiffness ($k=20$), exponential gating often yields lower error but exhibits heterogeneous behavior across random seeds, whereas at higher stiffness ($k=60$), linear gating becomes preferable, with additional reversals observed at larger $k$. These trends hold for both relative $L^2$ error and maximum pointwise error and are confirmed by paired Wilcoxon signed-rank tests with Holm correction. Overall, our results demonstrate that IC embeddings are not a neutral design choice in PINNs: the induced gradient scaling materially shapes optimization conditioning in stiff regimes, with distinct sensitivity patterns in baseline and adaptive spectral models.

PINNs刚性方程梯度缩放谱方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。