arXiv:2606.21828math.NAcs.LG2026-06被引 1

神经算子预热牛顿法时,误差小也不可靠,需加能量约束确保收敛。

Spectrally Safe Neural Operator Warm-Starts for Large-Scale Newton Solvers

论文配图:Spectrally Safe Neural Operator Warm-Starts for Large-Scale Newton Solvers
图 1 · 摘自论文原文
  • 用能量正则化微调神经算子,防止雅可比矩阵不定
  • 在640万自由度3D问题上提速5.4倍
  • 适合大规模非线性PDE求解,尤其对刚性材料

神经算子常用于非线性偏微分方程的牛顿求解器预热,前提是测试误差低能保证初始猜测落在吸引域内。我们发现这一前提不可靠:相对 $L^2$ 误差达 $O(10^{-3})$ 的算子仍可能生成离散雅可比矩阵不定的初始状态,因均方训练仅控制平均误差,却允许局部违反物理规律。以近不可压缩超弹性问题为例,这源于预测的体积变化 $\mathrm{det} F$ 偏离1,导致雅可比出现负特征值,即使预测场视觉上与参考解无异。小规模下仅为干扰,但在数百万自由度规模下则致命,因共轭梯度等克雷洛夫类求解器假设谱为正定。我们提出仅需短时间、无需标签的微调阶段——通过惩罚算子对离散能量的偏离,无需额外解数据,即可恢复雅可比正定。结合不完全外层循环,该方法在完整加载范围内收敛,而未正则化算子失败,3D问题中实现最高5.4倍的墙钟速度提升。

原文摘要 · Abstract (English)

Neural operators are increasingly used to warm-start Newton solvers for nonlinear PDEs, on the premise that a low test error places the initial guess inside the basin of attraction. We show that this premise is unreliable. An operator trained to the relative \(L^2\) error \(O(10^{-3})\) can still produce an initial state in which the discrete Jacobian is indefinite, because the mean-squared training controls error on average while leaving localized pointwise violations of the underlying physics. For a nearly incompressible hyperelasticity problem, we trace this to the predicted volume change: the operator disperses \(\mathrm{det} F\) well away from one, and the resulting Jacobian acquires negative eigenvalues even when the predicted field is visually indistinguishable from the reference. At a small scale, this is a nuisance; at a multi-million degree-of-freedom scale, it is disqualifying, since the conjugate gradient and other Krylov solvers needed for memory-feasible Newton steps assume a definite spectrum. We then show that a short, label-free fine-tuning phase -- penalizing the operator against the discrete energy, with no additional solution data -- shifts the Jacobian spectrum back to positive definite. Combined with an inexact outer loop, this gives a warm-started Newton method that converges across the full loading range where the unregularized operator fails, reaching up to 5.4\(\times\) wall-clock speedup over incremental continuation on a 3D problem with 6.4 million degrees of freedom.

神经算子牛顿法PDE求解能量正则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。