arXiv:2602.06842math.NAcs.LG2026-02中稿 · manuscript version…被引 2

AI解微分方程易陷入虚假收敛,训练策略决定可靠性

Are Deep Learning Based Hybrid PDE Solvers Reliable? Why Training Paradigms and Update Strategies Matter

  • 用神经算子融合传统求解器,但需匹配物理规律设计训练目标
  • 传统加速方法在非线性神经算子下失效,残差仍可高达10⁻²
  • 提出物理感知加速法,收敛速度提升近10倍,适合科学计算场景

基于深度学习的混合迭代方法(DL-HIMs)结合经典数值求解器与神经算子,利用其互补的谱偏差加速收敛。然而,许多方法会在虚假不动点停滞,此时神经更新消失但物理残差仍大,引发对科学计算可靠性的质疑。本文通过研究基于DeepONet的混合可迁移求解器(HINTS)和基于FFT的傅里叶神经求解器(FNS),发现当训练目标与求解动力学及物理规律不一致时,显著的物理残差会持续存在。进一步分析经典安德森加速(AA)发现,其形式不适用于非线性神经算子。为此,我们提出物理感知安德森加速(PA-AA),以最小化物理残差而非不动点更新。数值实验表明,PA-AA在更少迭代次数内恢复了可靠收敛,为人工智能驱动的偏微分方程求解器的可靠性问题提供了明确答案:性能不仅取决于架构,更依赖于物理启发的训练与迭代设计。

原文摘要 · Abstract (English)

Deep learning-based hybrid iterative methods (DL-HIMs) integrate classical numerical solvers with neural operators, utilizing their complementary spectral biases to accelerate convergence. Despite this promise, many DL-HIMs stagnate at false fixed points where neural updates vanish while the physical residual remains large, raising questions about reliability in scientific computing. In this paper, we provide evidence that performance is highly sensitive to training paradigms and update strategies, even when the neural architecture is fixed. Through a detailed study of a DeepONet-based hybrid iterative numerical transferable solver (HINTS) and an FFT-based Fourier neural solver (FNS), we show that significant physical residuals can persist when training objectives are not aligned with solver dynamics and problem physics. We further examine Anderson acceleration (AA) and demonstrate that its classical form is ill-suited for nonlinear neural operators. To overcome this, we introduce physics-aware Anderson acceleration (PA-AA), which minimizes the physical residual rather than the fixed-point update. Numerical experiments confirm that PA-AA restores reliable convergence in substantially fewer iterations. These findings provide a concrete answer to ongoing controversies surrounding AI-based PDE solvers: reliability hinges not only on architectures but on physically informed training and iteration design.

PDE求解神经算子收敛性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。