arXiv:2605.08408cs.LG2026-05被引 1

提出新优化器,让物理方程约束更严格地满足。

AdamFLIP: Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN Training

论文配图:AdamFLIP: Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN Training
图 1 · 摘自论文原文
  • 将物理约束转为硬约束,用反馈机制动态调节
  • 在纳维-斯托克斯方程上误差降低超过三分之二
  • 适合对约束精度要求高的科学计算场景

物理信息神经网络(PINN)为求解偏微分方程(PDE)的正向和反向问题提供了灵活框架,但标准训练依赖软惩罚形式,通过手动设定权重组合方程残差、数据不匹配及初/边界条件,常导致病态、对损失权重敏感且约束满足差。本文将PINN训练重构为等式约束优化问题,提出自适应动量反馈线性化优化器(AdamFLIP),核心思想是将约束残差视为受控动力系统的输出,通过拉格朗日乘子作为反馈输入,使残差趋向稳定线性收缩。AdamFLIP对反馈线性化的拉格朗日梯度采用亚当风格的一阶与二阶矩自适应,结合了严谨的约束处理与自适应优化的可扩展性和鲁棒性。我们在多个基准前向与反向PDE问题上测试了AdamFLIP,结果一致优于标准软约束PINN及现有最优约束优化器。具体而言,在纳维-斯托克斯方程基准上,相比最优方法,预测解的相对$L_2$误差降低超过三分之二。该框架为PINN训练提供了一种高效且计算可扩展的硬约束优化方法。

原文摘要 · Abstract (English)

Physics-informed neural networks (PINNs) provide a flexible framework for solving forward and inverse problems governed by partial differential equations (PDEs), but standard PINN training typically relies on soft penalty formulations that combine PDE residuals, data mismatch, and initial/boundary conditions using manually chosen weights. This often leads to ill-conditioning, sensitivity to loss weights, and poor constraint satisfaction. In this work, we reformulate PINN training as an equality-constrained optimization problem and propose a novel Adaptive Momentum Feedback Linearization Optimization for Hard Constrained PINN (AdamFLIP). The key idea is to view the constraint residuals as the output of a controlled dynamical system and to compute the Lagrange multiplier as a feedback input that locally drives these residuals toward stable linear contraction dynamics. AdamFLIP then applies Adam-style first- and second-moment adaptation to the resulting feedback-linearized Lagrangian gradient, combining principled constraint handling with the scalability and robustness of adaptive neural-network optimization. We test AdamFLIP on a range of benchmark forward and inverse PDE problem, and it consistently outperforms both the standard soft-constrained PINN and state-of-the-art constrained optimizers. Specifically, on the Navier--Stokes equations benchmark, AdamFLIP \textbf{reduces relative $L_2$ error by more than two thirds} for the predicted solution compared to the next best method. Our AdamFLIP framework provides an effective and computationally scalable hard constraint optimization method for PINN training.

PINN优化器物理约束深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。