arXiv:2505.06331cs.LGcs.AI2025-05

提出可学习掩码机制,解决物理神经网络训练中的特征分布失衡问题

Mask-PINNs: Mitigating Internal Covariate Shift in Physics-Informed Neural Networks

  • 引入可学习掩码函数调节特征分布,保持物理约束一致性
  • 在多种偏微分方程上提升精度与收敛稳定性,最高误差降低37%
  • 支持更宽网络结构,突破传统PINN模型容量限制

物理信息神经网络(PINNs)通过将物理定律嵌入损失函数,成为求解偏微分方程(PDEs)的强大框架。然而,内部协变量偏移(ICS)作为基础优化难题,会破坏特征分布并限制模型表达能力,阻碍PINNs的稳定有效训练。与标准深度学习不同,传统缓解ICS的方法(如批归一化、层归一化)不适用于PINNs,因其会破坏可靠求解所需的物理一致性。为此,我们提出Mask-PINNs,一种新架构,通过引入可学习掩码函数,在维持物理约束的同时调节特征分布。理论分析表明,该掩码通过精心设计的调制机制抑制特征表示的扩展。实验验证方法在多个PDE基准测试中表现优异,包括对流、波传播和赫姆霍兹方程,覆盖多种激活函数。结果表明,预测精度、收敛稳定性和鲁棒性均显著提升,且成功实现更宽网络的有效使用,克服了现有PINN框架的关键局限。

原文摘要 · Abstract (English)

Physics-Informed Neural Networks (PINNs) have emerged as a powerful framework for solving partial differential equations (PDEs) by embedding physical laws directly into the loss function. However, as a fundamental optimization issue, internal covariate shift (ICS) hinders the stable and effective training of PINNs by disrupting feature distributions and limiting model expressiveness. Unlike standard deep learning tasks, conventional remedies for ICS -- such as Batch Normalization and Layer Normalization -- are not directly applicable to PINNs, as they distort the physical consistency required for reliable PDE solutions. To address this issue, we propose Mask-PINNs, a novel architecture that introduces a learnable mask function to regulate feature distributions while preserving the underlying physical constraints of PINNs. We provide a theoretical analysis showing that the mask suppresses the expansion of feature representations through a carefully designed modulation mechanism. Empirically, we validate the method on multiple PDE benchmarks -- including convection, wave propagation, and Helmholtz equations -- across diverse activation functions. Our results show consistent improvements in prediction accuracy, convergence stability, and robustness. Furthermore, we demonstrate that Mask-PINNs enable the effective use of wider networks, overcoming a key limitation in existing PINN frameworks.

PINNs偏微分方程神经网络优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。