提出高效训练物理信息神经算子的方法,提升解微分方程的泛化能力。
On the training of physics-informed neural operators for solving parametric partial differential equations

- 对比三种算子结构,发现CViT在多类方程上表现最稳定。
- 揭示梯度冲突与因果违规等优化问题,可沿用PINN缓解策略。
- 物理约束训练在少数据时优于纯数据驱动,适合科学建模场景。
物理信息神经算子(PINOs)通过引入物理规律作为监督信号,学习偏微分方程的解算子,兼具神经算子的跨实例泛化能力与物理信息学习的数据效率。然而,其高效稳健训练仍不清晰。本文系统考察了架构设计、优化器选择、损失平衡与采样策略等关键组件,比较了DeepONet、FNO与CViT三种代表性算子骨架,在五类参数化偏微分方程上验证。结果表明,CViT在所有基准测试中均表现出一致且稳定的高性能。此外,发现此前在PINN中识别的优化病态(如梯度冲突、因果违反)同样存在于PINOs中,且针对PINN的缓解方法在此依然有效。进一步在不同数据条件下对比物理信息与纯数据驱动训练,发现精心设计的物理信息训练可达到甚至超越纯数据驱动神经算子性能。研究为理解并构建高效稳健的物理信息算子学习流程提供了实证依据。代码与数据见:https://github.com/NanxiiChen/PI-CViT。
原文摘要 · Abstract (English)
Physics-informed neural operators (PINOs) aim to learn solution operators for partial differential equations by using the governing physics as supervision, rather than relying solely on paired input-output simulation data. By incorporating physical constraints into the training objective, PINOs combine the cross-instance generalization of neural operators with the data efficiency of physics-informed learning. Despite this promise, how to train PINOs efficiently and robustly remains less well-understood than the training of either data-driven neural operators or physics-informed neural networks (PINNs). To bridge this gap, we examine key components of the PINO training pipeline, including architecture design, optimizer choice, loss balancing, and collocation-point sampling strategy. We study three representative operator backbones, Deep Operator Network (DeepONet), Fourier Neural Operator (FNO), and Continuous Vision Transformer (CViT), across five diverse parametric PDE systems. Our results show that CViT provides consistently strong and stable performance across the considered benchmarks. Beyond architecture, we find that several optimization pathologies previously identified in PINN training naturally arise in PINOs, including gradient conflicts and causal violation. We also find that mitigation algorithms developed for PINNs remain effective in the PINO setting. We further compare physics-informed and data-driven training under different data regimes, revealing that a carefully designed physics-informed training pipeline can match, and in some cases, outperform purely data-driven neural operators. Taken together, these findings provide a systematic empirical understanding of the optimization challenges in PINO training and inform a practical pipeline for efficient and robust physics-informed operator learning. Code and data are available at https://github.com/NanxiiChen/PI-CViT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。