构建可解多类偏微分方程的通用物理神经网络,用主动学习提升样本效率。
Towards a Foundation Model for Physics-Informed Neural Networks: Multi-PDE Learning with Active Sampling
- 统一架构训练四种不同偏微分方程,实现跨物理系统的泛化能力。
- 仅用50%数据时,主动学习使误差降低30%,40%数据下性能接近全量训练。
- 适合需高效建模复杂物理系统的研究人员,尤其关注低样本场景。
物理信息神经网络(PINNs)通过将物理定律嵌入神经网络训练,成为求解偏微分方程(PDE)的强大框架。然而传统PINN通常针对单一PDE设计,限制了在不同物理系统间的泛化能力。本文探索一种可解决多类PDE的基座PINN模型,基于四个典型方程——简谐振子(SHO)、一维热方程、一维波动方程与二维拉普拉斯方程——验证其统一架构的可行性。为提升样本效率,引入基于蒙特卡洛丢弃法(MC Dropout)不确定性估计的主动学习策略,迭代选择最具信息量的训练样本。对比10%至50%不同比例的数据集训练效果,结果表明:针对性不确定性采样显著提升小样本下的求解精度,实现高效多PDE学习。本工作证实了具备泛化能力的基座式PINN的可行性,可在不重设计网络结构的前提下适配多种物理问题。研究建议,结合主动学习的多PDE PINN是降低计算成本并保持高精度的有效方法。
原文摘要 · Abstract (English)
Physics-Informed Neural Networks (PINNs) have emerged as a powerful framework for solving partial differential equations (PDEs) by embedding physical laws into neural network training. However, traditional PINN models are typically designed for single PDEs, limiting their generalizability across different physical systems. In this work, we explore the potential of a foundation PINN model capable of solving multiple PDEs within a unified architecture. We investigate the efficacy of a single PINN framework trained on four distinct PDEs-the Simple Harmonic Oscillator (SHO), the 1D Heat Equation, the 1D Wave Equation, and the 2D Laplace Equation, demonstrating its ability to learn diverse physical dynamics. To enhance sample efficiency, we incorporate Active Learning (AL) using Monte Carlo (MC) Dropout-based uncertainty estimation, selecting the most informative training samples iteratively. We evaluate different active learning strategies, comparing models trained on 10%, 20%, 30%, 40%, and 50% of the full dataset, and analyze their impact on solution accuracy. Our results indicate that targeted uncertainty sampling significantly improves performance with fewer training samples, leading to efficient learning across multiple PDEs. This work highlights the feasibility of a generalizable PINN-based foundation model, capable of adapting to different physics-based problems without redesigning network architectures. Our findings suggest that multi-PDE PINNs with active learning can serve as an effective approach for reducing computational costs while maintaining high accuracy in physics-based deep learning applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。