用图神经网络模拟物理方程,少数据也能高精度预测长期动态。
Data-Efficient Time-Dependent PDE Surrogates: Graph Neural Simulators vs. Neural Operators
- 基于消息传递和数值时间步,模仿传统求解器建模微分方程演化
- 仅用3%轨迹即达<1%相对L2误差,自回归误差比FNO低82.5%
- 适合小样本、长时序的科学模拟,尤其适合物理规律明确的系统
构建高效、少数据的代理模型是推动人工智能赋能科学的核心。神经算子(NOs)通过常规神经网络近似函数空间间的映射,已成为偏微分方程(PDE)驱动系统的流行代理模型。然而,其对大数据依赖强且在低数据条件下泛化能力差,限制了实际应用。我们指出,这些局限源于其全局处理机制,未能利用物理系统的局部离散结构。为此,提出图神经模拟器(GNS),作为时间依赖型PDE的原理性代理建模范式。GNS结合消息传递与数值时间步进,通过建模瞬时时间导数学习PDE动力学,设计上模仿传统数值求解器,实现稳定长时序推演并增强归纳偏置以提升泛化能力。我们在四个经典PDE系统上进行严格评估:(1) 2D标量Burgers方程,(2) 2D耦合Burgers方程,(3) 2DAllen-Cahn方程,(4) 2D非线性浅水方程,对比最先进的神经算子(包括DeepONet和FNO)。结果表明,GNS显著更数据高效:仅使用3%可用轨迹即实现<1%相对L2误差,且随时间累积误差大幅降低(相比FNO自回归误差低82.5%,相比DeepONet低99.9%)。为优化训练数据选择,引入基于主成分分析(PCA)与KMeans聚类的轨迹筛选策略。这些发现有力证明,基于图结构的局部性和求解器启发设计的GNS,是最适配且可扩展的科学发现代理建模框架。
原文摘要 · Abstract (English)
Developing accurate, data-efficient surrogate models is central to advancing AI for Science. Neural operators (NOs), which approximate mappings between infinite-dimensional function spaces using conventional neural architectures, have gained popularity as surrogates for systems driven by partial differential equations (PDEs). However, their reliance on large datasets and limited ability to generalize in low-data regimes hinder their practical utility. We argue that these limitations arise from their global processing of data, which fails to exploit the local, discretized structure of physical systems. To address this, we propose Graph Neural Simulators (GNS) as a principled surrogate modeling paradigm for time-dependent PDEs. GNS leverages message-passing combined with numerical time-stepping schemes to learn PDE dynamics by modeling the instantaneous time derivatives. This design mimics traditional numerical solvers, enabling stable long-horizon rollouts and strong inductive biases that enhance generalization. We rigorously evaluate GNS on four canonical PDE systems: (1) 2D scalar Burgers', (2) 2D coupled Burgers', (3) 2D Allen-Cahn, and (4) 2D nonlinear shallow-water equations, comparing against state-of-the-art NOs including Deep Operator Network (DeepONet) and Fourier Neural Operator (FNO). Results demonstrate that GNS is markedly more data-efficient, achieving less than 1% relative L2 error using only 3% of available trajectories, and exhibits dramatically reduced error accumulation over time (82.5% lower autoregressive error than FNO, 99.9% lower than DeepONet). To choose the training data, we introduce a PCA combined with KMeans trajectory selection strategy. These findings provide compelling evidence that GNS, with its graph-based locality and solver-inspired design, is the most suitable and scalable surrogate modeling framework for AI-driven scientific discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。