用物理约束的Transformer模型,零仿真数据就能泛化到新边界条件。
A physics-informed transformer neural operator for learning generalized solutions of initial boundary value problems
- 基于交叉注意力设计迭代积分核单元,让模型理解初始/边界条件。
- 在5个方程上测试,未见条件误差仅为现有方法1/5至1/3。
- 无需训练数据即可预测非训练时间步的解,适合工程仿真场景。
初边值问题广泛存在于由非线性偏微分方程(PDEs)描述的工程与自然系统中。神经算子作为新兴方法,通过神经网络学习输入输出函数空间间的映射关系来求解。现有方法通常需针对新初边值条件重新训练,并依赖大量模拟数据。本文提出物理信息感知的Transformer神经算子(PINTO),可在无仿真数据的设定下,仅通过物理损失实现对未见初边值条件的高效泛化。核心创新在于采用交叉注意力实现的迭代核积分算子单元,将解域点转化为含初边值信息的表示向量,从而高效学习新场景下的解函数。PINTO应用于求解工程中重要方程:对流、Burgers、稳态与非稳态Navier-Stokes方程(三种流场场景)。在五组测试中,面对复杂未见初边值条件时,相对误差仅为当前领先物理信息算子方法的1/5至1/3。此外,模型可准确求解对流和Burgers方程在非训练时间步的解。代码已开源:https://github.com/quest-lab-iisc/PINTO。
原文摘要 · Abstract (English)
Initial boundary value problems arise commonly in applications with engineering and natural systems governed by nonlinear partial differential equations (PDEs). Operator learning is an emerging field for solving these equations by using a neural network to learn a map between infinite dimensional input and output function spaces. These neural operators are trained using a combination of data (observations or simulations) and PDE-residuals (physics-loss). A major drawback of existing neural approaches is the requirement to retrain with new initial/boundary conditions, and the necessity for a large amount of simulation data for training. We develop a physics-informed transformer neural operator (named PINTO) that efficiently generalizes to unseen initial and boundary conditions, trained in a simulation-free setting using only physics loss. The main innovation lies in our new iterative kernel integral operator units, implemented using cross-attention, to transform the PDE solution's domain points into an initial/boundary condition-aware representation vector, enabling efficient learning of the solution function for new scenarios. The PINTO architecture is applied to simulate the solutions of important equations used in engineering applications: advection, Burgers, and steady and unsteady Navier-Stokes equations (three flow scenarios). For these five test cases, we show that the relative errors during testing under challenging conditions of unseen initial/boundary conditions are only one-fifth to one-third of other leading physics informed operator learning methods. Moreover, our PINTO model is able to accurately solve the advection and Burgers equations at time steps that are not included in the training collocation points. The code is available at https://github.com/quest-lab-iisc/PINTO
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。