提出尺度一致性学习,让AI模型解偏微分方程时能跨雷诺数泛化。
Scale-Consistent Learning for Partial Differential Equations
- 利用偏微分方程的尺度可缩放性设计数据增强与损失函数
- 在雷诺数1000上训练的模型可泛化至250~10000范围,平均误差降低34%
- 适合需要跨尺度、跨参数求解复杂物理方程的研究者
机器学习模型在科学与工程中求解偏微分方程(PDE)方面展现出巨大潜力。以往的机器学习模型通常无法超出训练数据范围泛化:例如,针对纳维-斯托克斯方程的模型仅适用于特定雷诺数(Re)和预设域。为克服此限制,本文提出基于PDE尺度一致性特性的数据增强方案,并设计一种尺度感知神经算子,可建模多种尺度。该方法利用两个关键事实:(i) PDE可通过缩放重构,即给定域可缩放到单位尺寸,同时调整参数与边界条件以保持原解不变;(ii) 在给定域上的解算子在子域上具有一致性。据此构建尺度一致性损失,强制模型在原域与缩放子域上的解保持一致。由于神经算子天然具备多尺度拟合能力,特别适合融入该损失进行训练。实验在伯格斯方程、达西流、亥姆霍兹方程和纳维-斯托克斯方程上验证。引入尺度一致性后,于Re=1000训练的模型可泛化至250~10000的雷诺数范围,所有数据集平均误差相比基线降低34%。
原文摘要 · Abstract (English)
Machine learning (ML) models have emerged as a promising approach for solving partial differential equations (PDEs) in science and engineering. Previous ML models typically cannot generalize outside the training data; for example, a trained ML model for the Navier-Stokes equations only works for a fixed Reynolds number ($Re$) on a pre-defined domain. To overcome these limitations, we propose a data augmentation scheme based on scale-consistency properties of PDEs and design a scale-informed neural operator that can model a wide range of scales. Our formulation leverages the facts: (i) PDEs can be rescaled, or more concretely, a given domain can be re-scaled to unit size, and the parameters and the boundary conditions of the PDE can be appropriately adjusted to represent the original solution, and (ii) the solution operators on a given domain are consistent on the sub-domains. We leverage these facts to create a scale-consistency loss that encourages matching the solutions evaluated on a given domain and the solution obtained on its sub-domain from the rescaled PDE. Since neural operators can fit to multiple scales and resolutions, they are the natural choice for incorporating scale-consistency loss during training of neural PDE solvers. We experiment with scale-consistency loss and the scale-informed neural operator model on the Burgers' equation, Darcy Flow, Helmholtz equation, and Navier-Stokes equations. With scale-consistency, the model trained on $Re$ of 1000 can generalize to $Re$ ranging from 250 to 10000, and reduces the error by 34% on average of all datasets compared to baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。