用物理规律生成数据,结合新型AI算子高效求解微分方程。
AI paradigm for solving differential equations: first-principles data generation and scale-dilation operator AI solver
- 基于物理规律自动生成海量训练数据,成本极低。
- 提出可逆尺度膨胀算子,显著提升高频成分逼近精度。
- 适合需要高精度解的科学计算与工程仿真场景。
许多问题由微分方程(DEs) governing。人工智能(AI)是求解DEs的新路径,但数据稀缺且现有AI求解器难以逼近高频成分(AHFC)。本文提出一种求解多样化DEs的AI范式,包括基于物理规律的数据生成方法和尺度膨胀算子(SDO)AI求解器。通过先验知识或随机场生成解,代入DEs后通过平衡方程推导源项及初始/边界条件,从而以极低计算成本生成任意规模的第一性原理一致训练数据集。引入可逆SDO,利用多尺度解的傅里叶变换修复AHFC;设计具有时空耦合注意力机制的Transformer AI求解器,结合SDO。理论证明损失函数的海森矩阵条件数上界与解梯度的2-范数平方成正比,表明SDO使损失曲面更平滑,从而实现高效训练。在多种DEs上的大量测试表明,本范式在精度上持续优于当前最优方法。该工作使AI求解器真正适用于广泛的自然与工程领域。
原文摘要 · Abstract (English)
Many problems are governed by differential equations (DEs). Artificial intelligence (AI) is a new path for solving DEs. However, data is very scarce and existing AI solvers struggle with approximation of high frequency components (AHFC). We propose an AI paradigm for solving diverse DEs, including DE-ruled first-principles data generation methodology and scale-dilation operator (SDO) AI solver. Using either prior knowledge or random fields, we generate solutions and then substitute them into the DEs to derive the sources and initial/boundary conditions through balancing DEs, thus producing arbitrarily vast amount of, first-principles-consistent training datasets at extremely low computational cost. We introduce a reversible SDO that leverages the Fourier transform of the multiscale solutions to fix AHFC, and design a spatiotemporally coupled, attention-based Transformer AI solver of DEs with SDO. An upper bound on the Hessian condition number of the loss function is proven to be proportional to the squared 2-norm of the solution gradient, revealing that SDO yields a smoother loss landscape, consequently fixing AHFC with efficient training. Extensive tests on diverse DEs demonstrate that our AI paradigm achieves consistently superior accuracy over state-of-the-art methods. This work makes AI solver of DEs to be truly usable in broad nature and engineering fields.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。