用新结构RNN直接算时间导数,解方程更准更快
Revising the Structure of Recurrent Neural Networks to Eliminate Numerical Derivatives in Forming Physics Informed Loss Terms with Respect to Time
- 改造RNN结构,让每块预测时间区间,用反向传播算导数
- 在不规则域热传导问题上,误差比传统方法低一个数量级
- 适合需要高精度时间演化模拟的研究者
使用循环神经网络(RNN)求解非稳态偏微分方程(PDEs)通常需要在RNN各块之间进行数值微分以构建物理约束损失函数。然而,这会将数值微分的复杂性引入训练过程。本文提出修改传统RNN结构,使其能够对每个时间区间进行输出预测,从而通过反向传播算法计算输出对时间的导数。为此,各块的时间区间相互重叠,并定义它们之间的互损函数。此外,采用条件隐状态确保每块有唯一解,遗忘因子控制条件隐状态对后续块的影响。该新模型称为互区间RNN(MI-RNN),应用于三个基准问题:Burgers方程、不规则域中的非稳态热传导以及Green涡旋问题。结果表明,与现有含数值导数的RNN模型相比,MI-RNN能更准确地找到精确解。例如,在第二类问题中,相对误差降低了整整一个数量级。
原文摘要 · Abstract (English)
Solving unsteady partial differential equations (PDEs) using recurrent neural networks (RNNs) typically requires numerical derivatives between each block of the RNN to form the physics informed loss function. However, this introduces the complexities of numerical derivatives into the training process of these models. In this study, we propose modifying the structure of the traditional RNN to enable the prediction of each block over a time interval, making it possible to calculate the derivative of the output with respect to time using the backpropagation algorithm. To achieve this, the time intervals of these blocks are overlapped, defining a mutual loss function between them. Additionally, the employment of conditional hidden states enables us to achieve a unique solution for each block. The forget factor is utilized to control the influence of the conditional hidden state on the prediction of the subsequent block. This new model, termed the Mutual Interval RNN (MI-RNN), is applied to solve three different benchmarks: the Burgers equation, unsteady heat conduction in an irregular domain, and the Green vortex problem. Our results demonstrate that MI-RNN can find the exact solution more accurately compared to existing RNN models. For instance, in the second problem, MI-RNN achieved one order of magnitude less relative error compared to the RNN model with numerical derivatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。