将物理定律融入循环神经网络,用少量数据精准建模可调控动态系统。
Physics-Informed Echo State Networks for Modeling Controllable Dynamical Systems
- 融合物理方程的递归网络,通过微分方程约束提升建模能力。
- 在少样本下测试误差降低92%,显著减少过拟合。
- 适合工业控制、传感器稀疏场景下的系统建模与预测控制。
回声状态网络(ESN)是一种常用于建模非线性动态系统的递归神经网络,训练相对简单。通过将物理定律引入ESN训练过程,提出了物理信息增强的ESN(PI-ESN),最初用于无外部输入的混沌系统建模,因常微分方程(ODE)提供正则化,可大幅减少所需数据量。本文将PI-ESN扩展至含外部输入的可控非线性系统建模,并采用自适应平衡损失方法,协调残差回归项与物理信息损失项的权重。在两个由ODE描述的非线性系统(Van der Pol振子、四水箱系统)及一个微分代数系统(电潜泵)上的实验表明,所提方法优于传统ESN,尤其在数据稀缺时表现突出:仅用少量数据训练即可显著降低模型过拟合,测试误差相对减少达92%。进一步实验显示,该方法对ODE参数不确定性具有鲁棒性,且基于PI-ESN的模型预测控制性能优于普通ESN,尤其在训练数据有限时优势明显。
原文摘要 · Abstract (English)
Echo State Networks (ESNs) are recurrent neural networks usually employed for modeling nonlinear dynamic systems with relatively ease of training. By incorporating physical laws into the training of ESNs, Physics-Informed ESNs (PI-ESNs) were proposed initially to model chaotic dynamic systems without external inputs. They require less data for training since Ordinary Differential Equations (ODEs) of the considered system help to regularize the ESN. In this work, the PI-ESN is extended with external inputs to model controllable nonlinear dynamic systems. Additionally, an existing self-adaptive balancing loss method is employed to balance the contributions of the residual regression term and the physics-informed loss term in the total loss function. The experiments with two nonlinear systems modeled by ODEs, the Van der Pol oscillator and the four-tank system, and with one differential-algebraic (DAE) system, an electric submersible pump, revealed that the proposed PI-ESN outperforms the conventional ESN, especially in scenarios with limited data availability, showing that PI-ESNs can regularize an ESN model with external inputs previously trained on just a few datapoints, reducing its overfitting and improving its generalization error (up to 92% relative reduction in the test error). Further experiments demonstrated that the proposed PI-ESN is robust to parametric uncertainties in the ODE equations and that model predictive control using PI-ESN outperforms the one using plain ESN, particularly when training data is scarce.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。