用浅层循环解码器联合学习传感器数据与非线性动力学模型。
Sparse identification of nonlinear dynamics and Koopman operators with Shallow Recurrent Decoder Networks
- 基于SINDy正则化的浅层循环网络,从稀疏观测中重建全时空场。
- 在湍流、海表温度等数据上实现更高精度与更少数据需求。
- 模型可解释性强,适合需要物理可解释性的科学建模场景。
真实世界的时空数据建模因高维性、测量噪声、部分观测和昂贵的数据采集而极具挑战。本文提出稀疏非线性动力学与Koopman算子的浅层循环解码器方法(SINDy-SHRED),以简单实现、高效计算和鲁棒性能联合解决传感与模型识别问题。SINDy-SHRED利用门控循环单元建模稀疏传感器序列,并通过浅层解码器网络从隐状态空间重构完整时空场。算法引入基于SINDy的正则化,使隐空间逐步收敛至SINDy类函数形式,投影保持在集合内。若将SINDy限制为线性模型,则生成Koopman-SHRED模型。SINDy-SHRED(i)学习复杂时空动力学的符号化、可解释的低维隐空间生成模型;(ii)即使对已知物理系统也能发现新物理模型;(iii)具有可证明的鲁棒收敛性,损失曲面呈现全局凸性;(iv)在参数更少的前提下,实现更高精度、更强数据效率与更短训练时间。我们在偏微分方程数据(如湍流)、真实世界海表温度传感器数据及视频数据上进行系统实验。隐状态动力学的可解释性SINDy与Koopman模型支持稳定准确的长期视频预测,优于所有现有基线深度学习模型,包括Convolutional LSTM、PredRNN、ResNet和SimVP,表现更优,且在精度、训练时间和数据需求上均占优势。
原文摘要 · Abstract (English)
Modeling real-world spatio-temporal data is exceptionally difficult due to inherent high dimensionality, measurement noise, partial observations, and often expensive data collection procedures. In this paper, we present Sparse Identification of Nonlinear Dynamics with SHallow REcurrent Decoder networks (SINDy-SHRED), a method to jointly solve the sensing and model identification problems with simple implementation, efficient computation, and robust performance. SINDy-SHRED uses Gated Recurrent Units to model the temporal sequence of sparse sensor measurements along with a shallow decoder network to reconstruct the full spatio-temporal field from the latent state space. Our algorithm introduces a SINDy-based regularization for which the latent space progressively converges to a SINDy-class functional, provided the projection remains within the set. In restricting SINDy to a linear model, a Koopman-SHRED model is generated. SINDy-SHRED (i) learns a symbolic and interpretable generative model of a parsimonious and low-dimensional latent space for the complex spatio-temporal dynamics, (ii) discovers new physics models even for well-known physical systems, (iii) achieves provably robust convergence with an observed globally convex loss landscape, and (iv) achieves superior accuracy, data efficiency, and training time, all with fewer model parameters. We conduct systematic experimental studies on PDE data such as turbulent flows, real-world sensor measurements for sea surface temperature, and direct video data. The interpretable SINDy and Koopman models of latent state dynamics enable stable and accurate long-term video predictions, outperforming all current baseline deep learning models in accuracy, training time, and data requirements, including Convolutional LSTM, PredRNN, ResNet, and SimVP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。