arXiv:2411.12940nlin.CDcs.LG2024-11被引 9

揭示了数据驱动的动态系统预测中两种方法的本质等价性。

On the relationship between Koopman operator approximations and neural ordinary differential equations for data-driven time-evolution predictions

  • 将字典学习与状态空间投影结合,使EDMD-DL实现非线性演化
  • 在洛伦兹系统和湍流模型上表现媲美神经ODE,可预测极端事件
  • 适合研究非线性动力系统建模与机器学习交叉领域的研究者

本文探讨了状态空间方法与基于Koopman算子的方法在预测非线性动力系统时间演化中的关系。研究发现,当扩展动态模式分解结合字典学习(EDMD-DL)并引入状态空间投影时,其等价于状态空间上的非线性离散时间流映射的神经网络表示。该投影步骤引入非线性,显著提升预测性能。由此产生的系统可在离散或连续时间下建模,具有天然适合神经网络的结构:先将状态映射到高维特征空间,再通过线性组合表示映射或向量场。受此启发,我们结合两者的结构与训练方式,实现多种神经微分方程(ODE)与EDMD-DL变体。在洛伦兹系统及九模湍流剪切流模型上的数值实验表明,各方法在短时轨迹预测、长期统计重构和罕见事件预测方面表现相当。结果验证了带投影的EDMD-DL与神经ODE在动态建模上的等价性。此外,这些方法在极端事件预测上表现优于传统马尔可夫方法。

原文摘要 · Abstract (English)

This work explores the relationship between state space methods and Koopman operator-based methods for predicting the time-evolution of nonlinear dynamical systems. We demonstrate that extended dynamic mode decomposition with dictionary learning (EDMD-DL), when combined with a state space projection, is equivalent to a neural network representation of the nonlinear discrete-time flow map on the state space. We highlight how this projection step introduces nonlinearity into the evolution equations, enabling significantly improved EDMD-DL predictions. With this projection, EDMD-DL leads to a nonlinear dynamical system on the state space, which can be represented in either discrete or continuous time. This system has a natural structure for neural networks, where the state is first expanded into a high dimensional feature space followed by a linear mapping which represents the discrete-time map or the vector field as a linear combination of these features. Inspired by these observations, we implement several variations of neural ordinary differential equations (ODEs) and EDMD-DL, developed by combining different aspects of their respective model structures and training procedures. We evaluate these methods using numerical experiments on chaotic dynamics in the Lorenz system and a nine-mode model of turbulent shear flow, showing comparable performance across methods in terms of short-time trajectory prediction, reconstruction of long-time statistics, and prediction of rare events. These results highlight the equivalence of the EDMD-DL implementation with a state space projection to a neural ODE representation of the dynamics. We also show that these methods provide comparable performance to a non-Markovian approach in terms of prediction of extreme events.

动力系统神经ODEKoopman算子数据驱动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。