arXiv:2410.02843cs.LGcs.AI2024-10被引 4

用延迟微分方程建模部分可观测系统的记忆效应,提升预测精度。

Neural delay differential equations: learning non-Markovian closures for partially known dynamical systems

  • 基于时滞神经微分方程,用有限时间延迟捕捉系统记忆项。
  • 在混沌系统与实验数据上优于LSTM和ANODE等现有方法。
  • 适合建模传感器有限、需处理历史依赖的物理系统。

从数据学习动力系统近年取得显著进展,但多数方法假设可获取完整状态,这在实际中很少成立——系统通常仅通过少量传感器观测,导致部分可观测。为应对这一挑战,本文借鉴莫里-曾万吉理论,建立隐藏变量与记忆项间的理论联系,提出常时滞神经延迟微分方程(NDDEs)框架,提供一种连续时间方法,直接从数据中学习非马尔可夫动力学。记忆效应通过有限时间延迟捕获,延迟值由伴随法识别。在合成系统、混沌动力学及实验数据(如Kuramoto-Sivashinsky方程和腔流实验)上验证,结果表明NDDEs在部分可观测场景下表现优于现有方法,包括长短期记忆网络(LSTM)和增强神经常微分方程(ANODE)。总体而言,NDDEs为部分可观测条件下的非马尔可夫动力学建模提供了原则性且数据高效的方案。论文附开源实现。

原文摘要 · Abstract (English)

Recent advances in learning dynamical systems from data have shown significant promise. However, many existing methods assume access to the full state of the system -- an assumption that is rarely satisfied in practice, where systems are typically monitored through a limited number of sensors, leading to partial observability. To address this challenge, we draw inspiration from the Mori-Zwanzig formalism, which provides a theoretical connection between hidden variables and memory terms. Motivated by this perspective, we introduce a constant-lag Neural Delay Differential Equations (NDDEs) framework, providing a continuous-time approach for learning non-Markovian dynamics directly from data. These memory effects are captured using a finite set of time delays, which are identified via the adjoint method. We validate the proposed approach on a range of datasets, including synthetic systems, chaotic dynamics, and experimental measurements, such as the Kuramoto-Sivashinsky equation and cavity-flow experiments. Results demonstrate that NDDEs compare favourably with existing approaches for partially observed systems, including long short-term memory (LSTM) networks and augmented neural ordinary differential equations (ANODEs). Overall, NDDEs offer a principled and data-efficient framework for modelling non-Markovian dynamics under partial observability. An open-source implementation accompanies this article.

延迟微分非马尔可夫物理建模数据效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。