arXiv:2410.14240cs.LGcs.AI2024-10NeurIPS被引 18

用近线性RNN从数据自动发现最简分段线性动力系统模型

Almost-Linear RNNs Yield Highly Interpretable Symbolic Codes in Dynamical Systems Reconstruction

  • 提出AL-RNN,通过最少非线性项实现动力系统的分段线性建模
  • 在洛伦兹与罗斯勒系统上复现已知最小拓扑结构的分段线性表示
  • 生成可解释的符号编码,适合需数学分析的动力系统研究者

动力系统理论是科学与工程的基础,常以微分或递归方程描述随时间演化的系统行为。为提升模型的数学可处理性与可解释性,传统方法将非线性动力系统分解为由切换流形分隔的多个线性子系统,即分段线性(PWL)系统。这类模型在工程中广泛应用,也是研究系统拓扑性质的常见选择。然而,人工构建此类模型繁琐,仅适用于极低维情形;而从数据中推断时,通常产生过于复杂的表示,包含大量线性子区域。本文提出几乎线性循环神经网络(AL-RNN),能自动且稳健地从时间序列数据中提取最简PWL表示,使用尽可能少的非线性部分。AL-RNN可结合任意先进动力系统重构算法高效训练,并自然生成保持重要拓扑性质的符号编码。我们证明,在洛伦兹与罗斯勒系统中,AL-RNN以纯数据驱动方式发现了对应混沌吸引子的已知拓扑最小PWL表示。进一步在两个具有挑战性的实测数据集上展示,该方法可实现高度可解释的动态符号编码,极大促进对底层系统的数学与计算分析。

原文摘要 · Abstract (English)

Dynamical systems (DS) theory is fundamental for many areas of science and engineering. It can provide deep insights into the behavior of systems evolving in time, as typically described by differential or recursive equations. A common approach to facilitate mathematical tractability and interpretability of DS models involves decomposing nonlinear DS into multiple linear DS separated by switching manifolds, i.e. piecewise linear (PWL) systems. PWL models are popular in engineering and a frequent choice in mathematics for analyzing the topological properties of DS. However, hand-crafting such models is tedious and only possible for very low-dimensional scenarios, while inferring them from data usually gives rise to unnecessarily complex representations with very many linear subregions. Here we introduce Almost-Linear Recurrent Neural Networks (AL-RNNs) which automatically and robustly produce most parsimonious PWL representations of DS from time series data, using as few PWL nonlinearities as possible. AL-RNNs can be efficiently trained with any SOTA algorithm for dynamical systems reconstruction (DSR), and naturally give rise to a symbolic encoding of the underlying DS that provably preserves important topological properties. We show that for the Lorenz and Rössler systems, AL-RNNs discover, in a purely data-driven way, the known topologically minimal PWL representations of the corresponding chaotic attractors. We further illustrate on two challenging empirical datasets that interpretable symbolic encodings of the dynamics can be achieved, tremendously facilitating mathematical and computational analysis of the underlying systems.

动力系统RNN可解释性符号编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。