arXiv:2602.15649cs.LG2026-02被引 2

提出连续时间分段线性RNN,兼具物理可解释性与不规则采样处理能力。

Continuous-Time Piecewise-Linear Recurrent Neural Networks

  • 基于分段线性结构设计连续时间RNN,避免数值积分
  • 在含突变阈值系统上优于离散RNN与神经ODE,保持长期统计特性
  • 可半解析求解平衡点与极限环,适合科学建模场景

在动力系统重构(DSR)中,目标是恢复观测时间序列背后的动力系统(DS),学习一个能近似真实数据生成过程并重现其长期统计特性的生成代理模型。在科学和医学领域,这类模型需具备机制可解释性,以便通过数学分析洞察系统行为。分段线性(PL)、基于ReLU的RNN(PLRNNs)在该任务中表现优异,达到当前最优水平,且因结构简单而易于分析。然而,现有PLRNN均为离散时间映射,与多数物理和生物过程的连续时间本质不符,难以处理不规则采样数据。神经微分方程(Neural ODEs)虽支持连续时间,但性能不如PLRNN,且可解释性较差。本文提出连续时间分段线性RNN(cPLRNNs)的理论框架,开发了无需数值积分的高效训练与模拟算法,充分利用其分段线性结构。进一步展示如何在训练后的模型中半解析确定平衡点、极限环等重要拓扑结构。在包含硬阈值的系统基准测试中,cPLRNNs相比离散PLRNN与神经ODE均表现更优。

原文摘要 · Abstract (English)

In dynamical systems reconstruction (DSR) we aim to recover the dynamical system (DS) underlying observed time series. Specifically, we aim to learn a generative surrogate model which approximates the underlying, data-generating DS, and recreates its long-term properties (`climate statistics'). In scientific and medical areas, in particular, these models need to be mechanistically tractable -- through their mathematical analysis we would like to obtain insight into the recovered system's workings. Piecewise-linear (PL), ReLU-based RNNs (PLRNNs) have a strong track-record in this regard, representing SOTA DSR models while allowing mathematical insight by virtue of their PL design. However, all current PLRNN variants are discrete-time maps. This is in disaccord with the assumed continuous-time nature of most physical and biological processes, and makes it hard to accommodate data arriving at irregular temporal intervals. Neural ODEs are one solution, but they do not reach the DSR performance of PLRNNs and often lack their tractability. Here we develop theory for continuous-time PLRNNs (cPLRNNs): We present a novel algorithm for training and simulating such models, bypassing numerical integration by efficiently exploiting their PL structure. We further demonstrate how important topological objects like equilibria or limit cycles can be determined semi-analytically in trained models. We compare cPLRNNs to both their discrete-time cousins as well as Neural ODEs on DSR benchmarks, including systems with discontinuities which come with hard thresholds.

动力系统连续时间可解释性RNN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。