arXiv:2506.14113cs.LGcs.AI2025-06ICML被引 4

用线性RNN模拟非线性系统,提升时间序列预测精度

SKOLR: Structured Koopman Operator Linear RNN for Time-Series Forecasting

  • 将Koopman算子与线性RNN结合,通过延迟观测构建等价结构
  • 在多个数据集上达到领先性能,优于传统RNN和深度模型
  • 适合需要高效高精度预测的动态系统建模任务

Koopman算子理论通过将非线性动力系统映射到实值观测函数空间,实现线性算子表示,从而支持系统分析与时间序列预测。尽管线性优势明显,但该算子通常为无限维。因此,关键在于学习能生成可处理有限维近似的观测函数。本文揭示了Koopman算子近似与线性循环神经网络(RNN)之间的联系,表明通过引入包含滞后观测的扩展状态,可建立结构化Koopman算子与线性RNN更新之间的等价关系。基于此,提出SKOLR:利用可学习的信号谱分解与多层感知机(MLP)作为观测函数,通过高度并行的线性RNN堆栈实现结构化Koopman算子。在多种预测基准与动力系统上的数值实验表明,这种基于Koopman理论的简化设计展现出卓越性能。

原文摘要 · Abstract (English)

Koopman operator theory provides a framework for nonlinear dynamical system analysis and time-series forecasting by mapping dynamics to a space of real-valued measurement functions, enabling a linear operator representation. Despite the advantage of linearity, the operator is generally infinite-dimensional. Therefore, the objective is to learn measurement functions that yield a tractable finite-dimensional Koopman operator approximation. In this work, we establish a connection between Koopman operator approximation and linear Recurrent Neural Networks (RNNs), which have recently demonstrated remarkable success in sequence modeling. We show that by considering an extended state consisting of lagged observations, we can establish an equivalence between a structured Koopman operator and linear RNN updates. Building on this connection, we present SKOLR, which integrates a learnable spectral decomposition of the input signal with a multilayer perceptron (MLP) as the measurement functions and implements a structured Koopman operator via a highly parallel linear RNN stack. Numerical experiments on various forecasting benchmarks and dynamical systems show that this streamlined, Koopman-theory-based design delivers exceptional performance.

时间序列Koopman算子RNN动态系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。