arXiv:2607.24420stat.MLcs.LG2026-07

基于脑神经振荡机制的新型储池计算模型,提升时间序列预测性能。

Frequency-Based Reservoir computing

论文配图:Frequency-Based Reservoir computing
图 1 · 摘自论文原文
  • 用频率分组的振荡单元替代随机连接网络,模拟大脑多时间尺度特性
  • 能选择性放大和存储特定频率输入,在短时预测上优于传统随机储池
  • 适用于复杂时空动态系统预测,为储池设计提供生理与物理理论依据

储池计算作为一种高效的时间序列预测框架,仅通过线性回归训练输出层,保留储池(循环层)不变。尽管其训练简便、易于实验,但现有储池由随机连接节点构成,需大量超参数调优,缺乏清晰的工作机制解释与优化方法。本文提出一种基于频率的储池模型,灵感源自大脑的振荡动力学及其时间尺度层次结构。该模型可视为一组独立振荡单元的集合,每个单元处理输入信号的特定频段内容。通过将储池建模为受外部输入驱动的单个非线性振荡器,我们发现各单元能选择性地放大并存储特定输入频率,用于后续预测。频率基储池在性能上不劣于甚至优于等效随机储池;更重要的是,该方法可针对性优化短时预测能力,而随机储池不具备此特性。此外,该模型还能成功预测复杂的时空动态系统。结果表明,储池计算可通过借鉴大脑特性与非线性受迫振荡器理论进行理性设计。

原文摘要 · Abstract (English)

Reservoir computing has emerged as an efficient machine learning framework for predicting time series generated by dynamical systems. In contrast to other machine and deep learning approaches, a reservoir computing trains only the output layer via linear regression, leaving the reservoir (recurrent layer) untrained. This simplification makes reservoir computers easier to train and more amenable to experimentation. However, because current reservoirs consist of networks of randomly connected nodes and require the optimization of numerous hyperparameters, a framework that precisely explains how reservoir computing operates and how it can be optimized remains missing. Here, we propose a frequency-based reservoir inspired by the brain's oscillatory dynamics and its hierarchy of timescales. The frequency-based reservoir can be interpreted as an ensemble of independent oscillatory units, each processing a portion of the input's frequency content. This allows us to understand the reservoir's internal behavior by modeling it as a single unit driven by an external input. Borrowing from the theory of a nonlinear oscillator forced by complex periodic inputs, we found that units of the frequency-based reservoir selectively amplify and store specific input frequencies, which are then used for prediction. The frequency-based reservoir performs as well as or better than equivalent random reservoirs. Furthermore, the frequency-based approach can be optimized to improve short-term prediction, a property that random reservoirs lack. Finally, we show that the frequency-based reservoir can also predict complex spatiotemporal dynamics. Our results show that reservoir computing can be designed using brain properties and theoretical insights borrowed from the physics of forced nonlinear oscillators.

储池计算时间序列振荡动力学非线性系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。