用分段小池塘实现高效高维时空预测,比LSTM快百倍还准。
Sequential Reservoir Computing for Efficient High-Dimensional Spatiotemporal Forecasting
- 把大神经池拆成多个小池串联,降低内存和计算开销。
- 在混沌系统上预测时长远超LSTM,误差低20%-30%,训练成本降千倍。
- 适合需要实时、低功耗的科学与工程场景,如气候或流体模拟。
高维时空系统的预测对循环神经网络(RNN)和长短期记忆(LSTM)模型而言仍具计算挑战性,主要源于基于梯度的训练和内存瓶颈。储层计算(RC)通过将反向传播替换为固定递归层与凸读出优化,缓解了这些问题,但传统RC架构在输入维度增加时仍扩展性差。我们提出一种序列储层计算(Sequential RC)架构,将大型储层分解为一系列小型、相互连接的储层。该设计降低了内存和计算成本,同时保持长期时间依赖性。在低维混沌系统(Lorenz63)和高维物理模拟(二维涡度方程与浅水方程)上,Sequential RC实现了15-25%更长的有效预测时域,误差指标(SSIM、RMSE)降低20-30%,训练成本最高降低三个数量级,优于LSTM和标准RNN基线。结果表明,Sequential RC在保持传统RC简洁性和高效性的同时,显著提升了高维动力系统下的可扩展性。该方法为科学与工程应用中的实时、节能预测提供了可行路径。
原文摘要 · Abstract (English)
Forecasting high-dimensional spatiotemporal systems remains computationally challenging for recurrent neural networks (RNNs) and long short-term memory (LSTM) models due to gradient-based training and memory bottlenecks. Reservoir Computing (RC) mitigates these challenges by replacing backpropagation with fixed recurrent layers and a convex readout optimization, yet conventional RC architectures still scale poorly with input dimensionality. We introduce a Sequential Reservoir Computing (Sequential RC) architecture that decomposes a large reservoir into a series of smaller, interconnected reservoirs. This design reduces memory and computational costs while preserving long-term temporal dependencies. Using both low-dimensional chaotic systems (Lorenz63) and high-dimensional physical simulations (2D vorticity and shallow-water equations), Sequential RC achieves 15-25% longer valid forecast horizons, 20-30% lower error metrics (SSIM, RMSE), and up to three orders of magnitude lower training cost compared to LSTM and standard RNN baselines. The results demonstrate that Sequential RC maintains the simplicity and efficiency of conventional RC while achieving superior scalability for high-dimensional dynamical systems. This approach provides a practical path toward real-time, energy-efficient forecasting in scientific and engineering applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。