提出轻量卷积RNN,训练速度提升且预测更准。
Minimal Convolutional RNNs Accelerate Spatiotemporal Learning
- 将极简RNN的并行计算思想扩展到卷积结构,支持全并行训练。
- 在流体与气象数据上,训练速度远超传统模型,误差更低。
- 适合需要高效处理时空序列的科研与工程场景。
我们提出MinConvLSTM和MinConvGRU两种新型时空模型,将卷积循环网络的空间归纳偏置与极简、可并行化RNN的训练效率相结合。方法将MinLSTM和MinGRU的对数域前缀和公式拓展至卷积架构,实现完全并行训练,同时保留局部空间建模能力,消除了教师强制下的序列隐状态更新瓶颈。此外,引入受xLSTM启发的指数门控机制,进一步简化对数域计算。模型结构简洁、计算高效,参数量减少,可扩展性更强。我们在两个时空预测任务上评估:纳维-斯托克斯动力学和真实世界位势能数据。在训练速度上显著优于标准ConvLSTM和ConvGRU;在闭环自回归模式下,预测误差也更低。结果表明,结合卷积输入聚合的极简递归结构,是时空序列建模中兼具简洁性与空间复杂性的高效替代方案。
原文摘要 · Abstract (English)
We introduce MinConvLSTM and MinConvGRU, two novel spatiotemporal models that combine the spatial inductive biases of convolutional recurrent networks with the training efficiency of minimal, parallelizable RNNs. Our approach extends the log-domain prefix-sum formulation of MinLSTM and MinGRU to convolutional architectures, enabling fully parallel training while retaining localized spatial modeling. This eliminates the need for sequential hidden state updates during teacher forcing - a major bottleneck in conventional ConvRNN models. In addition, we incorporate an exponential gating mechanism inspired by the xLSTM architecture into the MinConvLSTM, which further simplifies the log-domain computation. Our models are structurally minimal and computationally efficient, with reduced parameter count and improved scalability. We evaluate our models on two spatiotemporal forecasting tasks: Navier-Stokes dynamics and real-world geopotential data. In terms of training speed, our architectures significantly outperform standard ConvLSTMs and ConvGRUs. Moreover, our models also achieve lower prediction errors in both domains, even in closed-loop autoregressive mode. These findings demonstrate that minimal recurrent structures, when combined with convolutional input aggregation, offer a compelling and efficient alternative for spatiotemporal sequence modeling, bridging the gap between recurrent simplicity and spatial complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。