arXiv:2605.01277cs.CVcs.AI2026-05

提出MIMO-ESP模型,高效融合时空信息并提升预测性能。

CNN-based Multi-In-Multi-Out Model for Efficient Spatiotemporal Prediction

  • 将时间轴独立处理,用空洞卷积捕获全局时空特征
  • 在三个基准数据集上优于现有模型,效率显著提升
  • 适合需要快速高精度时空预测的应用场景

近期基于卷积神经网络(CNN)或变换器(Transformer)的模型被提出,以克服循环神经网络(RNN)在时空预测中的局限性。这些模型避免了因序列特性导致的并行化效率低下和递归误差累积问题,表现优异。然而仍存在挑战:CNN因核的局部性难以捕捉全局信息,性能受限;且时间轴与通道轴混合处理造成信息混淆。Transformer模型因自注意力计算复杂度高,训练耗时长。本文提出一种基于CNN的多输入多输出高效时空预测模型(MIMO-ESP),通过在CNN基础上构建类Transformer结构,有效考虑全局信息,显著降低复杂度。同时,时间轴作为独立维度处理,利用空洞卷积协同建模时空信息。在视频、交通和降水预测三个主流基准数据集上的实验表明,MIMO-ESP在保持竞争力效率的同时,超越现有模型。消融实验证明各组件有效性,凸显该方法潜力。

原文摘要 · Abstract (English)

Recently, Convolutional Neural Network (CNN) or Transformer architecture based models have been proposed to overcome the limitations of Recurrent Neural Network (RNN) based models in spatiotemporal prediction. These models prevent the inefficiency of parallelization limitation due to the sequential properties and stacked error due to the recursive method, and show high performance. Novertheless, there are still some challengies. First, CNN based models have difficulty considering global information due to the local properties of the kernel, and their performance is limited. In addition, information is mixed because the time axis is combined with the channel axis of the image for processing. Models based on Transformer architecture have high complexity due to the self-attention calcuation and take a long training time. In this paper, we propose a new structure model called CNN-based Multi-In-Multi-Out model for Efficient Spatiotemporal Prediction (MIMO-ESP) to overcome these limitations. MIMO-ESP considers global information and significantly improves complexity by configuring a Transformer architecture based on CNN. In addition, it treats the time axis as an independent axis without combining it, and effectively considers spatiotemporal information together by applying dilation. This structure makes MIMO-ESP efficient and high performance. Extensive experiment results on three promising benchmark datasets which including video, traffic, and precipitation prediction tasks demonstrate that the usefulness of MIMO-ESP due to the achieved competitive efficiency while outperforming existing models. Furthermore, the ablation study results demonstrate the usefulness of the components of MIMO-ESP, emphasizing the potential of the proposed approaches.

时空预测CNN高效模型空洞卷积

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。