用Mamba提升长期时间序列预测效率,兼顾精度与速度。
UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mamba
- U形结构结合多尺度MLP与Mamba,捕捉长序列依赖
- 线性时间复杂度下在多个数据集上达到顶尖性能
- 适合需要高效处理超长序列的气象、金融等场景
多变量时间序列预测在交通、气象、金融等领域至关重要,尤其对极端天气事件预测意义重大。当前主流方法多基于Transformer架构,依赖注意力机制捕捉时序依赖,但其二次时间复杂度限制了输入序列长度的扩展,制约了实际应用。Mamba基于状态空间模型(SSM),具备线性时间复杂度,为高效序列建模提供可能。本文提出UmambaTSF,一种新型长期时间序列预测框架,融合U形编码器-解码器多尺度特征提取能力与Mamba的长序列表征优势。框架中引入改进的残差结构与可调设计的Mamba模块,有效捕获独特时序信号并灵活处理通道。实验表明,UmambaTSF在多个主流基准数据集上实现领先性能,同时保持线性时间复杂度与低内存消耗。
原文摘要 · Abstract (English)
Multivariate Time series forecasting is crucial in domains such as transportation, meteorology, and finance, especially for predicting extreme weather events. State-of-the-art methods predominantly rely on Transformer architectures, which utilize attention mechanisms to capture temporal dependencies. However, these methods are hindered by quadratic time complexity, limiting the model's scalability with respect to input sequence length. This significantly restricts their practicality in the real world. Mamba, based on state space models (SSM), provides a solution with linear time complexity, increasing the potential for efficient forecasting of sequential data. In this study, we propose UmambaTSF, a novel long-term time series forecasting framework that integrates multi-scale feature extraction capabilities of U-shaped encoder-decoder multilayer perceptrons (MLP) with Mamba's long sequence representation. To improve performance and efficiency, the Mamba blocks introduced in the framework adopt a refined residual structure and adaptable design, enabling the capture of unique temporal signals and flexible channel processing. In the experiments, UmambaTSF achieves state-of-the-art performance and excellent generality on widely used benchmark datasets while maintaining linear time complexity and low memory consumption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。