arXiv:2507.04381cs.AI2025-07

融合Mamba与线性Transformer,提升多变量时间序列预测精度

DC-Mamber: A Dual Channel Prediction Model based on Mamba and Linear Transformer for Multivariate Time Series Forecasting

  • 双通道设计:Mamba处理变量内局部特征,线性Transformer建模全局依赖
  • 在8个公开数据集上超越现有模型,显著提升预测准确率
  • 适合长序列多变量时序预测任务,兼顾效率与精度

在多变量时间序列预测(MTSF)中,现有方法通常分为通道独立与通道混合两类。前者将每个变量的时序信息视为独立标记,侧重捕捉单变量局部特征;后者在每一步构建多变量标记,强调全局时序依赖建模。主流模型基于Transformer或新兴的Mamba。Transformer通过自注意力机制擅长全局依赖建模,但对局部模式敏感度低,且计算复杂度为二次方,限制了长序列处理效率;而基于状态空间模型(SSMs)的Mamba实现线性复杂度,高效建模长程依赖,却难以并行聚合全局上下文信息。为克服两者局限,我们提出DC-Mamber,一种基于Mamba与线性Transformer的双通道预测模型。具体而言,基于Mamba的通道采用通道独立策略提取变量内特征,基于线性Transformer的通道采用通道混合策略建模跨时间步全局依赖。模型首先通过两个独立嵌入层将原始输入映射为两种特征表示,再分别由变量编码器(基于Mamba)和时间编码器(基于线性Transformer)处理,最后通过融合层整合双通道特征进行预测。在八个公开数据集上的大量实验表明,DC-Mamber在预测精度上优于现有模型。

原文摘要 · Abstract (English)

In multivariate time series forecasting (MTSF), existing strategies for processing sequences are typically categorized as channel-independent and channel-mixing. The former treats all temporal information of each variable as a token, focusing on capturing local temporal features of individual variables, while the latter constructs a token from the multivariate information at each time step, emphasizing the modeling of global temporal dependencies. Current mainstream models are mostly based on Transformer and the emerging Mamba. Transformers excel at modeling global dependencies through self-attention mechanisms but exhibit limited sensitivity to local temporal patterns and suffer from quadratic computational complexity, restricting their efficiency in long-sequence processing. In contrast, Mamba, based on state space models (SSMs), achieves linear complexity and efficient long-range modeling but struggles to aggregate global contextual information in parallel. To overcome the limitations of both models, we propose DC-Mamber, a dual-channel forecasting model based on Mamba and linear Transformer for time series forecasting. Specifically, the Mamba-based channel employs a channel-independent strategy to extract intra-variable features, while the Transformer-based channel adopts a channel-mixing strategy to model cross-timestep global dependencies. DC-Mamber first maps the raw input into two distinct feature representations via separate embedding layers. These representations are then processed by a variable encoder (built on Mamba) and a temporal encoder (built on linear Transformer), respectively. Finally, a fusion layer integrates the dual-channel features for prediction. Extensive experiments on eight public datasets confirm DC-Mamber's superior accuracy over existing models.

时间序列Mamba双通道预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。