arXiv:2604.27981cs.LGcs.AI2026-04

用优化算法提升MLP模型,高效预测多变量时间序列。

ITS-Mina: A Harris Hawks Optimization-Based All-MLP Framework with Iterative Refinement and External Attention for Multivariate Time Series Forecasting

论文配图:ITS-Mina: A Harris Hawks Optimization-Based All-MLP Framework with Iterative Refinement and External Attention for Multivariate Time Series Forecasting
图 1 · 摘自论文原文
  • 用迭代精炼机制加深网络,不增加参数量
  • 外注意力模块线性复杂度捕捉全局依赖
  • 自适应调参优化,适合数据差异大的场景

多变量时间序列预测在金融分析、能源管理、交通规划等实际应用中至关重要。尽管基于Transformer的架构流行,但近期研究发现更简单的MLP模型可在显著降低计算成本的同时达到竞争甚至更优性能。本文提出ITS-Mina,一种全新的全MLP框架,包含三项关键创新:(1) 迭代精炼机制通过重复应用共享参数的残差混洗堆栈,逐步增强时序表征,有效提升模型计算能力而不增加独立参数数量;(2) 外部注意力模块以可学习的记忆单元替代传统自注意力,实现线性复杂度的跨样本全局依赖建模;(3) 采用哈里斯鹰优化(HHO)算法自动调节丢弃率,实现针对各数据集的自适应正则化。在六个主流基准数据集上的大量实验表明,ITS-Mina在多个预测时长下均达到或超过十一个基线模型的最先进性能。

原文摘要 · Abstract (English)

Multivariate time series forecasting plays a pivotal role in numerous real-world applications, including financial analysis, energy management, and traffic planning. While Transformer-based architectures have gained popularity for this task, recent studies reveal that simpler MLP-based models can achieve competitive or superior performance with significantly reduced computational cost. In this paper, we propose ITS-Mina, a novel all-MLP framework for multivariate time series forecasting that integrates three key innovations: (1) an iterative refinement mechanism that progressively enhances temporal representations by repeatedly applying a shared-parameter residual mixer stack, effectively deepening the model's computational capacity without multiplying the number of distinct parameters; (2) an external attention module that replaces traditional self-attention with learnable memory units, capturing cross-sample global dependencies at linear computational complexity; and (3) a Harris Hawks Optimization (HHO) algorithm for automatic dropout rate tuning, enabling adaptive regularization tailored to each dataset. Extensive experiments on six widely-used benchmark datasets demonstrate that ITS-Mina achieves state-of-the-art or highly competitive performance compared to eleven baseline models across multiple forecasting horizons.

时间序列MLP优化算法注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。