arXiv:2511.09924cs.LGcs.AI2025-11

提出新型时序预测模型,有效捕捉弱周期信号并提升计算效率。

MDMLP-EIA: Multi-domain Dynamic MLPs with Energy Invariant Attention for Time Series Forecasting

  • 分强弱周期信号,自适应融合通道以抑制噪声
  • 能量不变注意力机制,提升对扰动的鲁棒性
  • 动态调整神经元数量,适合多通道时序数据

时序预测在多个领域至关重要。尽管基于MLP的方法在参数更少、鲁棒性更强的前提下实现了与Transformer相当的性能,但仍存在弱周期信号丢失、权重共享MLP容量受限、通道独立策略下通道融合不足等关键问题。为此,我们提出MDMLP-EIA(多域动态MLP结合能量不变注意力)模型,包含三项创新:首先,设计自适应融合双域季节性MLP,将季节信号分为强弱成分,采用自适应零初始化通道融合策略,在抑制噪声的同时有效整合预测结果;其次,引入能量不变注意力机制,自适应聚焦趋势与季节性预测中不同特征通道,保持总信号能量恒定,契合分解-预测-重构框架,增强抗干扰能力;第三,提出通道独立MLP的动态容量调节机制,神经元数量随通道数平方根增长,确保通道增多时仍具备足够表达能力。在九个基准数据集上的大量实验表明,MDMLP-EIA在预测精度和计算效率上均达到当前最优水平。

原文摘要 · Abstract (English)

Time series forecasting is essential across diverse domains. While MLP-based methods have gained attention for achieving Transformer-comparable performance with fewer parameters and better robustness, they face critical limitations including loss of weak seasonal signals, capacity constraints in weight-sharing MLPs, and insufficient channel fusion in channel-independent strategies. To address these challenges, we propose MDMLP-EIA (Multi-domain Dynamic MLPs with Energy Invariant Attention) with three key innovations. First, we develop an adaptive fused dual-domain seasonal MLP that categorizes seasonal signals into strong and weak components. It employs an adaptive zero-initialized channel fusion strategy to minimize noise interference while effectively integrating predictions. Second, we introduce an energy invariant attention mechanism that adaptively focuses on different feature channels within trend and seasonal predictions across time steps. This mechanism maintains constant total signal energy to align with the decomposition-prediction-reconstruction framework and enhance robustness against disturbances. Third, we propose a dynamic capacity adjustment mechanism for channel-independent MLPs. This mechanism scales neuron count with the square root of channel count, ensuring sufficient capacity as channels increase. Extensive experiments across nine benchmark datasets demonstrate that MDMLP-EIA achieves state-of-the-art performance in both prediction accuracy and computational efficiency.

时序预测MLP注意力机制能量守恒

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。