arXiv:2412.12227cs.LGcs.AI2024-12被引 7

EDformer通过分解时序信号提升多变量预测精度与可解释性

EDformer: Embedded Decomposition Transformer for Interpretable Multivariate Time Series Predictions

  • 先分解时序为趋势与季节成分,再分别建模增强表达能力
  • 在真实数据集上达到当前最优的预测准确率与效率
  • 提供可解释性分析,帮助理解关键特征与时间点的重要性

时间序列预测在气象预报、股市分析和科学模拟等领域具有重要意义。本文提出一种嵌入式分解Transformer模型EDformer,用于多变量时间序列预测。该模型复用Transformer架构,在不改变其核心结构的前提下,将输入的多变量信号分解为季节性和趋势成分。首先对显著的多变量季节成分进行反向维度重建,并在编码器阶段应用注意力机制与前馈网络;其中前馈网络对每个变量帧独立学习非线性表示,注意力机制则利用嵌入在变量帧中的各季节序列的时间点来捕捉多变量相关性。随后,趋势信号经投影后参与最终预测。EDformer在多个复杂真实世界时间序列数据集上取得了当前最优的预测精度与效率。此外,本文还引入模型可解释性技术,揭示模型决策依据,说明哪些特征或时间步对预测至关重要,从而提升预测结果的可解释性与可信度。

原文摘要 · Abstract (English)

Time series forecasting is a crucial challenge with significant applications in areas such as weather prediction, stock market analysis, and scientific simulations. This paper introduces an embedded decomposed transformer, 'EDformer', for multivariate time series forecasting tasks. Without altering the fundamental elements, we reuse the Transformer architecture and consider the capable functions of its constituent parts in this work. Edformer first decomposes the input multivariate signal into seasonal and trend components. Next, the prominent multivariate seasonal component is reconstructed across the reverse dimensions, followed by applying the attention mechanism and feed-forward network in the encoder stage. In particular, the feed-forward network is used for each variable frame to learn nonlinear representations, while the attention mechanism uses the time points of individual seasonal series embedded within variate frames to capture multivariate correlations. Therefore, the trend signal is added with projection and performs the final forecasting. The EDformer model obtains state-of-the-art predicting results in terms of accuracy and efficiency on complex real-world time series datasets. This paper also addresses model explainability techniques to provide insights into how the model makes its predictions and why specific features or time steps are important, enhancing the interpretability and trustworthiness of the forecasting results.

时间序列Transformer可解释性多变量预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。