arXiv:2410.03935cs.LGstat.ML2024-10中稿 · CIKM '24被引 7

用动态统计方法自适应归一化,提升深度模型在非平稳时间序列上的预测能力。

GAS-Norm: Score-Driven Adaptive Normalization for Non-Stationary Time Series Forecasting in Deep Learning

  • 基于GAS模型实时更新均值方差,动态归一化输入数据
  • 25个真实数据集测试中,21个场景下性能超越现有归一化方法
  • 可无缝接入任意深度时序模型,适合处理波动大的实际数据

尽管深度神经网络(DNN)在时序预测中广受欢迎,但其表现常不及简单统计模型。主要原因是许多过程存在数据非平稳性,输入数据的均值与方差变化会破坏DNN的预测能力。本文首先展示DNN在简单非平稳设置下的失效现象。随后提出GAS-Norm,一种结合广义自回归得分(GAS)模型与深度神经网络的自适应时序归一化与预测方法。GAS模型在每次新观测时估计均值与方差,提供更新的统计量以归一化DNN输入。DNN输出再通过GAS模型预测的统计量反归一化,形成融合统计建模与深度学习优势的混合框架。该自适应归一化显著提升模型在非平稳场景下的表现。方法具有模型无关性,可适配任意DNN时序预测模型。实验对比了GAS-Norm与其他前沿归一化方法,并将其与先进DNN模型结合,在Monash开放预测库的真实数据集上测试。结果表明,25个设置中有21个场景下,引入GAS-Norm后模型性能优于其他归一化方法。

原文摘要 · Abstract (English)

Despite their popularity, deep neural networks (DNNs) applied to time series forecasting often fail to beat simpler statistical models. One of the main causes of this suboptimal performance is the data non-stationarity present in many processes. In particular, changes in the mean and variance of the input data can disrupt the predictive capability of a DNN. In this paper, we first show how DNN forecasting models fail in simple non-stationary settings. We then introduce GAS-Norm, a novel methodology for adaptive time series normalization and forecasting based on the combination of a Generalized Autoregressive Score (GAS) model and a Deep Neural Network. The GAS approach encompasses a score-driven family of models that estimate the mean and variance at each new observation, providing updated statistics to normalize the input data of the deep model. The output of the DNN is eventually denormalized using the statistics forecasted by the GAS model, resulting in a hybrid approach that leverages the strengths of both statistical modeling and deep learning. The adaptive normalization improves the performance of the model in non-stationary settings. The proposed approach is model-agnostic and can be applied to any DNN forecasting model. To empirically validate our proposal, we first compare GAS-Norm with other state-of-the-art normalization methods. We then combine it with state-of-the-art DNN forecasting models and test them on real-world datasets from the Monash open-access forecasting repository. Results show that deep forecasting models improve their performance in 21 out of 25 settings when combined with GAS-Norm compared to other normalization methods.

时间序列自适应归一化GAS模型深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。