让预训练时间序列模型轻松用上外部变量,提升预测精度
ChronosX: Adapting Pretrained Time Series Models with Exogenous Variables
- 用模块化结构注入过去和未来外部变量信息
- 在32个合成数据集上优于现有基线方法
- 适合需要融合外部因素的零售、金融等领域
协变量提供了影响时间序列的外部因素信息,在许多现实场景中至关重要。例如在零售领域,促销活动或节假日等协变量会显著影响需求预测。近年来,基于大语言模型架构的预训练时间序列模型已实现高精度预测,但多数模型难以直接利用协变量,因其常与特定任务或领域绑定。本文提出一种新方法,通过模块化结构将协变量信息注入预训练模型,无需修改原有模型架构。为评估该方法,我们构建了一个包含32个不同动态特性的合成数据集基准。在合成与真实数据上的大量实验表明,该方法能有效融合协变量信息,显著优于现有基线方法。
原文摘要 · Abstract (English)
Covariates provide valuable information on external factors that influence time series and are critical in many real-world time series forecasting tasks. For example, in retail, covariates may indicate promotions or peak dates such as holiday seasons that heavily influence demand forecasts. Recent advances in pretraining large language model architectures for time series forecasting have led to highly accurate forecasters. However, the majority of these models do not readily use covariates as they are often specific to a certain task or domain. This paper introduces a new method to incorporate covariates into pretrained time series forecasting models. Our proposed approach incorporates covariate information into pretrained forecasting models through modular blocks that inject past and future covariate information, without necessarily modifying the pretrained model in consideration. In order to evaluate our approach, we introduce a benchmark composed of 32 different synthetic datasets with varying dynamics to evaluate the effectivity of forecasting models with covariates. Extensive evaluations on both synthetic and real datasets show that our approach effectively incorporates covariate information into pretrained models, outperforming existing baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。