用适配器让单变量模型高效做多变量时间序列预测
AdaPTS: Adapting Univariate Foundation Models to Probabilistic Multivariate Time Series Forecasting
- 设计适配器将多变量数据映射到潜在空间,独立应用预训练模型
- 在真实和合成数据上显著提升预测精度与不确定性量化能力
- 模块化设计适合实际场景,代码已开源供复现
预训练基础模型(FMs)在单变量时间序列预测中表现优异,但仍面临特征间复杂依赖关系处理及预测不确定性量化等实际挑战。本文提出适配器机制,通过特征空间变换,使预训练的单变量时间序列基础模型能有效应用于多变量任务。适配器将多变量输入投影至合适潜在空间,并对每个维度独立应用基础模型。受表征学习与部分随机贝叶斯神经网络研究启发,本文设计多种适配器及优化/推理策略。在合成与真实世界数据集上的实验验证了适配器的有效性,相比基线方法显著提升了预测准确率与不确定性量化性能。所提出的框架AdaPTS将适配器定位为一种模块化、可扩展且高效的多变量时间序列建模方案,推动基础模型在现实应用中的广泛采用。代码已公开于https://github.com/abenechehab/AdaPTS。
原文摘要 · Abstract (English)
Pre-trained foundation models (FMs) have shown exceptional performance in univariate time series forecasting tasks. However, several practical challenges persist, including managing intricate dependencies among features and quantifying uncertainty in predictions. This study aims to tackle these critical limitations by introducing adapters; feature-space transformations that facilitate the effective use of pre-trained univariate time series FMs for multivariate tasks. Adapters operate by projecting multivariate inputs into a suitable latent space and applying the FM independently to each dimension. Inspired by the literature on representation learning and partially stochastic Bayesian neural networks, we present a range of adapters and optimization/inference strategies. Experiments conducted on both synthetic and real-world datasets confirm the efficacy of adapters, demonstrating substantial enhancements in forecasting accuracy and uncertainty quantification compared to baseline methods. Our framework, AdaPTS, positions adapters as a modular, scalable, and effective solution for leveraging time series FMs in multivariate contexts, thereby promoting their wider adoption in real-world applications. We release the code at https://github.com/abenechehab/AdaPTS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。