用上下文样例微调时间序列模型,无需训练即可提升预测性能
In-Context Fine-Tuning for Time-Series Foundation Models
- 推理时输入目标序列及相关序列样例,模型动态适应目标分布
- 在多个基准上超越监督学习模型和现有时间序列基础模型
- 无需显式微调,效果接近专门训练的模型,适合快速部署
受时间序列基础模型在零样本预测中成功启发,我们提出一种时间序列基础模型的上下文微调方法。具体而言,设计了一个预训练模型,可在推理时通过输入多个相关时间序列样例,帮助其预测目标序列未来走势。该模型特别训练为利用上下文窗口中的多条相关序列(除目标序列历史外)来适应目标域的特定分布。实验表明,这种在推理时使用上下文样例的方法,在多个主流预测基准上表现显著优于监督深度学习方法、统计模型及其他时间序列基础模型。有趣的是,其性能甚至可媲美在目标域上显式微调的基础模型。
原文摘要 · Abstract (English)
Motivated by the recent success of time-series foundation models for zero-shot forecasting, we present a methodology for $\textit{in-context fine-tuning}$ of a time-series foundation model. In particular, we design a pretrained foundation model that can be prompted (at inference time) with multiple time-series examples, in order to forecast a target time-series into the future. Our foundation model is specifically trained to utilize examples from multiple related time-series in its context window (in addition to the history of the target time-series) to help it adapt to the specific distribution of the target domain at inference time. We show that such a foundation model that uses in-context examples at inference time can obtain much better performance on popular forecasting benchmarks compared to supervised deep learning methods, statistical models, as well as other time-series foundation models. Interestingly, our in-context fine-tuning approach even rivals the performance of a foundation model that is explicitly fine-tuned on the target domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。