轻量级时间序列模型,用周期性建模实现高效高精度预测
LightGTS: A Lightweight General Time Series Forecasting Model
- 通过周期性分词提取跨数据集的统一周期模式
- 在零样本和全样本下9个基准测试均达顶尖性能
- 模型轻量高效,适合资源受限场景使用
现有通用时间序列预测方法依赖大规模多源预训练构建参数庞大的基础模型,虽在多种数据集上表现优异,但计算开销大,不适用于资源受限场景。本文提出LightGTS,一种从周期一致性建模视角设计的轻量级通用时间序列预测模型。为处理多源预训练中不同尺度与内在周期,引入周期性分词(Periodical Tokenization),可提取跨数据集的统一周期模式;为更好利用解码过程中的周期性,提出周期性并行解码(Periodical Parallel Decoding),借助历史令牌提升预测效果。基于上述两项技术,充分利用时间序列固有的周期归纳偏置,LightGTS以轻量模型在9个真实世界基准上实现了零样本和全样本下的最优性能,显著优于现有时间序列基础模型的效率。
原文摘要 · Abstract (English)
Existing works on general time series forecasting build foundation models with heavy model parameters through large-scale multi-source pre-training. These models achieve superior generalization ability across various datasets at the cost of significant computational burdens and limitations in resource-constrained scenarios. This paper introduces LightGTS, a lightweight general time series forecasting model designed from the perspective of consistent periodical modeling. To handle diverse scales and intrinsic periods in multi-source pre-training, we introduce Periodical Tokenization, which extracts consistent periodic patterns across different datasets with varying scales. To better utilize the periodicity in the decoding process, we further introduce Periodical Parallel Decoding, which leverages historical tokens to improve forecasting. Based on the two techniques above which fully leverage the inductive bias of periods inherent in time series, LightGTS uses a lightweight model to achieve outstanding performance on general time series forecasting. It achieves state-of-the-art forecasting performance on 9 real-world benchmarks in both zero-shot and full-shot settings with much better efficiency compared with existing time series foundation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。