arXiv:2501.16178cs.LGstat.ML2025-01被引 5

用小波分解提升时间序列预测,轻量高效适合边缘部署

SWIFT: Mapping Sub-series with Wavelet Decomposition Improves Time Series Forecasting

  • 用小波变换实现无损降采样,保留关键时序特征
  • 跨频段信息融合仅需可学习滤波器,参数少效果好
  • 仅用一个共享线性层映射子序列,模型极简易部署

近期时间序列预测研究中,Transformer甚至大语言模型因强大的序列建模能力备受关注。然而在实际应用中,时间序列预测常需在资源受限的边缘设备上运行,难以承担大模型的计算开销。为此,虽有轻量模型提出,但其在非平稳序列上表现不佳。本文提出SWIFT,一种兼具强大性能与高效部署能力的轻量级长期时间序列预测模型。核心思路包括:(i) 利用小波变换对时间序列进行无损降采样;(ii) 通过可学习滤波器实现跨频段信息融合;(iii) 仅使用一个共享线性层或浅层MLP映射子序列。大量实验表明,SWIFT在多个数据集上达到当前最优(SOTA)性能,为边缘计算场景下的部署提供了可行方案。特别地,SWIFT-Linear参数量仅为单层线性模型在时域预测中的25%。代码已开源。

原文摘要 · Abstract (English)

In recent work on time-series prediction, Transformers and even large language models have garnered significant attention due to their strong capabilities in sequence modeling. However, in practical deployments, time-series prediction often requires operation in resource-constrained environments, such as edge devices, which are unable to handle the computational overhead of large models. To address such scenarios, some lightweight models have been proposed, but they exhibit poor performance on non-stationary sequences. In this paper, we propose $\textit{SWIFT}$, a lightweight model that is not only powerful, but also efficient in deployment and inference for Long-term Time Series Forecasting (LTSF). Our model is based on three key points: (i) Utilizing wavelet transform to perform lossless downsampling of time series. (ii) Achieving cross-band information fusion with a learnable filter. (iii) Using only one shared linear layer or one shallow MLP for sub-series' mapping. We conduct comprehensive experiments, and the results show that $\textit{SWIFT}$ achieves state-of-the-art (SOTA) performance on multiple datasets, offering a promising method for edge computing and deployment in this task. Moreover, it is noteworthy that the number of parameters in $\textit{SWIFT-Linear}$ is only 25\% of what it would be with a single-layer linear model for time-domain prediction. Our code is available at https://github.com/LancelotXWX/SWIFT.

时间序列小波变换轻量模型边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。