用PCA压缩时间序列时间维度,提速40%且不丢精度
Revisiting PCA for time series reduction in temporal dimension
- 对滑动窗口内时间序列做PCA降维,保留统计特征
- 使Informer训练推理提速40%,TimesNet显存降低30%
- 适合追求高效的时间序列模型部署者
深度学习推动了时间序列分析(TSA)的发展,能提取复杂模式用于分类、预测和回归。尽管传统降维聚焦变量空间以减少冗余和计算开销,但对时间维度的降维关注较少。本文重新审视主成分分析(PCA)在时间维度降维中的应用。普遍认为对时间维度使用PCA会破坏时序依赖,因此研究有限。然而,我们的理论分析与大量实验表明,在滑动窗口内应用PCA不仅保持模型性能,还提升效率。自回归预测中,窗口化部分保留时序结构,窗口内进行PCA可去噪并保留统计信息。通过预处理将时间序列降维后输入Linear、Transformer、CNN和RNN等TSA模型,显著加速训练与推理,降低资源消耗。特别地,该方法使Informer训练与推理速度提升最高达40%,使TimesNet GPU内存占用减少30%,且不牺牲准确性。与其他降维方法对比进一步验证了其有效性。
原文摘要 · Abstract (English)
Revisiting PCA for Time Series Reduction in Temporal Dimension; Jiaxin Gao, Wenbo Hu, Yuntian Chen; Deep learning has significantly advanced time series analysis (TSA), enabling the extraction of complex patterns for tasks like classification, forecasting, and regression. Although dimensionality reduction has traditionally focused on the variable space-achieving notable success in minimizing data redundancy and computational complexity-less attention has been paid to reducing the temporal dimension. In this study, we revisit Principal Component Analysis (PCA), a classical dimensionality reduction technique, to explore its utility in temporal dimension reduction for time series data. It is generally thought that applying PCA to the temporal dimension would disrupt temporal dependencies, leading to limited exploration in this area. However, our theoretical analysis and extensive experiments demonstrate that applying PCA to sliding series windows not only maintains model performance, but also enhances computational efficiency. In auto-regressive forecasting, the temporal structure is partially preserved through windowing, and PCA is applied within these windows to denoise the time series while retaining their statistical information. By preprocessing time-series data with PCA, we reduce the temporal dimensionality before feeding it into TSA models such as Linear, Transformer, CNN, and RNN architectures. This approach accelerates training and inference and reduces resource consumption. Notably, PCA improves Informer training and inference speed by up to 40% and decreases GPU memory usage of TimesNet by 30%, without sacrificing model accuracy. Comparative analysis against other reduction methods further highlights the effectiveness of PCA in improving the efficiency of TSA models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。