通过分解趋势与季节成分,提升时间序列预测的准确性
ST-MTM: Masked Time Series Modeling with Seasonal-Trend Decomposition for Time Series Forecasting
- 将时间序列分解为趋势和季节成分,分别设计掩码策略
- 在多个数据集上优于现有掩码建模与对比学习方法
- 适合需要高精度时序预测的工业场景
时间序列预测在工业应用中至关重要但极具挑战性。近年来,掩码时间序列建模通过重建被遮蔽片段来有效捕捉时序依赖关系。然而,原始时间序列中的语义信息来自多重成分的复杂时变模式,直接对原始序列进行掩码会忽略其内在语义结构,导致模型学习到虚假时序模式。为此,我们提出基于趋势-季节分解的掩码时间序列建模框架ST-MTM。该框架对趋势与季节成分分别设计掩码策略:对季节成分采用周期掩码,利用其多周期特性生成多个被遮蔽的季节序列;对趋势成分采用子序列掩码,遮蔽具有相似变化趋势的时段。此外,引入对比学习任务以增强多个被遮蔽季节表示之间的上下文一致性。实验表明,相较于现有的掩码建模、对比学习及监督预测方法,ST-MTM在多个数据集上均实现了更优的预测性能。
原文摘要 · Abstract (English)
Forecasting complex time series is an important yet challenging problem that involves various industrial applications. Recently, masked time-series modeling has been proposed to effectively model temporal dependencies for forecasting by reconstructing masked segments from unmasked ones. However, since the semantic information in time series is involved in intricate temporal variations generated by multiple time series components, simply masking a raw time series ignores the inherent semantic structure, which may cause MTM to learn spurious temporal patterns present in the raw data. To capture distinct temporal semantics, we show that masked modeling techniques should address entangled patterns through a decomposition approach. Specifically, we propose ST-MTM, a masked time-series modeling framework with seasonal-trend decomposition, which includes a novel masking method for the seasonal-trend components that incorporates different temporal variations from each component. ST-MTM uses a period masking strategy for seasonal components to produce multiple masked seasonal series based on inherent multi-periodicity and a sub-series masking strategy for trend components to mask temporal regions that share similar variations. The proposed masking method presents an effective pre-training task for learning intricate temporal variations and dependencies. Additionally, ST-MTM introduces a contrastive learning task to support masked modeling by enhancing contextual consistency among multiple masked seasonal representations. Experimental results show that our proposed ST-MTM achieves consistently superior forecasting performance compared to existing masked modeling, contrastive learning, and supervised forecasting methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。