分离长短期状态,让时间序列预测更好应对突发变化。
Disentangling Long-Short Term State Under Unknown Interventions for Online Time Series Forecasting
- 通过未知干预建模,分离长短期状态。
- 在多个基准数据集上优于现有方法,尤其适应非平稳场景。
- 适合需要实时更新的金融、气象等动态系统预测。
当前时间序列预测方法在在线场景下表现不佳,难以同时保持长期依赖并适应短期变化。尽管部分方法通过控制隐状态更新缓解此问题,却无法有效分离长短期状态,导致对非平稳性适应能力不足。为此,本文提出一种通用框架,基于短期变化可能由未知干预(如股市突发政策)引发的观察,形式化了带有未知干预的生成过程。在温和假设下,利用干预导致的短期状态独立性,建立了可识别性理论,实现长短期状态的解耦。在此基础上,构建了长短期解耦模型(LSTD),分别使用长/短时编码器提取状态,并引入平滑约束以保留长期依赖,中断依赖约束以遗忘短期依赖,进一步增强解耦效果。多个基准数据集上的实验表明,该模型在在线预测任务中显著优于现有方法,验证了其在真实场景中的有效性。
原文摘要 · Abstract (English)
Current methods for time series forecasting struggle in the online scenario, since it is difficult to preserve long-term dependency while adapting short-term changes when data are arriving sequentially. Although some recent methods solve this problem by controlling the updates of latent states, they cannot disentangle the long/short-term states, leading to the inability to effectively adapt to nonstationary. To tackle this challenge, we propose a general framework to disentangle long/short-term states for online time series forecasting. Our idea is inspired by the observations where short-term changes can be led by unknown interventions like abrupt policies in the stock market. Based on this insight, we formalize a data generation process with unknown interventions on short-term states. Under mild assumptions, we further leverage the independence of short-term states led by unknown interventions to establish the identification theory to achieve the disentanglement of long/short-term states. Built on this theory, we develop a long short-term disentanglement model (LSTD) to extract the long/short-term states with long/short-term encoders, respectively. Furthermore, the LSTD model incorporates a smooth constraint to preserve the long-term dependencies and an interrupted dependency constraint to enforce the forgetting of short-term dependencies, together boosting the disentanglement of long/short-term states. Experimental results on several benchmark datasets show that our \textbf{LSTD} model outperforms existing methods for online time series forecasting, validating its efficacy in real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。