arXiv:2412.09328cs.LGcs.AI2024-12被引 22

提出新型扩散模型ARMD,让时间序列预测更连续精准。

Auto-Regressive Moving Diffusion Models for Time Series Forecasting

论文配图:Auto-Regressive Moving Diffusion Models for Time Series Forecasting
图 1 · 摘自论文原文
  • 用链式扩散加先验,模拟时间序列连续演化过程。
  • 在7个数据集上超越现有扩散模型,显著提升预测精度。
  • 适合需要高精度时序预测的研究者和工业应用。

时间序列预测(TSF)在多个领域至关重要,基于扩散模型的最新进展展现出巨大潜力。然而,现有方法通常采用传统扩散模式,将TSF视为基于噪声的条件生成任务,忽视了时间序列固有的连续序列特性,导致扩散机制与预测目标严重错位,严重影响性能。受经典自回归移动平均(ARMA)理论启发,我们提出新型自回归移动扩散(ARMD)模型,首次实现基于连续序列演化的扩散式时序预测。不同于从白噪声开始的传统方法,本模型采用带先验的链式扩散,准确建模序列演化过程,并利用中间状态信息提升预测精度与稳定性。具体而言,将未来序列视为初始状态,历史序列作为最终状态,前向过程中通过滑动技术生成中间序列,使采样过程与预测目标对齐,形成无条件、连续序列的扩散预测模型。在7个常用数据集上的大量实验表明,该模型达到当前最优性能,显著优于现有扩散型时序预测模型。代码已开源:https://github.com/daxin007/ARMD。

原文摘要 · Abstract (English)

Time series forecasting (TSF) is essential in various domains, and recent advancements in diffusion-based TSF models have shown considerable promise. However, these models typically adopt traditional diffusion patterns, treating TSF as a noise-based conditional generation task. This approach neglects the inherent continuous sequential nature of time series, leading to a fundamental misalignment between diffusion mechanisms and the TSF objective, thereby severely impairing performance. To bridge this misalignment, and inspired by the classic Auto-Regressive Moving Average (ARMA) theory, which views time series as continuous sequential progressions evolving from previous data points, we propose a novel Auto-Regressive Moving Diffusion (ARMD) model to first achieve the continuous sequential diffusion-based TSF. Unlike previous methods that start from white Gaussian noise, our model employs chain-based diffusion with priors, accurately modeling the evolution of time series and leveraging intermediate state information to improve forecasting accuracy and stability. Specifically, our approach reinterprets the diffusion process by considering future series as the initial state and historical series as the final state, with intermediate series generated using a sliding-based technique during the forward process. This design aligns the diffusion model's sampling procedure with the forecasting objective, resulting in an unconditional, continuous sequential diffusion TSF model. Extensive experiments conducted on seven widely used datasets demonstrate that our model achieves state-of-the-art performance, significantly outperforming existing diffusion-based TSF models. Our code is available on GitHub: https://github.com/daxin007/ARMD.

时间序列扩散模型自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。