SimDiff用统一Transformer实现更准的时间序列点预测。
SimDiff: Simpler Yet Better Diffusion Model for Time Series Point Forecasting
- 单阶段端到端框架,用同一Transformer同时做去噪和预测。
- 通过多轮推断集成,均方误差显著降低,点预测性能达新高。
- 无需预训练模型,自适应强,适合追求高精度的时序预测场景。
扩散模型在时间序列概率预测中展现出潜力,但在点预测性能上常逊于回归方法。原因在于难以提供足够上下文偏差以应对分布漂移,且难平衡输出多样性与点预测所需的稳定性和精度。现有方法多聚焦于全分布建模,忽视高精度点预测策略;而部分点预测方法依赖预训练或联合训练的回归器,牺牲了扩散模型的生成灵活性。为此,我们提出SimDiff,一种单阶段、端到端的框架。SimDiff采用一个精心设计的统一Transformer网络,兼具去噪器与预测器功能,无需外部预训练或联合训练的回归器。通过内在输出多样性及多轮推断集成,显著提升均方误差精度,实现点预测新标杆。关键创新包括归一化无关性与均值中位数估计器,进一步增强适应性与稳定性。大量实验表明,SimDiff在时间序列点预测上显著优于现有方法。
原文摘要 · Abstract (English)
Diffusion models have recently shown promise in time series forecasting, particularly for probabilistic predictions. However, they often fail to achieve state-of-the-art point estimation performance compared to regression-based methods. This limitation stems from difficulties in providing sufficient contextual bias to track distribution shifts and in balancing output diversity with the stability and precision required for point forecasts. Existing diffusion-based approaches mainly focus on full-distribution modeling under probabilistic frameworks, often with likelihood maximization objectives, while paying little attention to dedicated strategies for high-accuracy point estimation. Moreover, other existing point prediction diffusion methods frequently rely on pre-trained or jointly trained mature models for contextual bias, sacrificing the generative flexibility of diffusion models. To address these challenges, we propose SimDiff, a single-stage, end-to-end framework. SimDiff employs a single unified Transformer network carefully tailored to serve as both denoiser and predictor, eliminating the need for external pre-trained or jointly trained regressors. It achieves state-of-the-art point estimation performance by leveraging intrinsic output diversity and improving mean squared error accuracy through multiple inference ensembling. Key innovations, including normalization independence and the median-of-means estimator, further enhance adaptability and stability. Extensive experiments demonstrate that SimDiff significantly outperforms existing methods in time series point forecasting.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。