arXiv:2506.20024cs.LGcs.AI2025-06NeurIPS被引 14

提出新型滚动扩散模型,更精准预测复杂系统随时间演化的不确定性。

Elucidated Rolling Diffusion Models for Probabilistic Forecasting of Complex Dynamics

  • 将扩散模型的噪声调度与滚动预报结合,动态建模不确定性增长。
  • 在流体模拟和全球气象预报中,优于主流基线模型,尤其在中长期预测上表现突出。
  • 适合需要精确捕捉不确定性传播的科学计算与气候预测领域研究者。

扩散模型是强大的概率预测工具,但大多数高维复杂系统应用中仅独立预测未来状态,难以建模复杂的时序依赖关系,且未显式考虑系统固有的不确定性逐步累积特性。虽然滚动扩散框架通过在长预测时域增加噪声来应对该问题,但其与先进高保真扩散技术的融合仍具挑战。本文提出首个成功统一滚动预报结构与精炼扩散模型(EDM)原理设计的框架——阐明式滚动扩散模型(ERDM)。我们对核心EDM组件——噪声调度、网络预处理和Heun采样器——进行了适配,使其适用于滚动预报场景。集成成功源于三项关键贡献:(i) 新颖的损失加权策略,聚焦于确定性向随机性过渡的中等预测范围;(ii) 利用预训练EDM进行初始窗口高效初始化;(iii) 针对渐进去噪设计的专用混合序列架构,实现鲁棒的时空特征提取。在2D Navier-Stokes模拟和1.5度分辨率的ERA5全球气象预测任务中,ERDM持续优于关键扩散基线模型,包括条件自回归EDM。ERDM为需要精确建模不确定性传播的动力系统预测提供了灵活而强大的通用框架。

原文摘要 · Abstract (English)

Diffusion models are a powerful tool for probabilistic forecasting, yet most applications in high-dimensional complex systems predict future states individually. This approach struggles to model complex temporal dependencies and fails to explicitly account for the progressive growth of uncertainty inherent to the systems. While rolling diffusion frameworks, which apply increasing noise to forecasts at longer lead times, have been proposed to address this, their integration with state-of-the-art, high-fidelity diffusion techniques remains a significant challenge. We tackle this problem by introducing Elucidated Rolling Diffusion Models (ERDM), the first framework to successfully unify a rolling forecast structure with the principled, performant design of Elucidated Diffusion Models (EDM). To do this, we adapt the core EDM components-its noise schedule, network preconditioning, and Heun sampler-to the rolling forecast setting. The success of this integration is driven by three key contributions: (i) a novel loss weighting scheme that focuses model capacity on the mid-range forecast horizons where determinism gives way to stochasticity; (ii) an efficient initialization strategy using a pre-trained EDM for the initial window; and (iii) a bespoke hybrid sequence architecture for robust spatiotemporal feature extraction under progressive denoising. On 2D Navier-Stokes simulations and ERA5 global weather forecasting at 1.5-degree resolution, ERDM consistently outperforms key diffusion-based baselines, including conditional autoregressive EDM. ERDM offers a flexible and powerful general framework for tackling diffusion-based dynamics forecasting problems where modeling uncertainty propagation is paramount.

扩散模型概率预测不确定性建模动力系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。