arXiv:2510.18707cs.LG2025-10NeurIPS被引 9

用扩散模型统一跨时尺度天气预测,解决长期预报误差累积问题。

OmniCast: A Masked Latent Diffusion Model for Weather Forecasting Across Time Scales

  • 用变分自编码器+扩散Transformer联合建模,跨时空联合采样
  • 在中长期预报上比现有方法快10到20倍,子季节至季节尺度达顶尖性能
  • 可稳定生成长达100年的大气状态序列,适合气候研究与灾害预警

跨时尺度的精准天气预报对应对气候变化至关重要。基于深度学习的数据驱动方法在中程预报中表现优异,但在更长的亚季节至季节(S2S)尺度上因自回归方式导致误差累积而表现不佳。本文提出OmniCast,一种可扩展且高精度的概率模型,统一建模全时域天气预测。OmniCast由两部分组成:一个将原始气象数据编码为连续低维潜在空间的变分自编码器(VAE),以及一个基于扩散的Transformer,用于根据初始条件潜在标记生成未来潜在标记序列。训练时,随机遮蔽未来标记,通过每标记扩散头学习其分布;推理时,通过迭代解码随机子集实现完整序列生成。这种时空联合采样有效缓解了自回归方法的误差累积问题。低维潜在空间支持对长序列未来状态的建模,使Transformer能捕捉超出初始条件的天气动力学。OmniCast在中程预报上性能媲美领先概率方法,但速度提升10至20倍,并在亚季节至季节尺度上各项指标均达到当前最优,包括准确率、物理一致性及概率评估。进一步实验表明,OmniCast可生成长达100年的稳定滚动预测。代码与模型检查点见https://github.com/tung-nd/omnicast。

原文摘要 · Abstract (English)

Accurate weather forecasting across time scales is critical for anticipating and mitigating the impacts of climate change. Recent data-driven methods based on deep learning have achieved significant success in the medium range, but struggle at longer subseasonal-to-seasonal (S2S) horizons due to error accumulation in their autoregressive approach. In this work, we propose OmniCast, a scalable and skillful probabilistic model that unifies weather forecasting across timescales. OmniCast consists of two components: a VAE model that encodes raw weather data into a continuous, lower-dimensional latent space, and a diffusion-based transformer model that generates a sequence of future latent tokens given the initial conditioning tokens. During training, we mask random future tokens and train the transformer to estimate their distribution given conditioning and visible tokens using a per-token diffusion head. During inference, the transformer generates the full sequence of future tokens by iteratively unmasking random subsets of tokens. This joint sampling across space and time mitigates compounding errors from autoregressive approaches. The low-dimensional latent space enables modeling long sequences of future latent states, allowing the transformer to learn weather dynamics beyond initial conditions. OmniCast performs competitively with leading probabilistic methods at the medium-range timescale while being 10x to 20x faster, and achieves state-of-the-art performance at the subseasonal-to-seasonal scale across accuracy, physics-based, and probabilistic metrics. Furthermore, we demonstrate that OmniCast can generate stable rollouts up to 100 years ahead. Code and model checkpoints are available at https://github.com/tung-nd/omnicast.

天气预报扩散模型长序列生成气候预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。