用扩散模型实现高精度、低不确定性、快的全球天气预报。
CoDiCast: Conditional Diffusion Model for Global Weather Prediction with Uncertainty Quantification
- 基于条件扩散模型,从噪声逐步生成未来天气场景。
- 6天预报每6小时一步,5个变量,12分钟完成(单张A100 GPU)。
- 适合需要快速且带不确定性的气象预测研究者。
准确的天气预报对科学与社会至关重要。现有方法难以同时具备高精度、低不确定性与高计算效率。传统集合数值天气预报(NWP)虽能量化不确定性,但计算成本高昂;多数机器学习方法虽高效准确,却是确定性的,无法捕捉不确定性。本文提出 CoDiCast,一种基于条件扩散模型的全球天气预测方法,在保证高精度的同时实现不确定性量化,并保持较低计算开销。其核心思想是模拟扩散模型中逆向去噪过程的条件版本:从纯高斯噪声出发,每一步基于近期观测进行条件生成,最终得到未来天气情景。通过多次从随机高斯噪声采样,实现集合预报以量化不确定性。CoDiCast 在欧洲中期天气预报中心(ECMWF)十年的 ERA5 再分析数据上训练。实验表明,该方法在准确性上优于多个现有数据驱动方法。可在配备80GB内存的消费级A100 GPU上,以5.625°纬经度分辨率,完成6天内每6小时一次的多变量(>5个)全球天气预报,耗时约12分钟。代码已开源:https://github.com/JimengShi/CoDiCast。
原文摘要 · Abstract (English)
Accurate weather forecasting is critical for science and society. Yet, existing methods have not managed to simultaneously have the properties of high accuracy, low uncertainty, and high computational efficiency. On one hand, to quantify the uncertainty in weather predictions, the strategy of ensemble forecast (i.e., generating a set of diverse predictions) is often employed. However, traditional ensemble numerical weather prediction (NWP) is computationally intensive. On the other hand, most existing machine learning-based weather prediction (MLWP) approaches are efficient and accurate. Nevertheless, they are deterministic and cannot capture the uncertainty of weather forecasting. In this work, we propose CoDiCast, a conditional diffusion model to generate accurate global weather prediction, while achieving uncertainty quantification with ensemble forecasts and modest computational cost. The key idea is to simulate a conditional version of the reverse denoising process in diffusion models, which starts from pure Gaussian noise to generate realistic weather scenarios for a future time point. Each denoising step is conditioned on observations from the recent past. Ensemble forecasts are achieved by repeatedly sampling from stochastic Gaussian noise to represent uncertainty quantification. CoDiCast is trained on a decade of ERA5 reanalysis data from the European Centre for Medium-Range Weather Forecasts (ECMWF). Experimental results demonstrate that our approach outperforms several existing data-driven methods in accuracy. Our conditional diffusion model, CoDiCast, can generate 6-day global weather forecasts, at 6-hour steps and $5.625^\circ$ latitude-longitude resolution, for over 5 variables, in about 12 minutes on a commodity A100 GPU machine with 80GB memory. The open-souced code is provided at https://github.com/JimengShi/CoDiCast.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。