arXiv:2412.12971cs.LG2024-12被引 33

用生成模型提升天气预测的多样性与效率,兼顾精度与算力。

ArchesWeather & ArchesWeatherGen: a deterministic and generative model for efficient ML weather forecasting

  • 基于Transformer构建去除非必要先验的确定性模型ArchesWeather。
  • 通过流匹配训练生成模型ArchesWeatherGen,实现15天轨迹每成员1分钟生成。
  • 开源全链路流程,适合气象研究者快速复现与应用。

天气预报在农业、物流、可再生能源预测及极端天气应对中至关重要。基于ERA5数据训练的深度学习模型相比传统数值模式表现优异。然而,许多应用需从未来天气状态分布中采样代表性结果。本文提出一种利用确定性模型设计概率模型的方法,提升性能并降低计算成本。首先提出基于Transformer的确定性模型ArchesWeather,通过移除过强归纳偏置改进Pangu-Weather。随后设计基于流匹配的生成模型ArchesWeatherGen,将ArchesWeather输出映射至ERA5真实状态分布。ArchesWeatherGen是真正的ERA5随机模拟器,在WeatherBench所有主要变量上超越IFS ENS和NeuralGCM(仅地势能略逊于NeuralGCM)。模型在1.5°分辨率下训练,ArchesWeather耗时约9个V100日,ArchesWeatherGen约45个V100日。推理阶段,单个A100 GPU每分钟生成一条15天天气轨迹。代码与模型开源,完整包含数据准备、训练与评估流程,地址:https://github.com/INRIA/geoarches。

原文摘要 · Abstract (English)

Weather forecasting plays a vital role in today's society, from agriculture and logistics to predicting the output of renewable energies, and preparing for extreme weather events. Deep learning weather forecasting models trained with the next state prediction objective on ERA5 have shown great success compared to numerical global circulation models. However, for a wide range of applications, being able to provide representative samples from the distribution of possible future weather states is critical. In this paper, we propose a methodology to leverage deterministic weather models in the design of probabilistic weather models, leading to improved performance and reduced computing costs. We first introduce \textbf{ArchesWeather}, a transformer-based deterministic model that improves upon Pangu-Weather by removing overrestrictive inductive priors. We then design a probabilistic weather model called \textbf{ArchesWeatherGen} based on flow matching, a modern variant of diffusion models, that is trained to project ArchesWeather's predictions to the distribution of ERA5 weather states. ArchesWeatherGen is a true stochastic emulator of ERA5 and surpasses IFS ENS and NeuralGCM on all WeatherBench headline variables (except for NeuralGCM's geopotential). Our work also aims to democratize the use of deterministic and generative machine learning models in weather forecasting research, with academic computing resources. All models are trained at 1.5° resolution, with a training budget of $\sim$9 V100 days for ArchesWeather and $\sim$45 V100 days for ArchesWeatherGen. For inference, ArchesWeatherGen generates 15-day weather trajectories at a rate of 1 minute per ensemble member on a A100 GPU card. To make our work fully reproducible, our code and models are open source, including the complete pipeline for data preparation, training, and evaluation, at https://github.com/INRIA/geoarches .

天气预测生成模型Transformer开源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。