用概率变压器同时预测天气和决策变量,提升预报实用性。
Probabilistic Transformers for Joint Modeling of Global Weather Dynamics and Decision-Centric Variables
- 设计联合建模大气动力与决策变量的概率变压器
- 2750万参数模型训练速度提升20-100倍,性能超现有气象模型
- 适合需直接输出决策支持变量的能源、航空等高风险场景
天气预报是电网调度、航空、农业和应急响应等关键领域决策的前提。但用户常面临困境:许多决策目标(如极端值、累积量、阈值突破)是大气状态变量的函数,而非状态本身,需通过后处理估算,易引入结构偏差。核心问题在于模型未直接学习这些函数的分布。本文提出GEM-2,一种概率变压器,联合建模全球大气动力与用户直接操作的变量。在CRPS目标下训练的轻量级模型(约275M参数)实现计算效率提升20-100倍,性能超越现有业务数值天气预报(NWP)模型,并可媲美依赖昂贵多步扩散过程或定制多阶段微调的机器学习模型。进一步验证其在决策理论评估中达到顶尖经济价值指标,在季节到次季节尺度稳定收敛至气候平均,且对多数常见架构和训练设计选择表现出意外鲁棒性。
原文摘要 · Abstract (English)
Weather forecasts sit upstream of high-stakes decisions in domains such as grid operations, aviation, agriculture, and emergency response. Yet forecast users often face a difficult trade-off. Many decision-relevant targets are functionals of the atmospheric state variables, such as extrema, accumulations, and threshold exceedances, rather than state variables themselves. As a result, users must estimate these targets via post-processing, which can be suboptimal and can introduce structural bias. The core issue is that decisions depend on distributions over these functionals that the model is not trained to learn directly. In this work, we introduce GEM-2, a probabilistic transformer that jointly learns global atmospheric dynamics alongside a suite of variables that users directly act upon. Using this training recipe, we show that a lightweight (~275M params) and computationally efficient (~20-100x training speedup relative to state-of-the-art) transformer trained on the CRPS objective can directly outperform operational numerical weather prediction (NWP) models and be competitive with ML models that rely on expensive multi-step diffusion processes or require bespoke multi-stage fine-tuning strategies. We further demonstrate state-of-the-art economic value metrics under decision-theoretic evaluation, stable convergence to climatology at S2S and seasonal timescales, and a surprising insensitivity to many commonly assumed architectural and training design choices.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。