AI天气预测的成败关键在训练方法,而非模型结构。
The Recipe Matters More Than the Kitchen:Mathematical Foundations of the AI Weather Prediction Pipeline
- 构建了涵盖数据、损失函数、训练策略的全流程数学框架
- 发现当前预报误差主要来自数据与损失设计,而非模型架构
- 首次证明极端天气预测存在线性偏差,适合气象算法研究者
AI天气预测发展迅速,但缺乏统一的数学理论解释预报精度的决定因素。现有理论仅关注特定架构,而2023–2026年实证表明,训练方法、损失函数设计和数据多样性对预报性能的影响至少与架构选择相当。本文提出两个互嵌贡献:理论上,基于球面逼近论、动力系统、信息论和统计学习理论,构建了覆盖完整学习流程(架构、损失函数、训练策略、数据分布)的框架。提出学习管道误差分解,证明估计误差(依赖损失与数据)在当前规模下主导近似误差(依赖架构)。建立损失函数谱理论,揭示均方误差导致球谐坐标下的频谱模糊;推导出分布外外推边界,证明数据驱动模型会系统性低估极端事件,偏差随极端程度线性增长。实证上,使用NVIDIA Earth2Studio与ERA5初始条件,在十种不同架构的AI天气模型上进行跨季节30次初始化评估,六项指标验证:所有MSE训练模型在高波数均出现谱能量损失;误差共识率上升,表明多数误差在架构间共享;极端事件中呈线性负偏差。综合评估得分实现多维统一评价,提出可训练前数学评估的指导框架。
原文摘要 · Abstract (English)
AI weather prediction has advanced rapidly, yet no unified mathematical framework explains what determines forecast skill. Existing theory addresses specific architectural choices rather than the learning pipeline as a whole, while operational evidence from 2023-2026 demonstrates that training methodology, loss function design, and data diversity matter at least as much as architecture selection. This paper makes two interleaved contributions. Theoretically, we construct a framework rooted in approximation theory on the sphere, dynamical systems theory, information theory, and statistical learning theory that treats the complete learning pipeline (architecture, loss function, training strategy, data distribution) rather than architecture alone. We establish a Learning Pipeline Error Decomposition showing that estimation error (loss- and data-dependent) dominates approximation error (architecture-dependent) at current scales. We develop a Loss Function Spectral Theory formalizing MSE-induced spectral blurring in spherical harmonic coordinates, and derive Out-of-Distribution Extrapolation Bounds proving that data-driven models systematically underestimate record-breaking extremes with bias growing linearly in record exceedance. Empirically, we validate these predictions via inference across ten architecturally diverse AI weather models using NVIDIA Earth2Studio with ERA5 initial conditions, evaluating six metrics across 30 initialization dates spanning all seasons. Results confirm universal spectral energy loss at high wavenumbers for MSE-trained models, rising Error Consensus Ratios showing that the majority of forecast error is shared across architectures, and linear negative bias during extreme events. A Holistic Model Assessment Score provides unified multi-dimensional evaluation, and a prescriptive framework enables mathematical evaluation of proposed pipelines before training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。