用大卷积核注意力网络提升中程天气预报精度
PuYun: Medium-Range Global Weather Forecasting Using Large Kernel Attention Convolutional Networks
- 采用大卷积核注意力结构,扩大感受野捕捉细粒度气象特征
- 10天预报时Z500 RMSE降至638 $m^2/s^2$,优于现有模型
- 分段级联设计适合5-10天中程预报,可推广至多阶段预测
准确的天气预报对理解与缓解气象影响至关重要。本文提出PuYun,一种基于大卷积核注意力卷积网络的自回归级联模型,其设计天然支持更长的预报周期,并扩展了有效感受野。通过在卷积层中融入大卷积核注意力机制,模型显著提升了捕捉精细空间特征的能力,从而提高了气象现象的预测精度。我们构建了两个版本:PuYun-Short(0-5天预报)和PuYun-Medium(5-10天预测)。仅使用PuYun-Short即在10天预报上超越GraphCast与FuXi-Short。第10天时,Z500的RMSE降至720 $m^2/s^2$,优于GraphCast的732 $m^2/s^2$ 和FuXi-Short的740 $m^2/s^2$;T2M的RMSE降至2.60 K,优于GraphCast的2.63 K和FuXi-Short的2.65 K。进一步采用级联策略融合PuYun-Short与PuYun-Medium后,整体性能优于FuXi-Short与FuXi-Medium的组合。第10天时,Z500 RMSE进一步降低至638 $m^2/s^2$,优于FuXi的641 $m^2/s^2$。结果表明该模型集成在中程天气预测中具有显著优势。训练代码与模型将开源。
原文摘要 · Abstract (English)
Accurate weather forecasting is essential for understanding and mitigating weather-related impacts. In this paper, we present PuYun, an autoregressive cascade model that leverages large kernel attention convolutional networks. The model's design inherently supports extended weather prediction horizons while broadening the effective receptive field. The integration of large kernel attention mechanisms within the convolutional layers enhances the model's capacity to capture fine-grained spatial details, thereby improving its predictive accuracy for meteorological phenomena. We introduce PuYun, comprising PuYun-Short for 0-5 day forecasts and PuYun-Medium for 5-10 day predictions. This approach enhances the accuracy of 10-day weather forecasting. Through evaluation, we demonstrate that PuYun-Short alone surpasses the performance of both GraphCast and FuXi-Short in generating accurate 10-day forecasts. Specifically, on the 10th day, PuYun-Short reduces the RMSE for Z500 to 720 $m^2/s^2$, compared to 732 $m^2/s^2$ for GraphCast and 740 $m^2/s^2$ for FuXi-Short. Additionally, the RMSE for T2M is reduced to 2.60 K, compared to 2.63 K for GraphCast and 2.65 K for FuXi-Short. Furthermore, when employing a cascaded approach by integrating PuYun-Short and PuYun-Medium, our method achieves superior results compared to the combined performance of FuXi-Short and FuXi-Medium. On the 10th day, the RMSE for Z500 is further reduced to 638 $m^2/s^2$, compared to 641 $m^2/s^2$ for FuXi. These findings underscore the effectiveness of our model ensemble in advancing medium-range weather prediction. Our training code and model will be open-sourced.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。