arXiv:2411.07814cs.AIphysics.ao-ph2024-11被引 13

CREDIT框架让科研人员轻松训练高效大气预测AI模型。

Community Research Earth Digital Intelligence Twin (CREDIT)

  • 构建可扩展的AI气象建模平台,支持数据处理到部署全流程
  • 两款新模型在10天预报中优于传统IFS系统,计算更省
  • 适合气象、气候研究者快速实验不同AI模型与数据配置

人工智能在数值天气预报(AI NWP)中的进展显著改变了大气建模方式。相比传统物理驱动系统(如集成预报系统IFS),AI NWP模型在多个全球指标上表现更优,且计算资源需求更低。然而现有模型受限于训练数据集和时间步选择,常产生伪影影响性能。为此,我们提出由美国国家科学基金会NCAR开发的社区研究地球数字智能孪生框架CREDIT,提供灵活、可扩展且易用的平台,支持在高性能计算系统上训练和部署基于AI的大气模型。该框架涵盖数据预处理、模型训练与评估的端到端流程,推动先进AI NWP能力的普及。通过CREDIT,我们展示了WXFormer——一种新型确定性视觉变换器,能自回归预测大气状态,采用谱归一化、填充和多步训练等技术缓解误差累积问题。此外,我们在该框架内训练了FUXI架构。结果表明,两者在六小时间隔的ERA5混合σ-压强层数据上训练后,在10天预报中普遍优于IFS HRES,有望提升效率与准确性。CREDIT模块化设计使研究者可灵活探索不同模型、数据集与训练配置,促进科学创新。

原文摘要 · Abstract (English)

Recent advancements in artificial intelligence (AI) for numerical weather prediction (NWP) have significantly transformed atmospheric modeling. AI NWP models outperform traditional physics-based systems, such as the Integrated Forecast System (IFS), across several global metrics while requiring fewer computational resources. However, existing AI NWP models face limitations related to training datasets and timestep choices, often resulting in artifacts that reduce model performance. To address these challenges, we introduce the Community Research Earth Digital Intelligence Twin (CREDIT) framework, developed at NSF NCAR. CREDIT provides a flexible, scalable, and user-friendly platform for training and deploying AI-based atmospheric models on high-performance computing systems. It offers an end-to-end pipeline for data preprocessing, model training, and evaluation, democratizing access to advanced AI NWP capabilities. We demonstrate CREDIT's potential through WXFormer, a novel deterministic vision transformer designed to predict atmospheric states autoregressively, addressing common AI NWP issues like compounding error growth with techniques such as spectral normalization, padding, and multi-step training. Additionally, to illustrate CREDIT's flexibility and state-of-the-art model comparisons, we train the FUXI architecture within this framework. Our findings show that both FUXI and WXFormer, trained on six-hourly ERA5 hybrid sigma-pressure levels, generally outperform IFS HRES in 10-day forecasts, offering potential improvements in efficiency and forecast accuracy. CREDIT's modular design enables researchers to explore various models, datasets, and training configurations, fostering innovation within the scientific community.

AI气象数字孪生大模型高算力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。