构建气象气候下游任务的多模态数据集,助力AI模型通用化发展。
WxC-Bench: A Novel Dataset for Weather and Climate Downstream Tasks
- 设计多模态数据集支持不同尺度天气气候任务
- 覆盖20-200公里至2500公里尺度的多种气象现象
- 公开数据与代码,适配科研与模型开发人员
高质量的机器学习就绪数据集在推动气象与气候人工智能模型开发中起着基础作用。尽管深度学习模型在气象气候领域快速发展,但针对特定下游任务的预处理、可直接使用的数据集仍十分稀缺。由于不同任务涉及的大气尺度(空间和时间)差异显著,构建此类高质量数据集极具挑战性。本文提出WxC-Bench(Weather and Climate Bench),一个面向气象与气候下游应用的多模态数据集,旨在支持通用化人工智能模型的开发。该数据集涵盖从介于β尺度(20–200公里)到天气尺度(约2500公里)的多种大气过程,包括航空湍流、飓风强度与路径监测、天气相似性搜索、重力波参数化以及自然语言报告生成。我们详细描述了数据集结构,并提供了基准分析的技术验证。所有数据及预处理代码已公开发布于Hugging Face:https://huggingface.co/datasets/nasa-impact/WxC-Bench。
原文摘要 · Abstract (English)
High-quality machine learning (ML)-ready datasets play a foundational role in developing new artificial intelligence (AI) models or fine-tuning existing models for scientific applications such as weather and climate analysis. Unfortunately, despite the growing development of new deep learning models for weather and climate, there is a scarcity of curated, pre-processed machine learning (ML)-ready datasets. Curating such high-quality datasets for developing new models is challenging particularly because the modality of the input data varies significantly for different downstream tasks addressing different atmospheric scales (spatial and temporal). Here we introduce WxC-Bench (Weather and Climate Bench), a multi-modal dataset designed to support the development of generalizable AI models for downstream use-cases in weather and climate research. WxC-Bench is designed as a dataset of datasets for developing ML-models for a complex weather and climate system, addressing selected downstream tasks as machine learning phenomenon. WxC-Bench encompasses several atmospheric processes from meso-$β$ (20 - 200 km) scale to synoptic scales (2500 km), such as aviation turbulence, hurricane intensity and track monitoring, weather analog search, gravity wave parameterization, and natural language report generation. We provide a comprehensive description of the dataset and also present a technical validation for baseline analysis. The dataset and code to prepare the ML-ready data have been made publicly available on Hugging Face -- https://huggingface.co/datasets/nasa-impact/WxC-Bench
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。