首个统一处理十类气象任务的通用气象基础模型,支持多模态数据输入。
WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning
- 通过统一任务表征与设计天气提示格式,整合多模态气象数据
- 在10项气象理解任务中表现优异,包括预报、超分辨率和图像转换
- 基于上下文学习实现未见任务泛化,适合跨领域气象研究者
地球天气系统包含复杂的气象数据模态和多样化的理解任务,对人类生活具有重要意义。现有数据驱动模型通常仅聚焦单一任务(如天气预报),虽取得良好效果,但难以在单一统一模型中应对多种复杂任务。此外,依赖有限真实观测数据进行单场景训练,限制了模型性能上限。为此,我们借鉴先进视觉基础模型与大语言模型中的上下文学习范式,提出首个通用气象基础模型 WeatherGFM,旨在统一解决广泛的气象理解任务。具体而言,我们首先统一各类气象任务的表征与定义,随后设计适用于单模态、多模态及时间序列模态的天气提示格式,并采用视觉提示问答范式进行统一任务训练。大量实验表明,WeatherGFM 能有效处理多达十种气象理解任务,包括天气预报、超分辨率、气象图像转换与后处理等,且在未见过的任务上展现出良好的泛化能力。
原文摘要 · Abstract (English)
The Earth's weather system encompasses intricate weather data modalities and diverse weather understanding tasks, which hold significant value to human life. Existing data-driven models focus on single weather understanding tasks (e.g., weather forecasting). Although these models have achieved promising results, they fail to tackle various complex tasks within a single and unified model. Moreover, the paradigm that relies on limited real observations for a single scenario hinders the model's performance upper bound. In response to these limitations, we draw inspiration from the in-context learning paradigm employed in state-of-the-art visual foundation models and large language models. In this paper, we introduce the first generalist weather foundation model (WeatherGFM), designed to address a wide spectrum of weather understanding tasks in a unified manner. More specifically, we initially unify the representation and definition of the diverse weather understanding tasks. Subsequently, we devised weather prompt formats to manage different weather data modalities, namely single, multiple, and temporal modalities. Finally, we adopt a visual prompting question-answering paradigm for the training of unified weather understanding tasks. Extensive experiments indicate that our WeatherGFM can effectively handle up to ten weather understanding tasks, including weather forecasting, super-resolution, weather image translation, and post-processing. Our method also showcases generalization ability on unseen tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。