arXiv:2508.12198physics.ao-phcs.AI2025-08

用小模型解析气象图,自动预测降雨概率。

Exploring Multimodal AI Reasoning for Meteorological Forecasting from Skew-T Diagrams

  • 用小语言模型+小视觉语言模型,模仿人类看气象图
  • 在韩国3小时降水数据上达到与专业预报模型相当的准确率
  • 模型能聚焦关键气象特征,适合想快速辅助预报的用户

大气探空观测是业务气象中的基础任务,通常需要人工对斜温图(Skew-T log-P)进行结构化视觉推理。尽管视觉-语言模型(VLM)在其他科学领域展现潜力,但其在气象图解读中的应用仍不充分。本研究提出一个轻量级AI助手,采用微调后的小型语言模型和小型视觉语言模型,模拟人类预报员的推理过程。通过课程学习框架,先训练模型从图中识别关键大气特征(基于视觉问答),再进行链式思维推理,基于视觉信息估算降雨概率。输入包括文本摘要或由数值天气预报(NWP)生成的斜温图,以及韩国自动气象站网络提供的三小时降水观测。评估显示,微调后的VLM仅依赖静态大气廓线,性能已接近操作级NWP模型。消融实验表明,视觉定位与推理监督至关重要;注意力热图分析证实模型聚焦于相关气象特征。结果表明,紧凑、可解释的多模态模型在气象预报中具有潜力,为大规模系统提供计算高效的替代方案,未来可扩展至更复杂任务。

原文摘要 · Abstract (English)

Forecasting from atmospheric soundings is a fundamental task in operational meteorology, often requiring structured visual reasoning over Skew-T log-P diagrams by human forecasters. While recent advances in Vision-Language Models (VLMs) have shown promise in other scientific domains, their application to meteorological diagram interpretation remains largely unexplored. In this study, we present a lightweight AI assistant that interprets Skew-T diagrams using a small language model (LM) and a small VLM fine-tuned to emulate human forecasters. Using a curriculum learning framework, we first train the models to identify key atmospheric features from diagrams through visual question answering, followed by chain-of-thought reasoning tasks that estimate precipitation probability based on the derived visual groundings. Model inputs include either textual summaries or generated Skew-T diagrams derived from operational Numerical Weather Prediction (NWP) forecasts, paired with three-hour precipitation observations from South Korea's Auto Weather Stations network. Evaluation results demonstrate that the fine-tuned VLM achieves skill comparable to an operational NWP model, despite relying solely on static atmospheric profiles. Ablation studies reveal that visual grounding and reasoning supervision are critical for performance, while attention map analysis confirms that the model learns to focus on relevant meteorological features. These findings highlight the potential of compact, interpretable multimodal models to support weather forecasting tasks. The approach offers a computationally efficient alternative to large-scale systems, and future work could extend it to more complex applications.

气象预报多模态视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。