arXiv:2510.04017cs.AIcs.LG2025-10被引 9

首个气象科学智能体框架,让大模型能对话式分析天气数据。

Zephyrus: An Agentic Framework for Weather Science

  • 构建可执行代码的气象环境,支持自然语言交互与数据分析
  • 在复杂任务上比纯文本模型高44个百分点正确率
  • 适合气候研究者、气象建模者及多模态AI开发者使用

面向气象科学的基础模型在海量结构化数值数据上预训练,性能超越传统预报系统。但缺乏基于语言的推理能力,限制了其在交互式科研流程中的应用。大型语言模型(LLMs)擅长文本理解与生成,却难以处理高维气象数据。我们首次构建了气象科学领域的智能体框架——Zephyrus。该框架包含基于Python的交互环境(ZephyrusWorld),集成WeatherBench 2数据索引器、自然语言地理编码工具、天气预报与气候模拟功能,以及用于查询多时间尺度气候统计(如均值、极端值、分位数)的气候模块。设计了基于多轮对话的气象智能体Zephyrus,通过迭代分析数据、观察结果并利用反馈循环优化策略。配套提出新基准ZephyrusBench,具备可扩展的数据生成管道,覆盖从基础查询到高级预报、极端事件检测和反事实推理的多样化问答对。实验表明,Zephyrus在该基准上显著优于纯文本基线,最高提升44个百分点正确率。然而,复杂任务仍具挑战性,凸显基准难度并指明未来改进方向。代码与基准已开源:https://github.com/Rose-STL-Lab/Zephyrus。

原文摘要 · Abstract (English)

Foundation models for weather science are pre-trained on vast amounts of structured numerical data and outperform traditional weather forecasting systems. However, these models lack language-based reasoning capabilities, limiting their utility in interactive scientific workflows. Large language models (LLMs) excel at understanding and generating text but cannot reason about high-dimensional meteorological datasets. We bridge this gap by building the first agentic framework for weather science. Our framework includes a Python code-based environment for agents (ZephyrusWorld) to interact with weather data, featuring tools including a WeatherBench 2 dataset indexer, geolocator for geocoding from natural language, weather forecasting, climate simulation capabilities, and a climatology module for querying precomputed climatological statistics (e.g., means, extremes, and quantiles) across multiple timescales. We design Zephyrus, a multi-turn LLM-based weather agent that iteratively analyzes weather datasets, observes results, and refines its approach through conversational feedback loops. We accompany the agent with a new benchmark, ZephyrusBench, with a scalable data generation pipeline that constructs diverse question-answer pairs across weather-related tasks, from basic lookups to advanced forecasting, extreme event detection, and counterfactual reasoning. Experiments on this benchmark demonstrate the strong performance of Zephyrus agents over text-only baselines, outperforming them by up to 44 percentage points in correctness. However, the hard tasks are still difficult even with frontier LLMs, highlighting the challenging nature of our benchmark and suggesting room for future development. Our codebase and benchmark are available at https://github.com/Rose-STL-Lab/Zephyrus.

智能体气象科学大模型交互分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。