arXiv:2505.08529cs.LGcs.AI2025-05被引 9

构建七类极端天气基准数据集,评估大模型在灾害预测中的可靠性。

ExEBench: Benchmarking Foundation Models on Extreme Earth Events

  • 设计覆盖全球的七类极端事件数据集,包含多源异构数据。
  • 涵盖灾害检测、监测与预报等实际任务,验证模型在极端值下的表现。
  • 适合气候研究、灾害预警与基础模型泛化性研究者使用。

地球正面临日益频繁的极端事件,对人类生命和生态系统构成重大威胁。近年来,机器学习尤其是基于大规模数据训练的基础模型(FMs)在特征提取方面表现优异,展现出在灾害管理中的潜力。然而,这些模型常继承训练数据中的偏差,导致在极端值场景下性能下降。为探究基础模型在极端事件中的可靠性,我们提出 extbf{ExE}Bench(极端地球基准),包含洪水、野火、风暴、热带气旋、极端降水、热浪和寒潮七类极端事件。该数据集具有全球覆盖、数据量差异大、数据来源多样等特点,涵盖不同空间、时间与光谱特性。为提升基础模型的实际应用价值,我们设置了多个贴近灾害管理需求的挑战性任务,包括极端事件检测、监测与预测。ExEBench旨在:(1)评估基础模型在多样化高影响任务与领域中的泛化能力;(2)推动适用于灾害管理的新机器学习方法发展;(3)提供平台以分析极端事件间的相互作用与级联效应,深化对地球系统在气候变化背景下的理解。数据集与代码已开源:https://github.com/zhaoshan2/EarthExtreme-Bench。

原文摘要 · Abstract (English)

Our planet is facing increasingly frequent extreme events, which pose major risks to human lives and ecosystems. Recent advances in machine learning (ML), especially with foundation models (FMs) trained on extensive datasets, excel in extracting features and show promise in disaster management. Nevertheless, these models often inherit biases from training data, challenging their performance over extreme values. To explore the reliability of FM in the context of extreme events, we introduce \textbf{ExE}Bench (\textbf{Ex}treme \textbf{E}arth Benchmark), a collection of seven extreme event categories across floods, wildfires, storms, tropical cyclones, extreme precipitation, heatwaves, and cold waves. The dataset features global coverage, varying data volumes, and diverse data sources with different spatial, temporal, and spectral characteristics. To broaden the real-world impact of FMs, we include multiple challenging ML tasks that are closely aligned with operational needs in extreme events detection, monitoring, and forecasting. ExEBench aims to (1) assess FM generalizability across diverse, high-impact tasks and domains, (2) promote the development of novel ML methods that benefit disaster management, and (3) offer a platform for analyzing the interactions and cascading effects of extreme events to advance our understanding of Earth system, especially under the climate change expected in the decades to come. The dataset and code are public https://github.com/zhaoshan2/EarthExtreme-Bench.

极端天气基础模型灾害预测数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。