arXiv:2603.23043cs.LGcs.AI2026-03被引 1

测试气候模型在无历史先例的未来气候下的可靠性,发现大模型仍易受外部强迫影响。

Assessing the Robustness of Climate Foundation Models under No-Analog Distribution Shifts

  • 仅用历史数据训练模型,模拟未来气候变化
  • 大模型误差绝对值低但相对波动大,降水误差增8.44%
  • 强调需考虑不同排放路径的训练和严格外部测试

气候变化加速导致系统非平稳性加剧,挑战基于机器学习的气候模拟器在训练分布外的泛化能力。尽管这些模拟器比传统地球系统模型更高效,但在‘无历史先例’的未来气候状态(即外部强迫使系统进入历史数据范围之外的状态)下,其可靠性存疑。评估该可靠性的主要障碍是数据污染:许多模型训练时已包含未来情景模拟,导致真实分布外(OOD)性能被掩盖。为此,我们针对三种前沿架构——U-Net、ConvLSTM 和专用于历史数据训练(1850–2014)的 ClimaX 基础模型——进行 OOD 鲁棒性基准测试。采用两种互补策略:(i) 时间外推至近期气候(2015–2023),(ii) 跨情景强迫变化,比较不同排放路径下的表现。分析显示存在准确率与稳定性权衡:虽 ClimaX 绝对误差最低,但在极端强迫情景下相对性能波动更大,降水误差最高上升 8.44%。结果表明,即使高容量基础模型受限于历史训练动态,仍对强迫轨迹敏感。研究强调必须采用情景感知训练和严格的 OOD 评估协议,以保障气候模拟器在变化气候下的鲁棒性。

原文摘要 · Abstract (English)

The accelerating pace of climate change introduces profound non-stationarities that challenge the ability of Machine Learning based climate emulators to generalize beyond their training distributions. While these emulators offer computationally efficient alternatives to traditional Earth System Models, their reliability remains a potential bottleneck under "no-analog" future climate states, which we define here as regimes where external forcing drives the system into conditions outside the empirical range of the historical training data. A fundamental challenge in evaluating this reliability is data contamination; because many models are trained on simulations that already encompass future scenarios, true out-of-distribution (OOD) performance is often masked. To address this, we benchmark the OOD robustness of three state-of-the-art architectures: U-Net, ConvLSTM, and the ClimaX foundation model specifically restricted to a historical-only training regime (1850-2014). We evaluate these models using two complementary strategies: (i) temporal extrapolation to the recent climate (2015-2023) and (ii) cross-scenario forcing shifts across divergent emission pathways. Our analysis within this experimental setup reveals an accuracy vs. stability trade-off: while the ClimaX foundation model achieves the lowest absolute error, it exhibits higher relative performance changes under distribution shifts, with precipitation errors increasing by up to 8.44% under extreme forcing scenarios. These findings suggest that when restricted to historical training dynamics, even high-capacity foundation models are sensitive to external forcing trajectories. Our results underscore the necessity of scenario-aware training and rigorous OOD evaluation protocols to ensure the robustness of climate emulators under a changing climate.

气候模拟模型鲁棒性分布外评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。