arXiv:2508.14315cs.LGphysics.ao-ph2025-08中稿 · NeurIPS

用联邦强化学习让气候模型自动调参,适应气候变化。

FedRAIN-Lite: Federated Reinforcement Algorithms for Improving Idealised Numerical Weather and Climate Models

  • 按纬度分块部署智能体,局部学参数、定期全局同步。
  • DDPG算法收敛快,热带和中纬度区均方误差更低。
  • 适合需要在线更新的复杂气候模型,代码开源可复现。

气候模型中的次网格参数化传统上是静态且离线调优的,难以适应变化的气候状态。本文提出 FedRAIN-Lite,一种联邦强化学习框架,模仿通用环流模型(GCM)的空间分解方式,将智能体分配至纬度带,实现局部参数学习并周期性进行全局聚合。通过一系列简化的能量平衡模型(ebm-v1 单智能体基线,ebm-v2 多智能体集成,ebm-v3 类GCM设置),我们在不同联邦配置下对比三种强化学习算法。结果表明,深度确定性策略梯度(DDPG)持续优于静态和单智能体基线,在ebm-v2和ebm-v3设置下均实现更快收敛与更低的区域加权均方误差,尤其在热带和中纬度地区表现突出。DDPG具备跨超参数迁移能力且计算成本低,非常适合地理自适应参数学习。该方法为高复杂度GCM提供了可扩展的在线学习路径,并构建了物理对齐、随气候变化演化的原型模型。代码已公开于 https://github.com/p3jitnath/climate-rl-fedrl。

原文摘要 · Abstract (English)

Sub-grid parameterisations in climate models are traditionally static and tuned offline, limiting adaptability to evolving states. This work introduces FedRAIN-Lite, a federated reinforcement learning (FedRL) framework that mirrors the spatial decomposition used in general circulation models (GCMs) by assigning agents to latitude bands, enabling local parameter learning with periodic global aggregation. Using a hierarchy of simplified energy-balance climate models, from a single-agent baseline (ebm-v1) to multi-agent ensemble (ebm-v2) and GCM-like (ebm-v3) setups, we benchmark three RL algorithms under different FedRL configurations. Results show that Deep Deterministic Policy Gradient (DDPG) consistently outperforms both static and single-agent baselines, with faster convergence and lower area-weighted RMSE in tropical and mid-latitude zones across both ebm-v2 and ebm-v3 setups. DDPG's ability to transfer across hyperparameters and low computational cost make it well-suited for geographically adaptive parameter learning. This capability offers a scalable pathway towards high-complexity GCMs and provides a prototype for physically aligned, online-learning climate models that can evolve with a changing climate. Code accessible at https://github.com/p3jitnath/climate-rl-fedrl.

联邦学习气候建模强化学习在线学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。