arXiv:2505.05452cs.LGmath-ph2025-05被引 3

用强化学习提升数据同化,兼顾物理约束与不确定性量化。

RL-DAUNCE: Reinforcement Learning-Driven Data Assimilation with Uncertainty-Aware Constrained Ensembles

  • 以多智能体模拟集合成员,动态优化状态估计
  • 在非高斯气候现象中优于传统集合卡尔曼滤波
  • 适合需要物理一致性与高效计算的气象建模场景

机器学习已成增强数据同化的重要工具。尽管监督学习仍是主流,强化学习(RL)凭借其序列决策框架,天然契合数据同化的迭代特性,可动态平衡模型预报与观测。本文提出RL-DAUNCE,一种基于强化学习的数据同化方法,通过三方面提升:第一,继承机器学习的计算效率,将智能体结构设计为类集合成员;第二,通过多集合成员推进实现不确定性量化,超越单一均值优化;第三,利用集合即智能体的设计,在同化过程中施加物理约束,保障状态估计的物理一致性。采用原始-对偶优化策略动态惩罚奖励函数,确保学习过程满足约束;同时通过限制动作空间保证状态变量边界。该方法应用于具有强非高斯特征和多重物理约束的莫顿-朱利安振荡(MJO)问题,结果表明,相比因违反物理约束而失效的标准集合卡尔曼滤波(EnKF),RL-DAUNCE表现更优,且性能接近受限集合卡尔曼滤波(constrained EnKF),尤其在恢复间歇信号、捕捉极端事件和量化不确定性方面表现优异,同时显著降低计算开销。

原文摘要 · Abstract (English)

Machine learning has become a powerful tool for enhancing data assimilation. While supervised learning remains the standard method, reinforcement learning (RL) offers unique advantages through its sequential decision-making framework, which naturally fits the iterative nature of data assimilation by dynamically balancing model forecasts with observations. We develop RL-DAUNCE, a new RL-based method that enhances data assimilation with physical constraints through three key aspects. First, RL-DAUNCE inherits the computational efficiency of machine learning while it uniquely structures its agents to mirror ensemble members in conventional data assimilation methods. Second, RL-DAUNCE emphasizes uncertainty quantification by advancing multiple ensemble members, moving beyond simple mean-state optimization. Third, RL-DAUNCE's ensemble-as-agents design facilitates the enforcement of physical constraints during the assimilation process, which is crucial to improving the state estimation and subsequent forecasting. A primal-dual optimization strategy is developed to enforce constraints, which dynamically penalizes the reward function to ensure constraint satisfaction throughout the learning process. Also, state variable bounds are respected by constraining the RL action space. Together, these features ensure physical consistency without sacrificing efficiency. RL-DAUNCE is applied to the Madden-Julian Oscillation, an intermittent atmospheric phenomenon characterized by strongly non-Gaussian features and multiple physical constraints. RL-DAUNCE outperforms the standard ensemble Kalman filter (EnKF), which fails catastrophically due to the violation of physical constraints. Notably, RL-DAUNCE matches the performance of constrained EnKF, particularly in recovering intermittent signals, capturing extreme events, and quantifying uncertainties, while requiring substantially less computational effort.

数据同化强化学习物理约束不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。