将生成模型与数据同化结合,提升气象预测精度。
PnP-DA: Towards Principled Plug-and-Play Integration of Variational Data Assimilation and Generative Models
- 用生成模型做先验,通过条件Wasserstein耦合融合观测数据
- 在多种观测稀疏度和噪声水平下,预测误差显著降低
- 无需反向传播神经网络,适合复杂系统实时预报
地球系统建模面临的核心挑战是:在计算高效的前提下捕捉复杂、多尺度的非线性动态,并最小化因简化带来的预报误差。即使最先进的基于人工智能或物理的预测系统也会出现误差累积。数据同化(DA)旨在通过最优融合(含噪)观测与模型先验预报来缓解误差,但传统变分方法常假设误差服从高斯分布,无法刻画混沌动力系统的真正非高斯特性。我们提出PnP-DA,一种即插即用算法,交替执行:(1) 基于马氏距离残差的轻量级梯度分析更新;(2) 通过条件Wasserstein耦合,对预训练生成先验进行单次前向传播,条件于背景预报。该策略放宽了严格的统计假设,利用丰富历史数据而无需显式正则化函数,且避免在同化循环中对编码先验的复杂神经网络进行反向传播。在标准混沌测试平台上的实验表明,该方法在不同观测稀疏度与噪声水平下均能持续降低预测误差,优于经典变分方法。
原文摘要 · Abstract (English)
Earth system modeling presents a fundamental challenge in scientific computing: capturing complex, multiscale nonlinear dynamics in computationally efficient models while minimizing forecast errors caused by necessary simplifications. Even the most powerful AI- or physics-based forecast system suffer from gradual error accumulation. Data assimilation (DA) aims to mitigate these errors by optimally blending (noisy) observations with prior model forecasts, but conventional variational methods often assume Gaussian error statistics that fail to capture the true, non-Gaussian behavior of chaotic dynamical systems. We propose PnP-DA, a Plug-and-Play algorithm that alternates (1) a lightweight, gradient-based analysis update (using a Mahalanobis-distance misfit on new observations) with (2) a single forward pass through a pretrained generative prior conditioned on the background forecast via a conditional Wasserstein coupling. This strategy relaxes restrictive statistical assumptions and leverages rich historical data without requiring an explicit regularization functional, and it also avoids the need to backpropagate gradients through the complex neural network that encodes the prior during assimilation cycles. Experiments on standard chaotic testbeds demonstrate that this strategy consistently reduces forecast errors across a range of observation sparsities and noise levels, outperforming classical variational methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。