用解析方法构建扩散模型,实现无需系统模型的高效数据同化。
Closed-form conditional diffusion models for data assimilation
- 基于核密度估计建模状态与观测联合分布,直接解析计算得分函数。
- 在洛伦兹63和96系统上,小到中等样本量下优于集合卡尔曼滤波和粒子滤波。
- 适用于无模型信息的黑箱系统,适合复杂非高斯分布的数据同化场景。
我们提出一种闭式条件扩散模型用于数据同化。扩散模型通过学习数据分布的得分函数(即对数概率密度梯度)来生成新样本,其逆向去噪过程可实现数据生成。传统方法通常用神经网络近似得分函数,而本文利用得分函数的解析可计算性,直接将系统状态与观测值进行同化。为高效评估得分函数,采用核密度估计建模状态与观测的联合分布。该方法继承了条件扩散模型在黑箱设置下的能力,即无需系统或观测模型的显式知识即可工作。结合扩散模型在逼近复杂非高斯分布方面的优势,该方法在性能上优于广泛使用的滤波方法。我们在中等维度的洛伦兹-63和洛伦兹-96系统及非线性观测模型上进行了评估,结果表明,在小至中等样本量下,该方法显著优于集合卡尔曼滤波和粒子滤波。
原文摘要 · Abstract (English)
We propose closed-form conditional diffusion models for data assimilation. Diffusion models use data to learn the score function (defined as the gradient of the log-probability density of a data distribution), allowing them to generate new samples from the data distribution by reversing a noise injection process. While it is common to train neural networks to approximate the score function, we leverage the analytical tractability of the score function to assimilate the states of a system with measurements. To enable the efficient evaluation of the score function, we use kernel density estimation to model the joint distribution of the states and their corresponding measurements. The proposed approach also inherits the capability of conditional diffusion models of operating in black-box settings, i.e., the proposed data assimilation approach can accommodate systems and measurement processes without their explicit knowledge. The ability to accommodate black-box systems combined with the superior capabilities of diffusion models in approximating complex, non-Gaussian probability distributions means that the proposed approach offers advantages over many widely used filtering methods. We evaluate the proposed method on nonlinear data assimilation problems based on the Lorenz-63 and Lorenz-96 systems of moderate dimensionality and nonlinear measurement models. Results show the proposed approach outperforms the widely used ensemble Kalman and particle filters when small to moderate ensemble sizes are used.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。