从稀疏噪声数据中无参数学习随机微分方程的漂移函数
Nonparametric learning of stochastic differential equations from sparse and noisy data
- 在再生核希尔伯特空间中直接学习漂移函数,不依赖预设形式
- 结合EM与序列蒙特卡洛方法,处理观测缺失下的似然不可计算问题
- 适用于低数据量、动态复杂的真实科学系统建模
本文提出一种系统性框架,从稀疏、噪声观测数据中构建数据驱动的随机微分方程(SDE)模型。不同于传统参数化方法假设漂移项已知函数形式,本工作目标是直接从数据中学习完整的漂移函数,无需强结构假设,尤其适用于动力学部分未知或高度复杂的科学领域。将估计问题建模为在再生核希尔伯特空间(RKHS)上最小化正则化负对数似然泛函。在稀疏观测情形下,未观测轨迹段导致SDE似然不可计算,为此我们开发了一种基于新型序列蒙特卡洛(SMC)方法的期望最大化(EM)算法,用于近似滤波分布并生成E步目标的蒙特卡洛估计。M步转化为RKHS上的正则化经验风险最小化问题,其解由核函数的有限线性组合给出,依据广义表示定理。为控制迭代过程中的模型复杂度,还引入混合贝叶斯变体,采用收缩先验识别核展开中的显著系数。我们建立了精确与近似EM序列的重要收敛理论结果。所提出的EM-SMC-RKHS方法可在低数据条件下准确估计随机动力系统的漂移函数,广泛适用于存在观测约束的连续时间建模场景。通过一系列数值实验验证了方法的有效性。
原文摘要 · Abstract (English)
The paper proposes a systematic framework for building data-driven stochastic differential equation (SDE) models from sparse, noisy observations. Unlike traditional parametric approaches, which assume a known functional form for the drift, our goal here is to learn the entire drift function directly from data without strong structural assumptions, making it especially relevant in scientific disciplines where system dynamics are partially understood or highly complex. We cast the estimation problem as minimization of the penalized negative log-likelihood functional over a reproducing kernel Hilbert space (RKHS). In the sparse observation regime, the presence of unobserved trajectory segments makes the SDE likelihood intractable. To address this, we develop an Expectation-Maximization (EM) algorithm that employs a novel Sequential Monte Carlo (SMC) method to approximate the filtering distribution and generate Monte Carlo estimates of the E-step objective. The M-step then reduces to a penalized empirical risk minimization problem in the RKHS, whose minimizer is given by a finite linear combination of kernel functions via a generalized representer theorem. To control model complexity across EM iterations, we also develop a hybrid Bayesian variant of the algorithm that uses shrinkage priors to identify significant coefficients in the kernel expansion. We establish important theoretical convergence results for both the exact and approximate EM sequences. The resulting EM-SMC-RKHS procedure enables accurate estimation of the drift function of stochastic dynamical systems in low-data regimes and is broadly applicable across domains requiring continuous-time modeling under observational constraints. We demonstrate the effectiveness of our method through a series of numerical experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。