用变换的高斯过程提升非平稳高维系统建模效率
Efficient Transformed Gaussian Process State-Space Models for Non-Stationary High-Dimensional Dynamical Systems
- 单个共享高斯过程搭配输入相关变换,降低复杂度
- 在真实和合成数据上实现更优的状态估计与预测精度
- 适合需要高效、准确动态建模的高维时序任务
高斯过程状态空间模型(GPSSM)为非线性动态系统提供了不确定性量化学习框架。然而,现有方法依赖多个独立的平稳高斯过程,导致高维场景下计算与参数复杂度过高,且难以建模非平稳动态。为此,我们提出一种高效的变换高斯过程状态空间模型(ETGPSSM),通过引入单一共享高斯过程与输入相关的归一化流,构建可表达的非平稳隐式过程先验,显著降低模型复杂度。针对隐式过程的推断,我们设计了联合近似后验分布及归一化流神经网络参数的变分推断算法,并将集合卡尔曼滤波(EnKF)融入变分框架,避免显式参数化潜在状态,实现高效准确的状态估计。在合成与真实数据集上的广泛实验表明,该模型在系统动态学习、高维状态估计与时间序列预测方面优于现有GPSSM与基于神经网络的SSM,在计算效率与准确性上均有提升。
原文摘要 · Abstract (English)
Gaussian process state-space models (GPSSMs) offer a principled framework for learning and inference in nonlinear dynamical systems with uncertainty quantification. However, existing GPSSMs are limited by the use of multiple independent stationary Gaussian processes (GPs), leading to prohibitive computational and parametric complexity in high-dimensional settings and restricted modeling capacity for non-stationary dynamics. To address these challenges, we propose an efficient transformed Gaussian process state-space model (ETGPSSM) for scalable and flexible modeling of high-dimensional, non-stationary dynamical systems. Specifically, our ETGPSSM integrates a single shared GP with input-dependent normalizing flows, yielding an expressive non-stationary implicit process prior that can capture complex transition dynamics while significantly reducing model complexity. For the inference of the implicit process, we develop a variational inference algorithm that jointly approximates the posterior over the underlying GP and the neural network parameters defining the normalizing flows. To avoid explicit variational parameterization of the latent states, we further incorporate the ensemble Kalman filter (EnKF) into the variational framework, enabling accurate and efficient state estimation. Extensive empirical evaluations on synthetic and real-world datasets demonstrate the superior performance of our ETGPSSM in system dynamics learning, high-dimensional state estimation, and time-series forecasting, outperforming existing GPSSMs and neural network-based SSMs in terms of computational efficiency and accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。