arXiv:2510.21974cs.LGstat.ML2025-10

DJGP用分区域投影提升高维间断函数建模精度。

Deep Jump Gaussian Processes for Surrogate Modeling of High-Dimensional Piecewise Continuous Functions

  • 用区域依赖投影矩阵捕捉局部低维结构。
  • 在合成与基准数据上预测误差更低,不确定性更可靠。
  • 适合高维分段连续函数的高效建模,如科学仿真场景。

我们提出Deep Jump Gaussian Processes (DJGP),用于高维空间中分段连续函数的代理建模。传统跳跃高斯过程(JGP)在高维输入空间中表现受限,DJGP通过引入区域特异的局部线性投影来改进,这些投影使用区域依赖矩阵捕捉局部低维子空间结构,契合JGP这类局部高斯过程的本质特性。为控制模型复杂度,我们在投影矩阵上施加高斯过程先验,使其在输入空间中平滑变化。投影后的输入再由JGP建模,以捕获响应与输入间的分段连续关系,形成独特的两层深度高斯过程架构。我们进一步设计了一种可扩展的变分推断算法,联合学习投影矩阵与JGP超参数。通过严格的理论分析和大量实验验证,我们推导出DJGP的泛化误差界,并将其分解为四类误差源,揭示其实际影响。在合成与基准数据集上的实验表明,相比现有方法,DJGP在预测精度和不确定性量化方面均有显著提升。

原文摘要 · Abstract (English)

We introduce Deep Jump Gaussian Processes (DJGP), a novel method for surrogate modeling of a piecewise continuous function on a high-dimensional domain. DJGP addresses the limitations of conventional Jump Gaussian Processes (JGP) in high-dimensional input spaces by integrating region-specific, locally linear projections with JGP modeling. These projections employ region-dependent matrices to capture local low-dimensional subspace structures, making them well suited to the inherently localized modeling behavior of JGPs, a variant of local Gaussian processes. To control model complexity, we place a Gaussian Process prior on the projection matrices, allowing them to evolve smoothly across the input space. The projected inputs are then modeled with a JGP to capture piecewise continuous relationships with the response. This yields a distinctive two-layer deep learning of GP/JGP. We further develop a scalable variational inference algorithm to jointly learn the projection matrices and JGP hyperparameters. Rigorous theoretical analysis and extensive empirical studies are provided to justify the proposed approach. In particular, we derive an oracle error bound for DJGP and decompose it into four distinct sources of error, which are then linked to practical implications. Experiments on synthetic and benchmark datasets demonstrate that DJGP achieves superior predictive accuracy and more reliable uncertainty quantification compared with existing methods.

高斯过程代理建模高维函数分段连续

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。