arXiv:2502.12395cs.LG2025-02被引 2

用确定性方法替代蒙特卡洛模拟,高效训练神经随机微分方程。

Efficient Neural SDE Training using Wiener-Space Cubature

  • 基于维纳空间立方积分,用确定性常微分方程解近似路径期望。
  • 在相同路径数下,误差收敛率达 O(1/n),优于传统 Monte-Carlo 的 O(1/sqrt(n))。
  • 无需随机布朗运动模拟,可并行使用高效常微分方程求解器,适合大规模训练。

神经随机微分方程(Neural SDE)将漂移和扩散项由神经网络参数化。其训练目标是优化向量场参数,使路径空间上的期望目标函数值最小。现有方法依赖路径梯度的蒙特卡洛估计,再结合采样计算梯度期望。本文提出一种新训练技术:基于维纳空间立方积分理论,将期望目标函数值近似为确定性常微分方程解的加权函数值之和。核心数学贡献是将立方积分界扩展至利普希茨非线性路径泛函场景。所提算法显著提升效率:避免布朗运动模拟,支持高效并行常微分方程求解;更重要的是,在合理正则性假设下,逼近误差以 O(1/n) 收敛,其中 n 为路径评估次数,优于标准蒙特卡洛的 O(1/sqrt(n)) 和准蒙特卡洛的 O(log(n)^d /n)。

原文摘要 · Abstract (English)

A neural stochastic differential equation (SDE) is an SDE with drift and diffusion terms parametrized by neural networks. The training procedure for neural SDEs consists of optimizing the SDE vector field (neural network) parameters to minimize the expected value of an objective functional on infinite-dimensional path-space. Existing training techniques focus on methods to efficiently compute path-wise gradients of the objective functional with respect to these parameters, then pair this with Monte-Carlo simulation to estimate the gradient expectation. In this work we introduce a novel training technique which bypasses and improves upon this Monte-Carlo simulation; we extend results in the theory of Wiener space cubature to approximate the expected objective functional value by a weighted sum of functional evaluations of deterministic ODE solutions. Our main mathematical contribution enabling this approximation is an extension of cubature bounds to the setting of Lipschitz-nonlinear functionals acting on path-space. Our resulting constructive algorithm allows for more computationally efficient training along several lines. First, it circumvents Brownian motion simulation and enables the use of efficient parallel ODE solvers, thus decreasing the complexity of path-functional evaluation. Furthermore, and more surprisingly, we show that the number of paths required to achieve a given (expected loss functional oracle value) approximation can be reduced in this deterministic cubature regime. Specifically, we show that under reasonable regularity assumptions we can observe a O(1/n) convergence rate, where n is the number of path evaluations; in contrast with the standard O(1/sqrt(n)) rate of naive Monte-Carlo or the O(log(n)^d /n) rate of quasi-Monte-Carlo.

随机微分方程高效训练确定性积分

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。