arXiv:2601.05227stat.MLcs.LG2026-01

用随机微分方程建模时序数据不确定性,提升生成与推理稳定性。

Stochastic Deep Learning: A Probabilistic Framework for Modeling Uncertainty in Structured Temporal Data

  • 在变分自编码器隐空间嵌入伊藤SDE,实现连续时间不确定性建模。
  • 通过神经网络参数化漂移与扩散项,支持不规则采样和复杂动态结构。
  • 提出路径正则化伴随损失,增强训练稳定性和梯度优化能力。

本文提出一种融合随机微分方程(SDE)与深度生成模型的新框架——随机潜变量微分推断(SLDI),用于提升结构化时序数据中不确定性量化的性能。该方法在变分自编码器的潜空间中嵌入伊藤型SDE,实现灵活的连续时间不确定性建模,并保持严谨的数学基础。SDE的漂移项与扩散项由神经网络参数化,支持数据驱动推断,可泛化经典时间序列模型以处理不规则采样和复杂动态结构。核心理论贡献在于将伴随状态与专用神经网络联合参数化,形成耦合的前向-后向系统,同时捕捉潜变量演化与梯度动态。引入路径正则化伴随损失,并基于随机微积分分析方差缩减的梯度流,为深层潜变量SDE提供新的训练稳定性工具。本工作统一并扩展了变分推断、连续时间生成建模与控制论优化,为未来随机概率机器学习发展奠定坚实基础。

原文摘要 · Abstract (English)

I propose a novel framework that integrates stochastic differential equations (SDEs) with deep generative models to improve uncertainty quantification in machine learning applications involving structured and temporal data. This approach, termed Stochastic Latent Differential Inference (SLDI), embeds an Itô SDE in the latent space of a variational autoencoder, allowing for flexible, continuous-time modeling of uncertainty while preserving a principled mathematical foundation. The drift and diffusion terms of the SDE are parameterized by neural networks, enabling data-driven inference and generalizing classical time series models to handle irregular sampling and complex dynamic structure. A central theoretical contribution is the co-parameterization of the adjoint state with a dedicated neural network, forming a coupled forward-backward system that captures not only latent evolution but also gradient dynamics. I introduce a pathwise-regularized adjoint loss and analyze variance-reduced gradient flows through the lens of stochastic calculus, offering new tools for improving training stability in deep latent SDEs. My paper unifies and extends variational inference, continuous-time generative modeling, and control-theoretic optimization, providing a rigorous foundation for future developments in stochastic probabilistic machine learning.

随机微分方程时序建模不确定性量化生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。