arXiv:2409.17294stat.MLcs.LG2024-09被引 3

用薛定谔桥方法生成高质量条件数据,无需直接估计密度

Schrödinger bridge based deep conditional generative learning

  • 基于随机微分方程构建条件生成过程,用神经网络学习漂移项
  • 生成样本质量优于现有方法,可有效估算条件均值与方差
  • 适合需要高质量条件生成的科研与工业场景

条件生成模型在机器学习中取得重要进展,可通过引入额外信息控制数据合成。本文提出一种基于薛定谔桥的深度条件生成方法,从时间0的固定点出发,通过单位时间扩散过程,在时间1生成目标条件分布。采用Euler-Maruyama方法离散化随机微分方程,利用深度神经网络非参数化估计漂移项。该方法适用于低维与高维条件生成问题。数值实验表明,尽管本方法不直接提供条件密度估计,但生成样本质量显著优于多个现有方法。此外,这些样本可有效用于估计条件密度及相关统计量,如条件均值和条件标准差。

原文摘要 · Abstract (English)

Conditional generative models represent a significant advancement in the field of machine learning, allowing for the controlled synthesis of data by incorporating additional information into the generation process. In this work we introduce a novel Schrödinger bridge based deep generative method for learning conditional distributions. We start from a unit-time diffusion process governed by a stochastic differential equation (SDE) that transforms a fixed point at time $0$ into a desired target conditional distribution at time $1$. For effective implementation, we discretize the SDE with Euler-Maruyama method where we estimate the drift term nonparametrically using a deep neural network. We apply our method to both low-dimensional and high-dimensional conditional generation problems. The numerical studies demonstrate that though our method does not directly provide the conditional density estimation, the samples generated by this method exhibit higher quality compared to those obtained by several existing methods. Moreover, the generated samples can be effectively utilized to estimate the conditional density and related statistical quantities, such as conditional mean and conditional standard deviation.

条件生成扩散模型生成对抗网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。