arXiv:2410.13431cs.LGcs.AI2024-10被引 2

用最优传输解决扩散模型前后分布不匹配问题

Solving Prior Distribution Mismatch in Diffusion Models via Optimal Transport

  • 通过最优传输映射对齐反向初始与正向终态分布
  • 理论证明可完全消除先验误差,提升生成质量
  • 适合关注扩散模型机理与性能优化的研究者

扩散模型在生成建模中取得显著进展,但正向终态分布与反向初始分布之间的不匹配导致先验误差,使采样轨迹偏离真实分布,严重限制模型性能。该问题还引发信噪比非零、去噪误差累积、生成质量下降和采样效率受限等连锁问题。本文提出基于最优传输(OT)的先验误差消除框架:构建从反向初始分布到正向终态分布的OT映射,实现两分布精确匹配;利用Wasserstein距离量化先验误差上界,证明可通过OT映射有效消除误差;并推导出动态OT与概率流的渐近一致性,揭示该方法与扩散过程内在机制高度兼容。实验表明,该方法在理论上和实践中均完全消除了先验误差,为优化扩散模型性能提供了通用且严格的解决方案。

原文摘要 · Abstract (English)

Diffusion Models (DMs) have achieved remarkable progress in generative modeling. However, the mismatch between the forward terminal distribution and reverse initial distribution introduces prior error, leading to deviations of sampling trajectories from the true distribution and severely limiting model performance. This issue further triggers cascading problems, including non-zero Signal-to-Noise Ratio, accumulated denoising errors, degraded generation quality, and constrained sampling efficiency. To address this issue, this paper proposes a prior error elimination framework based on Optimal Transport (OT). Specifically, an OT map from the reverse initial distribution to the forward terminal distribution is constructed to achieve precise matching of the two distributions. Meanwhile, the upper bound of the prior error is quantified using the Wasserstein distance, proving that the prior error can be effectively eliminated via the OT map. Additionally, by deriving the asymptotic consistency between dynamic OT and probability flow, this method is revealed to be highly compatible with the intrinsic mechanism of the diffusion process. Experimental results demonstrate that the proposed method completely eliminates the prior error both theoretically and practically, providing a universal and rigorous solution for optimizing the performance of DMs.

扩散模型最优传输生成模型误差消除

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。