arXiv:2509.24710stat.MLcs.LG2025-09

通过流形吸引力改进扩散模型,生成更干净的图像样本。

MAD: Manifold Attracted Diffusion

  • 基于数据流形假设,设计扩展得分函数区分噪声与真实特征方向。
  • 在简化设定下可将微小噪声波动归零,保留主要数据结构。
  • 适用于图像去噪、生成质量提升,尤其适合处理含噪训练数据场景。

基于得分的扩散模型是生成图像分布样本的有效方法。本文考虑训练数据来自目标分布的噪声版本的情形,提出一种高效可实现的推理修改方法,用于生成无噪声样本。该方法受流形假设启发:有意义的数据集中在高维空间的低维流形上。核心思想是,噪声表现为流形外方向的微小变化,而真实数据变化主要集中在流形内方向。我们引入扩展得分概念,并在简化设定中证明其可将小幅度波动归零,同时保持大幅变化不变。我们描述如何从标准得分近似高效计算该扩展得分,并在玩具问题、合成数据和真实数据上验证其有效性。

原文摘要 · Abstract (English)

Score-based diffusion models are a highly effective method for generating samples from a distribution of images. We consider scenarios where the training data comes from a noisy version of the target distribution, and present an efficiently implementable modification of the inference procedure to generate noiseless samples. Our approach is motivated by the manifold hypothesis, according to which meaningful data is concentrated around some low-dimensional manifold of a high-dimensional ambient space. The central idea is that noise manifests as low magnitude variation in off-manifold directions in contrast to the relevant variation of the desired distribution which is mostly confined to on-manifold directions. We introduce the notion of an extended score and show that, in a simplified setting, it can be used to reduce small variations to zero, while leaving large variations mostly unchanged. We describe how its approximation can be computed efficiently from an approximation to the standard score and demonstrate its efficacy on toy problems, synthetic data, and real data.

扩散模型图像生成去噪流形学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。