提出直线匹配模型,让扩散采样更准更快。
Generative Lines Matching Models
- 用确定性微分方程建模源与目标分布间的直线映射
- 在CIFAR-10上仅1步就达1.57的FID,效率领先
- 适合追求高保真、低采样步数的生成任务
本文揭示了关键去噪模型训练损失中的奇点问题,导致去噪器预测坍缩至源或目标分布的均值,产生虚假吸引盆,扭曲去噪轨迹并增加采样步数。为克服此缺陷,我们利用某些去噪扩散与得分匹配模型提供的确定性常微分方程采样器,建立源与目标分布之间的明确定义变量变换。基于此对应关系,提出一种新的概率流模型——直线匹配模型(LMM),通过匹配两分布间全局直线插值路径实现建模。实验表明,LMM产生的流场具有显著的时间一致性,轨迹直度优异。除采样高效外,该框架还可通过引入领域特定重建损失和对抗损失,并针对实际采样过程优化训练,提升生成样本保真度。在主流基准数据集上,LMM实现卓越性能:在CIFAR-10上以NFE=1/2达到FID 1.57/1.39;在ImageNet 64x64上为1.47/1.17;在AFHQ 64x64上为2.68/1.54。最后,理论分析表明,使用最优传输关联两分布存在维度诅咒,配对集合大小(小批量)需随信号维度指数级增长。
原文摘要 · Abstract (English)
In this paper we identify the source of a singularity in the training loss of key denoising models, that causes the denoiser's predictions to collapse towards the mean of the source or target distributions. This degeneracy creates false basins of attraction, distorting the denoising trajectories and ultimately increasing the number of steps required to sample these models. We circumvent this artifact by leveraging the deterministic ODE-based samplers, offered by certain denoising diffusion and score-matching models, which establish a well-defined change-of-variables between the source and target distributions. Given this correspondence, we propose a new probability flow model, the Lines Matching Model (LMM), which matches globally straight lines interpolating the two distributions. We demonstrate that the flow fields produced by the LMM exhibit notable temporal consistency, resulting in trajectories with excellent straightness scores. Beyond its sampling efficiency, the LMM formulation allows us to enhance the fidelity of the generated samples by integrating domain-specific reconstruction and adversarial losses, and by optimizing its training for the sampling procedure used. Overall, the LMM achieves state-of-the-art FID scores with minimal NFEs on established benchmark datasets: 1.57/1.39 (NFE=1/2) on CIFAR-10, 1.47/1.17 on ImageNet 64x64, and 2.68/1.54 on AFHQ 64x64. Finally, we provide a theoretical analysis showing that the use of optimal transport to relate the two distributions suffers from a curse of dimensionality, where the pairing set size (mini-batch) must scale exponentially with the signal dimension.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。