提出双端一致性模型,实现高效稳定的一步生成。
Dual-End Consistency Model
- 通过选择关键子轨迹优化训练过程,提升稳定性。
- 在ImageNet上实现1.70的FID,一步生成性能领先。
- 适合需要快速生成的部署场景,如实时图像合成。
扩散和流模型的慢速迭代采样仍是实际部署的主要瓶颈。尽管一致性模型(CMs)是当前基于蒸馏的高效生成方法,但其大规模应用仍受限于训练不稳和采样僵化两大问题。现有方法通过结构调整或正则化目标缓解,却忽略了对轨迹选择的关键依赖。本文分析发现,训练不稳源于自监督项引起的损失发散,采样僵化则源于误差累积。为此,我们提出双端一致性模型(DE-CM),通过选取关键子轨迹簇实现稳定有效训练。该方法分解PF-ODE轨迹,以三个关键子轨迹为优化目标。利用连续时间一致性模型目标实现少步蒸馏,并以流匹配作为边界正则器稳定训练。此外,提出新型噪声到噪声(N2N)映射,可将噪声映射至任意点,缓解首步误差累积。大量实验表明,本方法在ImageNet 256x256数据集上实现1.70的最优FID分数,优于现有基于CM的一步生成方法。
原文摘要 · Abstract (English)
The slow iterative sampling nature remains a major bottleneck for the practical deployment of diffusion and flow-based generative models. While consistency models (CMs) represent a state-of-the-art distillation-based approach for efficient generation, their large-scale application is still limited by two key issues: training instability and inflexible sampling. Existing methods seek to mitigate these problems through architectural adjustments or regularized objectives, yet overlook the critical reliance on trajectory selection. In this work, we first conduct an analysis on these two limitations: training instability originates from loss divergence induced by unstable self-supervised term, whereas sampling inflexibility arises from error accumulation. Based on these insights and analysis, we propose the Dual-End Consistency Model (DE-CM) that selects vital sub-trajectory clusters to achieve stable and effective training. DE-CM decomposes the PF-ODE trajectory and selects three critical sub-trajectories as optimization targets. Specifically, our approach leverages continuous-time CMs objectives to achieve few-step distillation and utilizes flow matching as a boundary regularizer to stabilize the training process. Furthermore, we propose a novel noise-to-noisy (N2N) mapping that can map noise to any point, thereby alleviating the error accumulation in the first step. Extensive experimental results show the effectiveness of our method: it achieves a state-of-the-art FID score of 1.70 in one-step generation on the ImageNet 256x256 dataset, outperforming existing CM-based one-step approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。