arXiv:2502.16972cs.CVcs.LG2025-02NeurIPS被引 11

提出SCoT统一一致性模型与修正流,实现快速采样。

SCoT: Unifying Consistency Models and Rectified Flows via Straight-Consistent Trajectories

  • 设计直线一致轨迹,同时满足路径直与一致性
  • 采样速度显著提升,无需依赖数值求解器
  • 适合需要高效生成的图像生成场景

预训练扩散模型常用于从随机噪声生成清晰数据(如图像),形成噪声与对应清晰图像的配对。对这些模型进行蒸馏可视为在配对中构建先进轨迹以加速采样。例如,一致性模型蒸馏通过构建一致投影函数来调控轨迹,但采样效率仍有待提升;修正流方法强制轨迹为直线以实现更快采样,却依赖数值微分方程求解器,可能引入近似误差。本文通过提出直线一致轨迹(SCoT)模型,弥合一致性模型与修正流方法之间的差距。SCoT同时具备路径直与一致性的双重优势,通过优化两个关键目标实现平衡:(1) 将SCoT映射的梯度调节为常数;(2) 保证轨迹一致性。大量实验表明,SCoT在有效性和效率上均表现优异。

原文摘要 · Abstract (English)

Pre-trained diffusion models are commonly used to generate clean data (e.g., images) from random noises, effectively forming pairs of noises and corresponding clean images. Distillation on these pre-trained models can be viewed as the process of constructing advanced trajectories within the pair to accelerate sampling. For instance, consistency model distillation develops consistent projection functions to regulate trajectories, although sampling efficiency remains a concern. Rectified flow method enforces straight trajectories to enable faster sampling, yet relies on numerical ODE solvers, which may introduce approximation errors. In this work, we bridge the gap between the consistency model and the rectified flow method by proposing a Straight Consistent Trajectory~(SCoT) model. SCoT enjoys the benefits of both approaches for fast sampling, producing trajectories with consistent and straight properties simultaneously. These dual properties are strategically balanced by targeting two critical objectives: (1) regulating the gradient of SCoT's mapping to a constant, (2) ensuring trajectory consistency. Extensive experimental results demonstrate the effectiveness and efficiency of SCoT.

生成模型扩散模型轨迹优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。