提出更简单高效的扩散模型生成方法,无需复杂路径修正。
Rectified Diffusion: Straightness Is Not Your Need in Rectified Flow
- 用预训练模型生成噪声-样本对,直接重训即可
- 新方法在Stable Diffusion上更快更优,训练成本更低
- 适合追求高效生成的视觉应用开发者
扩散模型虽显著提升图像生成质量,但因求解生成微分方程计算量大而速度慢。主流的修正流(Rectified Flow)通过拉直轨迹提升速度,其核心包括:1)采用扩散形式的流匹配,2)使用$oldsymbol v$-预测,3)执行修正(即重流)。本文指出,修正成功的关键在于利用预训练扩散模型获取匹配的噪声与样本对,再用这些数据重新训练;因此前两个组件并非必需。此外,我们强调路径直线性并非必要目标,而是流匹配模型的一种特例。真正关键的是实现一阶近似的微分路径,而像DDPM和Sub-VP这类模型的路径本就天然弯曲。基于此,我们提出矩形扩散(Rectified Diffusion),将修正方法的适用范围从流匹配模型拓展至更广泛的扩散模型。我们在Stable Diffusion v1-5和Stable Diffusion XL上验证了该方法,不仅大幅简化了此前基于修正流的工作(如InstaFlow)的训练流程,且性能更优、训练成本更低。代码已开源:https://github.com/G-U-N/Rectified-Diffusion。
原文摘要 · Abstract (English)
Diffusion models have greatly improved visual generation but are hindered by slow generation speed due to the computationally intensive nature of solving generative ODEs. Rectified flow, a widely recognized solution, improves generation speed by straightening the ODE path. Its key components include: 1) using the diffusion form of flow-matching, 2) employing $\boldsymbol v$-prediction, and 3) performing rectification (a.k.a. reflow). In this paper, we argue that the success of rectification primarily lies in using a pretrained diffusion model to obtain matched pairs of noise and samples, followed by retraining with these matched noise-sample pairs. Based on this, components 1) and 2) are unnecessary. Furthermore, we highlight that straightness is not an essential training target for rectification; rather, it is a specific case of flow-matching models. The more critical training target is to achieve a first-order approximate ODE path, which is inherently curved for models like DDPM and Sub-VP. Building on this insight, we propose Rectified Diffusion, which generalizes the design space and application scope of rectification to encompass the broader category of diffusion models, rather than being restricted to flow-matching models. We validate our method on Stable Diffusion v1-5 and Stable Diffusion XL. Our method not only greatly simplifies the training procedure of rectified flow-based previous works (e.g., InstaFlow) but also achieves superior performance with even lower training cost. Our code is available at https://github.com/G-U-N/Rectified-Diffusion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。