用恒定加速度改进图像生成轨迹,提升少步生成质量。
Constant Acceleration Flow
- 引入恒定加速度模型替代恒定速度,增强轨迹表达能力。
- 在CIFAR-10和ImageNet上实现单步生成优于现有方法。
- 适合追求高效少步生成的扩散模型研究者使用。
修正流(Rectified flow)与重流(reflow)方法通过逐步拉直常微分方程(ODE)流,显著加速了生成过程。它们基于图像与噪声对可近似为恒定速度直线轨迹的假设。然而,我们发现恒定速度建模及重流过程在准确学习配对间直线轨迹方面存在局限,导致少步生成性能不佳。为此,我们提出恒定加速度流(Constant Acceleration Flow, CAF),基于简单恒定加速度方程构建新框架。CAF将加速度作为可学习变量,提升了对ODE流的表达与估计精度。此外,我们提出两种优化技术:初始速度条件化加速度模型,以及对初始速度的重流过程。在玩具数据集、CIFAR-10和ImageNet 64x64上的全面实验表明,CAF在单步生成上优于当前最优基线。同时,CAF显著改善了少步生成中的配对保持与逆向重建效果。代码已公开于 https://github.com/mlvlab/CAF。
原文摘要 · Abstract (English)
Rectified flow and reflow procedures have significantly advanced fast generation by progressively straightening ordinary differential equation (ODE) flows. They operate under the assumption that image and noise pairs, known as couplings, can be approximated by straight trajectories with constant velocity. However, we observe that modeling with constant velocity and using reflow procedures have limitations in accurately learning straight trajectories between pairs, resulting in suboptimal performance in few-step generation. To address these limitations, we introduce Constant Acceleration Flow (CAF), a novel framework based on a simple constant acceleration equation. CAF introduces acceleration as an additional learnable variable, allowing for more expressive and accurate estimation of the ODE flow. Moreover, we propose two techniques to further improve estimation accuracy: initial velocity conditioning for the acceleration model and a reflow process for the initial velocity. Our comprehensive studies on toy datasets, CIFAR-10, and ImageNet 64x64 demonstrate that CAF outperforms state-of-the-art baselines for one-step generation. We also show that CAF dramatically improves few-step coupling preservation and inversion over Rectified flow. Code is available at \href{https://github.com/mlvlab/CAF}{https://github.com/mlvlab/CAF}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。