让流模型在推理时用更多计算提升生成质量
Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing
- 用随机微分方程实现流模型的粒子采样
- 可将图像生成质量提升至现有最佳水平
- 适合追求高精度生成的视觉算法研究者
我们提出一种针对预训练流模型的推理时扩展方法。近期,推理时扩展在大语言模型和扩散模型中受到广泛关注,通过利用额外计算提升样本质量或更好对齐用户偏好。对于扩散模型,中间去噪步骤的随机性使得粒子采样更高效。然而,流模型虽因生成速度快、输出质量高而在当前图像与视频生成模型中流行,但其确定性生成过程使得扩散模型中的高效推理扩展方法无法直接应用。为此,我们提出三个关键思想:1)基于SDE的生成,使流模型具备粒子采样能力;2)插值转换,扩大搜索空间并增强样本多样性;3)滚动预算强制(RBF),自适应分配各时间步计算资源以最大化预算利用率。实验表明,基于方差保持(VP)插值的SDE生成显著提升粒子采样方法在流模型中的推理扩展性能。此外,结合VP-SDE的RBF达到最优表现,优于所有已有推理扩展方法。
原文摘要 · Abstract (English)
We propose an inference-time scaling approach for pretrained flow models. Recently, inference-time scaling has gained significant attention in LLMs and diffusion models, improving sample quality or better aligning outputs with user preferences by leveraging additional computation. For diffusion models, particle sampling has allowed more efficient scaling due to the stochasticity at intermediate denoising steps. On the contrary, while flow models have gained popularity as an alternative to diffusion models--offering faster generation and high-quality outputs in state-of-the-art image and video generative models--efficient inference-time scaling methods used for diffusion models cannot be directly applied due to their deterministic generative process. To enable efficient inference-time scaling for flow models, we propose three key ideas: 1) SDE-based generation, enabling particle sampling in flow models, 2) Interpolant conversion, broadening the search space and enhancing sample diversity, and 3) Rollover Budget Forcing (RBF), an adaptive allocation of computational resources across timesteps to maximize budget utilization. Our experiments show that SDE-based generation, particularly variance-preserving (VP) interpolant-based generation, improves the performance of particle sampling methods for inference-time scaling in flow models. Additionally, we demonstrate that RBF with VP-SDE achieves the best performance, outperforming all previous inference-time scaling approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。