arXiv:2507.09212cs.LGcs.CV2025-07被引 4

用确定性模型提供更好起点,让扩散生成快4-6倍

Warm Starts Accelerate Conditional Diffusion

  • 用条件信息预测初始分布,替代随机噪声起点
  • 仅需4-6次函数计算即可生成逼真样本,10-12次达性能饱和
  • 兼容主流扩散模型,适合追求高效生成的开发者

生成模型如扩散模型和流匹配通过逐步精炼噪声生成高质量样本,但过程极其缓慢,通常需要数百次函数评估。本文提出温启动扩散(WSD),利用一个简单且确定性的模型,通过提供更优的起始点显著加速条件生成。不再从无信息的 $N(oldsymbol{0}, I)$ 先验开始,而是基于输入上下文 $C$ 预测一个有信息量的先验 $N( ilde{oldsymbol{μ}}_C, ext{diag}( ilde{oldsymbol{σ}}^2_C))$。该温启动大幅缩短生成路径,显著减少所需扩散步数,尤其当上下文 $C$ 信息丰富时效果更明显。WSD可应用于任意标准扩散或流匹配算法,与高效求解器等技术正交且协同,实现简单。我们在多种场景验证,发现其在高效采样阶段显著优于标准扩散,在仅4-6次函数评估下生成真实样本,10-12次即达到性能饱和。

原文摘要 · Abstract (English)

Generative models like diffusion and flow-matching create high-fidelity samples by progressively refining noise. The refinement process is notoriously slow, often requiring hundreds of function evaluations. We introduce Warm-Start Diffusion (WSD), a method that uses a simple, deterministic model to dramatically accelerate conditional generation by providing a better starting point. Instead of starting generation from an uninformed $N(\boldsymbol{0}, I)$ prior, our deterministic warm-start model predicts an informed prior $N(\hat{\boldsymbolμ}_C, \text{diag}(\hat{\boldsymbolσ}^2_C))$, whose moments are conditioned on the input context $C$. This warm start substantially reduces the distance the generative process must traverse, and therefore the number of diffusion steps required, particularly when the context $C$ is strongly informative. WSD is applicable to any standard diffusion or flow matching algorithm, is orthogonal to and synergistic with other fast sampling techniques like efficient solvers, and is simple to implement. We test WSD in a variety of settings, and find that it substantially outperforms standard diffusion in the efficient sampling regime, generating realistic samples using only 4-6 function evaluations, and saturating performance with 10-12.

扩散模型高效生成条件采样

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。