高维下分类器自由引导可精准生成目标分布
Classifier-Free Guidance: From High-Dimensional Analysis to Generalized Guidance Forms
- 从高维理论证明:维度越高,引导偏差越小
- 发现非线性引导形式在高维下仍保持精确生成
- 适合追求高质量图像生成的科研与工程人员
分类器自由引导(CFG)是扩散模型和流匹配模型中广泛使用的条件生成技术,能实现高质量生成。其关键理论挑战在于刻画CFG诱导的分布,尤其是在真实数据相关的高维场景中。以往研究发现,CFG会改变目标分布,使其更尖锐、更靠近类别边界。本文提供了一种高维分析,表明这些偏差随数据维度增加而消失。我们提出一个‘维度之福’结果:在足够高甚至无限维时,CFG可准确复现目标分布。基于此理论,我们证明存在一大类引导形式具有该性质,包括非线性扩展。研究一种简单的幂律型非线性引导,实验证明其在鲁棒性、样本保真度和多样性上均有提升。结果在先进扩散模型和流匹配模型上,针对类别条件生成与文生图任务均得到验证。
原文摘要 · Abstract (English)
Classifier-Free Guidance (CFG) is a widely adopted technique in diffusion and flow-based generative models, enabling high-quality conditional generation. A key theoretical challenge is characterizing the distribution induced by CFG, particularly in high-dimensional settings relevant to real-world data. Previous works have shown that CFG modifies the target distribution, steering it towards a distribution sharper than the target one, more shifted towards the boundary of the class. In this work, we provide a high-dimensional analysis of CFG, showing that these distortions vanish as the data dimension grows. We present a blessing-of-dimensionality result demonstrating that in sufficiently high and infinite dimensions, CFG accurately reproduces the target distribution. Using our high-dimensional theory, we show that there is a large family of guidances enjoying this property, in particular non-linear CFG generalizations. We study a simple non-linear power-law version, for which we demonstrate improved robustness, sample fidelity and diversity. Our findings are validated with experiments on class-conditional and text-to-image generation using state-of-the-art diffusion and flow-matching models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。