解析了无分类器引导为何能提升图像生成质量
Towards Understanding the Mechanisms of Classifier-Free Guidance
- 通过线性模型分析发现，引导机制包含三部分：均值偏移、特征增强与通用特征抑制
- 在多数噪声水平下，线性与非线性模型的引导行为高度一致
- 为理解扩散模型中图像生成机制提供了可解释性新视角
无分类器引导（CFG）是当前先进图像生成系统的核心技术，但其内在机制仍不清晰。本文首先在简化的线性扩散模型中分析CFG，发现其行为与非线性情况高度相似。分析揭示，线性CFG通过三个独立成分提升生成质量：(i) 均值偏移项，近似将样本导向类别均值方向；(ii) 正向对比主成分（CPC）项，放大类别特异性特征；(iii) 负向CPC项，抑制普遍存在于无条件数据中的通用特征。随后在真实非线性扩散模型中验证这些发现：在广泛噪声水平下，线性与非线性CFG行为相近。尽管在低噪声时二者逐渐偏离，但线性分析所得见解仍有助于理解非线性情形下的引导机制。
原文摘要 · Abstract (English)
Classifier-free guidance (CFG) is a core technique powering state-of-the-art image generation systems, yet its underlying mechanisms remain poorly understood. In this work, we begin by analyzing CFG in a simplified linear diffusion model, where we show its behavior closely resembles that observed in the nonlinear case. Our analysis reveals that linear CFG improves generation quality via three distinct components: (i) a mean-shift term that approximately steers samples in the direction of class means, (ii) a positive Contrastive Principal Components (CPC) term that amplifies class-specific features, and (iii) a negative CPC term that suppresses generic features prevalent in unconditional data. We then verify these insights in real-world, nonlinear diffusion models: over a broad range of noise levels, linear CFG resembles the behavior of its nonlinear counterpart. Although the two eventually diverge at low noise levels, we discuss how the insights from the linear analysis still shed light on the CFG's mechanism in the nonlinear regime.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。