arXiv:2506.19713cs.LG2025-06被引 10

分离高低频引导,低尺度也能生成高保真图像

Guidance in the Frequency Domain Enables High-Fidelity Sampling at Low CFG Scales

  • 将引导分解为低频(结构)和高频(细节)分量分别控制
  • 在低引导尺度下显著提升图像保真度,避免高尺度过饱和
  • 适用于需高质量输出的扩散模型,尤其适合资源受限场景

分类器自由引导(CFG)已成为现代条件扩散模型的核心组件。尽管实际效果显著,但其提升生成质量、细节与提示对齐的内在机制尚不明确。本文从频率域视角分析CFG,发现低频引导主导全局结构与条件对齐,高频引导则主要增强视觉保真度。然而,标准CFG在所有频率上使用统一引导强度,导致高尺度下过饱和、多样性下降,低尺度下视觉质量劣化。为此,提出频率解耦引导(FDG),将CFG分解为低频与高频分量,并分别施加不同引导强度。实验表明,FDG在多个数据集与模型上均显著提升样本保真度,同时保持多样性,优于标准CFG,在FID与召回率指标上表现更优,可作为即插即用的替代方案。

原文摘要 · Abstract (English)

Classifier-free guidance (CFG) has become an essential component of modern conditional diffusion models. Although highly effective in practice, the underlying mechanisms by which CFG enhances quality, detail, and prompt alignment are not fully understood. We present a novel perspective on CFG by analyzing its effects in the frequency domain, showing that low and high frequencies have distinct impacts on generation quality. Specifically, low-frequency guidance governs global structure and condition alignment, while high-frequency guidance mainly enhances visual fidelity. However, applying a uniform scale across all frequencies -- as is done in standard CFG -- leads to oversaturation and reduced diversity at high scales and degraded visual quality at low scales. Based on these insights, we propose frequency-decoupled guidance (FDG), an effective approach that decomposes CFG into low- and high-frequency components and applies separate guidance strengths to each component. FDG improves image quality at low guidance scales and avoids the drawbacks of high CFG scales by design. Through extensive experiments across multiple datasets and models, we demonstrate that FDG consistently enhances sample fidelity while preserving diversity, leading to improved FID and recall compared to CFG, establishing our method as a plug-and-play alternative to standard classifier-free guidance.

扩散模型频率分析图像生成引导优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。