arXiv:2506.11039cs.LGcs.AI2025-06ICML被引 10

解决扩散模型高提示词权重下的色彩失真问题

Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolation

  • 在潜在空间中通过角度对齐替代幅度外推
  • 高提示词权重下图像颜色失真减少57%
  • 适合追求高质量图文一致性的生成任务

无分类器引导(CFG)是文本到图像潜在扩散模型中的关键进展,已成为实现高质量图像合成的核心技术。然而,在高引导权重下,虽然文本-图像对齐显著增强,但生成图像会出现明显的色彩失真。我们发现这些失真源于潜在空间中样本范数的放大。本文提出一个理论框架,阐明了范数放大及异常扩散现象的机制。基于理论洞察和潜在空间结构,我们提出了角域引导(ADG)算法,通过约束幅度变化并优化角度对齐,有效缓解色彩失真,同时保持高引导权重下的文本-图像对齐效果。实验表明,ADG显著优于现有方法,生成图像不仅文本对齐更优,且颜色保真度更高,更符合人类感知偏好。

原文摘要 · Abstract (English)

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights, where text-image alignment is significantly enhanced, CFG also leads to pronounced color distortions in the generated images. We identify that these distortions stem from the amplification of sample norms in the latent space. We present a theoretical framework that elucidates the mechanisms of norm amplification and anomalous diffusion phenomena induced by classifier-free guidance. Leveraging our theoretical insights and the latent space structure, we propose an Angle Domain Guidance (ADG) algorithm. ADG constrains magnitude variations while optimizing angular alignment, thereby mitigating color distortions while preserving the enhanced text-image alignment achieved at higher guidance weights. Experimental results demonstrate that ADG significantly outperforms existing methods, generating images that not only maintain superior text alignment but also exhibit improved color fidelity and better alignment with human perceptual preferences.

扩散模型图像生成提示词引导色彩保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。