arXiv:2503.18137cs.CV2025-03CVPR被引 15

通过几何滤波优化扩散模型采样轨迹,提升文本生成图像质量。

TCFG: Tangential Damping Classifier-free Guidance

  • 用奇异值分解过滤条件与无条件得分的奇异向量,对齐两者方向。
  • 在不增加计算量前提下,显著提升图像质量和条件一致性。
  • 适合追求高质量文本生成图像的开发者与研究者使用。

扩散模型在文本到图像生成中取得显著成功,主要得益于无分类器引导(CFG)技术,该技术通过结合条件得分(如文本条件)与无条件得分来控制输出。然而,无条件得分负责估计相邻时间步间流形间的转换,可能无意中干扰特定条件下的生成路径。本文从几何角度出发,提出一种新方法:利用奇异值分解过滤条件与无条件得分的奇异向量,使两者对齐,从而优化采样轨迹,使其更贴近目标流形。该方法在无需额外计算成本的情况下提升了图像质量。研究深入揭示了扩散模型中得分函数的行为机制,并提供了一种实现更精确、语义连贯图像合成的实用技术。

原文摘要 · Abstract (English)

Diffusion models have achieved remarkable success in text-to-image synthesis, largely attributed to the use of classifier-free guidance (CFG), which enables high-quality, condition-aligned image generation. CFG combines the conditional score (e.g., text-conditioned) with the unconditional score to control the output. However, the unconditional score is in charge of estimating the transition between manifolds of adjacent timesteps from $x_t$ to $x_{t-1}$, which may inadvertently interfere with the trajectory toward the specific condition. In this work, we introduce a novel approach that leverages a geometric perspective on the unconditional score to enhance CFG performance when conditional scores are available. Specifically, we propose a method that filters the singular vectors of both conditional and unconditional scores using singular value decomposition. This filtering process aligns the unconditional score with the conditional score, thereby refining the sampling trajectory to stay closer to the manifold. Our approach improves image quality with negligible additional computation. We provide deeper insights into the score function behavior in diffusion models and present a practical technique for achieving more accurate and contextually coherent image synthesis.

扩散模型图像生成得分函数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。