arXiv:2601.21892cs.CVcs.AI2026-01被引 1

通过流形投影改进无分类器引导,提升生成质量与稳定性

Improving Classifier-Free Guidance of Flow Matching via Manifold Projection

  • 将无分类器引导重构为带流形约束的同伦优化问题
  • 在大模型上显著提升生成保真度与提示对齐性,且对引导尺度更鲁棒
  • 无需训练,适用于扩散与流模型,特别适合高阶生成任务

无分类器引导(CFG)是扩散与流模型中实现可控生成的常用技术。尽管效果显著,其依赖的线性外推策略对引导尺度敏感。本文从优化角度重新诠释CFG:流匹配中的速度场对应一系列平滑距离函数的梯度,引导隐变量向缩放的目标图像集逼近。该视角揭示标准CFG仅为梯度的近似,预测差距(条件与无条件输出之差)决定引导敏感性。基于此,我们提出一种带流形约束的同伦优化采样方法,需在采样过程中加入流形投影,采用增量梯度下降实现。为进一步提升效率与稳定性,引入无需额外模型评估的Anderson加速。所提方法完全无需训练,在多个基准上一致提升生成保真度、提示对齐性及对引导尺度的鲁棒性。在大型模型如DiT-XL-2-256、Flux和Stable Diffusion 3.5上均取得显著改进。

原文摘要 · Abstract (English)

Classifier-free guidance (CFG) is a widely used technique for controllable generation in diffusion and flow-based models. Despite its empirical success, CFG relies on a heuristic linear extrapolation that is often sensitive to the guidance scale. In this work, we provide a principled interpretation of CFG through the lens of optimization. We demonstrate that the velocity field in flow matching corresponds to the gradient of a sequence of smoothed distance functions, which guides latent variables toward the scaled target image set. This perspective reveals that the standard CFG formulation is an approximation of this gradient, where the prediction gap, the discrepancy between conditional and unconditional outputs, governs guidance sensitivity. Leveraging this insight, we reformulate the CFG sampling as a homotopy optimization with a manifold constraint. This formulation necessitates a manifold projection step, which we implement via an incremental gradient descent scheme during sampling. To improve computational efficiency and stability, we further enhance this iterative process with Anderson Acceleration without requiring additional model evaluations. Our proposed methods are training-free and consistently refine generation fidelity, prompt alignment, and robustness to the guidance scale. We validate their effectiveness across diverse benchmarks, demonstrating significant improvements on large-scale models such as DiT-XL-2-256, Flux, and Stable Diffusion 3.5.

生成模型流匹配无分类器引导优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。