arXiv:2501.15420cs.CVcs.AI2025-01ICML被引 16

无需引导采样,训练直接生成高质量图像。

Visual Generation Without Guidance

  • 通过参数化条件模型实现无引导训练,仅用一个模型采样。
  • 在五种视觉模型上性能媲美有引导方法,FID更低或相当。
  • 可直接从零训练,代码改动极小,适合快速部署。

Classifier-Free Guidance(CFG)是各类视觉生成模型的默认技术,但采样需同时调用条件与无条件模型。本文提出无需引导采样的新算法——无引导训练(Guidance-Free Training, GFT),其性能与CFG相当,却只需单个模型采样,计算成本减半。GFT不依赖预训练的CFG网络,支持从零开始训练。该方法保持与CFG相同的最大似然目标,仅在条件模型参数化方式上不同。实现GFT仅需对现有代码库进行微小修改,多数设计与超参可直接沿用CFG。我们在五种不同的视觉生成模型上进行了广泛实验,涵盖扩散、自回归和掩码预测模型,结果表明GFT在各项指标上均达到或超越CFG基准,且在多样性-保真度权衡上表现一致,同时完全无引导。代码将开源于https://github.com/thu-ml/GFT。

原文摘要 · Abstract (English)

Classifier-Free Guidance (CFG) has been a default technique in various visual generative models, yet it requires inference from both conditional and unconditional models during sampling. We propose to build visual models that are free from guided sampling. The resulting algorithm, Guidance-Free Training (GFT), matches the performance of CFG while reducing sampling to a single model, halving the computational cost. Unlike previous distillation-based approaches that rely on pretrained CFG networks, GFT enables training directly from scratch. GFT is simple to implement. It retains the same maximum likelihood objective as CFG and differs mainly in the parameterization of conditional models. Implementing GFT requires only minimal modifications to existing codebases, as most design choices and hyperparameters are directly inherited from CFG. Our extensive experiments across five distinct visual models demonstrate the effectiveness and versatility of GFT. Across domains of diffusion, autoregressive, and masked-prediction modeling, GFT consistently achieves comparable or even lower FID scores, with similar diversity-fidelity trade-offs compared with CFG baselines, all while being guidance-free. Code will be available at https://github.com/thu-ml/GFT.

图像生成无引导采样扩散模型训练优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。