通过优化控制条件提升图像生成可控性,效果优于现有方法。
CPO: Condition Preference Optimization for Controllable Image Generation
- 在控制条件层面做偏好学习,避免图像质量干扰
- 相比ControlNet++,分割、姿态等任务误差降低超10%
- 训练更稳定高效,适合需要高精度控制的生成场景
为提升文本到图像生成的可控性,ControlNet引入基于图像的控制信号,ControlNet++则改善了生成图像与输入控制信号间的像素级循环一致性。但ControlNet++仅优化低噪声时刻(如t < 200),忽略高噪声阶段并引入近似误差。直接使用偏好优化(DPO)虽可全时步优化,但难以确保对比图像仅在可控性上差异而其他因素不变。为此,本文提出条件偏好优化(CPO):不比较生成图像,而是对控制条件进行偏好学习,构建胜/败控制信号($\mathbf{c}^{w}$, $\mathbf{c}^{l}$),训练模型偏好优条件。该方法消除混淆因素,理论和实证均显示更低方差与更优性能。实验表明,CPO在多种控制类型上显著优于SOTA ControlNet++:分割误差降低超10%,人体姿态误差下降70%–80%,边缘与深度图误差减少2%–5%。且数据准备所需计算与存储更少。
原文摘要 · Abstract (English)
To enhance controllability in text-to-image generation, ControlNet introduces image-based control signals, while ControlNet++ improves pixel-level cycle consistency between generated images and the input control signal. To avoid the prohibitive cost of back-propagating through the sampling process, ControlNet++ optimizes only low-noise timesteps (e.g., $t < 200$) using a single-step approximation, which not only ignores the contribution of high-noise timesteps but also introduces additional approximation errors. A straightforward alternative for optimizing controllability across all timesteps is Direct Preference Optimization (DPO), a fine-tuning method that increases model preference for more controllable images ($I^{w}$) over less controllable ones ($I^{l}$). However, due to uncertainty in generative models, it is difficult to ensure that win--lose image pairs differ only in controllability while keeping other factors, such as image quality, fixed. To address this, we propose performing preference learning over control conditions rather than generated images. Specifically, we construct winning and losing control signals, $\mathbf{c}^{w}$ and $\mathbf{c}^{l}$, and train the model to prefer $\mathbf{c}^{w}$. This method, which we term \textit{Condition Preference Optimization} (CPO), eliminates confounding factors and yields a low-variance training objective. Our approach theoretically exhibits lower contrastive loss variance than DPO and empirically achieves superior results. Moreover, CPO requires less computation and storage for dataset curation. Extensive experiments show that CPO significantly improves controllability over the state-of-the-art ControlNet++ across multiple control types: over $10\%$ error rate reduction in segmentation, $70$--$80\%$ in human pose, and consistent $2$--$5\%$ reductions in edge and depth maps.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。