让图像生成模型像画画一样反复修改,提升细节和一致性。
RRFC: Recursive Refinement via Feedback Conditioning for Iterative Image-to-Image Generation

- 用自身上一轮输出作为反馈信号,指导模型迭代优化。
- 在18种组合中7次提升质量,尤其在保真度和身份一致性任务上效果显著。
- 无需重设计模型,可通用接入现有生成器,适合追求高质量图像的场景。
条件图像到图像生成器通常是单次完成:一次前向传播即输出结果,无法进一步优化。尽管训练目标是单步产出最佳结果,但若能自适应地迭代修正,仍有改进空间。本文提出递归精炼反馈调控(RRFC)框架,通过将最新预测结果作为辅助通道反馈回模型,实现对输出的动态修正。该方法保持原有生成器架构不变,仅调整其条件输入方式,适用于对抗、平衡与扩散类等多种模型,无需重新设计。在六种基线模型和三个配对图像转换任务上评估,共覆盖18个设置。结果显示,7次显著提升,7次退化,4次无显著差异。增益集中在重建保真度和身份一致任务,而5次退化均出现在单一语义布局任务,所有模型均表现下降。说明反馈精炼有效性的关键在于目标与评价指标的一致性。
原文摘要 · Abstract (English)
Conditional image-to-image generators are single-shot: they map input features to an output in one forward pass and treat it as final, with no opportunity to improve on it. Although trained to produce the best possible result in one step, such a model leaves room for improvement if it can adaptively revise its own output over iterations. We propose Recursive Refinement via Feedback Conditioning (RRFC), a novel feedback-conditioning framework for iterative output refinement that teaches a model to adaptively revise its output by conditioning on a new signal, namely its most recent previous prediction, which is fed back as an auxiliary set of channels alongside the original input. This preserves the generator's core architecture while modifying its conditioning interface and, depending on the model family, its training or inference procedure, so RRFC can be attached to existing generators without redesign. We evaluate RRFC across six baselines spanning adversarial, equilibrium, and diffusion-based models and three paired image-to-image translation tasks. Across 18 architecture-task settings, RRFC yields seven Holm-corrected improvements, seven degradations, and four non-significant changes. The gains concentrate on reconstruction-fidelity and identity settings, while five of the seven degradations fall on the single semantic-layout task, where every model declines. These results indicate that feedback-based refinement helps when its objective overlaps with the evaluated property, and that its gains concentrate on the tasks where that overlap holds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。