让图像编辑中间态懂目标,提升大模型修改精准度。
Target-aware Image Editing via Cycle-consistent Constraints
- 用可学习噪声构建目标感知的中间状态,不盲目破坏图像。
- 通过循环一致性训练,实现源图与目标图双向还原。
- 无需反演,动态调整采样步数,效率更高适合实际应用。
近期预训练的文本到图像流模型在文本引导图像编辑上取得了显著进展。主流方法采用先破坏后恢复的范式:将源图像先破坏为一个可编辑的‘中间状态’,再在提示词指导下恢复为目标图像。然而,现有方法构建中间状态时是目标无关的,主要关注源图像重建,忽视了向特定编辑目标的语义差距。这一设计导致当目标修改与源图像差异较大时,编辑能力受限或结果不一致。本文认为中间状态应具备目标感知性,即有选择地破坏与编辑相关的内容,同时保留无关部分。为此,我们提出 FlowCycle,一种无反演、基于流的编辑框架,用可学习噪声参数化破坏过程,并通过循环一致性优化。通过迭代地从源图编辑到目标图并且回复到源图,施加双重一致性约束,FlowCycle 学习生成目标感知的中间状态,实现忠实修改的同时保持源图一致性。为提高效率,进一步通过动态调整采样步数加速优化。大量消融实验表明,FlowCycle 在编辑性能上表现更优。
原文摘要 · Abstract (English)
Recent pre-trained text-to-image flow models have enabled remarkable progress in text-based image editing. Mainstream approaches adopt a corruption-then-restoration paradigm, where the source image is first corrupted into an editable ``intermediate state'' and then restored to the target image under the prompt guidance. However, current methods construct this intermediate state in a target-agnostic manner, i.e., they mainly focus on realizing source image reconstruction while neglecting the semantic gaps towards the specific editing target. This design inherently results in limited editability or inconsistency when the desired modifications substantially deviate from the source. In this paper, we argue that the intermediate state should be target-aware, i.e., selectively corrupting editing-relevant contents while preserving editing-irrelevant ones. Thus, we propose FlowCycle, an inversion-free and flow-based editing framework that parameterizes corruption with learnable noises and optimizes them through a cycle-consistent process. By iteratively editing the source to the target and recovering back to the source with dual consistency constraints, FlowCycle learns to produce a target-aware intermediate state, enabling faithful modifications while preserving source consistency. For efficiency, we further accelerate the optimization by dynamically adjusting the sampling steps. Extensive ablations demonstrated that FlowCycle achieves superior editing performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。