arXiv:2602.14068cs.CV2026-02中稿 · ICML被引 2

让图像编辑不破坏无关区域,提升内容一致性。

CoCoEdit: Content-Consistent Image Editing via Region Regularized Reinforcement Learning

  • 用区域正则化强化学习,约束非编辑区不变。
  • 40K高质量样本训练,像素级相似性奖励更精准。
  • 适合需要高保真编辑的视觉应用,如设计、医疗影像。

图像编辑随着大规模生成模型的发展取得了显著进展。然而,现有模型多关注目标对象与区域的编辑效果,常导致非目标区域出现意外变化。本文提出一种基于区域正则化强化学习的内容一致性编辑后训练框架(CoCoEdit)。首先,通过精细化指令与掩码扩充现有编辑数据集,从中筛选出40,000个多样且高质量的样本作为训练集。随后引入像素级相似性奖励,补充基于多模态大模型(MLLM)的奖励,使模型在编辑过程中兼顾编辑质量与内容一致性。为克服奖励的空间无差别性,提出区域正则化器,对高奖励样本保持非编辑区域稳定,对低奖励样本鼓励有效编辑。评估方面,为GEdit-Bench和ImgEdit-Bench标注了编辑掩码,并引入像素级相似性指标衡量内容一致性和编辑质量。将CoCoEdit应用于Qwen-Image-Edit和FLUX-Kontext,不仅取得与先进模型相当的编辑评分,且在PSNR/SSIM指标及人工主观评价中显著提升内容一致性。

原文摘要 · Abstract (English)

Image editing has achieved impressive results with the development of large-scale generative models. However, existing models mainly focus on the editing effects of intended objects and regions, often leading to unwanted changes in unintended regions. We present a post-training framework for Content-Consistent Editing (CoCoEdit) via region regularized reinforcement learning. We first augment existing editing datasets with refined instructions and masks, from which 40K diverse and high quality samples are curated as training set. We then introduce a pixel-level similarity reward to complement MLLM-based rewards, enabling models to ensure both editing quality and content consistency during the editing process. To overcome the spatial-agnostic nature of the rewards, we propose a region-based regularizer, aiming to preserve non-edited regions for high-reward samples while encouraging editing effects for low-reward samples. For evaluation, we annotate editing masks for GEdit-Bench and ImgEdit-Bench, introducing pixel-level similarity metrics to measure content consistency and editing quality. Applying CoCoEdit to Qwen-Image-Edit and FLUX-Kontext, we achieve not only competitive editing scores with state-of-the-art models, but also significantly better content consistency, measured by PSNR/SSIM metrics and human subjective ratings.

图像编辑内容一致强化学习生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。