通过自迭代优化,精准编辑图像目标区域且不破坏其他部分。
SR-Edit: Region-Aware Image Editing via Self-Refinement

- 用模型自身预测逐步细化区域分割,避免依赖外部标注。
- 每轮迭代修正非编辑区,保持生成过程自然性。
- 适合需要高保真图像编辑的科研与设计场景。
随着生成模型的快速发展,图像编辑取得了显著进展,但实现仅精确修改目标区域且严格保留其他区域的忠实编辑仍具挑战。由于实际中难以获取外部区域标注,现有方法尝试自动推断编辑与非编辑区域,并对后者施加一致性约束以提升保留效果。然而,这些方法仍存在区域估计不准和启发式修正策略扭曲原始生成过程的问题,反而引入新伪影。我们提出SR-Edit,一种通过迭代自精炼克服上述问题的图像编辑框架。具体而言,每轮迭代中,SR-Edit首先通过轻量后处理从模型自身预测中提取越来越精确且自洽的区域分离;随后,在非编辑区域通过与原采样动态一致的修正更新实现保留。大量实验表明,相比现有技术,SR-Edit在保留性和整体图像质量上均表现更优。
原文摘要 · Abstract (English)
With the recent rapid progress in generative models, image editing has made remarkable advances, yet achieving faithful edits that precisely modify only the target regions while strictly preserving all other regions remains challenging. Since externally provided region annotations are often difficult to obtain in practice, a growing body of work seeks to improve preservation by automatically inferring edit and non-edit regions, and then enforcing consistency on the latter. However, these approaches still suffer from inaccurate region estimation and heuristic correction strategies that distort the native inference process, making methods designed for fidelity themselves a new source of artifacts. We propose SR-Edit, an image editing framework that overcomes these issues via iterative self-refinement. Specifically, at each iteration, SR-Edit first (i) extracts progressively precise and self-consistent region separation from the model's own predictions by lightweight post-processing, and then (ii) enforces preservation in non-edit areas through correction updates that remain aligned with the original sampling dynamics. Extensive experiments demonstrate that SR-Edit achieves superior preservation and overall image quality compared to existing editing techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。