arXiv:2501.08279cs.CV2025-01CVPR被引 27

新方法用被删区域引导图像修复,更准更稳。

SmartEraser: Remove Anything from Images using Masked-Region Guidance

  • 保留被删区域作引导,避免误生成目标物
  • 在复杂场景下修复效果显著优于现有方法
  • 适合需要精准删除且保持上下文的图像编辑任务

物体移除传统上依赖掩码-修复范式,即遮盖区域被排除在输入之外,模型仅依靠未遮盖部分进行修复,缺乏被遮区域的上下文信息,常导致结果不稳定。本文提出SmartEraser,采用新型“被遮区域引导”范式:将被遮区域保留在输入中,作为修复过程的指导。该方法具有三大优势:(a) 引导模型准确识别待删除对象,防止其在输出中重新生成;(b) 用户掩码通常超出物体边界,有助于保留周围上下文;(c) 提升复杂场景下的修复稳定性。基于此,构建了大规模数据集Syn4Removal,利用实例分割数据将物体复制粘贴至图像上作为删除目标,原图作为真实标签。实验表明,SmartEraser显著优于现有方法,在复杂构图场景中表现更优。

原文摘要 · Abstract (English)

Object removal has so far been dominated by the mask-and-inpaint paradigm, where the masked region is excluded from the input, leaving models relying on unmasked areas to inpaint the missing region. However, this approach lacks contextual information for the masked area, often resulting in unstable performance. In this work, we introduce SmartEraser, built with a new removing paradigm called Masked-Region Guidance. This paradigm retains the masked region in the input, using it as guidance for the removal process. It offers several distinct advantages: (a) it guides the model to accurately identify the object to be removed, preventing its regeneration in the output; (b) since the user mask often extends beyond the object itself, it aids in preserving the surrounding context in the final result. Leveraging this new paradigm, we present Syn4Removal, a large-scale object removal dataset, where instance segmentation data is used to copy and paste objects onto images as removal targets, with the original images serving as ground truths. Experimental results demonstrate that SmartEraser significantly outperforms existing methods, achieving superior performance in object removal, especially in complex scenes with intricate compositions.

图像修复目标删除上下文引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。