arXiv:2607.21318cs.CVcs.AI2026-07

无需用户指定区域,实现精准物体替换与背景保留。

PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing

论文配图:PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing
图 1 · 摘自论文原文
  • 通过提示对比捕捉语义差异,直接定位需编辑区域。
  • 在去噪过程中联合发现源移除与目标生成区域,提升编辑完整性。
  • 每步采样动态保护无关内容,适合复杂场景的零样本编辑。

将一个物体替换为类别或形状不同的物体,需要完全移除源对象、不受源轮廓限制地自然形成目标对象,同时保持无关内容不变。现有无训练编辑方法要么从源/目标提示的最终预测中定位编辑区域,要么通过非选择性地复用源特征来保留背景内容,缺乏显式区域发现。在到达最终预测前,提示引起的语义差异会经过额外网络变换,可能模糊其空间定位,降低精度;非选择性特征复用则在编辑完整性和背景保留之间产生权衡。为此,我们提出PC-Edit,一种用于无训练多模态扩散图像编辑的提示对比框架。PC-Edit对比源提示和目标提示下的图像标记注意力输出,直接在文本条件信息传递至图像标记的位置捕捉提示引发的语义差异。该对比同时识别反演阶段的源擦除区域和去噪阶段的目标生成区域,二者并集可抑制源残留,同时允许目标自然形成。此外,PC-Edit在每个采样步骤中通过前序注意力块估计当前编辑区域,并在后续块中立即注入缓存的源键值对(K/V)特征以保护该区域外的内容,从而在潜在表示更新前即实现背景保护。在PIE-Bench和我们提出的EditRegion-Bench上的实验,包含单/多对象添加与替换的人工验证编辑区域标注,表明PC-Edit在无用户指定编辑区域的方法中,取得了最佳的编辑质量和背景保留效果。

原文摘要 · Abstract (English)

Replacing an object with one that differs in category or shape requires complete source removal, natural target formation unconstrained by the source silhouette, and preservation of unrelated content. Existing training-free editors either localize edits from terminal predictions under source and target prompts or preserve unrelated content through spatially unselective source-feature reuse without explicit region discovery. Before reaching the terminal predictions, prompt-induced semantic differences undergo additional network transformations that may obscure their spatial localization, reducing localization precision. Spatially unselective feature reuse forces a trade-off between edit completeness and background preservation. Therefore, we propose PC-Edit, a prompt-contrastive framework for training-free MM-DiT editing. PC-Edit contrasts the image-token attention outputs under the source and target prompts, capturing prompt-induced semantic differences directly where text-conditioned information is delivered to image tokens. The same contrast identifies a source-erasure region during inversion and a target-emergence region during denoising. Their union suppresses source remnants while allowing the target object to form naturally. PC-Edit further couples region discovery and background preservation within each sampling step by estimating the current edit region from preceding attention blocks and immediately injecting cached source K/V features outside it in subsequent blocks, thereby protecting unrelated content before the latent update. Experiments on PIE-Bench and our EditRegion-Bench, with human-verified edit-region annotations for single- and multi-object addition and replacement, show that PC-Edit achieves the best editing quality and background preservation among methods without user-specified edit regions.

图像编辑扩散模型提示对比零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。