arXiv:2606.18906cs.CV2026-06

解决多对象图像编辑中的注意力泄漏问题,提升精准度。

BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing

论文配图:BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing
图 1 · 摘自论文原文
  • 通过约束注意力机制,防止不同对象间信号混淆。
  • 在单次扩散过程中实现多对象精准编辑,效果优于现有方法。
  • 适合需要精细控制多个物体的图像编辑场景。

真实图像编辑可实现视觉内容的精确操控,但现有方法在复杂多对象场景中常失败,导致语义融合、对象重复或编辑不完整。我们将其归因于去噪过程中空间区域与文本标记间的注意力泄漏。具体识别出两种泄漏形式:编辑标记泄漏(因模糊的标记-区域对齐导致对象融合)和源主导泄漏(未改变的源对象标记压制目标实体的注意力)。为此,我们提出BindEdit,通过在单个扩散轨迹中施加注意力级约束来解决。为抑制编辑标记泄漏,BindEdit联合正则化交叉注意力与自注意力,使每个目标标记组绑定至对应空间区域并保持实例分离;为抑制源主导泄漏,引入交叉注意力再平衡机制,增强目标标记影响,削弱可编辑区域内的残留源语义。此外,区域保真项确保目标概念在整个编辑掩码内一致表达。我们还构建了一个涵盖多种对象数量与类别的综合性多对象基准。大量实验表明,BindEdit在单次扩散轨迹中持续优于现有方法,且在单对象与多对象编辑场景中均表现稳健。

原文摘要 · Abstract (English)

Real image editing enables precise manipulation of visual content, yet existing methods often fail in complex multi-object scenarios, causing semantic blending, object duplication, or incomplete edits. We attribute these failures to attention leakage, where signals across spatial regions and text tokens become entangled during the denoising process. Specifically, we identify two distinct forms of leakage: Edit-Token Leakage, where ambiguous token-region alignment leads to object blending, and Source Dominance Leakage, where tokens of unchanged source objects overwhelm the attention intended for target entities. To resolve these leakages, we propose \textbf{BindEdit}, which enforces attention-level constraints within a single diffusion trajectory. To suppress Edit-Token Leakage, BindEdit jointly regularizes cross- and self-attention so that each target token group is bound to its corresponding spatial region while maintaining instance-level separation. To suppress Source Dominance Leakage, a cross-attention re-balancing mechanism amplifies target token influence and attenuates residual source semantics within editable regions. Moreover, a region fidelity term ensures that each target concept is expressed coherently across the entire editing mask. Additionally, we propose a comprehensive multi-object benchmark encompassing diverse object counts and categories. Extensive experiments demonstrate that BindEdit consistently outperforms existing methods within a single diffusion trajectory, maintaining robust performance across both single- and multi-object editing scenarios.

图像编辑注意力机制扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。