解决密集场景下物体移除时的误匹配问题,提升修复一致性。
DORS: Dynamic Attention Routing for Diffusion-based Object Removal in Dense Scenes

- 动态注意力路由机制,区分目标与相似干扰物
- 在密集场景中减少遗漏移除和重复伪影
- 专为复杂场景设计,适合高精度图像编辑应用
物体移除旨在根据掩码消除指定目标物体,同时保持周围区域视觉一致性。现有方法通常依赖周围区域的上下文信息,但在密集场景中,若周围存在与目标物体视觉相似的实例,这种依赖会引发语义干扰,导致移除不完整。该问题源于自注意力机制中的错误信息传播:被遮蔽的查询因全局相似性匹配而与相似实例对齐。为此,我们提出基于扩散模型的密集场景物体移除框架DORS,其核心为动态注意力路由机制,包含两个互补组件:实例过滤注意力(IFA),通过动态构建掩码引导的注意力约束,抑制来自相似实例的误导性语义信息;上下文引导路由(CGR),动态分配互补场景信息以维持视觉一致性。我们还引入了DOR-Bench,一个面向密集场景物体移除的专用基准测试集。大量实验证明,DORS显著优于现有最优方法,尤其在减少不完整移除和重复伪影方面表现突出。代码将开源于https://github.com/httang1224/DORS。
原文摘要 · Abstract (English)
Object removal aims to eliminate target objects specified by a mask while preserving visual consistency with the surrounding regions. Existing methods typically rely on contextual information from surrounding regions. However, in dense scenes where the surrounding regions contain instances visually similar to the removal target, such reliance often leads to semantic interference, resulting in incomplete removal. This problem arises from erroneous information propagation in the attention space, where masked queries tend to align with such instances due to global similarity matching in self-attention. To address this challenge, we propose a Diffusion-based Object Removal framework for dense Scenes, dubbed DORS, built upon a Dynamic Attention Routing mechanism comprising two complementary components: Instance-Filtered Attention (IFA), which suppresses misleading semantic information from similar instances through dynamically constructed mask-guided attention constraints, and Context-Guided Routing (CGR), which dynamically routes complementary scene information to maintain visual consistency. We further introduce DOR-Bench, a benchmark tailored for object removal in dense scenes. Extensive experiments demonstrate that DORS outperforms state-of-the-art methods, particularly in reducing incomplete removal and duplicate artifacts. The code will be available at https://github.com/httang1224/DORS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。