通过显式分离前景与背景,提升无监督场景分解的准确性。
Unsupervised Structural Scene Decomposition via Foreground-Aware Slot Attention with Pseudo-Mask Guidance
- 分两阶段处理:先粗分前景背景,再聚焦前景对象
- 引入伪掩码引导,减少前景过分割问题
- 适合需要精准物体发现的视觉理解任务
近期基于槽注意力的对象中心表示学习表明,无需监督即可将视觉场景分解为对象槽表示。然而,现有方法通常不区分前景与背景,导致背景干扰,真实数据上实例发现性能不佳。为此,我们提出前景感知槽注意力(FASA),一种两阶段框架,显式分离前景与背景以实现精确物体发现。第一阶段通过双槽竞争机制粗略分解场景,区分前景与背景区域,槽初始化采用聚类策略,生成显著区域的结构化表示。第二阶段引入掩码槽注意力机制,首个槽捕捉背景,其余槽竞争表示各个前景对象。为缓解前景过分割,我们利用自监督图像特征构建的补丁亲和图生成伪掩码引导,指导前景槽学习。在合成与真实数据集上的大量实验表明,FASA持续优于现有最先进方法,验证了显式前景建模与伪掩码引导在鲁棒场景分解与物体一致表示中的有效性。代码将公开。
原文摘要 · Abstract (English)
Recent advances in object-centric representation learning have shown that slot attention-based methods can effectively decompose visual scenes into object slot representations without supervision. However, existing approaches typically process foreground and background regions indiscriminately, often resulting in background interference and suboptimal instance discovery performance on real-world data. To address this limitation, we propose Foreground-Aware Slot Attention (FASA), a two-stage framework that explicitly separates foreground from background to enable precise object discovery. In the first stage, FASA performs a coarse scene decomposition to distinguish foreground from background regions through a dual-slot competition mechanism. These slots are initialized via a clustering-based strategy, yielding well-structured representations of salient regions. In the second stage, we introduce a masked slot attention mechanism where the first slot captures the background while the remaining slots compete to represent individual foreground objects. To further address over-segmentation of foreground objects, we incorporate pseudo-mask guidance derived from a patch affinity graph constructed with self-supervised image features to guide the learning of foreground slots. Extensive experiments on both synthetic and real-world datasets demonstrate that FASA consistently outperforms state-of-the-art methods, validating the effectiveness of explicit foreground modeling and pseudo-mask guidance for robust scene decomposition and object-coherent representation. Code will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。