arXiv:2507.23755cs.CV2025-07中稿 · ACM MM 2025被引 13

通过重初始化与自蒸馏,提升对象中心学习的物体分割精度。

Slot Attention with Re-Initialization and Self-Distillation

  • 引入槽位重初始化,消除冗余槽位干扰。
  • 利用首轮注意力图逼近末轮效果,实现自蒸馏监督。
  • 在物体发现与识别任务上达到新最佳性能。

不同于基于密集特征图的主流方法,对象中心学习(OCL)将视觉场景表示为子符号级的对象特征向量(称为槽位),在涉及视觉模态的任务中具有高度灵活性。传统OCL通过迭代应用竞争性交叉注意力(称为槽位注意力)将对象超像素聚合到槽位中,以槽位作为查询。然而,槽位一旦初始化便被重复使用,导致冗余槽位与有效槽位竞争表示对象,常造成物体被错误分割成部分。此外,主流方法仅从解码槽位重建输入来获取监督信号,忽略了内部信息的潜在监督价值。为此,我们提出带有重初始化与自蒸馏的槽位注意力(DIAS):i)减少聚合槽位冗余,并对多余聚合进行重初始化以更新剩余槽位;ii)驱动首轮聚合中的劣质注意力图逼近末轮的优质注意力图,实现自蒸馏。实验表明,DIAS在物体发现、识别等OCL任务上达到当前最优表现,同时提升了高级视觉预测与推理能力。代码与模型检查点已公开于 https://github.com/Genera1Z/DIAS。

原文摘要 · Abstract (English)

Unlike popular solutions based on dense feature maps, Object-Centric Learning (OCL) represents visual scenes as sub-symbolic object-level feature vectors, termed slots, which are highly versatile for tasks involving visual modalities. OCL typically aggregates object superpixels into slots by iteratively applying competitive cross attention, known as Slot Attention, with the slots as the query. However, once initialized, these slots are reused naively, causing redundant slots to compete with informative ones for representing objects. This often results in objects being erroneously segmented into parts. Additionally, mainstream methods derive supervision signals solely from decoding slots into the input's reconstruction, overlooking potential supervision based on internal information. To address these issues, we propose Slot Attention with re-Initialization and self-Distillation (DIAS): $\emph{i)}$ We reduce redundancy in the aggregated slots and re-initialize extra aggregation to update the remaining slots; $\emph{ii)}$ We drive the bad attention map at the first aggregation iteration to approximate the good at the last iteration to enable self-distillation. Experiments demonstrate that DIAS achieves state-of-the-art on OCL tasks like object discovery and recognition, while also improving advanced visual prediction and reasoning. Our source code and model checkpoints are available on https://github.com/Genera1Z/DIAS.

对象中心学习注意力机制自蒸馏物体分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。