arXiv:2604.00549cs.CV2026-04中稿 · CVPR

不训练也能精准识别多图中共同显著物体,效果远超现有方法。

TF-SSD: A Strong Pipeline via Synergic Mask Filter for Training-free Co-salient Object Detection

  • 用SAM生成候选掩码,再通过DINO注意力筛选关键区域。
  • 在多个数据集上提升13.7%,超越最新无训练方法。
  • 适合追求高效、无需训练的显著目标检测场景。

共显著物体检测(CoSOD)旨在分割一组相关图像中一致出现的显著物体。尽管近期基于训练的方法取得显著进展,但仍受限于封闭集数据集,泛化能力有限。然而,很少有研究探索视觉基础模型(VFMs)在CoSOD中的潜力,而这些模型展现出强大的泛化能力和鲁棒的显著性理解。本文首次研究并利用VFMs进行CoSOD,提出一种新颖的无训练方法TF-SSD,通过SAM与DINO的协同作用实现。首先,使用SAM生成全面的原始候选掩码,构成候选掩码池;随后,设计一个质量掩码生成器过滤冗余掩码,获得精炼掩码集。由于该生成器基于SAM,缺乏语义显著性理解,因此引入一种图像内显著性滤波器,利用DINO的注意力图识别单张图像内的视觉显著掩码。此外,为扩展跨图像的显著性理解,提出一种图像间原型选择器,计算跨图像原型间的相似度得分,选出得分最高的掩码作为最终预测。大量实验表明,我们的TF-SSD在多个基准上优于现有方法,例如相比最近的无训练方法提升13.7%。代码已开源:https://github.com/hzz-yy/TF-SSD。

原文摘要 · Abstract (English)

Co-salient Object Detection (CoSOD) aims to segment salient objects that consistently appear across a group of related images. Despite the notable progress achieved by recent training-based approaches, they still remain constrained by the closed-set datasets and exhibit limited generalization. However, few studies explore the potential of Vision Foundation Models (VFMs) to address CoSOD, which demonstrate a strong generalized ability and robust saliency understanding. In this paper, we investigate and leverage VFMs for CoSOD, and further propose a novel training-free method, TF-SSD, through the synergy between SAM and DINO. Specifically, we first utilize SAM to generate comprehensive raw proposals, which serve as a candidate mask pool. Then, we introduce a quality mask generator to filter out redundant masks, thereby acquiring a refined mask set. Since this generator is built upon SAM, it inherently lacks semantic understanding of saliency. To this end, we adopt an intra-image saliency filter that employs DINO's attention maps to identify visually salient masks within individual images. Moreover, to extend saliency understanding across group images, we propose an inter-image prototype selector, which computes similarity scores among cross-image prototypes to select masks with the highest score. These selected masks serve as final predictions for CoSOD. Extensive experiments show that our TF-SSD outperforms existing methods (e.g., 13.7\% gains over the recent training-free method). Codes are available at https://github.com/hzz-yy/TF-SSD.

显著物体检测无训练视觉模型掩码筛选

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。