arXiv:2510.17484cs.CV2025-10

无需标注数据,用双聚类与最优传输生成精准显著性掩码。

Split-Fuse-Transport: Annotation-Free Saliency via Dual Clustering and Optimal Transport Alignment

  • 分治融合:高熵像素用谱聚类,低熵用k-means,再通过最优传输对齐。
  • 在5个基准上,比无监督方法最高提升36%的F-measure。
  • 适合追求高精度无标注显著性检测的研究者和工程应用。

显著性物体检测(SOD)旨在分割图像中视觉突出区域,是多种计算机视觉任务的基础。我们提出,当存在可靠伪掩码时,SOD可达到接近有监督的精度,且无需任何像素级标签。重新审视基于原型的方法,发现边界像素与内部像素具有显著不同的几何特性;同时,若原型质量较差,全局一致性约束的最优传输(OT)难以发挥效用。为此,我们提出POTNet,一种改进的原型最优传输框架,将POT的单一k-means步骤替换为熵引导的双聚类头:高熵像素由谱聚类组织,低熵像素由k-means处理,两组原型随后通过OT对齐。该分-融-传输设计可在单次前向传播中生成更清晰、具备局部感知能力的伪掩码,无需人工先验。这些掩码用于监督标准的MaskFormer风格编码器-解码器,构建出AutoSOD——一个端到端的无监督SOD流程,取代SelfMask的离线投票机制,同时提升准确率与训练效率。在五个基准上的大量实验表明,AutoSOD相比无监督方法最高提升26%、弱监督方法最高提升36%的F-measure,进一步缩小了与全监督模型的差距。

原文摘要 · Abstract (English)

Salient object detection (SOD) aims to segment visually prominent regions in images and serves as a foundational task for various computer vision applications. We posit that SOD can now reach near-supervised accuracy without a single pixel-level label, but only when reliable pseudo-masks are available. We revisit the prototype-based line of work and make two key observations. First, boundary pixels and interior pixels obey markedly different geometry; second, the global consistency enforced by optimal transport (OT) is underutilized if prototype quality is weak. To address this, we introduce POTNet, an adaptation of Prototypical Optimal Transport that replaces POT's single k-means step with an entropy-guided dual-clustering head: high-entropy pixels are organized by spectral clustering, low-entropy pixels by k-means, and the two prototype sets are subsequently aligned by OT. This split-fuse-transport design yields sharper, part-aware pseudo-masks in a single forward pass, without handcrafted priors. Those masks supervise a standard MaskFormer-style encoder-decoder, giving rise to AutoSOD, an end-to-end unsupervised SOD pipeline that eliminates SelfMask's offline voting yet improves both accuracy and training efficiency. Extensive experiments on five benchmarks show that AutoSOD outperforms unsupervised methods by up to 26% and weakly supervised methods by up to 36% in F-measure, further narrowing the gap to fully supervised models.

显著性检测无监督学习最优传输双聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。