arXiv:2602.23759cs.CV2026-02

纯自监督实现高精度图像分割,无需人工标注或预训练模型。

Learning Accurate Segmentation Purely from Self-Supervision

  • 通过自监督特征构建图结构,用NCut进行粗分割。
  • 迭代优化补丁聚类,提升空间一致性和语义一致性。
  • 零样本泛化能力强,适用于伪装物体检测任务。

无任何人工标注的准确物体分割仍是计算机视觉的核心挑战。本文提出Selfment,一种完全自监督的分割框架,直接从原始图像中分割前景物体,无需人工标签、预训练分割模型或后处理。Selfment首先基于自监督特征构建补丁级关联图,并使用NCut获得初始粗粒度前景-背景分离。随后引入迭代补丁优化(IPO),通过迭代补丁聚类逐步增强特征空间中的空间一致性和语义一致性。优化后的掩码作为监督信号,训练轻量级分割头,采用对比学习和区域一致性目标,使模型学习到稳定且可迁移的物体表征。尽管方法简单且无任何人工监督,Selfment在多个基准上达到新SOTA。在ECSSD上对之前无监督显著性检测方法的F_max提升4.0%,HKUIS提升4.6%,PASCAL-S提升5.7%。此外,无需额外微调,Selfment在伪装物体检测任务上表现出色:在CHAMELEON上达到0.910的S_m,CAMO上达到0.792的F_β^ω,优于所有现有无监督方法,甚至媲美最先进的有监督方法。

原文摘要 · Abstract (English)

Accurately segmenting objects without any manual annotations remains one of the core challenges in computer vision. In this work, we introduce Selfment, a fully self-supervised framework that segments foreground objects directly from raw images without human labels, pretrained segmentation models, or any post-processing. Selfment first constructs patch-level affinity graphs from self-supervised features and applies NCut to obtain an initial coarse foreground--background separation. We then introduce Iterative Patch Optimization (IPO), a feature-space refinement procedure that progressively enforces spatial coherence and semantic consistency through iterative patch clustering. The refined masks are subsequently used as supervisory signals to train a lightweight segmentation head with contrastive and region-consistency objectives, allowing the model to learn stable and transferable object representations. Despite its simplicity and complete absence of manual supervision, Selfment sets new state-of-the-art (SoTA) results across multiple benchmarks. It achieves substantial improvements on $F_{\max}$ over previous unsupervised saliency detection methods on ECSSD ($+4.0\%$), HKUIS ($+4.6\%$), and PASCAL-S ($+5.7\%$). Moreover, without any additional fine-tuning, Selfment demonstrates remarkable zero-shot generalization to camouflaged object detection tasks (e.g., $0.910$ $S_m$ on CHAMELEON and $0.792$ $F_β^ω$ on CAMO), outperforming all existing unsupervised approaches and even rivaling the SoTA fully supervised methods.

自监督图像分割零样本无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。