arXiv:2511.13714cs.CVcs.AI2025-11被引 4

无需标注数据,就能任意控制分割精细程度。

UnSAMv2: Self-Supervised Learning Enables Segment Anything at Any Granularity

  • 通过自监督学习发现大量掩码与粒度配对,引入粒度控制嵌入。
  • 仅用6000张无标签图像,显著提升SAM-2在11个基准上的性能。
  • 适合需要灵活分割精度的视觉任务,如交互式、全图和视频分割。

Segment Anything Model(SAM)系列已成为广泛应用的视觉基础模型,但其对分割粒度的控制能力有限。用户常需手动调整,通过添加提示或从预生成掩码中选择来获得所需细节,这一过程存在歧义,同一提示可能对应多个合理掩码,而收集所有粒度的密集标注成本过高,使监督方法不可行。为此,我们提出UnSAMv2,实现无需人工标注即可任意粒度分割。UnSAMv2扩展了UnSAM的分治策略,发现大量掩码-粒度配对,并引入新型粒度控制嵌入,实现对分割尺度的精确连续控制。令人惊讶的是,仅使用6,000张无标签图像和0.02%额外参数,UnSAMv2显著提升SAM-2,在交互式、全图及视频分割任务中实现任意粒度分割。在超过11个基准上评估,其NoC_{90}(5.69 → 4.75)、1-IoU(58.0 → 73.1)和AR_{1000}(49.6 → 68.3)均明显改善,表明少量无标签数据结合粒度感知的自监督学习,可充分释放视觉基础模型潜力。

原文摘要 · Abstract (English)

The Segment Anything Model (SAM) family has become a widely adopted vision foundation model, but its ability to control segmentation granularity remains limited. Users often need to refine results manually - by adding more prompts or selecting from pre-generated masks - to achieve the desired level of detail. This process can be ambiguous, as the same prompt may correspond to several plausible masks, and collecting dense annotations across all granularities is prohibitively expensive, making supervised solutions infeasible. To address this limitation, we introduce UnSAMv2, which enables segment anything at any granularity without human annotations. UnSAMv2 extends the divide-and-conquer strategy of UnSAM by discovering abundant mask-granularity pairs and introducing a novel granularity control embedding that enables precise, continuous control over segmentation scale. Remarkably, with only $6$K unlabeled images and $0.02\%$ additional parameters, UnSAMv2 substantially enhances SAM-2, achieving segment anything at any granularity across interactive, whole-image, and video segmentation tasks. Evaluated on over $11$ benchmarks, UnSAMv2 improves $\text{NoC}_{90}$ (5.69 $\rightarrow$ 4.75), 1-IoU (58.0 $\rightarrow$ 73.1), and $\text{AR}_{1000}$ (49.6 $\rightarrow$ 68.3), showing that small amounts of unlabeled data with a granularity-aware self-supervised learning method can unlock the potential of vision foundation models.

分割模型自监督学习粒度控制SAM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。