arXiv:2601.00537cs.CV2026-01中稿 · IEEE TIP被引 3

提升SAM在低对比度场景的分割能力,保持零样本泛化性

Boosting Segment Anything Model to Generalize Visually Non-Salient Scenarios

  • 通过边缘令牌交互与非显著特征挖掘,增强低层特征利用
  • 在3.5万张图像数据集上实现零样本分割性能显著提升
  • 仅增加少量参数,4小时可完成训练,适合实际部署

Segment Anything Model(SAM)虽具备出色的零样本分割能力,但在低对比度的视觉非显著场景中表现受限,难以准确捕捉边界。本文提出VNS-SAM,通过掩码-边缘令牌交互解码器和非显著特征挖掘模块,有效利用SAM的低层特征,在几乎不增加参数和计算量的前提下,提升了对非显著特征的理解能力。新增参数可在4小时内完成优化,具备实用性。为此构建了包含超3.5万张图像的统一数据集VNS-SEG,用于系统评估模型在各类非显著场景下的分割性能与泛化能力。大量实验表明,VNS-SAM在多种零样本分割任务中均表现优异,展现出广阔的实际应用前景。代码与数据集已公开。

原文摘要 · Abstract (English)

Segment Anything Model (SAM), known for its remarkable zero-shot segmentation capabilities, has garnered significant attention in the community. Nevertheless, its performance is challenged when dealing with what we refer to as visually non-salient scenarios, where there is low contrast between the foreground and background. In these cases, existing methods often cannot capture accurate contours and fail to produce promising segmentation results. In this paper, we propose Visually Non-Salient SAM (VNS-SAM), aiming to enhance SAM's perception of visually non-salient scenarios while preserving its original zero-shot generalizability. We achieve this by effectively exploiting SAM's low-level features through two designs: Mask-Edge Token Interactive decoder and Non-Salient Feature Mining module. These designs help the SAM decoder gain a deeper understanding of non-salient characteristics with only marginal parameter increments and computational requirements. The additional parameters of VNS-SAM can be optimized within 4 hours, demonstrating its feasibility and practicality. In terms of data, we established VNS-SEG, a unified dataset for various VNS scenarios, with more than 35K images, in contrast to previous single-task adaptations. It is designed to make the model learn more robust VNS features and comprehensively benchmark the model's segmentation performance and generalizability on VNS scenarios. Extensive experiments across various VNS segmentation tasks demonstrate the superior performance of VNS-SAM, particularly under zero-shot settings, highlighting its potential for broad real-world applications. Codes and datasets are publicly available at https://guangqian-guo.github.io/VNS-SAM.

分割模型零样本低对比度SAM改进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。