arXiv:2604.05433cs.CV2026-04被引 3

不用训练,用SAM3+拼图就能实现顶尖少样本分割

Few-Shot Semantic Segmentation Meets SAM3

论文配图:Few-Shot Semantic Segmentation Meets SAM3
图 1 · 摘自论文原文
  • 将支持图与查询图拼接在同一画布,直接调用冻结的SAM3
  • 在PASCAL-5i和COCO-20i上达到最新最好结果
  • 发现负提示反而削弱目标特征,适合轻量级部署场景

少样本语义分割(FSS)旨在仅凭少量标注样本分割新类别。现有方法多依赖大量迭代训练以学习可迁移表征,计算成本高且对分布偏移敏感。本文从现代视觉基础模型视角重新审视FSS,探索将分割一切模型3(SAM3)作为免训练解决方案的潜力。通过复用其可提示概念分割(PCS)能力,采用简单空间拼接策略,将支持图与查询图置于同一画布,使完全冻结的SAM3无需微调或结构改动即可完成分割。在PASCAL-5i和COCO-20i上的实验表明,此最小设计已达当前最优性能,超越诸多复杂设计方法。此外,我们发现负提示在少样本设置中可能适得其反:常削弱目标表征,导致预测崩溃,尽管其初衷是抑制干扰项。这表明,简单的空间构型即可激发强跨图像推理能力,同时也揭示了当前基础模型处理冲突提示信号的局限性。代码见:https://github.com/WongKinYiu/FSS-SAM3

原文摘要 · Abstract (English)

Few-Shot Semantic Segmentation (FSS) focuses on segmenting novel object categories from only a handful of annotated examples. Most existing approaches rely on extensive episodic training to learn transferable representations, which is both computationally demanding and sensitive to distribution shifts. In this work, we revisit FSS from the perspective of modern vision foundation models and explore the potential of Segment Anything Model 3 (SAM3) as a training-free solution. By repurposing its Promptable Concept Segmentation (PCS) capability, we adopt a simple spatial concatenation strategy that places support and query images into a shared canvas, allowing a fully frozen SAM3 to perform segmentation without any fine-tuning or architectural changes. Experiments on PASCAL-$5^i$ and COCO-$20^i$ show that this minimal design already achieves state-of-the-art performance, outperforming many heavily engineered methods. Beyond empirical gains, we uncover that negative prompts can be counterproductive in few-shot settings, where they often weaken target representations and lead to prediction collapse despite their intended role in suppressing distractors. These findings suggest that strong cross-image reasoning can emerge from simple spatial formulations, while also highlighting limitations in how current foundation models handle conflicting prompt signals. Code at: https://github.com/WongKinYiu/FSS-SAM3

少样本分割SAM3零样本视觉模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。