arXiv:2511.19425cs.CV2025-11被引 8

SAM3-Adapter让大模型精准分割隐身物体、阴影和医学图像。

SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentation

  • 为SAM3设计专用适配器,提升细粒度分割能力。
  • 在医学影像、隐身物体等任务上刷新最佳性能纪录。
  • 高效轻量,适合医疗、安防等实际场景部署。

大规模基础模型的兴起重塑了图像分割领域,如Segment Anything实现了跨任务的惊人泛化能力。然而,前代模型(包括SAM及其后续版本)在伪装物体检测、医学图像分割、细胞图像分割和阴影检测等低级细粒度任务上仍表现不佳。为此,我们于2023年首次提出SAM-Adapter,显著提升了这些难题的性能。随着Segment Anything 3(SAM3)——一个架构更优、训练更高效的进化版本出现——我们重新审视这些长期挑战。本文提出SAM3-Adapter,首个专为SAM3设计的适配框架,充分释放其分割潜力。SAM3-Adapter不仅降低计算开销,还在多个下游任务中持续超越SAM与SAM2基线方案,建立新基准,涵盖医学影像、伪装物体分割及阴影检测。基于原始SAM-Adapter的模块化设计,SAM3-Adapter具备更强泛化性、更丰富的任务适应能力与显著提升的分割精度。大量实验表明,融合SAM3与本适配器相较所有先前方案,在准确率、鲁棒性和效率上均表现更优。代码、预训练模型与数据处理流程已公开。

原文摘要 · Abstract (English)

The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous generations-including SAM and its successor-still struggle with fine-grained, low-level segmentation challenges such as camouflaged object detection, medical image segmentation, cell image segmentation, and shadow detection. To address these limitations, we originally proposed SAM-Adapter in 2023, demonstrating substantial gains on these difficult scenarios. With the emergence of Segment Anything 3 (SAM3)-a more efficient and higher-performing evolution with a redesigned architecture and improved training pipeline-we revisit these long-standing challenges. In this work, we present SAM3-Adapter, the first adapter framework tailored for SAM3 that unlocks its full segmentation capability. SAM3-Adapter not only reduces computational overhead but also consistently surpasses both SAM and SAM2-based solutions, establishing new state-of-the-art results across multiple downstream tasks, including medical imaging, camouflaged (concealed) object segmentation, and shadow detection. Built upon the modular and composable design philosophy of the original SAM-Adapter, SAM3-Adapter provides stronger generalizability, richer task adaptability, and significantly improved segmentation precision. Extensive experiments confirm that integrating SAM3 with our adapter yields superior accuracy, robustness, and efficiency compared to all prior SAM-based adaptations. We hope SAM3-Adapter can serve as a foundation for future research and practical segmentation applications. Code, pre-trained models, and data processing pipelines are available.

图像分割SAM3医学影像伪装检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。