arXiv:2506.05221cs.CV2025-06被引 5

让SAM模型在医学图像上精准分割,无需训练即可自适应调整。

SAM-aware Test-time Adaptation for Universal Medical Image Segmentation

  • 测试时动态转换单通道医学图像为三通道,匹配SAM输入要求。
  • 利用交并比引导多尺度一致性,提升分割语义对齐效果。
  • 无需微调,在6个灰度数据集上超越全微调模型,适合通用医疗分割场景。

将通用图像分割模型SAM应用于医学图像分割仍面临跨领域适应性差的问题。尽管微调版本如MedSAM在相似模态或器官上表现良好,但在未见数据上泛化能力不足。为此,我们提出SAM感知的测试时自适应框架SAM-TTA,该方法轻量灵活,保留SAM的固有泛化能力的同时提升医学图像分割精度。针对自然图像与医学图像在输入层面(通道不匹配)和语义层面(边界清晰度差异)的差异,SAM-TTA引入两个互补模块:自适应贝塞尔曲线变换(SBCT),通过少量可学习参数在测试时将单通道医学图像转为三通道以适配SAM;IoU引导的多尺度自适应(IMA),利用SAM内置的IoU分数强化输出置信度、双尺度预测一致性及中间特征一致性,实现语义对齐。在八个公开医学图像分割任务(六组灰度、两组内窥镜彩色)上的实验表明,SAM-TTA持续优于当前最优测试时自适应方法。尤其在六个灰度数据集上,其性能甚至超越全微调模型,平均Dice提升4.8%(较MedSAM)和7.4%(较SAM-Med2D),确立了通用医学图像分割的新范式。代码已开源。

原文摘要 · Abstract (English)

Leveraging the Segment Anything Model (SAM) for medical image segmentation remains challenging due to its limited adaptability across diverse medical domains. Although fine-tuned variants, such as MedSAM, improve performance in scenarios similar to the training modalities or organs, they may lack generalizability to unseen data. To overcome this limitation, we propose SAM-aware Test-time Adaptation (SAM-TTA), a lightweight and flexible framework that preserves SAM's inherent generalization ability while enhancing segmentation accuracy for medical images. SAM-TTA tackles two major challenges: (1) input-level discrepancy caused by channel mismatches between natural and medical images, and (2) semantic-level discrepancy due to different object characteristics in natural versus medical images (e.g., with clear boundaries vs. ambiguous structures). To this end, we introduce two complementary components: a self-adaptive Bezier Curve-based Transformation (SBCT), which maps single-channel medical images into SAM-compatible three-channel images via a few learnable parameters to be optimized at test time; and IoU-guided Multi-scale Adaptation (IMA), which leverages SAM's intrinsic IoU scores to enforce high output confidence, dual-scale prediction consistency, and intermediate feature consistency, to improve semantic-level alignments. Extensive experiments on eight public medical image segmentation tasks, covering six grayscale and two color (endoscopic) tasks, demonstrate that SAM-TTA consistently outperforms state-of-the-art test-time adaptation methods. Notably, on six grayscale datasets, SAM-TTA even surpasses fully fine-tuned models, achieving significant Dice improvements (i.e., average 4.8% and 7.4% gains over MedSAM and SAM-Med2D) and establishing a new paradigm for universal medical image segmentation. Code is available at https://github.com/JianghaoWu/SAM-TTA.

医学分割测试时自适应SAM模型轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。