arXiv:2507.14613cs.CV2025-07被引 4

用轻量适配器让SAM2高效追踪医学视频目标,小数据也能高精度

Depthwise-Dilated Convolutional Adapters for Medical Object Tracking and Segmentation Using the Segment Anything Model 2

  • 设计深度膨胀适配器,低参数量增强多尺度特征提取
  • 在肿瘤分割和心室追踪任务中分别达0.93和0.97的Dice分数
  • 首次系统探索适配器优化SAM2用于医学视频追踪,适合医疗视觉研究者

近期医学图像分割进展主要依赖深度学习,但多数方法受限于模态特异性设计,在动态医学成像场景中适应性差。基于流式记忆机制的Segment Anything Model 2(SAM2)为基于提示的通用解决方案提供了新可能。然而,将此类模型适配至医学视频通常需大规模数据重训练或迁移学习,带来高计算成本与灾难性遗忘风险。为此,我们提出DD-SAM2,一种高效适配框架,引入深度膨胀适配器(DD-Adapter),以极小参数开销提升多尺度特征提取能力,实现仅用少量训练数据对SAM2进行有效微调。与仅关注静态图像的现有适配方法不同,DD-SAM2充分利用SAM2的流式记忆机制,实现医学视频目标跟踪与分割。在TrackRad2025(肿瘤分割)和EchoNet-Dynamic(左心室追踪)数据集上的全面评估表明,该方法性能优越,分别取得0.93和0.97的Dice分数。据我们所知,这是首个系统探索适配器优化SAM2用于医学视频分割与追踪的工作。代码、数据集及模型将公开于https://github.com/apple1986/DD-SAM2。

原文摘要 · Abstract (English)

Recent advances in medical image segmentation have been driven by deep learning; however, most existing methods remain limited by modality-specific designs and exhibit poor adaptability to dynamic medical imaging scenarios. The Segment Anything Model 2 (SAM2) and its related variants, which introduce a streaming memory mechanism for real-time video segmentation, present new opportunities for prompt-based, generalizable solutions. Nevertheless, adapting these models to medical video scenarios typically requires large-scale datasets for retraining or transfer learning, leading to high computational costs and the risk of catastrophic forgetting. To address these challenges, we propose DD-SAM2, an efficient adaptation framework for SAM2 that incorporates a Depthwise-Dilated Adapter (DD-Adapter) to enhance multi-scale feature extraction with minimal parameter overhead. This design enables effective fine-tuning of SAM2 on medical videos with limited training data. Unlike existing adapter-based methods focused solely on static images, DD-SAM2 fully exploits SAM2's streaming memory for medical video object tracking and segmentation. Comprehensive evaluations on TrackRad2025 (tumor segmentation) and EchoNet-Dynamic (left ventricle tracking) datasets demonstrate superior performance, achieving Dice scores of 0.93 and 0.97, respectively. To the best of our knowledge, this work provides an initial attempt at systematically exploring adapter-based SAM2 fine-tuning for medical video segmentation and tracking. Code, datasets, and models will be publicly available at https://github.com/apple1986/DD-SAM2.

医学图像视频分割SAM2适配器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。