用少量标注数据实现医学图像精准分割,尤其擅长模糊边界识别。
MedSAM-CA: A CNN-Augmented ViT with Attention-Enhanced Multi-Scale Fusion for Medical Image Segmentation
- 融合卷积与注意力机制,增强边界细节恢复能力
- 仅用2%训练数据达全量数据97%性能,显著降低标注依赖
- 适合标注稀缺的临床场景,如皮肤镜、CT、MRI分割
医学图像分割在临床诊断与治疗规划中至关重要,准确的边界划分对病灶定位、器官识别和量化评估不可或缺。近年来深度学习方法显著提升了分割精度,但两大挑战仍存:一是模型性能严重依赖大规模标注数据,而医疗数据因隐私和标注成本难获取;二是低对比度、恶性病变导致的边界模糊等临床难题仍影响分割效果。为此,本文提出MedSAM-CA,一种基于预训练模型Medical Segment Anything(MedSAM)的架构级微调方法,减少对人工标注的依赖。该方法引入两个核心组件:并行于MedSAM编码器的卷积注意力增强边界精修网络(CBR-Net),通过分层卷积处理恢复长距离注意力机制遗漏的边界信息;嵌入解码器的注意力增强特征融合块(Atte-FFB),融合CBR-Net跳接路径中的多尺度细粒度特征与解码器上采样的全局表征,提升边界精度。在涵盖皮肤镜、CT、MRI的公开数据集上验证了有效性:在皮肤镜数据集上仅使用2%训练数据即达94.43% Dice,相当于全量数据训练性能的97.25%,证明其在低资源临床场景下的强有效性。
原文摘要 · Abstract (English)
Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning, where accurate boundary delineation is essential for precise lesion localization, organ identification, and quantitative assessment. In recent years, deep learning-based methods have significantly advanced segmentation accuracy. However, two major challenges remain. First, the performance of these methods heavily relies on large-scale annotated datasets, which are often difficult to obtain in medical scenarios due to privacy concerns and high annotation costs. Second, clinically challenging scenarios, such as low contrast in certain imaging modalities and blurry lesion boundaries caused by malignancy, still pose obstacles to precise segmentation. To address these challenges, we propose MedSAM-CA, an architecture-level fine-tuning approach that mitigates reliance on extensive manual annotations by adapting the pretrained foundation model, Medical Segment Anything (MedSAM). MedSAM-CA introduces two key components: the Convolutional Attention-Enhanced Boundary Refinement Network (CBR-Net) and the Attention-Enhanced Feature Fusion Block (Atte-FFB). CBR-Net operates in parallel with the MedSAM encoder to recover boundary information potentially overlooked by long-range attention mechanisms, leveraging hierarchical convolutional processing. Atte-FFB, embedded in the MedSAM decoder, fuses multi-level fine-grained features from skip connections in CBR-Net with global representations upsampled within the decoder to enhance boundary delineation accuracy. Experiments on publicly available datasets covering dermoscopy, CT, and MRI imaging modalities validate the effectiveness of MedSAM-CA. On dermoscopy dataset, MedSAM-CA achieves 94.43% Dice with only 2% of full training data, reaching 97.25% of full-data training performance, demonstrating strong effectiveness in low-resource clinical settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。