arXiv:2412.05888cs.CV2024-12中稿 · publication at the…被引 12

轻量医学分割模型,单卡一天训练,性能超越主流方法

MCP-MedSAM: A Powerful Lightweight Medical Segment Anything Model Trained with a Single GPU in Just One Day

  • 设计模态与内容双提示机制,提升分割精度
  • 单张A100 GPU一天完成训练,显存仅40GB
  • 适合资源有限但需高精度医疗图像分割的场景

医学图像分割旨在将图像划分为有意义的区域,重点关注解剖结构和病灶识别,广泛应用于医疗领域。深度学习显著推动了该任务的自动化进展。近期提出的分割任意模型(SAM)作为首个分割基础模型,激发了其在医学领域的适配研究。然而,SAM模型庞大、对显存要求高,限制了其在医学场景中的可扩展性。本文提出MCP-MedSAM,一种强大且轻量的医学专用分割模型,可在单张A100 GPU(40GB显存)上仅用一天完成训练,同时实现优异的分割性能。针对不同模态间差异显著及边界框内需目标信息的问题,引入模态提示与内容提示两种提示方式,经提示编码器处理后,嵌入表示可有效提升性能且不增加训练开销。此外,采用基于模态的数据采样策略缓解模态间数据不平衡问题,确保各模态表现均衡。模型在大规模挑战数据集上训练与评估,相较榜单顶尖方法,表现更优,代码已公开于https://github.com/dong845/MCP-MedSAM。

原文摘要 · Abstract (English)

Medical image segmentation involves partitioning medical images into meaningful regions, with a focus on identifying anatomical structures and lesions. It has broad applications in healthcare, and deep learning methods have enabled significant advancements in automating this process. Recently, the introduction of the Segmentation Anything Model (SAM), the first foundation model for segmentation task, has prompted researchers to adapt it for the medical domain to improve performance across various tasks. However, SAM's large model size and high GPU requirements hinder its scalability and development in the medical domain. In this work, we propose MCP-MedSAM, a powerful and lightweight medical SAM model designed to be trainable on a single A100 GPU with 40GB of memory within one day while delivering superior segmentation performance. Recognizing the significant internal differences between modalities and the need for direct segmentation target information within bounding boxes, we introduce two kinds of prompts: the modality prompt and the content prompt. After passing through the prompt encoder, their embedding representations can further improve the segmentation performance by incorporating more relevant information without adding significant training overhead. Additionally, we adopt an effective modality-based data sampling strategy to address data imbalance between modalities, ensuring more balanced performance across all modalities. Our method was trained and evaluated using a large-scale challenge dataset, compared to top-ranking methods on the challenge leaderboard, MCP-MedSAM achieved superior performance while requiring only one day of training on a single GPU. The code is publicly available at \textcolor{blue}{https://github.com/dong845/MCP-MedSAM}.}

医学分割轻量化模型单卡训练SAM改进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。