轻量级CNN模型实现高效3D医学图像交互分割,泛化能力强于SAM。
Lightweight Method for Interactive 3D Medical Image Segmentation with Multi-Round Result Fusion
- 基于2D CNN和记忆模块,通过用户提示生成并传播2D掩码至3D序列。
- 多轮结果融合机制提升分割稳定性,减少交互次数,保持高精度。
- 模型轻量化,适合资源受限环境部署,推理效率高。
在医学影像中,精确标注病灶或器官通常需要大量时间。由于3D体数据包含数百甚至数千张切片,标注过程极为耗时。尽管分割一切模型(SAM)因其出色的零样本泛化能力受到关注,但其在医学领域的应用仍面临挑战。本文提出轻量级3D医学图像交互分割网络LIM-Net,基于2D CNN主干网络,从用户提示生成2D提示掩码,并通过记忆模块传播至3D序列。为提升分割稳定性和准确性,引入多轮结果融合(MRF)模块,选择并合并多轮交互中的最优掩码。在多个数据集和模态上的实验表明,LIM-Net性能优异,对未见数据的泛化能力优于基于SAM的模型,且交互次数更少,精度相当。更重要的是,其轻量化设计显著降低显存占用,适用于资源受限环境。该工作为交互式医学图像分割提供了有效替代方案,与SAM形成互补。代码将开源。
原文摘要 · Abstract (English)
In medical imaging, precise annotation of lesions or organs is often required. However, 3D volumetric images typically consist of hundreds or thousands of slices, making the annotation process extremely time-consuming and laborious. Recently, the Segment Anything Model (SAM) has drawn widespread attention due to its remarkable zero-shot generalization capabilities in interactive segmentation. While researchers have explored adapting SAM for medical applications, such as using SAM adapters or constructing 3D SAM models, a key question remains: Can traditional CNN networks achieve the same strong zero-shot generalization in this task? In this paper, we propose the Lightweight Interactive Network for 3D Medical Image Segmentation (LIM-Net), a novel approach demonstrating the potential of compact CNN-based models. Built upon a 2D CNN backbone, LIM-Net initiates segmentation by generating a 2D prompt mask from user hints. This mask is then propagated through the 3D sequence via the Memory Module. To refine and stabilize results during interaction, the Multi-Round Result Fusion (MRF) Module selects and merges optimal masks from multiple rounds. Our extensive experiments across multiple datasets and modalities demonstrate LIM-Net's competitive performance. It exhibits stronger generalization to unseen data compared to SAM-based models, with competitive accuracy while requiring fewer interactions. Notably, LIM-Net's lightweight design offers significant advantages in deployment and inference efficiency, with low GPU memory consumption suitable for resource-constrained environments. These promising results demonstrate LIM-Net can serve as a strong baseline, complementing and contrasting with popular SAM models to further boost effective interactive medical image segmentation. The code will be released at \url{https://github.com/goodtime-123/LIM-Net}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。