arXiv:2509.15874cs.CV2025-09CVPR被引 2

轻量级3D医学图像分割模型,支持交互式操作且训练快。

ENSAM: an efficient foundation model for interactive segmentation of 3D medical images

  • 基于SegResNet的U-Net结构,融合提示编码与归一化注意力机制。
  • 单卡6小时完成5000例多模态数据训练,最终DSC达0.627。
  • 适合算力有限场景,无需预训练权重也能表现优异。

我们提出ENSAM(等变、归一化、通用分割模型),一种轻量级且可提示的3D医学图像通用分割模型。ENSAM采用基于SegResNet的编码器,结合提示编码器与掩码解码器,构建类U-Net架构,引入潜在交叉注意力、相对位置编码、归一化注意力及Muon优化器进行训练。该模型专为小样本和低算力环境设计,在单块32 GB GPU上仅用6小时,从少于5,000个来自多种模态(CT、MRI、PET、超声、显微)的体积数据中从零开始训练。在CVPR 2025基础模型交互式3D生物医学图像分割挑战赛的隐藏测试集上,其获得DSC AUC为2.404,NSD AUC为2.266,最终DSC为0.627,最终NSD为0.597,优于两个已有基线模型(VISTA3D、SAM-Med3D),与第三个(SegVol)相当,最终DSC更优但其余三项指标稍逊。在核心集赛道中,排名10进5,是未使用预训练权重方法中的最佳。消融实验表明,相对位置编码与Muon优化器均显著加速收敛并提升分割质量。

原文摘要 · Abstract (English)

We present ENSAM (Equivariant, Normalized, Segment Anything Model), a lightweight and promptable model for universal 3D medical image segmentation. ENSAM combines a SegResNet-based encoder with a prompt encoder and mask decoder in a U-Net-style architecture, using latent cross-attention, relative positional encoding, normalized attention, and the Muon optimizer for training. ENSAM is designed to achieve good performance under limited data and computational budgets, and is trained from scratch on under 5,000 volumes from multiple modalities (CT, MRI, PET, ultrasound, microscopy) on a single 32 GB GPU in 6 hours. As part of the CVPR 2025 Foundation Models for Interactive 3D Biomedical Image Segmentation Challenge, ENSAM was evaluated on hidden test set with multimodal 3D medical images, obtaining a DSC AUC of 2.404, NSD AUC of 2.266, final DSC of 0.627, and final NSD of 0.597, outperforming two previously published baseline models (VISTA3D, SAM-Med3D) and matching the third (SegVol), surpassing its performance in final DSC but trailing behind in the other three metrics. In the coreset track of the challenge, ENSAM ranks 5th of 10 overall and best among the approaches not utilizing pretrained weights. Ablation studies confirm that our use of relative positional encodings and the Muon optimizer each substantially speed up convergence and improve segmentation quality.

3D分割轻量模型医学图像交互分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。