arXiv:2601.15759cs.CVcs.LG2026-01被引 2

FeTal-SAM无需重训练即可灵活分割胎儿脑MRI,支持任意结构标注。

Atlas-Assisted Segment Anything Model for Fetal Brain MRI (FeTal-SAM)

  • 用多模板配准生成空间对齐的提示,结合SAM实现可配置分割
  • 在两个数据集上对高对比结构达顶尖性能,平均Dice接近基准模型
  • 适合需要快速切换解剖定义的临床与研究场景

本文提出FeTal-SAM,一种专为胎儿脑MRI分割设计的Segment Anything Model新变体。传统深度学习方法需大量标注数据且标签固定,难以适应变化需求。通过融合基于模板的提示与基础模型理念,FeTal-SAM解决了两大问题:一是无需重训练即可应对不同标签定义;二是区分分割是依赖真实图像对比度还是学习的空间先验。利用多模板配准生成空间对齐的标签模板作为密集提示,配合边界框提示,输入SAM分割解码器,实现逐结构二值分割,再融合重建完整3D分割体积。在dHCP数据集和自建数据集上的评估表明,其对皮层板、小脑等高对比结构的分割性能与针对特定标签训练的顶尖基线相当,而对低对比结构(如海马、杏仁核)略有下降。结果表明,该方法无需反复训练,即可灵活分割任意用户指定解剖结构,具有成为通用胎儿脑影像分析工具的潜力。

原文摘要 · Abstract (English)

This paper presents FeTal-SAM, a novel adaptation of the Segment Anything Model (SAM) tailored for fetal brain MRI segmentation. Traditional deep learning methods often require large annotated datasets for a fixed set of labels, making them inflexible when clinical or research needs change. By integrating atlas-based prompts and foundation-model principles, FeTal-SAM addresses two key limitations in fetal brain MRI segmentation: (1) the need to retrain models for varying label definitions, and (2) the lack of insight into whether segmentations are driven by genuine image contrast or by learned spatial priors. We leverage multi-atlas registration to generate spatially aligned label templates that serve as dense prompts, alongside a bounding-box prompt, for SAM's segmentation decoder. This strategy enables binary segmentation on a per-structure basis, which is subsequently fused to reconstruct the full 3D segmentation volumes. Evaluations on two datasets, the dHCP dataset and an in-house dataset demonstrate FeTal-SAM's robust performance across gestational ages. Notably, it achieves Dice scores comparable to state-of-the-art baselines which were trained for each dataset and label definition for well-contrasted structures like cortical plate and cerebellum, while maintaining the flexibility to segment any user-specified anatomy. Although slightly lower accuracy is observed for subtle, low-contrast structures (e.g., hippocampus, amygdala), our results highlight FeTal-SAM's potential to serve as a general-purpose segmentation model without exhaustive retraining. This method thus constitutes a promising step toward clinically adaptable fetal brain MRI analysis tools.

胎儿脑医学图像分割模型零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。