对比4种超声基础模型,发现预训练方式显著影响胎儿切面分类效果。
Benchmarking Ultrasound Foundation Models for Fetal Plane Classification
- 用西班牙和非洲数据集跨人群评估4种超声基础模型与传统CNN、ViT的性能。
- FetalCLIP在零样本线性探测中表现最优,外域测试F1达0.9731。
- 不同预训练目标导致迁移能力差异大,选型关键看下游任务适配性。
超声在产科中广泛应用,因其安全、易获取且可实时成像。但其解读仍依赖操作者,易受噪声和伪影影响。深度学习虽有潜力解决此问题,但通常需大量标注数据,而临床超声数据难以获取。基础模型(FMs)提供替代方案,利用大量超声图像学习可迁移表征,以少量标注数据实现泛化。本文对胎儿切面分类任务进行了全面基准测试,评估了四种超声专用基础模型(USFM、MOFO、UltraSAM、FetalCLIP),并与两种卷积网络基线(ResNet50、EfficientNet-V2)及一个在自然图像上预训练的ViT(DINOv3)进行比较。所有模型均在西班牙胎儿超声数据集上采用5折患者级交叉验证训练,并在同域数据和外部非洲队列上测试,以评估跨人群泛化能力。结果表明:在线性探测设置下,FetalCLIP表现最佳(同域F1=0.9261,异域F1=0.9731);在全微调设置下,USFM表现最优(同域F1=0.9476,异域F1=0.9515)。MOFO与UltraSAM在两种设置下均退化严重,部分情况下甚至不如自然图像预训练模型。研究揭示,预训练模型的选择对胎儿切面分类性能影响显著,因不同预训练目标导致迁移能力差异。
原文摘要 · Abstract (English)
Ultrasound is widely used in obstetric care due to its safety, accessibility, and real-time imaging. However, interpretation remains operator-dependent and susceptible to noise and artifacts. Deep learning models have shown strong performance to solve these problem, but they typically require large annotated datasets that are difficult to obtain in clinical ultrasound. Foundation models (FMs) offer an alternative, using a large number of ultrasound images to learn transferable representations that can generalize with limited labeled data. This work presents a comprehensive benchmark of ultrasound-specific FMs for fetal plane classification. We evaluated four ultrasound FMs (USFM, MOFO, UltraSAM, FetalCLIP) against two CNN baselines (ResNet50, EfficientNet-V2) and a ViT (DINOv3) pretrained on natural images. We trained all models under two complementary settings: full fine-tuning and linear probing with a frozen encoder. All models were trained using 5-fold patient-level cross-validation on a Spanish fetal ultrasound dataset and tested on both in-domain data and an external African cohort to assess cross-population generalization. We found that FetalCLIP achieved the best results in the linear probing setting (F1 = 0.9261 for in-domain, F1 = 0.9731 for out-of-domain), while USFM performed best in the full fine-tuning setting (F1 = 0.9476 for in-domain, F1 = 0.9515 for out-of-domain). MOFO and UltraSAM degraded most in both settings, underperforming natural image pretrained models in some cases. These findings highlight how the choice of pretrained model strongly affects fetal plane classification performance, since different pretraining objectives lead to different levels of transferability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。