打造可通用的超声AI基础模型,支持多场景临床应用
A Fully Open and Generalizable Foundation Model for Ultrasound Clinical Applications
- 用自监督学习构建跨设备多中心超声数据集,提升模型泛化能力
- 在10项诊断任务中超越现有模型,450万张图像支撑性能优势
- 开源代码与模型,适合医疗AI研究者快速适配新任务
人工智能若能通过整合多源数据有效学习超声影像表征,将极大推动临床诊疗进步。然而,真实临床环境中大规模标注数据稀缺,且专用模型泛化能力有限,制约了通用超声AI的发展。本研究提出EchoCare——一种面向通用临床应用的超声基础模型,基于我们构建的公开大型数据集EchoCareData,该数据集包含450万张来自五大洲23个国家的超声图像,覆盖多种成像设备和多元人群。不同于采用现成视觉基础模型架构的方法,我们引入分层分类器,实现像素级与表征级特征的联合学习,同时捕捉全局解剖结构与局部超声特性。仅需少量训练,EchoCare在涵盖疾病诊断、病灶分割、器官检测、标志点预测、定量回归、图像增强及报告生成等10个代表性超声基准任务上均优于当前最优模型。代码与预训练模型已公开,支持微调与本地化适配,具备扩展至更多应用场景的能力。EchoCare为多样化临床超声应用提供了完全开放且可泛化的基础模型。
原文摘要 · Abstract (English)
Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However, the scarcity of large labeled datasets in real-world clinical environments and the limited generalizability of task-specific models have hindered the development of generalizable clinical AI models for ultrasound applications. In this study, we present EchoCare, a novel ultrasound foundation model for generalist clinical use, developed via self-supervised learning on our curated, publicly available, large-scale dataset EchoCareData. EchoCareData comprises 4.5 million ultrasound images, sourced from over 23 countries across 5 continents and acquired via a diverse range of distinct imaging devices, thus encompassing global cohorts that are multi-center, multi-device, and multi-ethnic. Unlike prior studies that adopt off-the-shelf vision foundation model architectures, we introduce a hierarchical classifier into EchoCare to enable joint learning of pixel-level and representation-level features, capturing both global anatomical contexts and local ultrasound characteristics. With minimal training, EchoCare outperforms state-of-the-art comparison models across 10 representative ultrasound benchmarks of varying diagnostic difficulties, spanning disease diagnosis, lesion segmentation, organ detection, landmark prediction, quantitative regression, imaging enhancement and report generation. The code and pretrained model are publicly released, rendering EchoCare accessible for fine-tuning and local adaptation, supporting extensibility to additional applications. EchoCare provides a fully open and generalizable foundation model to boost the development of AI technologies for diverse clinical ultrasound applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。