arXiv:2410.11092cs.CVcs.AI2024-10被引 20

EchoApex是首个通用超声心动图视觉基础模型,可高效处理多种临床任务。

EchoApex: A General-Purpose Vision Foundation Model for Echocardiography

  • 基于自监督学习,在2000万张超声图像上预训练
  • 在28个子任务中表现优于专用模型,准确率提升显著
  • 适合临床研究与医疗AI开发人员使用

超声心动图的定量评估对精准诊断心脏状况、监测疾病进展和指导治疗至关重要。由于探头类型、制造商和病理差异导致图像多样性高,现有AI模型难以跨场景泛化。我们提出EchoApex,首个面向超声心动图的通用视觉基础模型,涵盖多种临床应用。该模型在11家临床中心的超过2000万张图像上通过自监督学习进行预训练。结合任务特定解码器和适配模块,证明其在4类临床任务共28个子任务中的有效性,包括视图分类、结构交互分割、左心室肥厚检测以及从视图序列自动估算射血分数。相比最先进的专用模型,EchoApex采用统一图像编码架构,性能更优,体现了域内大规模预训练的优势。此外,该模型展示了为超声心动图定制通用视觉基础模型的潜力,能够高效且有效地应对多样化的临床需求。

原文摘要 · Abstract (English)

Quantitative evaluation of echocardiography is essential for precise assessment of cardiac condition, monitoring disease progression, and guiding treatment decisions. The diverse nature of echo images, including variations in probe types, manufacturers, and pathologies, poses challenges for developing artificial intelligent models that can generalize across different clinical practice. We introduce EchoApex, the first general-purpose vision foundation model echocardiography with applications on a variety of clinical practice. Leveraging self-supervised learning, EchoApex is pretrained on over 20 million echo images from 11 clinical centres. By incorporating task-specific decoders and adapter modules, we demonstrate the effectiveness of EchoApex on 4 different kind of clinical applications with 28 sub-tasks, including view classification, interactive structure segmentation, left ventricle hypertrophy detection and automated ejection fraction estimation from view sequences. Compared to state-of-the-art task-specific models, EchoApex attains improved performance with a unified image encoding architecture, demonstrating the benefits of model pretraining at scale with in-domain data. Furthermore, EchoApex illustrates the potential for developing a general-purpose vision foundation model tailored specifically for echocardiography, capable of addressing a diverse range of clinical applications with high efficiency and efficacy.

超声心动图基础模型自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。