用视觉模型模拟心脏超声医生,自动测量左心室关键指标
Think as Cardiac Sonographers: Marrying SAM with Left Ventricular Indicators Measurements According to Clinical Guidelines
- 结合SAM模型与关键点定位,同步完成分割与解剖点识别
- 在超声数据集上实现符合临床指南的左心室指标测量
- 适合医学影像分析、智能超声辅助诊断的研究者使用
根据临床超声心动图指南进行左心室(LV)指标测量对心血管疾病诊断至关重要。尽管现有算法已尝试实现自动化LV量化,但由于训练数据量通常较小,难以捕捉通用视觉表征。因此,引入具备丰富先验知识的视觉基础模型(VFM)尤为必要。然而,以分割任何模型(SAM)为代表的VFM虽擅长分割,却难以识别关键解剖点,而这些点正是LV指标测量的核心。本文提出新型框架AutoSAME,将SAM的强大视觉理解能力与分割及关键点定位任务相结合,模拟心脏超声医生的操作流程,实现符合临床指南的LV指标测量。我们进一步在AutoSAME中引入滤波交叉分支注意力(FCBA),从频域角度利用分割特征增强关键点热图回归(HR)性能,优化后者的视觉表示;同时提出空间引导提示对齐(SGPA),基于左心室的空间特性自动生成提示嵌入,提升密集预测的准确性。大量实验表明,各项设计均有效,且AutoSAME在左心室分割、关键点定位与指标测量上表现更优。代码将开源于https://github.com/QC-LIU-1997/AutoSAME。
原文摘要 · Abstract (English)
Left ventricular (LV) indicator measurements following clinical echocardiog-raphy guidelines are important for diagnosing cardiovascular disease. Alt-hough existing algorithms have explored automated LV quantification, they can struggle to capture generic visual representations due to the normally small training datasets. Therefore, it is necessary to introduce vision founda-tional models (VFM) with abundant knowledge. However, VFMs represented by the segment anything model (SAM) are usually suitable for segmentation but incapable of identifying key anatomical points, which are critical in LV indicator measurements. In this paper, we propose a novel framework named AutoSAME, combining the powerful visual understanding of SAM with seg-mentation and landmark localization tasks simultaneously. Consequently, the framework mimics the operation of cardiac sonographers, achieving LV indi-cator measurements consistent with clinical guidelines. We further present fil-tered cross-branch attention (FCBA) in AutoSAME, which leverages relatively comprehensive features in the segmentation to enhance the heatmap regression (HR) of key points from the frequency domain perspective, optimizing the vis-ual representation learned by the latter. Moreover, we propose spatial-guided prompt alignment (SGPA) to automatically generate prompt embeddings guid-ed by spatial properties of LV, thereby improving the accuracy of dense pre-dictions by prior spatial knowledge. The extensive experiments on an echocar-diography dataset demonstrate the efficiency of each design and the superiori-ty of our AutoSAME in LV segmentation, landmark localization, and indicator measurements. The code will be available at https://github.com/QC-LIU-1997/AutoSAME.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。