用多视角超声图像增强心电图表征,提升心脏病理判断能力
Echo2ECG: Enhancing ECG Representations with Cardiac Morphology from Multi-View Echos
- 通过多视角超声与心电图自监督对齐,学习心脏形态结构
- 在三个数据集上分类结构性心脏表型准确率显著领先
- 模型小巧(比最大基线小18倍)且适合临床筛查应用
心电图(ECG)是低成本、广泛应用的诊断工具,用于检测心房颤动等电生理异常,但无法直接测量心脏形态特征如左心室射血分数(LVEF),此类信息通常需依赖超声心动图(Echo)。从心电图预测这些形态特征可实现早期、便捷的健康筛查。现有自监督方法因仅对齐单视角超声,存在表征错配问题,只能捕捉局部解剖信息。为此,我们提出Echo2ECG,一种多模态自监督学习框架,利用多视角超声中的心脏形态结构来增强心电图表征。我们在两个临床相关任务上评估该框架作为心电图特征提取器的表现:(1)在三个数据集上分类结构性心脏表型;(2)使用心电图查询检索具有相似形态特征的超声研究。结果表明,尽管其特征表示比最大基线小18倍,所提取的心电图表征在两项任务中均持续优于最先进单模态与多模态基线。这证明Echo2ECG是一种鲁棒、高效的心电图特征提取器。代码已开源:https://github.com/michelleespranita/Echo2ECG。
原文摘要 · Abstract (English)
Electrocardiography (ECG) is a low-cost, widely used modality for diagnosing electrical abnormalities like atrial fibrillation by capturing the heart's electrical activity. However, it cannot directly measure cardiac morphological phenotypes, such as left ventricular ejection fraction (LVEF), which typically require echocardiography (Echo). Predicting these phenotypes from ECG would enable early, accessible health screening. Existing self-supervised methods suffer from a representational mismatch by aligning ECGs to single-view Echos, which only capture local, spatially restricted anatomical snapshots. To address this, we propose Echo2ECG, a multimodal self-supervised learning framework that enriches ECG representations with the heart's morphological structure captured in multi-view Echos. We evaluate Echo2ECG as an ECG feature extractor on two clinically relevant tasks that fundamentally require morphological information: (1) classification of structural cardiac phenotypes across three datasets, and (2) retrieval of Echo studies with similar morphological characteristics using ECG queries. Our extracted ECG representations consistently outperform those of state-of-the-art unimodal and multimodal baselines across both tasks, despite being 18x smaller than the largest baseline. These results demonstrate that Echo2ECG is a robust, powerful ECG feature extractor. Our code is accessible at https://github.com/michelleespranita/Echo2ECG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。