arXiv:2607.16323eess.SPcs.CV2026-07

用12导联心电图回答复杂心脏问题,辅助基层医生判断病情。

ECG-LLM: Foundation Model for ECG-Based Cardiac Reasoning

论文配图:ECG-LLM: Foundation Model for ECG-Based Cardiac Reasoning
图 1 · 摘自论文原文
  • 基于多模态数据训练的大型语言模型,能从心电图直接推理心血管问题。
  • 准确还原心率等常规指标,并预测心超和磁共振中的复杂结构异常。
  • 适合临床急症分诊场景,让非专科医生也能做出精准初步判断。

心电图(ECG)是心脏症状的标准筛查手段,但一线分诊常无法及时获取超声心动图(ECHO)或心脏磁共振(CMR)等影像学确诊信息。现有大多数心电图人工智能系统仅限于固定诊断标签或自动生成报告,限制了其在个性化临床推理中的应用。为此,我们提出ECG-LLM,一个在四个队列共679,112份心电图研究(来自186,409名患者)上训练的条件化大语言模型。通过一种新型的多模态到语言的监督策略,该模型在由心电图信号、临床背景、CMR和ECHO生成的结构化问答对上进行训练。这一统一框架使模型仅凭12导联心电图即可回答多样化的心血管问题,涵盖传统解读及标准心电图不可见的表型。ECG-LLM成功恢复了心率等常规测量值,并显著预测出复杂的CMR衍生表型,包括心室与心房容积、心功能;尤其关键的是,它能够检测出重要超声心动图表型,如左室壁增厚、主动脉瓣狭窄、右室收缩功能障碍。在标准心电图理解任务中,其表现达到或超过现有基线,在诊断报告生成和ECG-QA基准测试中均表现优异。该多模态框架突破了固定标签预测的局限,为全科医生和一线分诊提供可问诊的临床推理支持,适用于专家评审延迟的场景。

原文摘要 · Abstract (English)

Electrocardiography (ECG) is an inexpensive, standard-of-care test for cardiac symptoms, but front-line triage often lacks immediate access to definitive imaging such as echocardiography (ECHO) or cardiac magnetic resonance (CMR). Furthermore, most existing ECGAI systems are limited to fixed diagnostic labels or automated reports, constraining their use for patient-specific clinical reasoning. To address this gap, we introduce ECG-LLM, an ECG-conditioned large language model trained across four cohorts comprising 679,112 ECG studies from 186,409 patients. Using a novel multimodal-to-language supervision strategy, ECG-LLM is trained on clinically structured question-answer pairs derived from ECG signals, clinical context, CMR, and ECHO. This unified approach enables the model to answer diverse cardiovascular questions from a 12-lead ECG alone, spanning both conventional interpretation and phenotypes not directly visible on standard ECGs. ECG-LLM successfully recovers conventional ECG measurements, such as heart rate, and strongly predicts complex CMR-derived phenotypes, including ventricular and atrial volumes and ventricular function. Crucially, it detects vital echocardiographic phenotypes, including increased LV wall thickness, aortic stenosis, and right-ventricular systolic dysfunction. On standard ECG understanding tasks, ECG-LLM matches or exceeds existing baselines for diagnostic report generation and the ECG-QA benchmark. By moving beyond fixed-label prediction, this multimodal framework provides clinically valuable, question-driven cardiovascular reasoning to support general practitioner and front-line triage decisions when specialist review is delayed.

心电图大模型临床推理多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。