通用心电图大模型支持多场景输入与多任务理解
anyECG-chat: A Generalist ECG-MLLM for Flexible ECG Input and Multi-Task Understanding
- 构建可处理长时程、少导联心电图的多任务数据集
- 模型支持动态长度和多导联输入,实现异常波形定位等新任务
- 适合临床真实场景,如家庭监测与多份心电图对比分析
多模态大语言模型(MLLM)在心电图(ECG)分析中的应用日益受到关注。然而,现有针对心电图的MLLM大多仅限于12导联、短时程(10秒)单份心电图的报告生成,未能充分发挥其潜力。为此,我们构建了anyECG数据集,涵盖报告生成、异常波形定位及开放问答等多种任务;不仅包含标准医院心电图,还引入了家庭环境中常见的长时程、少导联心电图以及临床常见的多份心电图对比场景。在此基础上,提出anyECG-chat模型,支持动态长度和多份心电图输入。采用三阶段课程训练策略,在anyECG数据集上进行训练。全面评估表明,该模型不仅能完成常规报告生成,还能有效处理家庭环境下的长时程少导联心电图异常定位,以及多份心电图的综合对比分析。代码与数据已开源:https://github.com/CuCl-2/anyECG-chat。
原文摘要 · Abstract (English)
The advent of multimodal large language models (MLLMs) has sparked interest in their application to electrocardiogram (ECG) analysis. However, existing ECG-focused MLLMs primarily focus on report generation tasks, often limited to single 12-lead, short-duration (10s) ECG inputs, thereby underutilizing the potential of MLLMs. To this end, we aim to develop a MLLM for ECG analysis that supports a broader range of tasks and more flexible ECG inputs. However, existing ECG-QA datasets are often monotonous. To address this gap, we first constructed the anyECG dataset, which encompasses a wide variety of tasks, including report generation, abnormal waveform localization, and open-ended question answering. In addition to standard hospital ECGs, we introduced long-duration reduced-lead ECGs for home environments and multiple ECG comparison scenarios commonly encountered in clinical practice. Furthermore, we propose the anyECG-chat model, which supports dynamic-length ECG inputs and multiple ECG inputs. We trained the model using a three-stage curriculum training recipe with the anyECG dataset. A comprehensive evaluation was conducted, demonstrating that anyECG-chat is capable of supporting various practical application scenarios, including not only common report generation tasks but also abnormal waveform localization for long-duration reduced-lead ECGs in home environments and comprehensive comparative analysis of multiple ECGs. Our code and data are available at: https://github.com/CuCl-2/anyECG-chat.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。