让心电图局部特征与报告标签精准对应,提升诊断准确性
Fine-grained Contrastive Learning for ECG-Report Alignment with Waveform Enhancement
- 用标签专属的心电图表征实现局部信号与报告标签的细粒度对齐
- 在六大数据集上超越现有方法,零样本预测准确率提升显著
- 通过大模型补全缺失波形信息,解决真实数据中55%报告缺细节的问题
心电图对心血管疾病诊断至关重要。现有对比学习方法多关注整体心电图与报告的对齐,忽略了局部心电图特征与报告标签之间的关联。本文提出FG-CLEP(细粒度对比语言心电图预训练),通过标签特定的心电图表示,实现特定心电图片段与报告中每个标签的细粒度对齐。此外,我们发现MIMIC-ECG训练数据集中近55%的心电图报告缺乏详细波形特征,阻碍了细粒度对齐。为此,我们设计了从粗到精的训练流程,利用大语言模型(LLMs)恢复缺失的波形特征,并通过粗粒度模型验证其输出。同时,标签级对齐比报告级更易产生假阴性,因不同报告可能共享相同标签。为此,我们引入语义相似度矩阵,引导模型识别并修正假阴性。在六个数据集上的实验表明,FG-CLEP显著提升了细粒度对齐效果,在零样本预测和线性探测任务中均优于当前最优方法。生成的细粒度报告还能提升其他方法的性能。
原文摘要 · Abstract (English)
Electrocardiograms (ECGs) are essential for diagnosing cardiovascular diseases. However, existing ECG-Report contrastive learning methods focus on whole-ECG and report alignment, missing the link between local ECG features and individual report tags. In this paper, we propose FG-CLEP (Fine-Grained Contrastive Language ECG Pre-training), which achieves fine-grained alignment between specific ECG segments and each tag in the report via tag-specific ECG representations. Furthermore, we found that nearly 55\% of ECG reports in the MIMIC-ECG training dataset lack detailed waveform features, which hinders fine-grained alignment. To address this, we introduce a coarse-to-fine training process that leverages large language models (LLMs) to recover these missing waveform features and validate the LLM outputs using a coarse model. Additionally, fine-grained alignment at the tag level, rather than at the report level, exacerbates the false negative problem, as different reports may share common tags. To mitigate this, we introduce a semantic similarity matrix to guide the model in identifying and correcting false negatives. Experiments on six datasets demonstrate that FG-CLEP significantly improves fine-grained alignment, outperforming state-of-the-art methods in both zero-shot prediction and linear probing. Meanwhile, the fine-grained reports we generate also enhance the performance of other methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。