用患者记忆队列增强心电图自监督预训练模型
Enhancing Contrastive Learning-based Electrocardiogram Pretrained Model with Patient Memory Queue
- 引入患者记忆队列缓解批次内患者样本不足问题
- 在三个数据集上表现优于现有对比学习方法
- 适合小样本场景下的心电图分析研究者使用
在自动心电图(ECG)诊断领域,由于标注数据相对有限,如何基于无标签数据构建鲁棒的ECG预训练模型是研究重点。近年来,基于对比学习的ECG预训练模型利用心电图中固有的患者级自监督信号,即患者一致性,展现出潜力。其核心思想是将正负样本对重新定义为同一患者内的样本(内部)和不同患者间的样本(外部),以提供更丰富的共享上下文来学习有效表示。然而,这些方法因批次内同患者样本数量不足,难以充分挖掘患者一致性。为此,本文提出一种结合患者记忆队列(PMQ)的对比学习框架,通过维护大规模患者记忆队列缓解模型退化问题。为进一步提升预训练性能,还引入两种新的数据增强方法,为正负样本对提供更多视角。在三个公开数据集上、三种不同数据比例下进行的大量实验表明,该方法整体性能超越以往对比学习方法,并在标注数据稀缺场景下表现出更强鲁棒性。
原文摘要 · Abstract (English)
In the field of automatic Electrocardiogram (ECG) diagnosis, due to the relatively limited amount of labeled data, how to build a robust ECG pretrained model based on unlabeled data is a key area of focus for researchers. Recent advancements in contrastive learning-based ECG pretrained models highlight the potential of exploiting the additional patient-level self-supervisory signals inherent in ECG. They are referred to as patient contrastive learning. Its rationale is that multiple physical recordings from the same patient may share commonalities, termed patient consistency, so redefining positive and negative pairs in contrastive learning as intrapatient and inter-patient samples provides more shared context to learn an effective representation. However, these methods still fail to efficiently exploit patient consistency due to the insufficient amount of intra-inter patient samples existing in a batch. Hence, we propose a contrastive learning-based ECG pretrained model enhanced by the Patient Memory Queue (PMQ), which incorporates a large patient memory queue to mitigate model degeneration that can arise from insufficient intra-inter patient samples. In order to further enhance the performance of the pretrained model, we introduce two extra data augmentation methods to provide more perspectives of positive and negative pairs for pretraining. Extensive experiments were conducted on three public datasets with three different data ratios. The experimental results show that the comprehensive performance of our method outperforms previous contrastive learning methods and exhibits greater robustness in scenarios with limited labeled data. The code is available at https://github.com/3hiuwoo/PMQ.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。