用自监督方法提升多导联心电图分类精度,仅用1%标注数据达88.1%准确率。
ECG-NAT: A Self-supervised Neighborhood Attention Transformer for Multi-lead Electrocardiogram Classification
- 设计分层邻域注意力机制,同时捕捉心跳细节与节律模式。
- 两阶段训练:先自编码重建信号,再联合对比与交叉熵微调。
- 低资源下表现优异,适合实时心电诊断应用。
心电图心律失常分类因信号变异、噪声干扰、标注数据有限而困难,且模型难以兼顾准确率与效率。现有自监督方法多关注全局上下文或局部形态,少有实现分层多尺度特征提取。本文提出面向多导联心电图分类的自监督邻域注意力变换器(ECG-NAT)。采用两阶段训练:第一阶段在多个数据集上使用掩码自编码器重建部分遮蔽的心电信号,学习鲁棒的领域不变表示;第二阶段通过结合监督对比损失与交叉熵损失进行判别性微调,对齐表征与标签预测。分层注意力机制以低计算成本高效捕获从单个心跳形态到整体节律模式的多尺度时序特征。在基准数据集上,仅使用1%标注数据即达88.1%准确率,展现出强低资源适应能力。该框架兼具高分类性能与计算效率,适用于实时心电诊断。代码将在录用后公开于https://github.com/Mahsagazeran/ECG-NAT。
原文摘要 · Abstract (English)
Electrocardiogram (ECG) arrhythmia classification remains challenging due to signal variability, noise, limited labeled data, and the difficulty in achieving both accuracy and efficiency in models. While self-supervised learning reduces label dependency, most methods target either global contextual features or local morphological patterns, but rarely implement hierarchical multi-scale feature extraction. ECG signals require architectures that simultaneously capture fine-grained beat-level morphology and broader rhythm-level dependencies with computational efficiency. To overcome this limitation, this paper proposes the Electrocardiogram Neighborhood Attention Transformer (ECG-NAT), a novel self-supervised learning approach tailored for multi-lead ECG classification. Our two-stage approach begins with generative pretraining, using a masked autoencoder to reconstruct partially masked ECG signals across multiple diverse datasets, enabling the model to learn robust, domain-invariant representations from unlabeled data. This is followed by discriminative fine-tuning with a dual-loss function that combines supervised contrastive and cross-entropy losses, aligning representation learning with label prediction. The hierarchical attention mechanism efficiently captures multi-scale temporal features from localized beat morphology to broader rhythm patterns at low computational cost. ECG-NAT achieves robust performance on benchmark datasets, with 88.1\% accuracy using only 1\% labeled data, demonstrating strong efficacy in low-resource settings. The framework combines superior classification performance with computational efficiency, making it practical for real-time ECG diagnosis. The code will be made available upon acceptance at: https://github.com/Mahsagazeran/ECG-NAT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。