用自监督模型从脑电和心率信号中高效学习新生儿缺氧缺血性脑病分类特征
Neonatal Hypoxic-ischaemic Encephalopathy Classification from the EEG and HRV Signals Using a Conformer based Masked Autoencoder

- 融合卷积与注意力机制的Conformer架构,结合掩码自编码器进行无标签生理信号表征学习
- 在脑电数据上实现97.19%和96.56%的分类AUC,心率变异性数据达82.42% AUC
- 适合医疗信号分析、小样本场景下的医学影像/生理信号建模研究者
本文提出MAEConformer,一种结合Conformer架构与掩码自编码器(MAE)范式的自监督学习框架,用于从大量未标注的脑电图(EEG)和心率变异性(HRV)信号中进行大规模表征学习。通过融合卷积操作与基于Transformer的自注意力机制,该模型能有效捕捉生理时间序列中的局部时序模式与长程上下文依赖关系。为提升重建精度与表征质量,引入多分辨率短时傅里叶变换(MR-STFT)损失,使模型可联合学习多尺度的时域与频域特征。针对不同模态分别在6,030小时(EEG)和4,868小时(HRV)未标注数据上预训练,随后迁移至专家标注的下游任务。实验表明,所学表征具有强可迁移性与数据效率:在基于EEG的缺氧缺血性脑病(HIE)严重程度分类任务中,预训练的MAE-EEG模型在二分类与四分类任务中测试AUC分别达到97.19%和96.56%,优于多种先进监督与自监督基线;在基于HRV的分类任务中,MAE-HRV取得82.42%的测试AUC,超越自监督Transformer与监督卷积基线。结果证明了MAEConformer在多生理模态下学习鲁棒、可迁移表征的有效性。
原文摘要 · Abstract (English)
In this paper, we propose the MAEConformer, a novel self-supervised learning framework that combines the Conformer architecture with the Masked Autoencoder (MAE) paradigm for large-scale representation learning from unlabelled electroencephalography (EEG) and heart rate variability (HRV) signals. By integrating convolutional operations with Transformer-based self-attention, MAEConformer effectively captures both local temporal patterns and long-range contextual dependencies in physiological time series. To enhance reconstruction fidelity and representation quality, a multi-resolution short-time Fourier transform (MR-STFT) loss is incorporated alongside the reconstruction objective, enabling the model to jointly learn temporal and spectral characteristics across multiple scales. Modality-specific EEG and HRV MAEConformer models were pretrained on 6,030h and 4,868h of unlabelled recordings, respectively, and subsequently transferred to expert-annotated downstream tasks. Experimental results demonstrate that the learned representations provide strong transferability and data efficiency. In EEG-based hypoxic ischemic encephalopathy (HIE) severity classification, the pretrained MAE-EEG model achieved test AUCs of 97.19% and 96.56% for binary and four-class classification tasks, respectively, outperforming a range of state-of-the-art supervised and self-supervised baselines. On the HRV-based HIE severity classification task, MAE-HRV achieved a test AUC of 82.42%, surpassing both self-supervised Transformer-based and supervised convolutional baselines. These findings demonstrate the effectiveness of MAEConformer for learning robust and transferable representations across multiple physiological modalities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。