用结构化状态空间模型自监督学习心电波形,提升长序列建模与少样本泛化能力。
SL-S4Wave: Self-Supervised Learning of Physiological Waveforms with Structured State Space Models

- 结合对比学习与多尺度卷积的S4架构,捕捉心电波形的局部与长程依赖。
- 在少样本下仍优于主流方法,长段波形识别准确率超90%。
- 适用于心律失常检测与脑电任务,跨域泛化能力强。
建模高采样率、多通道、含噪的生理时间序列数据(如心电图)面临挑战。现有自监督学习方法虽能从无标签数据中学习表征,但在捕捉长程依赖和噪声不变特征方面表现不足。结构化状态空间模型(S4)擅长长序列建模,但原有S4架构难以刻画多通道生理波形特性。本文提出SL-S4Wave,一种融合对比学习与定制化编码器的自监督框架。编码器采用多层全局卷积与多尺度子核设计,可同时捕获细粒度局部模式与长时序依赖。在真实数据集上的实验表明:(1)在挑战性心律失常检测任务中持续优于先进监督与自监督基线;(2)仅需少量标注样本即达高精度,体现强标签效率;(3)对长波形段保持鲁棒性能,有效建模复杂时序动态;(4)可迁移至未见心律失常类型,展现良好跨域泛化能力。此外,在多个脑电任务上也超越强基线,证明方法普适性。
原文摘要 · Abstract (English)
Modeling long-sequence medical time series data, such as electrocardiograms (ECG), poses significant challenges due to high sampling rates, multichannel signal complexity, inherent noise, and limited labeled data. While recent self-supervised learning (SSL) methods, based on various encoder architectures such as convolutional neural networks, have been proposed to learn representations from unlabeled data, they often fall short in capturing long-range dependencies and noise-invariant features. Structured state space models (S4) excel at long-sequence modeling, but existing S4 architectures fail to capture the unique characteristics of multichannel physiological waveforms. In this work, we propose SL-S4Wave, a self-supervised learning framework that combines contrastive learning with a tailored encoder built on structured state space models. The encoder incorporates multi-layer global convolution using multiscale subkernels, enabling the capture of both fine-grained local patterns and long-range temporal dependencies in noisy, high-resolution multichannel waveforms. Extensive experiments on real-world datasets demonstrate that SL-S4Wave (1) consistently outperforms state-of-the-art supervised and self-supervised baselines in a challenging arrhythmia detection task, (2) achieves high performance with significantly fewer labeled examples, showcasing strong label efficiency, and (3) maintains robust performance on long waveform segments, highlighting its capacity to model complex temporal dynamics in long sequences that most existing approaches fail to efficiently model, and (4) transfers effectively to unseen arrhythmia types, underscoring its robust cross-domain generalization. We additionally evaluate SL-S4Wave on multiple EEG tasks, achieving superior performance over strong baselines, demonstrating generalizability of our approach beyond cardiac waveforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。