用跨模态对齐统一处理睡眠信号,支持不完整数据且效果优于传统方法。
sleep2vec: Unified Cross-Modal Alignment for Heterogeneous Nocturnal Biosignals
- 通过跨模态对比学习,统一建模九种不同睡眠生物信号。
- 在42,249个夜间记录上训练,对缺失传感器仍保持稳定性能。
- 首次揭示睡眠信号的模态多样性与模型容量的缩放规律,适合临床研究者。
从睡眠分期到临床诊断的任务通常依赖标准多导睡眠图(PSG)设备、床边监测仪和可穿戴设备,这些设备采集多种夜间生物信号(如EEG、EOG、ECG、SpO$_2$)。然而,设备间差异和频繁的传感器脱落给多模态信号的统一建模带来重大挑战。我们提出 exttt{sleep2vec},一种针对多样化且不完整的夜间生物信号的基础模型,通过跨模态对齐学习共享表示。该模型在42,249个整夜记录上使用 extit{人口统计、年龄、站点与病史感知的InfoNCE}目标进行对比预训练,融合生理与采集元数据(如年龄、性别、记录站点),动态加权负样本,缓解群体特异性捷径。在下游睡眠分期和临床结果评估任务中, exttt{sleep2vec}持续超越强基线,对任意可用模态子集和传感器脱落均保持鲁棒性。我们进一步首次刻画了夜间生物信号在模态多样性与模型容量方面的缩放规律。这些结果表明,结合合理缩放策略的统一跨模态对齐,可实现标签高效、通用的现实世界夜间生物信号建模。
原文摘要 · Abstract (English)
Tasks ranging from sleep staging to clinical diagnosis traditionally rely on standard polysomnography (PSG) devices, bedside monitors and wearable devices, which capture diverse nocturnal biosignals (e.g., EEG, EOG, ECG, SpO$_2$). However, heterogeneity across devices and frequent sensor dropout pose significant challenges for unified modelling of these multimodal signals. We present \texttt{sleep2vec}, a foundation model for diverse and incomplete nocturnal biosignals that learns a shared representation via cross-modal alignment. \texttt{sleep2vec} is contrastively pre-trained on 42,249 overnight recordings spanning nine modalities using a \textit{Demography, Age, Site \& History-aware InfoNCE} objective that incorporates physiological and acquisition metadata (\textit{e.g.}, age, gender, recording site) to dynamically weight negatives and mitigate cohort-specific shortcuts. On downstream sleep staging and clinical outcome assessment, \texttt{sleep2vec} consistently outperforms strong baselines and remains robust to any subset of available modalities and sensor dropout. We further characterize, to our knowledge for the first time, scaling laws for nocturnal biosignals with respect to modality diversity and model capacity. Together, these results show that unified cross-modal alignment, coupled with principled scaling, enables label-efficient, general-purpose modelling of real-world nocturnal biosignals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。