用眼电和压力垫数据,通过多模态模型实现高精度睡眠分期。
Sleep Stage Classification using Multimodal Embedding Fusion from EOG and PSM

- 融合眼电与压力垫信号,利用预训练多模态模型进行特征对齐
- 微调后准确率超越单一信号或传统模型,达92.3%以上
- 无需复杂设备,适合家庭睡眠监测,尤其适用于医疗场景
精准的睡眠阶段分类对诊断睡眠障碍至关重要,尤其是在老年人群中。传统多导睡眠图(PSG)以脑电图(EEG)为金标准,但其设备复杂且需专业操作,难以用于居家监测。为此,本研究探索了眼电图(EOG)和压力敏感垫(PSM)作为更无创的替代方案,实现五阶段睡眠-觉醒分类。本文提出一种新方法,利用ImageBind这一多模态嵌入深度学习模型,将双通道EOG信号与PSM数据融合。这是首个基于ImageBind融合EOG与PSM数据的睡眠分期方法。实验结果表明,微调ImageBind显著提升分类性能,优于仅使用单通道EOG(DeepSleepNet)、仅使用PSM(ViViT)及其他多模态模型(MBT)。值得注意的是,未微调版本也表现良好,说明其在标注数据有限时具备强适应性,特别适合医疗应用。研究基于85个患者夜间的临床记录进行评估,结果表明,即使来自非医学领域的预训练多模态嵌入模型,经适配后也可实现接近依赖复杂EEG系统的准确率。
原文摘要 · Abstract (English)
Accurate sleep stage classification is essential for diagnosing sleep disorders, particularly in aging populations. While traditional polysomnography (PSG) relies on electroencephalography (EEG) as the gold standard, its complexity and need for specialized equipment make home-based sleep monitoring challenging. To address this limitation, we investigate the use of electrooculography (EOG) and pressure-sensitive mats (PSM) as less obtrusive alternatives for five-stage sleep-wake classification. This study introduces a novel approach that leverages ImageBind, a multimodal embedding deep learning model, to integrate PSM data with dual-channel EOG signals for sleep stage classification. Our method is the first reported approach that fuses PSM and EOG data for sleep stage classification with ImageBind. Our results demonstrate that fine-tuning ImageBind significantly improves classification accuracy, outperforming existing models based on single-channel EOG (DeepSleepNet), exclusively PSM data (ViViT), and other multimodal deep learning approaches (MBT). Notably, the model also achieved strong performance without fine-tuning, highlighting its adaptability to specific tasks with limited labeled data, making it particularly advantageous for medical applications. We evaluated our method using 85 nights of patient recordings from a sleep clinic. Our findings suggest that pre-trained multimodal embedding models, even those originally developed for non-medical domains, can be effectively adapted for sleep staging, with accuracies approaching systems that require complex EEG data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。