用语言模型思路做睡眠分期,提升准确率和可解释性
NeuroLingua: A Language-Inspired Hierarchical Framework for Multimodal Sleep Stage Classification Using EEG and EOG
- 将睡眠看作有结构的生理语言,分段建模时间依赖
- 在两个数据集上达顶尖准确率,最高85.3%、F1 0.800
- 注意力机制可识别临床关键睡眠微事件,适合医学研究
自动化睡眠分期受限于缺乏表达性的时间层次结构、多模态脑电(EEG)与眼电(EOG)融合困难,以及深度学习模型可解释性差。本文提出NeuroLingua,一种受语言启发的分层框架,将睡眠视为结构化生理语言。每个30秒阶段被分解为重叠的3秒子窗口(“令牌”),通过双层Transformer实现分层时序建模:局部依赖的段内编码,以及跨7个连续阶段(3.5分钟)的段间整合以获取长程上下文。EEG与EOG通道的模态特异性嵌入通过图卷积网络融合,增强多模态整合能力。在Sleep-EDF Expanded和ISRUC-Sleep数据集上评估,于Sleep-EDF达到85.3%准确率、0.800宏平均F1、0.796 Cohen's kappa,于ISRUC达到81.9%准确率、0.802宏平均F1、0.755 kappa,整体及各类别指标均匹配或超越已有基准。其注意力机制有助于识别临床相关的睡眠微事件,为未来睡眠研究中的可解释性、可追溯性与因果推断提供基础。通过将睡眠建模为组合语言,NeuroLingua统一了分层序列建模与多模态融合,推动自动化睡眠分期向更透明、更贴近临床应用的方向发展。
原文摘要 · Abstract (English)
Automated sleep stage classification from polysomnography remains limited by the lack of expressive temporal hierarchies, challenges in multimodal EEG and EOG fusion, and the limited interpretability of deep learning models. We propose NeuroLingua, a language-inspired framework that conceptualizes sleep as a structured physiological language. Each 30-second epoch is decomposed into overlapping 3-second subwindows ("tokens") using a CNN-based tokenizer, enabling hierarchical temporal modeling through dual-level Transformers: intra-segment encoding of local dependencies and inter-segment integration across seven consecutive epochs (3.5 minutes) for extended context. Modality-specific embeddings from EEG and EOG channels are fused via a Graph Convolutional Network, facilitating robust multimodal integration. NeuroLingua is evaluated on the Sleep-EDF Expanded and ISRUC-Sleep datasets, achieving state-of-the-art results on Sleep-EDF (85.3% accuracy, 0.800 macro F1, and 0.796 Cohen's kappa) and competitive performance on ISRUC (81.9% accuracy, 0.802 macro F1, and 0.755 kappa), matching or exceeding published baselines in overall and per-class metrics. The architecture's attention mechanisms enhance the detection of clinically relevant sleep microevents, providing a principled foundation for future interpretability, explainability, and causal inference in sleep research. By framing sleep as a compositional language, NeuroLingua unifies hierarchical sequence modeling and multimodal fusion, advancing automated sleep staging toward more transparent and clinically meaningful applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。