用随机投影实现轻量级时序建模,提升移动端睡眠分期效率
Efficient Temporal Modeling for Mobile Sleep Staging via Lightweight Random Attention
- 采用固定随机投影替代可学习时序模块,通过相似性聚合实现轻量建模
- 在Sleep-EDF-20和Sleep-EDF-78上准确率与F1提升1-3%
- 适合可穿戴设备实时应用,对不同主干网络有强泛化能力
移动端睡眠分期是家庭睡眠监测与闭环调控的基础。但现有序列模型如RNN和Transformer计算开销大,难以部署于移动设备。本文提出随机注意力(RA),一种基于固定随机投影的轻量级时序建模模块,将可学习序列建模替换为基于相似性的聚合机制。RA在不增加额外参数的前提下实现有效的时序平滑。我们进一步通过随机注意力先验核(RAPK)提供理论解释,将RA分解为全局平滑项与特征相似性项,揭示了时序睡眠结构的可解释性。在Sleep-EDF-20和Sleep-EDF-78上的实验表明,RA在单个时间片段基准上持续提升准确率与F1分数1-3%,性能媲美LSTM、GRU和Transformer。RA还展现出对不同主干编码器的强泛化能力,并优于传统时序平滑方法。结果表明,通过基于相似性的轻量级时序聚合即可实现高效睡眠分期,适用于实时可穿戴场景。
原文摘要 · Abstract (English)
Mobile sleep staging serves as a foundational infrastructure for in-home sleep monitoring and closed-loop modulation. But existing sequential models such as RNNs and Transformers are computationally expensive for mobile deployment. In this paper, we propose Random Attention (RA), a lightweight temporal modeling module based on fixed random projections, which replaces learnable sequence modeling with similarity-based aggregation. RA introduces little additional parameters beyond the epoch encoder while enabling effective temporal smoothing. We further provide a theoretical interpretation via the Random Attention Prior Kernel (RAPK), which decomposes RA into a global smoothing term and a feature similarity term, offering an interpretable view of temporal sleep structure. Experiments on Sleep-EDF-20 and Sleep-EDF-78 show that RA consistently improves epoch-wise baselines by 1-3\% in accuracy and F1 score, while achieving competitive performance compared with LSTM, GRU, and Transformer models. RA also demonstrates strong generalization across different backbone encoders and improved robustness over conventional temporal smoothing methods. These results indicate that efficient sleep staging can be achieved through lightweight similarity-based temporal aggregation, making RA suitable for real-time wearable applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。