arXiv:2511.03488cs.LG2025-11

用注意力机制融合多种生理信号,提升睡眠分期的跨数据集泛化能力

NAPS: Attention-Based Fusion of Heterogeneous Physiological Signals

  • 设计三轴注意力模块,自适应融合不同模态与通道的生理信号
  • 在多数据集睡眠分期任务中达到当前最佳跨域泛化性能
  • 适合需要处理异构生理数据的医疗AI研究者使用

生理信号具有固有的异质性:采集设备、模态数量与类型、通道数、质量及任务相关性均不相同。这种差异给需跨受试者、传感器和临床环境泛化的机器学习模型带来挑战。现有方法通常仅训练于有限模态或单通道,导致表征能力有限;简单融合(如池化或投票)无法自适应加权不同信号源,也难以捕捉时序、空间及跨模态依赖。本文提出NAPS(神经生理信号聚合器),通过专用三轴注意力机制与维度自适应训练,实现稳健的高维传感器配置融合。在多导睡眠图(PSG)自动睡眠分期这一真实场景中验证:记录包含多种生理信号(如EEG、EOG、EMG等),且跨数据集与机构配置差异显著。利用冻结的预训练单模态编码器,NAPS动态整合表示或预测结果,在多个数据集上实现当前最优的跨域泛化性能。

原文摘要 · Abstract (English)

Physiological signals are inherently heterogeneous: they are collected under diverse acquisition setups, differ in the number and type of modalities and channels, varying in quality, reliability, and relevance across tasks. This variability poses a major challenge for machine learning models required to generalize across subjects, sensors, and clinical environments. Existing approaches typically train on limited modalities or single channels, leading to marginal representations that, on their own, fail to capture the systemic complexity of the physiological state; naive fusion of such representations, such as via pooling or voting schemes, is typically suboptimal, as it cannot adaptively weight different sources or capture temporal, spatial, and cross-modality dependencies. We introduce NAPS (Neural Aggregator of Physiological Signals), a neural module that performs principled data fusion to derive unified physiological representations, employing an ad hoc tri-axial attention mechanism and dimension-adaptive training to robustly manage varying high-dimensional sensor configurations. We test NAPS on automatic sleep staging from polysomnography (PSG), an ideal real-world application, where recordings consist of multiple physiological signals (EEG, EOG, EMG, ...), considerably varying in configuration across datasets and institutions. Leveraging frozen pretrained unimodal encoders, NAPS dynamically integrates representations or predictions, achieving state-of-the-art generalization across multiple datasets.

生理信号融合注意力机制睡眠分期多模态学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。