arXiv:2412.09758cs.LGeess.SP2024-12被引 37

首个可通用处理多种可穿戴生理信号的时序基础模型

Toward Foundation Model for Multivariate Wearable Sensing of Physiological Signals

  • 设计通道感知注意力机制,融合传感器间与传感器内关系
  • 在11个数据集上跨18种应用表现超越基线,零样本仍有效
  • 适合医疗健康领域研究者快速适配新传感器和任务

时序基础模型在多种数据类型的任务中表现出色,但可穿戴传感数据因模式与频段差异大,尤其在医疗健康应用中面临挑战。核心难点在于构建能高效适应异构传感配置与应用场景的通用表征。为此,我们提出NormWear,首个多模态、普适性的基础模型,用于从可穿戴生理信号中提取通用且信息丰富的表征。具体地,设计了带有共享[CLS]标记的通道感知注意力机制,以检测单传感器内及跨传感器的信号模式,从而更好地利用时间序列本身及其传感器间的关联信息。该模型在涵盖PPG、ECG、EEG、GSR和IMU的多种公开数据集上进行预训练。实验表明,其在11个公开可穿戴传感数据集上,覆盖18项应用(包括心理健康、身体状态推断、生命体征估计和疾病风险评估),在零样本、部分样本和全样本设置下均显著优于对比方法,展现出在真实医疗场景中的广泛适用性。

原文摘要 · Abstract (English)

Time-series foundation models excel at tasks like forecasting across diverse data types by leveraging informative waveform representations. Wearable sensing data, however, pose unique challenges due to their variability in patterns and frequency bands, especially for healthcare-related outcomes. The main obstacle lies in crafting generalizable representations that adapt efficiently across heterogeneous sensing configurations and applications. To address this, we propose NormWear, the first multi-modal and ubiquitous foundation model designed to extract generalized and informative representations from wearable sensing data. Specifically, we design a channel-aware attention mechanism with a shared special liaison [CLS] token to detect signal patterns in both intra-sensor and inter-sensors. This helps the model to extract more meaningful information considering both time series themselves and the relationships between input sensors. This helps the model to be widely compatible with various sensors settings. NormWear is pretrained on a diverse set of physiological signals, including PPG, ECG, EEG, GSR, and IMU, from various public datasets. Our model shows exceptional generalizability across 11 public wearable sensing datasets, spanning 18 applications in mental health, body state inference, vital sign estimation, and disease risk evaluation. It consistently outperforms competitive baselines under zero-shot, partial-shot, and full-shot settings, indicating broad applicability in real-world health applications.

可穿戴传感时序模型基础模型生理信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。