用小波分解增强多尺度信号重建,提升可穿戴设备心率数据的模型泛化能力
Wavelet-Driven Masked Multiscale Reconstruction for PPG Foundation Models
- 通过小波变换分解信号,在多个频段上掩码重建,让模型学习跨时频特征
- 在17/19个健康任务中优于或持平现有开源模型,基于32,000用户共1700万段数据训练
- 适合需要多尺度生理信号理解的数字健康研究者和可穿戴设备开发者
可穿戴基础模型有望通过从日常环境中收集的大规模生物信号中学习可迁移表征,推动数字健康变革。尽管大规模预训练已取得进展,但多数方法忽视了光电容积脉搏波(PPG)信号的频谱结构,而生理节律在多个频率带中展开。受启发于下游健康任务依赖细粒度波形形态到全局节律动态的多分辨率特征,我们提出针对PPG表征学习的掩码多尺度重建(MMR)——一种自监督预训练框架,显式从PPG数据的分层时频尺度中学习。预训练任务设计为重建经小波多分辨率分解后随机掩码的系数,迫使Transformer编码器整合时间与频域信息。我们使用约32,000名智能手表用户的1700万段10秒未标注PPG数据对模型进行预训练。在19个健康相关任务中的17个上,基于大规模可穿戴PPG数据训练的MMR模型表现优于或匹配现有开源PPG基础模型、时间序列基础模型及其他自监督基线。对学习嵌入的深入分析与系统消融实验验证了小波表示的价值,表明其能捕捉鲁棒且具有生理依据的特征。这些结果共同凸显了MMR作为通用化PPG基础模型的重要潜力。
原文摘要 · Abstract (English)
Wearable foundation models have the potential to transform digital health by learning transferable representations from large-scale biosignals collected in everyday settings. While recent progress has been made in large-scale pretraining, most approaches overlook the spectral structure of photoplethysmography (PPG) signals, wherein physiological rhythms unfold across multiple frequency bands. Motivated by the insight that many downstream health-related tasks depend on multi-resolution features spanning fine-grained waveform morphology to global rhythmic dynamics, we introduce Masked Multiscale Reconstruction (MMR) for PPG representation learning - a self-supervised pretraining framework that explicitly learns from hierarchical time-frequency scales of PPG data. The pretraining task is designed to reconstruct randomly masked out coefficients obtained from a wavelet-based multiresolution decomposition of PPG signals, forcing the transformer encoder to integrate information across temporal and spectral scales. We pretrain our model with MMR using ~17 million unlabeled 10-second PPG segments from ~32,000 smartwatch users. On 17 of 19 diverse health-related tasks, MMR trained on large-scale wearable PPG data improves over or matches state-of-the-art open-source PPG foundation models, time-series foundation models, and other self-supervised baselines. Extensive analysis of our learned embeddings and systematic ablations underscores the value of wavelet-based representations, showing that they capture robust and physiologically-grounded features. Together, these results highlight the potential of MMR as a step toward generalizable PPG foundation models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。