arXiv:2410.20542cs.LGeess.SP2024-10ICLR被引 92

首个开放的脉搏波信号基础模型,提升健康监测泛化能力

PaPaGei: Open Foundation Models for Optical Physiological Signals

  • 基于57000小时无标签数据,融合生理形态知识进行表征学习
  • 在20个任务中平均提升分类准确率6.3%、回归指标2.9%
  • 模型轻量高效,仅需70倍小参数量即超越大模型,适合多场景应用

光体积描记法(PPG)是监测生物信号与心血管健康的主要非侵入性技术,广泛应用于临床与可穿戴设备。尽管机器学习模型在PPG信号上展现潜力,但普遍存在任务特定、泛化能力差的问题。现有研究受限于单一设备数据集、缺乏域外泛化探索,且缺少公开模型,影响可复现性。为此,我们提出PaPaGei,首个面向PPG信号的开源基础模型。该模型在超过57,000小时的数据上预训练,涵盖2000万条来自公开数据集的未标注PPG片段。我们引入一种新型表示学习方法,利用个体间PPG波形形态的领域知识,实现比传统对比学习更丰富的表征。我们在10个不同数据集上的20项任务中评估了PaPaGei,覆盖心血管健康、睡眠障碍、妊娠监测与福祉评估。结果表明,其在至少14项任务中分类与回归性能分别提升6.3%和2.9%。尤为关键的是,该模型在数据与参数效率方面表现优异,仅需70倍小规模即超越更大模型。此外,我们还评估了模型在不同肤色人群中的鲁棒性,为未来模型偏见评估建立基准。PaPaGei可作为特征提取器或多模态模型编码器,推动多模态健康监测发展。

原文摘要 · Abstract (English)

Photoplethysmography (PPG) is the leading non-invasive technique for monitoring biosignals and cardiovascular health, with widespread adoption in both clinical settings and consumer wearable devices. While machine learning models trained on PPG signals have shown promise, they tend to be task-specific and struggle with generalization. Current research is limited by the use of single-device datasets, insufficient exploration of out-of-domain generalization, and a lack of publicly available models, which hampers reproducibility. To address these limitations, we present PaPaGei, the first open foundation model for PPG signals. The model is pre-trained on over 57,000 hours of data, comprising 20 million unlabeled PPG segments from publicly available datasets. We introduce a novel representation learning approach that leverages domain knowledge of PPG signal morphology across individuals, enabling the capture of richer representations compared to traditional contrastive learning methods. We evaluate PaPaGei against state-of-the-art time-series foundation models and self-supervised learning benchmarks across 20 tasks from 10 diverse datasets, spanning cardiovascular health, sleep disorders, pregnancy monitoring, and wellbeing assessment. Our model demonstrates superior performance, improving classification and regression metrics by 6.3% and 2.9% respectively in at least 14 tasks. Notably, PaPaGei achieves these results while being more data- and parameter-efficient, outperforming models that are 70x larger. Beyond accuracy, we examine model robustness across different skin tones, establishing a benchmark for bias evaluation in future models. PaPaGei can serve as both a feature extractor and an encoder for multimodal models, opening up new opportunities for multimodal health monitoring.

PPG基础模型健康监测自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。