用五百万用户数据训练可通用的可穿戴健康模型,实现少样本精准预测。
Towards a General Intelligence and Interface for Wearable Health Data

- 基于超万亿分钟无标签数据预训练可穿戴健康基础模型
- 在35项健康任务中表现显著提升,支持少样本学习与生成
- 集成大模型代理自动优化下游任务,临床验证响应更安全可靠
尽管无处不在的可穿戴传感器捕捉了丰富的行为与生理信息,但将这些信号转化为个性化健康洞察仍具挑战。由于表型多样性及个体基线健康、生理和生活方式差异,从低级传感器数据生成表征高级状态的特征极为困难。此外,收集配对健康结果标注的可穿戴数据耗时耗力,回顾性标注几乎不可行,导致高质量标注数据稀缺。为克服这些限制,我们提出一个可穿戴健康基础模型,该模型在来自五百万参与者的超大规模数据集上预训练,涵盖超过一万亿分钟的无标签传感器信号。实验表明,模型容量与预训练数据量的联合扩展带来了系统性性能提升,在涵盖心血管、代谢、睡眠、心理健康及生活方式选择等35项健康预测任务中均取得进展。研究发现,这一群体规模的表征支持高效的少样本学习与生成能力,可用于稳健的日常指标估计。为进一步利用该表征,我们部署由大语言模型代理组成的“教室”,自主搜索基于模型嵌入构建的下游预测头空间,展现广泛性能提升,且提升程度随大模型容量增加而增强。最后,我们将这些下游预测器集成至个人健康代理中,使模型响应更相关、更具上下文意识且更安全,并通过1,860名临床医生的评估验证了其有效性。
原文摘要 · Abstract (English)
While ubiquitous wearable sensors capture a wealth of behavioral and physiological information, effectively transforming these signals into personalized health insights is challenging. Specifically, converting low-level sensor data into representations capable of characterizing higher-level states is difficult due to high phenotypic diversity and variation in individual baseline health, physiology, and lifestyle factors. Moreover, collecting wearable data paired with health outcome annotations is laborious and expensive, and retrospective annotation remains practically unfeasible, contributing to a scarcity of data with high-quality labels. To overcome these limitations, we propose a foundation model for wearable health that is pretrained on more than one trillion minutes of unlabeled sensor signals drawn from a large cohort of five million participants. We demonstrate that the joint scaling of model capacity and pretraining data volume leads to systematic improvements in performance, as evaluated on a diverse set of 35 health prediction tasks, spanning cardiovascular, metabolic, sleep, and mental health, as well as lifestyle choices and demographic factors. We find that this population scale representation unlocks label-efficient few-shot learning and generative capabilities for robust daily metric estimation. To further leverage this learned representation, we deploy a classroom of LLM agents to autonomously search the space of downstream predictive heads built on the model embeddings, showing broad performance improvements that increase with LLM model capacity. Finally, we show how integrating these downstream predictors into a Personal Health Agent can support model responses that are more relevant, contextually aware, and safe, and we validate this via 1,860 ratings from a cohort of clinicians.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。