arXiv:2409.09549cs.LGcs.AI2024-09被引 3

用可穿戴设备数据训练健康基础模型,实现高效低耗的疾病早期检测。

COMFORT: A Continual Fine-Tuning Framework for Foundation Models Targeted at Consumer Healthcare

  • 基于健康人群数据预训练Transformer模型,采用掩码建模方法。
  • 结合低秩适配技术,实现多疾病检测且内存开销降低52%。
  • 适合资源受限的边缘设备,支持个性化医疗和持续学习。

可穿戴医疗传感器(WMSs)正推动智能医疗发展,实现对用户生理信号的持续实时监测,尤其在消费者健康领域具有重要意义。尽管Transformer在多个领域表现优异,但在敏感领域如智能医疗中的应用仍受限于数据获取难与隐私问题。为弥合基于Transformer的基础模型与基于WMS的疾病检测之间的差距,本文提出COMFORT——一种面向消费者健康领域的持续微调框架。COMFORT首先在大量仅来自健康个体的商用可穿戴设备采集的生理信号数据上预训练一个Transformer基础模型,采用掩码数据建模(MDM)目标。随后,通过多种参数高效微调(PEFT)方法(如低秩适配LoRA及其变体)对模型进行下游疾病检测任务的微调。此外,COMFORT持续存储由PEFT算法获得的低秩分解矩阵,构建多疾病检测库,实现边缘设备上的可扩展、内存高效的疾病检测。实验表明,COMFORT在性能上具有竞争力的同时,相比传统方法内存开销降低最高达52%。因此,COMFORT为消费者健康领域提供了个性化、主动式的高效早期疾病检测解决方案。

原文摘要 · Abstract (English)

Wearable medical sensors (WMSs) are revolutionizing smart healthcare by enabling continuous, real-time monitoring of user physiological signals, especially in the field of consumer healthcare. The integration of WMSs and modern machine learning (ML) enables unprecedented solutions to efficient early-stage disease detection. Despite the success of Transformers in various fields, their application to sensitive domains, such as smart healthcare, remains underexplored due to limited data accessibility and privacy concerns. To bridge the gap between Transformer-based foundation models and WMS-based disease detection, we propose COMFORT, a continual fine-tuning framework for foundation models targeted at consumer healthcare. COMFORT introduces a novel approach for pre-training a Transformer-based foundation model on a large dataset of physiological signals exclusively collected from healthy individuals with commercially available WMSs. We adopt a masked data modeling (MDM) objective to pre-train this health foundation model. We then fine-tune the model using various parameter-efficient fine-tuning (PEFT) methods, such as low-rank adaptation (LoRA) and its variants, to adapt it to various downstream disease detection tasks that rely on WMS data. In addition, COMFORT continually stores the low-rank decomposition matrices obtained from the PEFT algorithms to construct a library for multi-disease detection. The COMFORT library enables scalable and memory-efficient disease detection on edge devices. Our experimental results demonstrate that COMFORT achieves highly competitive performance while reducing memory overhead by up to 52% relative to conventional methods. Thus, COMFORT paves the way for personalized and proactive solutions to efficient and effective early-stage disease detection for consumer healthcare.

健康监测低秩适配边缘计算疾病检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。