arXiv:2502.07608cs.LGcs.HC2025-02中稿 · CHIL 2025被引 7

用时间模型直接对接大模型,让可穿戴设备更懂心理健康

Time2Lang: Bridging Time-Series Foundation Models and Large Language Models for Health Sensing Beyond Prompting

  • 跳过文本转换,直接将时序模型输出映射到大模型表征
  • 在256人17251天数据上实现抑郁预测,推理时间不随长度增长
  • 适合做长期健康监测的大模型应用,尤其需避免信息损失的场景

大语言模型(LLM)在结合行为感知数据时展现出健康应用潜力。传统方法将传感器数据转为文本提示,易出错、计算量大且需领域知识,尤其处理长时序数据时问题突出。尽管时序基础模型(TFM)能有效学习时间数据表征,但如何与LLM融合仍具挑战。本文提出Time2Lang框架,直接将TFM输出映射至LLM表征,无需中间文本转换。先在合成数据上以周期性预测为预训练任务,再在心理健康分类任务上评估。在两个纵向可穿戴与移动传感数据集上验证:基于步数数据对256名参与者17,251天进行每日抑郁预测;基于对话时长对46名参与者10周数据进行幸福状态分类。Time2Lang推理时间几乎恒定,不受输入长度影响,生成嵌入保留自相关等关键时序特征。结果表明,该方法能有效整合TFM与LLM,减少信息损失并实现性能迁移。据我们所知,这是首个将TFM与LLM用于健康感知的研究,为未来复杂医疗任务中通用大模型的应用奠定基础。

原文摘要 · Abstract (English)

Large language models (LLMs) show promise for health applications when combined with behavioral sensing data. Traditional approaches convert sensor data into text prompts, but this process is prone to errors, computationally expensive, and requires domain expertise. These challenges are particularly acute when processing extended time series data. While time series foundation models (TFMs) have recently emerged as powerful tools for learning representations from temporal data, bridging TFMs and LLMs remains challenging. Here, we present Time2Lang, a framework that directly maps TFM outputs to LLM representations without intermediate text conversion. Our approach first trains on synthetic data using periodicity prediction as a pretext task, followed by evaluation on mental health classification tasks. We validate Time2Lang on two longitudinal wearable and mobile sensing datasets: daily depression prediction using step count data (17,251 days from 256 participants) and flourishing classification based on conversation duration (46 participants over 10 weeks). Time2Lang maintains near constant inference times regardless of input length, unlike traditional prompting methods. The generated embeddings preserve essential time-series characteristics such as auto-correlation. Our results demonstrate that TFMs and LLMs can be effectively integrated while minimizing information loss and enabling performance transfer across these distinct modeling paradigms. To our knowledge, we are the first to integrate a TFM and an LLM for health, thus establishing a foundation for future research combining general-purpose large models for complex healthcare tasks.

健康传感时序模型大模型融合可穿戴设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。