用Transformer+注意力机制,让可穿戴设备数据预测更准且能解释时间细节。
HealthCAT: An Interpretable Encoder-only Transformer Framework for Health Indicator Prediction and Temporal Interpretation of Wearable Sensor Data

- Encoder-only Transformer结合注意力激活标记,实现每一步的时间解释。
- 在两个数据集上准确率提升12%,F1最高增17%(p<0.05)。
- 适合关注行为模式与健康干预的研究者,支持个体化分析。
可穿戴传感器持续记录细粒度多变量时序数据,为建模与健康结果相关的行为模式提供了可能。然而,现有深度学习方法侧重预测精度而忽视可解释性,限制了其在健康研究中的应用。本文提出HealthCAT,一种集成Encoder-only Transformer与注意力类激活标记(AttentiveCAT)的灵活框架,可生成与类别相关的、时间步级的解释,并映射至相关行为周期(如昼夜节律),支持个体层面的可穿戴数据解析。我们在两个真实世界可穿戴数据集(共306名参与者)上评估HealthCAT,其在两个数据集上的F1-score最高提升17%,准确率提升12%(p<0.05)。遮蔽实验显示,HealthCAT识别的时间步比随机选择具有显著更高的预测价值(p<0.05),表明其识别出的时间点具备预测意义。通过结合高精度预测与经验证的时间步解释,HealthCAT推动可穿戴数据分析从聚合指标迈向支持健康监测、行为模式分析与干预设计的时序模式挖掘。该工作意义在于,它不仅能准确预测健康指标,还能揭示运动模式发生的时间与方式,而非仅依赖汇总统计量。
原文摘要 · Abstract (English)
Wearable sensors continuously capture fine-grained multivariate time-series data, providing opportunities to model behavioural patterns associated with health outcomes. However, existing deep learning methods prioritise predictive accuracy over interpretability, limiting their application in health research. In this study, we present HealthCAT, a flexible framework that integrates an Encoder-only Transformer with an Attentive Class Activation Token (AttentiveCAT) to generate class-specific, time-step-level interpretations. These interpretations can be mapped back onto behavioural cycles that are relevant to the domain (e.g., time-of-day), supporting individual-level analysis of wearable sensor data. We evaluated HealthCAT using two real-world wearable sensor datasets (306 participants in total). HealthCAT outperformed deep learning baselines by up to 17\% in F1-score and 12\% in accuracy on both datasets ($p<0.05$). In masking experiments, the time steps identified by HealthCAT carried significantly more predictive value than random selection across all masking conditions ($p<0.05$), indicating that the identified time steps are predictively informative. By coupling predictive performance with validated time-step-level interpretability, HealthCAT moves wearable sensor analysis beyond aggregated metrics towards temporal patterns that support health monitoring, behavioural pattern analysis, and intervention design in health research. The significance of this work is that it enables accurate prediction of health indicators from wearable sensor data while providing insights into when and how physical activity patterns occur, rather than relying solely on aggregated summary measures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。