对比消费级手表与科研设备,验证压力检测模型跨设备泛化能力。
Extending Stress Detection Reproducibility to Consumer Wearable Sensors
- 用本科生实验数据对比四种设备的压力检测表现,评估模型可复现性。
- 心率变异性+皮电反应组合提升多数设备的预测效果,最高AUROC达0.961。
- 消费级手表如Garmin表现接近科研设备,适合真实场景长期监测。
可穿戴传感器广泛用于采集生理数据并构建压力检测模型,但多数研究仅基于单一数据集,缺乏对模型在不同设备、人群或研究条件下的可复现性评估。本文将先前在多研究间模型可复现性的评估扩展至消费级可穿戴设备。通过在35名本科生中开展标准化压力诱导实验,比较了研究级设备(Biopac MP160、Polar H10、Empatica E4)与消费级设备(Garmin Forerunner 55s)的性能。结果表明,Biopac MP160表现最佳,符合其金标准预期;结合心率变异性(HRV)和皮电反应(EDA)可显著提升多数设备的压力预测能力。尽管Empatica E4在留一被试除外(LOSO)评估中表现优异(最高AUROC 0.953),但在使用预训练工具测试时表现不佳(AUROC 0.723),暴露硬件-模型兼容性带来的泛化挑战。而Garmin Forerunner 55s在心理算术任务中达到最高AUROC 0.961,与Polar H10(0.954)、Empatica E4(HRV+EDA:0.953)相当,且具备更适合自由生活场景的佩戴优势。
原文摘要 · Abstract (English)
Wearable sensors are widely used to collect physiological data and develop stress detection models. However, most studies focus on a single dataset, rarely evaluating model reproducibility across devices, populations, or study conditions. We previously assessed the reproducibility of stress detection models across multiple studies, testing models trained on one dataset against others using heart rate (with R-R interval) and electrodermal activity (EDA). In this study, we extended our stress detection reproducibility to consumer wearable sensors. We compared validated research-grade devices, to consumer wearables - Biopac MP160, Polar H10, Empatica E4, to the Garmin Forerunner 55s, assessing device-specific stress detection performance by conducting a new stress study on undergraduate students. Thirty-five students completed three standardized stress-induction tasks in a lab setting. Biopac MP160 performed the best, being consistent with our expectations of it as the gold standard, though performance varied across devices and models. Combining heart rate variability (HRV) and EDA enhanced stress prediction across most scenarios. However, Empatica E4 showed variability; while HRV and EDA improved stress detection in leave-one-subject-out (LOSO) evaluations (AUROC up to 0.953), device-specific limitations led to underperformance when tested with our pre-trained stress detection tool (AUROC 0.723), highlighting generalizability challenges related to hardware-model compatibility. Garmin Forerunner 55s demonstrated strong potential for real-world stress monitoring, achieving the best mental arithmetic stress detection performance in LOSO (AUROC up to 0.961) comparable to research-grade devices like Polar H10 (AUROC 0.954), and Empatica E4 (AUROC 0.905 with HRV-only model and AUROC 0.953 with HRV+EDA model), with the added advantage of consumer-friendly wearability for free-living contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。