arXiv:2509.03240cs.LGcs.AI2025-09

提出新评估方法,更好检测可穿戴设备中的压力事件

Evaluation of Stress Detection as Time Series Events -- A Novel Window-Based F1-Metric

  • 引入带时间容差的窗口化F1指标,适应事件渐变特性
  • 在三个生理数据集上显示,传统指标会高估模型性能
  • 适合关注时间精度差异的医疗健康场景研究者使用

准确评估时间序列中的事件检测对可穿戴设备压力监测等应用至关重要。尽管真实现象是渐进且时间扩散的,但地面实况通常标注为单点事件,导致标准指标如F1和点调整F1(F1$_{pa}$)在现实世界不平衡数据集中常误判模型表现。本文提出一种基于窗口的F1指标(F1$_w$),引入时间容差,使评估更稳健。在三个生理数据集(两个野外采集:ADARP、Wrist Angel;一个实验:ROAD)上的实证分析表明,F1$_w$揭示了传统指标无法捕捉的模型性能模式,且其窗口大小可结合领域知识调整以避免过估计。以TimesFM预测为例,仅使用我们的时间容错指标才在两个野外场景中显示出相对于随机与空模型的统计显著提升。本工作填补了时间序列评估的关键空白,并为要求时间精度各异的医疗应用提供实用指导。

原文摘要 · Abstract (English)

Accurate evaluation of event detection in time series is essential for applications such as stress monitoring with wearable devices, where ground truth is typically annotated as single-point events, even though the underlying phenomena are gradual and temporally diffused. Standard metrics like F1 and point-adjusted F1 (F1$_{pa}$) often misrepresent model performance in such real-world, imbalanced datasets. We introduce a window-based F1 metric (F1$_w$) that incorporates temporal tolerance, enabling a more robust assessment of event detection when exact alignment is unrealistic. Empirical analysis in three physiological datasets, two in-the-wild (ADARP, Wrist Angel) and one experimental (ROAD), indicates that F1$_w$ reveals meaningful model performance patterns invisible to conventional metrics, while its window size can be adapted to domain knowledge to avoid overestimation. We show that the choice of evaluation metric strongly influences the interpretation of model performance: using predictions from TimesFM, only our temporally tolerant metrics reveal statistically significant improvements over random and null baselines in the two in-the-wild use cases. This work addresses key gaps in time series evaluation and provides practical guidance for healthcare applications where requirements for temporal precision vary by context.

事件检测时间序列评估指标健康监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。