用频谱损失提升加速度计数据自监督预训练,显著提高活动识别准确率。
Frequency-Aware Masked Autoencoders for Human Activity Recognition using Accelerometers
- 设计频谱感知的损失函数,利用加速度数据的频率特性优化自编码器。
- 在10.9万未标注数据上预训练,线性探测时主体级F1提升12.7%。
- 适合做可穿戴设备长期活动识别,尤其对标注数据少的任务有优势。
可穿戴加速度计广泛用于持续监测身体活动。尽管监督学习和深度学习已被用于从原始加速度数据中提取活动信息,但进展受限于公开标注数据量有限。利用大规模未标注数据进行自监督预训练是人体活动识别(HAR)领域相对较新且研究不足的方法。本文采用时间序列变压器掩码自编码器(MAE)进行自监督预训练,并提出两种基于频谱图的新损失函数:对数尺度均值幅度(LMM)和对数尺度幅度方差(LMV)损失。将这些损失与均方误差(MSE)损失在MAE训练中对比。我们使用大规模未标注的英国生物银行加速度数据集(n = 109k)进行预训练,并在较小的标注数据集上通过线性分类器评估下游HAR性能。结果表明,使用LMM损失预训练相比MSE损失预训练,主体级F1分数提升了12.7%。相较于最先进的基于ResNet的HAR模型,我们的LMM预训练变换器模型在线性探测时表现更优(F1提升9.8%),在使用LSTM分类器微调时表现相当。加入LMV损失反而降低了性能。这些发现确立了LMM损失在加速度数据MAE预训练中的鲁棒有效性,展示了序列模型在自由生活状态下HAR中的预训练潜力。
原文摘要 · Abstract (English)
Wearable accelerometers are widely used for continuous monitoring of physical activity. Supervised machine learning and deep learning algorithms have long been used to extract meaningful activity information from raw accelerometry data, but progress has been hampered by the limited amount of labeled data that is publicly available. Exploiting large unlabeled datasets using self-supervised pretraining is a relatively new and underexplored approach in the field of human activity recognition (HAR). We used a time-series transformer masked autoencoder (MAE) approach to self-supervised pretraining and propose two novel spectrogram-based loss functions: the log-scale meanmagnitude (LMM) and log-scale magnitude variance (LMV) losses. We compared these losses with the mean squared error (MSE) loss for MAE training. We leveraged the large unlabeled UK Biobank accelerometry dataset (n = 109k) for pretraining and evaluated downstream HAR performance using a linear classifier in a smaller labelled dataset. We found that pretraining with the LMM loss improved performance compared to an MAE pretrained with the MSE loss, with 12.7% increase in subject-wise F1 score when using linear probing. Compared with a state-of-the-art ResNet-based HAR model, our LMM-pretrained transformer models performed better (+9.8% F1) with linear probing and comparably when fine-tuned using an LSTM classifier. The addition of the LMV to the LMM loss decreased performance compared to the LMM loss alone. These findings establish the LMM loss as a robust and effective method for pretraining MAE models on accelerometer data for HAR and show the potential of pretraining sequence-based models for free-living HAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。