评测自监督学习在可泛化的穿戴设备动作识别中的表现。
BenchHAR: Benchmarking Self-Supervised Learning for Generalizable Sensor-based Activity Recognition

- 构建统一框架,评估8种自监督方法在12种模型上的跨分布泛化能力。
- 混合预训练(重建+对比)效果最佳,增加预训练数据比增加标注数据更有效。
- 自研设备数据泛化更好,肢体数据易迁移到躯干位置,非目标动作数据无帮助。
基于可穿戴传感器的人体动作识别(HAR)支持广泛的健康与行为科学应用。然而,数据异质性和标注数据稀缺限制了其实际泛化能力。视觉和语言领域自监督学习(SSL)的最新进展表明,其能从无标签数据中学习通用表征。但鲜有研究系统比较SSL方法的泛化性能或探索如何适配于通用HAR。为此,我们提出BenchHAR,一个统一框架,用于评估传感器型HAR中SSL方法在未见目标分布上的泛化能力。BenchHAR整合了一个大规模数据集(约25.8万样本),并在12种编码器-分类器架构上评估了8种代表性SSL方法。结果表明:现有SSL方法难以实现理想泛化;(1)混合预训练范式(结合重建与对比)表现最优,CNN编码器最擅长学习通用表征,而更复杂的分类器进一步提升泛化;(2)增加下游任务类别的预训练数据量持续改善泛化,而增加标注数据收益有限;有趣的是,引入非下游任务类别的无标签数据并未提升泛化;(3)自研设备采集的数据泛化性优于科研级设备,肢体传感器数据更易迁移到躯干位置。BenchHAR提供统一基准与可操作洞见,推动通用传感器型HAR系统发展。代码已开源。
原文摘要 · Abstract (English)
Human Activity Recognition (HAR) from wearable sensors supports broad healthcare and behavior science applications. However, data heterogeneity and the scarcity of labeled data limit its real-world generalization. Recent advances in self-supervised learning (SSL) in vision and language domains have shown strong capability for learning generalizable representations from unlabeled data. Yet, few studies have systematically compared the generalization performance of SSL methods or explored how to adapt them for generalizable HAR. To address these gaps, we present BenchHAR, a unified framework for evaluating the generalization capability of SSL methods for sensor-based HAR on unseen target distributions. BenchHAR curates a large-scale dataset (~258K samples) and evaluates eight representative SSL methods across 12 encoder-classifier architectures. Our results reveal that existing SSL methods struggle to achieve satisfactory generalization performance. We find that: (1) For HAR models, the hybrid paradigm (combining reconstruction and contrastive pretraining) achieves the best overall performance. The CNN encoder exhibits the strongest ability to learn generalizable representations, while more expressive classifier architectures further improve generalization. (2) For data scale, increasing the amount of pretraining data from downstream activity classes consistently improves generalization, while adding more labeled data yields limited gains. Interestingly, incorporating unlabeled data from non-downstream activity classes does not improve generalization. (3) Sensor data collected from custom-grade devices generalizes better than that from research-grade devices, and data from limb transfers more effectively to trunk positions. BenchHAR provides a unified benchmark and actionable insights for generalizable sensor-based HAR systems. Our code is available at https://github.com/saiketa/HAR-Bench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。