用自监督学习让智能手表快速识别新动作,只需少量示例。
TransfHAR: Self-Supervised Wrist Representations for On-Demand Activity Recognition

- 从大量无标签动作中预训练可迁移的运动特征
- 仅用5个样本达86.7%准确率,1分钟录制后升至90.4%
- 适合个性化动作识别,无需重新标注数据
细粒度腕部动作识别可支持流程指导与情境感知辅助,但为每个新任务、用户和动作粒度获取标注数据仍是瓶颈。我们提出TransfHAR,一种基于自监督腕部惯性测量单元(IMU)的即时细粒度动作识别框架,通过全局未标注动作学习可迁移的运动先验。实验表明,在粗粒度腕部动作(如坐、走、锻炼)上进行自监督预训练,能学到足够丰富的运动结构,以迁移至预训练中未出现的细粒度操作性、手势及程序化动作(如弹响、搅拌、挥手)。我们将TransfHAR实现为实时智能手表应用,用户仅需少量示范即可定义并扩展个人动作集。在三个离线跨数据集评估中,其平均平衡准确率比使用完整标签集的全监督基线高出6.2个百分点,且传感器通道数相等或更多。在10名参与者各执行7个新动作的实验室研究中,每类5个样本时达到86.7%平衡准确率,单次1分钟录制后提升至90.4%。结果表明,广泛自监督腕部预训练为即时细粒度动作识别提供了有效基础。
原文摘要 · Abstract (English)
Fine-grained wrist activity recognition can support applications such as procedural step guidance and context-aware assistance, yet acquiring labeled data for every new task, user, and activity granularity remains a bottleneck. We present TransfHAR, a self-supervised wrist IMU framework for on-demand, fine-grained activity recognition by learning transferable motion priors from global, unlabeled activities. We show that self-supervised pretraining on coarse wrist IMU activities (e.g., sitting, walking, exercise) learns motion structure rich enough to transfer to fine-grained manipulative, gestural, and procedural activities (e.g., snapping, stirring, waving) that are absent from pretraining. We implement TransfHAR as a real-time smartwatch application that lets users define and expand their own activity set for personalized recognition from only a few demonstrations. Across three offline cross-dataset evaluations, TransfHAR matches or exceeds fully supervised baselines that use complete label sets with equal or additional sensor channels, by 6.2 balanced-accuracy points on average. In an in-lab study with 10 participants each performing seven novel wrist activities, TransfHAR reaches 86.7% balanced accuracy across participants with five examples per class and 90.4% when updated from a single one-minute recording per class. These results indicate that broad self-supervised wrist pretraining provides an effective foundation for on-demand fine-grained activity recognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。