用运动基元提升可解释性,让可穿戴设备识活动更准更通用。
MoPFormer: Motion-Primitive Transformer for Wearable-Sensor Activity Recognition
- 将传感器信号拆成语义化的运动基元,用Transformer学时间特征。
- 在6个数据集上超越主流方法,跨数据集性能提升显著。
- 适合关注模型可解释性和跨域泛化的研究者使用。
基于可穿戴传感器的人体活动识别(HAR)面临可解释性差的问题,严重制约跨数据集泛化能力。为此,我们提出运动基元变压器(MoPFormer),一种新颖的自监督框架,通过将惯性测量单元信号分段并量化为语义明确的运动基元,结合Transformer架构学习丰富的时序表示。该框架包含两个阶段:第一阶段将多通道传感器流划分为短片段,并量化为离散的“运动基元”码字;第二阶段通过上下文感知嵌入模块增强这些标记序列,再由Transformer编码器处理。所提方法可通过掩码运动建模目标进行预训练,以重建缺失的基元,从而在多种传感器配置下获得鲁棒表征。在六个HAR基准测试上的实验表明,MoPFormer不仅优于现有先进方法,且在多个数据集间实现良好泛化。更重要的是,学习到的运动基元显著提升了可解释性与跨数据集性能,捕捉了不同数据集中相似活动的共性运动模式。
原文摘要 · Abstract (English)
Human Activity Recognition (HAR) with wearable sensors is challenged by limited interpretability, which significantly impacts cross-dataset generalization. To address this challenge, we propose Motion-Primitive Transformer (MoPFormer), a novel self-supervised framework that enhances interpretability by tokenizing inertial measurement unit signals into semantically meaningful motion primitives and leverages a Transformer architecture to learn rich temporal representations. MoPFormer comprises two stages. The first stage is to partition multi-channel sensor streams into short segments and quantize them into discrete ``motion primitive'' codewords, while the second stage enriches those tokenized sequences through a context-aware embedding module and then processes them with a Transformer encoder. The proposed MoPFormer can be pre-trained using a masked motion-modeling objective that reconstructs missing primitives, enabling it to develop robust representations across diverse sensor configurations. Experiments on six HAR benchmarks demonstrate that MoPFormer not only outperforms state-of-the-art methods but also successfully generalizes across multiple datasets. More importantly, the learned motion primitives significantly enhance both interpretability and cross-dataset performance by capturing fundamental movement patterns that remain consistent across similar activities, regardless of dataset origin.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。