融合注意力机制的模型,提升可穿戴设备动作识别准确率。
SETransformer: A Hybrid Attention-Based Architecture for Robust Human Activity Recognition
- 结合Transformer与通道注意力,捕捉长时间动态和关键传感器信息。
- 在WISDM数据集上达84.68%准确率,显著优于LSTM等基线模型。
- 适合移动端、医疗监测等实际部署场景,结果可解释性强。
基于可穿戴传感器数据的人体动作识别(HAR)已成为移动计算、医疗健康和人机交互的核心任务。尽管传统深度学习模型如卷积神经网络(CNN)和循环神经网络(RNN)取得成功,但往往难以捕捉长时序依赖关系和多传感器通道间的上下文关联。为此,我们提出SETransformer,一种混合深度神经架构,结合基于Transformer的时序建模、通道级挤压-激励(SE)注意力机制以及可学习的时间注意力池化。该模型以原始三轴加速度计数据为输入,利用全局自注意力机制捕捉扩展时间窗口内的活动特异性运动动态,同时自适应强化有效传感器通道和关键时间步。我们在WISDM数据集上评估该模型,结果表明其显著优于传统模型(包括LSTM、GRU、BiLSTM和CNN基线)。所提模型在验证集上达到84.68%的准确率和84.64%的宏平均F1分数,超越所有基线模型。实验显示,SETransformer是适用于真实世界HAR任务的高效且可解释的解决方案,具备在移动与普适传感应用中部署的潜力。
原文摘要 · Abstract (English)
Human Activity Recognition (HAR) using wearable sensor data has become a central task in mobile computing, healthcare, and human-computer interaction. Despite the success of traditional deep learning models such as CNNs and RNNs, they often struggle to capture long-range temporal dependencies and contextual relevance across multiple sensor channels. To address these limitations, we propose SETransformer, a hybrid deep neural architecture that combines Transformer-based temporal modeling with channel-wise squeeze-and-excitation (SE) attention and a learnable temporal attention pooling mechanism. The model takes raw triaxial accelerometer data as input and leverages global self-attention to capture activity-specific motion dynamics over extended time windows, while adaptively emphasizing informative sensor channels and critical time steps. We evaluate SETransformer on the WISDM dataset and demonstrate that it significantly outperforms conventional models including LSTM, GRU, BiLSTM, and CNN baselines. The proposed model achieves a validation accuracy of 84.68\% and a macro F1-score of 84.64\%, surpassing all baseline architectures by a notable margin. Our results show that SETransformer is a competitive and interpretable solution for real-world HAR tasks, with strong potential for deployment in mobile and ubiquitous sensing applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。