用扩散模型增强数据,结合时空注意力提升动作识别准确率。
USAD: End-to-End Human Activity Recognition via Diffusion Model with Spatiotemporal Attention
- 用无监督扩散模型生成新数据,缓解小样本和类别不平衡问题。
- 多分支时空注意力网络在三个数据集上分别达到98.84%、93.81%、80.92%准确率。
- 适合资源受限设备部署,对罕见动作识别有显著提升。
人体动作识别(HAR)旨在从传感器数据中推断正在进行的动作,广泛应用于健康监测、安全防护和运动分析。尽管研究众多,仍面临标注样本少、高层特征提取不足以及轻量设备性能不佳等挑战。本文提出一种基于多注意力交互机制的综合优化方法:首先采用无监督、统计引导的扩散模型进行数据增强,缓解标注数据稀缺与严重类别不平衡问题;其次设计多分支时空交互网络,通过并行的3×3、5×5、7×7卷积核捕捉序列数据的多尺度特征,结合时间注意力识别关键时间点,空间注意力增强传感器间交互;引入跨分支特征融合单元提升表征能力;最后采用自适应多损失函数融合策略,动态调整损失权重实现整体优化。在WISDM、PAMAP2、OPPORTUNITY三个公开数据集上的实验表明,所提无监督数据增强时空注意力扩散网络(USAD)分别取得98.84%、93.81%、80.92%的准确率,显著优于现有方法。此外,嵌入式设备上的实际部署验证了该方法的高效性与可行性。
原文摘要 · Abstract (English)
The primary objective of human activity recognition (HAR) is to infer ongoing human actions from sensor data, a task that finds broad applications in health monitoring, safety protection, and sports analysis. Despite proliferating research, HAR still faces key challenges, including the scarcity of labeled samples for rare activities, insufficient extraction of high-level features, and suboptimal model performance on lightweight devices. To address these issues, this paper proposes a comprehensive optimization approach centered on multi-attention interaction mechanisms. First, an unsupervised, statistics-guided diffusion model is employed to perform data augmentation, thereby alleviating the problems of labeled data scarcity and severe class imbalance. Second, a multi-branch spatio-temporal interaction network is designed, which captures multi-scale features of sequential data through parallel residual branches with 3*3, 5*5, and 7*7 convolutional kernels. Simultaneously, temporal attention mechanisms are incorporated to identify critical time points, while spatial attention enhances inter-sensor interactions. A cross-branch feature fusion unit is further introduced to improve the overall feature representation capability. Finally, an adaptive multi-loss function fusion strategy is integrated, allowing for dynamic adjustment of loss weights and overall model optimization. Experimental results on three public datasets, WISDM, PAMAP2, and OPPORTUNITY, demonstrate that the proposed unsupervised data augmentation spatio-temporal attention diffusion network (USAD) achieves accuracies of 98.84%, 93.81%, and 80.92% respectively, significantly outperforming existing approaches. Furthermore, practical deployment on embedded devices verifies the efficiency and feasibility of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。